scrapy-plugins/scrapy-playwright
Some data may be outdated — see provenance labels.
🎠Playwright integration for Scrapy observed · 2026-09-28
Health v2 · maintenance only
83/100
- Activity 93
- Release rhythm 61
- Longevity 100
How is this computed?
round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10) — computed 2026-10-21. Adoption (stars, forks) is never an input.
- gap_med: 125.0
- age_days: 2170
- days_rel: 102
- days_push: 43
- n_releases_24m: 7
Adoption not part of the score
1452 stars · 161 forks observed · 2026-09-28
What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded
A Scrapy download handler that uses Playwright for Python to fetch pages, enabling scraping of JavaScript-rendered sites while keeping the normal Scrapy workflow. It supports Chromium, Firefox, and WebKit via asyncio integration.
Use cases
- scrape javascript-rendered pages with scrapy
- render dynamic content in a scrapy spider
- use playwright browser automation inside scrapy
- crawl single-page applications with scrapy
- handle pages that require js execution while scraping
When to choose
- you already use Scrapy and need JavaScript rendering
- you want browser automation without leaving Scrapy's scheduling and item pipeline
- you need multiple browser engines (Chromium, Firefox, WebKit)
When to avoid
- you need a standalone scraper without Scrapy
- simple static HTML scraping where plain Scrapy requests suffice
- non-Python or non-asyncio project setups
Facets
library · maturity active
web-scraping http-client browser-extension crawlers web-development python cli cross-platform scrapy playwright headless-browser javascript-rendering download-handler asyncio automation
2 sources
- readme: https://github.com/scrapy-plugins/scrapy-playwright · fetched 2026-09-28 · 0416fe407955
- registry_pypi: https://pypi.org/pypi/scrapy-playwright/json · fetched 2026-08-29 · 12e580b89f26
Member repositories
| Repository | Role | Health v2 |
|---|---|---|
| scrapy-plugins/scrapy-playwright | main | 83 |
For agents
markdown · JSON · MCP: product_card(name="scrapy-plugins/scrapy-playwright")
Data as of 2026-10-19T08:05:51.212177+00:00 · Report a problem