scrapy-plugins/scrapy-playwright
🎭 Playwright integration for Scrapy observed · 2026-08-28
Health v2 · maintenance only
86/100
- Activity 94
- Release rhythm 68
- Longevity 100
How is this computed?
round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10) — computed 2026-09-02. Adoption (stars, forks) is never an input.
- gap_med: 125.0
- age_days: 2122
- days_rel: 54
- days_push: 41
- n_releases_24m: 7
Adoption not part of the score
1439 stars · 158 forks observed · 2026-08-28
What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded
A Scrapy download handler that uses Playwright for Python to fetch pages, enabling scraping of JavaScript-rendered sites while keeping the normal Scrapy workflow. It supports Chromium, Firefox, and WebKit via asyncio integration.
Use cases
- scrape javascript-rendered pages with scrapy
- render dynamic content in a scrapy spider
- use playwright browser automation inside scrapy
- crawl single-page applications with scrapy
- handle pages that require js execution while scraping
When to choose
- you already use Scrapy and need JavaScript rendering
- you want browser automation without leaving Scrapy's scheduling and item pipeline
- you need multiple browser engines (Chromium, Firefox, WebKit)
When to avoid
- you need a standalone scraper without Scrapy
- simple static HTML scraping where plain Scrapy requests suffice
- non-Python or non-asyncio project setups
Facets
library · maturity active
web-scraping http-client browser-extension crawlers web-development python cli cross-platform scrapy playwright headless-browser javascript-rendering download-handler asyncio automation
2 sources
- readme: https://github.com/scrapy-plugins/scrapy-playwright · fetched 2026-08-28 · 0416fe407955
- registry_pypi: https://pypi.org/pypi/scrapy-playwright/json · fetched 2026-08-29 · 12e580b89f26
Member repositories
| Repository | Role | Health v2 |
|---|---|---|
| scrapy-plugins/scrapy-playwright | main | 86 |
For agents
markdown · JSON · MCP: product_card(name="scrapy-plugins/scrapy-playwright")
Data as of 2026-08-30T08:39:29.467469+00:00 · Report a problem