# scrapy-plugins/scrapy-splash

Scrapy+Splash for JavaScript integration

Repository: https://github.com/scrapy-plugins/scrapy-splash
Canonical: https://ross.abutalabs.com/products/scrapy-splash
Language: Python
License: BSD-3-Clause
License Family: permissive
Topics: scrapy, headless-browsers
Last push: 2025-02-11T17:03:30+00:00

## Health v2 (maintenance only)
Score: 26/100 (v2, computed 2026-09-03T02:20:16.233290+00:00)
- activity 6, release rhythm 8, longevity 100
- inputs: {"age_days": 4860, "days_push": 568, "days_rel": 589, "gap_med": null, "n_releases_24m": 1}
- flags: none
- formula: round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10)

## Adoption (not part of the score)
Stars 3227, forks 456 (observed 2026-08-28T04:07:50.004095+00:00)

## What it is
A Scrapy plugin that integrates the Splash headless browser service to enable crawling and scraping of JavaScript-rendered web pages. It provides downloader and spider middlewares plus a request fingerprinter that route Scrapy requests through Splash's HTTP API.

## Use cases
- scrape websites that require JavaScript rendering
- crawl single-page applications with Scrapy
- execute custom JavaScript while crawling pages
- capture screenshots of pages during a Scrapy crawl
- handle cookies and proxies when rendering pages with Splash

## When to choose
- you already use Scrapy and need to render JavaScript-heavy pages
- you want a maintained, battle-tested bridge between Scrapy and Splash
- you need fine-grained control over rendering options like wait time, proxies, and cookies

## When to avoid
- you need a general-purpose headless browser without Scrapy
- you prefer Playwright or Puppeteer-based scraping pipelines
- you cannot run a separate Splash service (e.g., via Docker)

## Facets
- artifact type: library
- maturity: maintenance
- function: web-scraping, http-client, middleware
- domain: web-development, crawlers, developer-tools
- platform: python, cross-platform
- tags: scrapy, splash, javascript-rendering, headless-browser, spiders, docker

## Member repositories
- scrapy-plugins/scrapy-splash (main) score 26

## Provenance
- Observed fields: from GitHub, fetched 2026-08-28T04:07:50.004095+00:00.
- Health v2: computed from the inputs above; adoption is never an input.
- Inferred fields (summary, facets, guidance): AI-extracted, prompt v1, taxonomy v1, on 2026-08-29T18:44:10.312204+00:00, confidence not recorded.
  - readme: https://github.com/scrapy-plugins/scrapy-splash (fetched 2026-08-28T04:07:50.004095+00:00, sha 00ba3230bd02)
  - registry_pypi: https://pypi.org/pypi/scrapy-splash/json (fetched 2026-08-29T09:37:43.658061+00:00, sha 702e85c17bcd)
- Data as of 2026-08-30T08:39:29.467469+00:00.