D4Vinci/Scrapling
🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! observed · 2026-08-28
Health v2 · maintenance only
89/100
- Activity 99
- Release rhythm 99
- Longevity 49
How is this computed?
round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10) — computed 2026-09-03. Adoption (stars, forks) is never an input.
- gap_med: 7.5
- age_days: 689
- days_rel: 10
- days_push: 8
- n_releases_24m: 53
Adoption not part of the score
76660 stars · 7663 forks observed · 2026-08-28
What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded
Scrapling is an adaptive Python web scraping framework that handles everything from single requests to full-scale concurrent crawls. It features self-healing selectors that relocate elements when page structures change, stealth fetchers that bypass anti-bot systems like Cloudflare, and a Scrapy-like spider API with proxy rotation and adaptive throttling.
Use cases
- scrape product data from e-commerce sites
- crawl multiple pages concurrently with proxy rotation
- bypass Cloudflare and anti-bot protection when fetching pages
- extract data that survives website design changes
- scrape dynamic JavaScript-rendered websites
- build a spider to crawl an entire site
- expose web scraping to AI agents via MCP
When to choose
- you need scraping that adapts when website HTML structure changes
- target sites use anti-bot systems like Cloudflare Turnstile
- you want a Scrapy-like crawling API with modern stealth fetching in one library
- you need both fast HTTP fetching and browser-based dynamic rendering
When to avoid
- you only need simple static HTTP requests without parsing
- you need a distributed scraping cluster at massive scale
- your project is in a language other than Python
- you need strict legal compliance tooling around scraping permissions
Facets
framework · maturity active
web-scraping parser http-client workflow-automation mcp crawlers web-development developer-tools python cross-platform adaptive-scraping anti-bot-bypass stealth-fetching spider-framework playwright xpath-selectors data-extraction automation docker
3 sources
- readme: https://github.com/D4Vinci/Scrapling · fetched 2026-08-28 · 34559550ac58
- homepage: https://scrapling.readthedocs.io/en/latest/ · fetched 2026-08-28 · 31c9185255aa
- registry_pypi: https://pypi.org/pypi/scrapling/json · fetched 2026-08-28 · 76311fe1a6d0
Member repositories
| Repository | Role | Health v2 |
|---|---|---|
| D4Vinci/Scrapling | main | 89 |
For agents
markdown · JSON · MCP: product_card(name="D4Vinci/Scrapling")
Data as of 2026-08-30T08:39:29.467469+00:00 · Report a problem