lorien/awesome-web-scraping resource
List of libraries, tools and APIs for web scraping and data processing. observed · 2026-08-28
Health v2 · maintenance only
77/100
- Activity 99
- Release rhythm 35
- Longevity 100
Flags: no_releases no_license
How is this computed?
round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10) — computed 2026-09-03. Adoption (stars, forks) is never an input.
- gap_med: n/a
- age_days: 4039
- days_rel: n/a
- days_push: 7
- n_releases_24m: 0
Adoption not part of the score
8133 stars · 930 forks observed · 2026-08-28
What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded
A curated awesome-list of web scraping libraries, tools, APIs, and manuals across Python, PHP, Ruby, JavaScript, Go, and CLI tools. It also links to captcha solving services, proxy marketplaces, headless browser lists, and community discussion groups.
Use cases
- find a web scraping library for python
- discover crawling frameworks for go or ruby
- learn web scraping from tutorials and books
- find captcha solving services
- compare headless browsers for scraping
- find cli tools for scraping websites
When to choose
- you want a curated starting point for scraping tools in a specific language
- you need links to manuals, proxies, and captcha services in one place
When to avoid
- you need a working scraping tool rather than a list of links
- you need guaranteed licensing or maintained code, since it is a list with a nonstandard license
Facets
learning-resource · maturity active
web-scraping developer-tools crawlers web-development awesome-lists cross-platform awesome-list crawling scraping captcha-solving proxies curated-list
1 source
- readme: https://github.com/lorien/awesome-web-scraping · fetched 2026-08-28 · aff108e1987f
Member repositories
| Repository | Role | Health v2 |
|---|---|---|
| lorien/awesome-web-scraping | main | 77 |
For agents
markdown · JSON · MCP: product_card(name="lorien/awesome-web-scraping")
Data as of 2026-08-30T08:39:29.467469+00:00 · Report a problem