yujiosaka/headless-chrome-crawler
Distributed crawler powered by Headless Chrome observed · 2026-08-28
Health v2 · maintenance only
23/100
- Activity 0
- Release rhythm 8
- Longevity 100
How is this computed?
round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10) — computed 2026-09-03. Adoption (stars, forks) is never an input.
- gap_med: n/a
- age_days: 3196
- days_rel: n/a
- days_push: 1222
- n_releases_24m: 0
Adoption not part of the score
5635 stars · 404 forks observed · 2026-08-28
What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded
A Node.js library providing a distributed web crawler powered by Headless Chrome via Puppeteer. It can crawl JavaScript-rendered (SPA) websites and export results as CSV or JSON Lines.
Use cases
- crawl single-page apps built with React or Vue
- scrape dynamic websites that need JavaScript rendering
- run a distributed crawler with configurable concurrency and retries
- export crawled pages to CSV or JSON Lines
- respect robots.txt and follow sitemap.xml while crawling
- take screenshots of pages as crawling evidence
When to choose
- target sites are rendered client-side with modern frontend frameworks
- you need distributed crawling with Redis-backed cache and priority queues
- you want a promise-based Node.js API on top of Puppeteer for crawling
When to avoid
- you only need to crawl static HTML where simple HTTP requests suffice
- your project is not on Node.js
- you need actively maintained software with frequent updates
Facets
library · maturity maintenance
web-scraping http-client caching crawlers web-development cross-platform headless-chrome puppeteer distributed-crawling scraper dynamic-websites spa-crawling automation nodejs
2 sources
- readme: https://github.com/yujiosaka/headless-chrome-crawler · fetched 2026-08-28 · d5e25f424491
- registry_npm: https://registry.npmjs.org/headless-chrome-crawler · fetched 2026-08-29 · 308a48a3e65b
Member repositories
| Repository | Role | Health v2 |
|---|---|---|
| yujiosaka/headless-chrome-crawler | main | 23 |
For agents
markdown · JSON · MCP: product_card(name="yujiosaka/headless-chrome-crawler")
Data as of 2026-08-30T08:39:29.467469+00:00 · Report a problem