# jaypyles/Scraperr

Self-hosted webscraper.

Repository: https://github.com/jaypyles/Scraperr
Canonical: https://ross.abutalabs.com/products/scraperr
Homepage: https://scraperr-docs.pages.dev/
Language: TypeScript
License: MIT
License Family: permissive
Topics: opensource, self-hosted, webscraper, docker, helm, kubernetes, playwright, python, scraping, web-scraper, web-scrapers, web-scraping, webscraping
Archived: true
Last push: 2025-10-12T16:55:31+00:00

## Health v2 (maintenance only)
Score: 10/100 (v2, computed 2026-09-02T17:46:02.011165+00:00)
- activity 46, release rhythm 40, longevity 56
- inputs: {"age_days": 788, "days_push": 325, "days_rel": 416, "gap_med": 2, "n_releases_24m": 20}
- flags: archived
- formula: round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10)

## Adoption (not part of the score)
Stars 4910, forks 249 (observed 2026-08-28T04:09:02.280117+00:00)

## What it is
Scraperr is a self-hosted web scraping application with a web UI that lets users scrape websites without writing code, using XPath-based extraction, job queues, and domain spidering. It is built with FastAPI, Playwright, and Next.js, and deploys via Docker or Helm.

## Use cases
- scrape websites without writing code
- extract data from web pages using xpath
- crawl all pages within a domain
- download images and videos from scraped pages
- export scraped data to csv or markdown
- manage a queue of scraping jobs
- self-host a web scraper with docker

## When to choose
- you want a no-code, self-hosted scraping tool with a UI
- you need XPath-based extraction and domain-wide spidering
- you want job queues, notifications, and CSV/markdown export out of the box
- you deploy with Docker or Kubernetes/Helm

## When to avoid
- you need a programmatic scraping library to embed in your own code
- you require large-scale distributed crawling beyond a single self-hosted instance
- you need scraping of sites requiring complex authentication or heavy JavaScript interaction beyond Playwright defaults

## Facets
- artifact type: application
- maturity: active
- function: web-scraping, self-hosted, gui, data-visualization, scheduling
- domain: web-development, crawlers, self-hosted
- platform: self-hosted, python
- tags: xpath, playwright, fastapi, nextjs, no-code-scraping, helm, data-export, automation, data-engineering, docker, kubernetes, web-server

## Member repositories
- jaypyles/Scraperr (main) score 10

## Provenance
- Observed fields: from GitHub, fetched 2026-08-28T04:09:02.280117+00:00.
- Health v2: computed from the inputs above; adoption is never an input.
- Inferred fields (summary, facets, guidance): AI-extracted, prompt v1, taxonomy v1, on 2026-08-29T18:18:04.550726+00:00, confidence not recorded.
  - readme: https://github.com/jaypyles/Scraperr (fetched 2026-08-28T04:09:02.280117+00:00, sha 390f513825a1)
  - homepage: https://scraperr-docs.pages.dev/ (fetched 2026-08-29T09:00:28.422406+00:00, sha a78105121c6a)
- Data as of 2026-08-30T08:39:29.467469+00:00.