# matthewmueller/x-ray

The next web scraper. See through the <html> noise.

Repository: https://github.com/matthewmueller/x-ray
Canonical: https://ross.abutalabs.com/products/x-ray
Language: JavaScript
License: MIT
License Family: permissive
Last push: 2026-08-02T20:45:57+00:00

## Health v2 (maintenance only)
Score: 66/100 (v2, computed 2026-09-03T02:20:16.233290+00:00)
- activity 95, release rhythm 8, longevity 100
- inputs: {"age_days": 4228, "days_push": 31, "days_rel": null, "gap_med": null, "n_releases_24m": 0}
- flags: none
- formula: round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10)

## Adoption (not part of the score)
Stars 5907, forks 342 (observed 2026-08-28T04:09:32.137008+00:00)

## What it is
x-ray is a Node.js web scraping library that lets you define flexible schemas to structure data from any website using jQuery-like selectors. It supports pagination, crawling, throttling, and pluggable drivers such as HTTP and PhantomJS.

## Use cases
- scrape structured data from web pages into json
- crawl a blog and extract post titles and links with pagination
- extract product listings from an e-commerce site
- scrape a website without writing raw cheerio code
- stream scraped pages to a file incrementally
- scrape javascript-rendered pages with a phantomjs driver

## When to choose
- you want a declarative schema-based scraping api in node.js
- you need pagination and crawling built into your scraper
- you want composable selectors with throttling and limits

## When to avoid
- you need a full headless browser like puppeteer or playwright for complex sites
- you are scraping in python or another non-node language
- you need actively developed bleeding-edge scraping features

## Facets
- artifact type: library
- maturity: maintenance
- function: web-scraping, parser, http-client
- domain: web-development, crawlers
- platform: -
- tags: cheerio, scraper, pagination, crawler, phantomjs-driver, data-engineering, nodejs, javascript

## Member repositories
- matthewmueller/x-ray (main) score 66

## Provenance
- Observed fields: from GitHub, fetched 2026-08-28T04:09:32.137008+00:00.
- Health v2: computed from the inputs above; adoption is never an input.
- Inferred fields (summary, facets, guidance): AI-extracted, prompt v1, taxonomy v1, on 2026-08-29T17:51:17.918107+00:00, confidence not recorded.
  - readme: https://github.com/matthewmueller/x-ray (fetched 2026-08-28T04:09:32.137008+00:00, sha 7de243f03cb5)
  - registry_npm: https://registry.npmjs.org/x-ray (fetched 2026-08-29T08:47:00.434001+00:00, sha 67cfa89750c4)
- Data as of 2026-08-30T08:39:29.467469+00:00.
