lorey/mlscraper

Health v2 · maintenance only

Flags: no_license

Adoption not part of the score

1385 stars · 92 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

mlscraper is a Python library that automatically extracts structured data from HTML pages using machine learning. Instead of writing CSS selectors or XPath rules manually, you provide a few example outputs and it learns the extraction rules to apply to new pages.

Use cases

• scrape structured data from html pages without writing css selectors
• extract data from websites by providing example values
• train a scraper from sample data and apply it to new pages
• automatically find extraction rules for html dom nodes
• convert html pages into clean dictionaries of data
• build a web scraper without manual selector engineering

When to choose

• you want to scrape data from similar HTML pages but don't want to hand-write selectors
• you have a few example outputs and want the rules figured out automatically
• you prefer an open-source Python alternative to point-and-click scraping services
• you need to extract data repeatedly from pages with consistent structure

When to avoid

• you need to scrape JavaScript-rendered single-page applications rather than static HTML
• you need a no-code browser-based scraping tool with a visual interface
• you have no example data available to train the extractor
• you need a battle-tested 1.0 release, since the stable PyPI version is still 0.x

Facets

library · maturity active

web-scraping machine-learning parser data-science crawlers web-development machine-learning data-science python cross-platform html-extraction automatic-scraping example-based-training structured-data-extraction

Member repositories

For agents

markdown · JSON · MCP: product_card(name="lorey/mlscraper")