alirezamika/autoscraper

Health v2 · maintenance only

Adoption not part of the score

7904 stars · 817 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

AutoScraper is a Python library that automatically learns scraping rules from a URL or HTML content plus a list of sample data you want to extract. The learned scraper object can then be reused on new pages to fetch similar elements or exact matching values.

Use cases

• scrape all post titles from a stackoverflow question page
• extract live stock prices from yahoo finance
• learn scraping rules from example data instead of writing css selectors
• reuse a learned scraper on new urls to get similar content
• scrape product prices and names from e-commerce pages
• extract urls or html tag values from a web page automatically

When to choose

• you want to scrape structured data without hand-writing selectors or xpath
• you have sample values of what you want and need rules generated automatically
• you need a lightweight python library for repeated scraping of similar pages

When to avoid

• you need javascript-rendered page scraping out of the box
• you need large-scale distributed crawling infrastructure
• you need full control over parsing logic for complex or highly dynamic sites

Facets

library · maturity stable

web-scraping machine-learning parser crawlers web-development machine-learning python cross-platform scraper automatic-rule-learning crawler data-extraction automation

Member repositories

For agents

markdown · JSON · MCP: product_card(name="alirezamika/autoscraper")