dragnet-org/dragnet

Health v2 · maintenance only

Adoption not part of the score

1277 stars · 175 forks observed · 2026-10-12

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

Dragnet is a Python library that uses machine learning models to extract the main article content, and optionally user comments, from HTML web pages. It provides simple extraction functions plus sklearn-style trainable extractors with pre-trained models.

Use cases

• extract main article text from html pages
• strip boilerplate and chrome from web pages
• extract article content and comments from a webpage
• readability-style content extraction in python
• train a custom content extraction model
• clean html for text mining pipelines

When to choose

• you need high-accuracy main-content extraction from article pages
• you want to also capture user comments alongside the article
• you want to train or fine-tune your own extraction model with sklearn-style APIs

When to avoid

• you need to extract structured data like tables or product listings rather than article text
• you need a maintained general-purpose scraper with JavaScript rendering
• your project requires actively developed dependencies and recent community activity

Facets

library · maturity maintenance

nlp parser machine-learning web-scraping web-development machine-learning crawlers python content-extraction boilerplate-removal html-parsing readability article-extraction natural-language-processing

Member repositories

For agents

markdown · JSON · MCP: product_card(name="dragnet-org/dragnet")