YahooArchive/anthelion
Anthelion is a plugin for Apache Nutch to crawl semantic annotations within HTML pages. observed · 2026-08-28
Health v2 · maintenance only
10/100
- Activity 0
- Release rhythm 35
- Longevity 100
Flags: no_releases archived
How is this computed?
round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10) — computed 2026-09-03. Adoption (stars, forks) is never an input.
- gap_med: n/a
- age_days: 3964
- days_rel: n/a
- days_push: 3912
- n_releases_24m: 0
Adoption not part of the score
2827 stars · 656 forks observed · 2026-08-28
What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded
Anthelion is an Apache Nutch plugin for focused crawling of semantic data embedded in HTML pages. It uses an online learning classifier to prioritize data-rich pages and extracts Microdata, Microformats, and RDFa annotations via the any23 library.
Use cases
- crawl the web for pages with semantic annotations
- extract microdata and RDFa from HTML pages
- prioritize fetching structured-data-rich pages during a crawl
- build a search index of semantic triples
- run focused crawling with online learning feedback
When to choose
- you already run Apache Nutch 1.x and want to target semantic-data-rich pages
- you need to extract Microdata, Microformats, or RDFa during crawling
When to avoid
- you need a maintained crawler or support for modern Nutch versions
- you want a standalone scraper without Nutch
- you need active community support - the project is archived and unmaintained
Facets
plugin · maturity abandoned
web-scraping machine-learning parser search-engine nlp crawlers web-development jvm focused-crawling semantic-web apache-nutch microdata rdfa microformats online-learning structured-data-extraction search natural-language-processing
4 sources
- readme: https://github.com/YahooArchive/anthelion · fetched 2026-08-28 · 33a600289459
- homepage: https://labs.yahoo.com/publications/6702/focused-crawling-structured-data · fetched 2026-08-29 · 017705c1b36a
- site_page: https://help.yahoo.com/kb/search/sln2244.html · fetched 2026-08-29 · 83c7a5ff14fa
- site_page: https://help.yahoo.com/kb/search-for-desktop/SLN2206.html?impressions=true · fetched 2026-08-29 · 13dfe80ed993
Member repositories
| Repository | Role | Health v2 |
|---|---|---|
| YahooArchive/anthelion | main | 10 |
For agents
markdown · JSON · MCP: product_card(name="YahooArchive/anthelion")
Data as of 2026-08-30T08:39:29.467469+00:00 · Report a problem