# YahooArchive/anthelion

Anthelion is a plugin for Apache Nutch to crawl semantic annotations within HTML pages.

Repository: https://github.com/YahooArchive/anthelion
Canonical: https://ross.abutalabs.com/products/anthelion
Homepage: https://labs.yahoo.com/publications/6702/focused-crawling-structured-data
Language: Java
License: Apache-2.0
License Family: permissive
Archived: true
Last push: 2015-12-17T07:21:20+00:00

## Health v2 (maintenance only)
Score: 10/100 (v2, computed 2026-09-03T02:20:16.233290+00:00)
- activity 0, release rhythm 35, longevity 100
- inputs: {"age_days": 3964, "days_push": 3912, "days_rel": null, "gap_med": null, "n_releases_24m": 0}
- flags: no_releases, archived
- formula: round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10)

## Adoption (not part of the score)
Stars 2827, forks 656 (observed 2026-08-28T04:07:24.220921+00:00)

## What it is
Anthelion is an Apache Nutch plugin for focused crawling of semantic data embedded in HTML pages. It uses an online learning classifier to prioritize data-rich pages and extracts Microdata, Microformats, and RDFa annotations via the any23 library.

## Use cases
- crawl the web for pages with semantic annotations
- extract microdata and RDFa from HTML pages
- prioritize fetching structured-data-rich pages during a crawl
- build a search index of semantic triples
- run focused crawling with online learning feedback

## When to choose
- you already run Apache Nutch 1.x and want to target semantic-data-rich pages
- you need to extract Microdata, Microformats, or RDFa during crawling

## When to avoid
- you need a maintained crawler or support for modern Nutch versions
- you want a standalone scraper without Nutch
- you need active community support - the project is archived and unmaintained

## Facets
- artifact type: plugin
- maturity: abandoned
- function: web-scraping, machine-learning, parser, search-engine, nlp
- domain: crawlers, web-development
- platform: jvm
- tags: focused-crawling, semantic-web, apache-nutch, microdata, rdfa, microformats, online-learning, structured-data-extraction, search, natural-language-processing

## Member repositories
- YahooArchive/anthelion (main) score 10

## Provenance
- Observed fields: from GitHub, fetched 2026-08-28T04:07:24.220921+00:00.
- Health v2: computed from the inputs above; adoption is never an input.
- Inferred fields (summary, facets, guidance): AI-extracted, prompt v1, taxonomy v1, on 2026-08-30T07:38:12.649932+00:00, confidence not recorded.
  - readme: https://github.com/YahooArchive/anthelion (fetched 2026-08-28T04:07:24.220921+00:00, sha 33a600289459)
  - homepage: https://labs.yahoo.com/publications/6702/focused-crawling-structured-data (fetched 2026-08-29T09:53:33.051979+00:00, sha 017705c1b36a)
  - site_page: https://help.yahoo.com/kb/search/sln2244.html (fetched 2026-08-29T09:53:33.061225+00:00, sha 83c7a5ff14fa)
  - site_page: https://help.yahoo.com/kb/search-for-desktop/SLN2206.html?impressions=true (fetched 2026-08-29T09:53:33.063198+00:00, sha 13dfe80ed993)
- Data as of 2026-08-30T08:39:29.467469+00:00.