gsh199449/spider
A configurable web spider with a easy-to-use web console observed · 2026-10-21
Health v2 · maintenance only
57/100
- Activity 77
- Release rhythm 8
- Longevity 100
How is this computed?
round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10) — computed 2026-10-21. Adoption (stars, forks) is never an input.
- gap_med: n/a
- age_days: 3618
- days_rel: n/a
- days_push: 139
- n_releases_24m: 0
Adoption not part of the score
997 stars · 471 forks observed · 2026-10-21
What it is AI-extracted, prompt v1, taxonomy v1, 2026-09-07, confidence 0.85
Gather Platform is a Java-based configurable web crawler built on the WebMagic kernel, with a web console for configuring and managing scraping tasks without coding. It also manages scraped data with search, CRUD, and NLP features like keyword, summary, and entity extraction.
Use cases
- scrape websites without writing code
- configure a crawler through a web console
- extract article body and publish time automatically
- extract keywords, summaries, and entities from scraped pages
- search and manage collected data
- analyze relationships between people and places in articles
When to choose
- you need a no-code crawler with a management UI
- you want built-in NLP processing of scraped content
- you want fast deployment on JVM with optional Elasticsearch integration
When to avoid
- you need a lightweight headless scraping library to embed in code
- you require modern actively-maintained tooling or non-Java stacks
- you need distributed large-scale crawling beyond its design
Facets
application · maturity maintenance
web-scraping search-engine nlp data-science crawlers data-science jvm windows self-hosted webmagic crawler-console elasticsearch text-mining no-code-crawler search natural-language-processing web-server linux macos
1 source
- readme: https://github.com/gsh199449/spider · fetched 2026-10-21 · 374afad2e78f
Member repositories
| Repository | Role | Health v2 |
|---|---|---|
| gsh199449/spider | main | 57 |
For agents
markdown · JSON · MCP: product_card(name="gsh199449/spider")
Data as of 2026-10-19T08:05:51.212177+00:00 · Report a problem