# Boris-code/feapder

🚀🚀🚀feapder is an easy to use, powerful crawler framework | feapder是一款上手简单，功能强大的Python爬虫框架。内置AirSpider、Spider、TaskSpider、BatchSpider四种爬虫解决不同场景的需求。且支持断点续爬、监控报警、浏览器渲染、海量数据去重等功能。更有功能强大的爬虫管理系统feaplat为其提供方便的部署及调度

Repository: https://github.com/Boris-code/feapder
Canonical: https://ross.abutalabs.com/products/feapder
Homepage: http://feapder.com
Language: Python
License: NOASSERTION
License Family: other
Topics: scrapy, feapder, spider, crawler, python, feaplat
Last push: 2026-08-21T11:16:52+00:00

## Health v2 (maintenance only)
Score: 74/100 (v2, computed 2026-09-03T02:39:23.370411+00:00)
- activity 98, release rhythm 29, longevity 100
- inputs: {"age_days": 2033, "days_push": 12, "days_rel": 260, "gap_med": 305, "n_releases_24m": 2}
- flags: no_license
- formula: round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10)

## Adoption (not part of the score)
Stars 3735, forks 548 (observed 2026-08-28T04:08:15.804332+00:00)

## What it is
feapder is a powerful, easy-to-use Python web crawling framework offering four spider types (AirSpider, Spider, TaskSpider, BatchSpider) for different scenarios. It supports distributed crawling, resume-from-breakpoint, monitoring and alerting, browser rendering, and massive-scale data deduplication, with the feaplat management system for deployment and scheduling.

## Use cases
- scrape websites at scale with a python crawler framework
- build a distributed web crawler
- resume a crawl after it crashes
- render javascript-heavy pages while scraping
- monitor and get alerts when a crawler fails
- deduplicate massive amounts of scraped data
- schedule and manage crawlers from a web UI

## When to choose
- you need distributed or batch crawling with data-loss protection out of the box
- you want built-in monitoring, alerting, and browser rendering in one framework
- you prefer a simpler, batteries-included alternative to Scrapy

## When to avoid
- you only need a one-off simple HTTP fetch where requests suffices
- you need a framework with a large English-speaking community and ecosystem
- your project requires a permissively documented license - the GitHub license is nonstandard

## Facets
- artifact type: framework
- maturity: active
- function: web-scraping, http-client, monitoring, alerting, scheduling, browser-extension
- domain: crawlers, web-development
- platform: python, windows, cross-platform
- tags: crawler-framework, distributed-crawling, browser-rendering, data-deduplication, resume-crawl, scrapy-alternative, feaplat, automation, data-engineering, linux, macos

## Member repositories
- Boris-code/feapder (main) score 74

## Provenance
- Observed fields: from GitHub, fetched 2026-08-28T04:08:15.804332+00:00.
- Health v2: computed from the inputs above; adoption is never an input.
- Inferred fields (summary, facets, guidance): AI-extracted, prompt v1, taxonomy v1, on 2026-08-29T18:29:11.216219+00:00, confidence not recorded.
  - readme: https://github.com/Boris-code/feapder (fetched 2026-08-28T04:08:15.804332+00:00, sha 27376f10ecfc)
  - homepage: http://feapder.com (fetched 2026-08-29T09:23:44.930310+00:00, sha bd63fb8d65fb)
  - registry_pypi: https://pypi.org/pypi/feapder/json (fetched 2026-08-29T09:23:44.941492+00:00, sha 0fcc31331267)
- Data as of 2026-08-30T08:39:29.467469+00:00.