ShilongLee/Crawler
抖音爬虫(a_bogus最新版)、快手、哔哩哔哩、小红书、淘宝、京东、微博等平台爬虫开源api接口服务器。docker一键快速部署。 observed · 2026-08-28
Health v2 · maintenance only
53/100
- Activity 86
- Release rhythm 8
- Longevity 59
Flags: no_license
How is this computed?
round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10) — computed 2026-09-02. Adoption (stars, forks) is never an input.
- gap_med: n/a
- age_days: 831
- days_rel: 700
- days_push: 85
- n_releases_24m: 1
Adoption not part of the score
1435 stars · 368 forks observed · 2026-08-28
What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded
A self-hostable crawler API server that exposes HTTP endpoints for scraping public data from Douyin, Kuaishou, Bilibili, Xiaohongshu, Weibo, Taobao, and JD, including search, post details, comments, user info, and media downloads. It supports one-click Docker deployment, account/cookie management, and an IP proxy pool with rotation.
Use cases
- scrape douyin videos and comments
- download xiaohongshu videos without watermark
- fetch bilibili video details and download
- search weibo posts via api
- get taobao product reviews
- self-host a social media scraper api
- rotate residential proxies while crawling
When to choose
- you need a ready-made HTTP API for Chinese social/e-commerce platforms
- you want Docker one-click deployment
- you need media downloads like watermark-free Xiaohongshu videos
When to avoid
- you need platforms outside the supported list
- you require commercial use - the license and disclaimer forbid it
- you need JD post/comment/user details, which are not yet implemented
Facets
service · maturity active
web-scraping http-server api-framework proxy crawlers social-media e-commerce web-development python self-hosted windows douyin kuaishou bilibili xiaohongshu weibo taobao jd media-download anti-crawling a-bogus docker nodejs web-server linux macos
1 source
- readme: https://github.com/ShilongLee/Crawler · fetched 2026-08-28 · 43d7539771c5
Member repositories
| Repository | Role | Health v2 |
|---|---|---|
| ShilongLee/Crawler | main | 53 |
For agents
markdown · JSON · MCP: product_card(name="ShilongLee/Crawler")
Data as of 2026-08-30T08:39:29.467469+00:00 · Report a problem