# ShilongLee/Crawler

抖音爬虫(a_bogus最新版)、快手、哔哩哔哩、小红书、淘宝、京东、微博等平台爬虫开源api接口服务器。docker一键快速部署。

Repository: https://github.com/ShilongLee/Crawler
Canonical: https://ross.abutalabs.com/products/shilonglee-crawler
Language: JavaScript
License: NOASSERTION
License Family: other
Last push: 2026-06-09T03:22:56+00:00

## Health v2 (maintenance only)
Score: 53/100 (v2, computed 2026-09-02T17:46:02.011165+00:00)
- activity 86, release rhythm 8, longevity 59
- inputs: {"age_days": 831, "days_push": 85, "days_rel": 700, "gap_med": null, "n_releases_24m": 1}
- flags: no_license
- formula: round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10)

## Adoption (not part of the score)
Stars 1435, forks 368 (observed 2026-08-28T04:04:43.498994+00:00)

## What it is
A self-hostable crawler API server that exposes HTTP endpoints for scraping public data from Douyin, Kuaishou, Bilibili, Xiaohongshu, Weibo, Taobao, and JD, including search, post details, comments, user info, and media downloads. It supports one-click Docker deployment, account/cookie management, and an IP proxy pool with rotation.

## Use cases
- scrape douyin videos and comments
- download xiaohongshu videos without watermark
- fetch bilibili video details and download
- search weibo posts via api
- get taobao product reviews
- self-host a social media scraper api
- rotate residential proxies while crawling

## When to choose
- you need a ready-made HTTP API for Chinese social/e-commerce platforms
- you want Docker one-click deployment
- you need media downloads like watermark-free Xiaohongshu videos

## When to avoid
- you need platforms outside the supported list
- you require commercial use - the license and disclaimer forbid it
- you need JD post/comment/user details, which are not yet implemented

## Facets
- artifact type: service
- maturity: active
- function: web-scraping, http-server, api-framework, proxy
- domain: crawlers, social-media, e-commerce, web-development
- platform: python, self-hosted, windows
- tags: douyin, kuaishou, bilibili, xiaohongshu, weibo, taobao, jd, media-download, anti-crawling, a-bogus, docker, nodejs, web-server, linux, macos

## Member repositories
- ShilongLee/Crawler (main) score 53

## Provenance
- Observed fields: from GitHub, fetched 2026-08-28T04:04:43.498994+00:00.
- Health v2: computed from the inputs above; adoption is never an input.
- Inferred fields (summary, facets, guidance): AI-extracted, prompt v1, taxonomy v1, on 2026-08-30T04:36:50.483223+00:00, confidence not recorded.
  - readme: https://github.com/ShilongLee/Crawler (fetched 2026-08-28T04:04:43.498994+00:00, sha 43d7539771c5)
- Data as of 2026-08-30T08:39:29.467469+00:00.