# nghuyong/WeiboSpider

持续维护的新浪微博采集工具🚀🚀🚀

Repository: https://github.com/nghuyong/WeiboSpider
Canonical: https://ross.abutalabs.com/products/nghuyong-weibospider
Language: Python
License: MIT
License Family: permissive
Topics: scrapy, python, weibo, weibospider
Last push: 2026-06-30T09:48:07+00:00

## Health v2 (maintenance only)
Score: 73/100 (v2, computed 2026-09-02T17:46:02.011165+00:00)
- activity 90, release rhythm 35, longevity 100
- inputs: {"age_days": 3230, "days_push": 64, "days_rel": null, "gap_med": null, "n_releases_24m": 0}
- flags: no_releases
- formula: round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10)

## Adoption (not part of the score)
Stars 4109, forks 836 (observed 2026-08-28T04:08:35.697542+00:00)

## What it is
A continuously maintained Python web scraping tool for Sina Weibo built on Scrapy and the new weibo.com API. It collects user profiles, posts, followers, follows, reposts, comments, and keyword search results into JSONL files.

## Use cases
- scrape weibo user profiles and posts
- collect weibo comments and reposts for research
- search weibo posts by keyword and save results
- gather weibo follower and following lists
- build a Chinese social media dataset for NLP

## When to choose
- you need structured Weibo data with rich fields from the current weibo.com API
- you want a small, readable Scrapy codebase you can customize quickly
- you need multiple collection modes (users, posts, comments, search) in one tool

## When to avoid
- you need to scrape platforms other than Weibo
- you cannot provide a valid logged-in weibo.com cookie
- you need a no-code or GUI scraping solution

## Facets
- artifact type: cli-tool
- maturity: active
- function: web-scraping, data-generation, etl
- domain: crawlers, social-media
- platform: python, cli, cross-platform
- tags: weibo, scrapy, sina-weibo, social-media-scraping, l-output, data-engineering, natural-language-processing

## Member repositories
- nghuyong/WeiboSpider (main) score 73

## Provenance
- Observed fields: from GitHub, fetched 2026-08-28T04:08:35.697542+00:00.
- Health v2: computed from the inputs above; adoption is never an input.
- Inferred fields (summary, facets, guidance): AI-extracted, prompt v1, taxonomy v1, on 2026-08-29T18:23:12.780971+00:00, confidence not recorded.
  - readme: https://github.com/nghuyong/WeiboSpider (fetched 2026-08-28T04:08:35.697542+00:00, sha 96d21053bd0d)
- Data as of 2026-08-30T08:39:29.467469+00:00.