NanmiCoder/MediaCrawler
小红书笔记 | 评论爬虫、抖音视频 | 评论爬虫、快手视频 | 评论爬虫、B 站视频 ｜ 评论爬虫、微博帖子 ｜ 评论爬虫、百度贴吧帖子 ｜ 百度贴吧评论回复爬虫 | 知乎问答文章｜评论爬虫 observed · 2026-08-28
Health v2 · maintenance only
73/100
- Activity 97
- Release rhythm 35
- Longevity 84
Flags: no_releases no_license
How is this computed?
round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10) — computed 2026-09-02. Adoption (stars, forks) is never an input.
- gap_med: n/a
- age_days: 1181
- days_rel: n/a
- days_push: 19
- n_releases_24m: 0
Adoption not part of the score
63826 stars · 12418 forks observed · 2026-08-28
What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded
MediaCrawler is a Python-based multi-platform social media crawler that scrapes notes, videos, posts, and comments from Xiaohongshu, Douyin, Kuaishou, Bilibili, Weibo, Baidu Tieba, and Zhihu. It uses Playwright browser automation with preserved login sessions to obtain signature parameters without reverse-engineering encryption algorithms.
Use cases
- scrape xiaohongshu notes and comments by keyword
- collect douyin video comments for research
- crawl bilibili video comments and replies
- harvest weibo posts and second-level comments
- export social media data to csv, , sqlite, or mysql
- generate comment word clouds from scraped data
- crawl a specific creator's profile posts
When to choose
- you need posts and comments from Chinese social media platforms without writing JS reverse-engineering code
- you want keyword search, post detail, and creator page crawling in one tool
- you need flexible storage options like CSV, JSON, SQLite, or MySQL
When to avoid
- you need commercial or large-scale scraping - the project explicitly forbids commercial use and mass crawling
- you need platforms outside its supported list like Twitter or Instagram
- your environment cannot run Playwright browsers or Node.js for signature generation
Facets
cli-tool · maturity active
web-scraping data-generation search-engine crawlers social-media python cross-platform cli playwright xiaohongshu douyin kuaishou bilibili weibo zhihu baidu-tieba social-media-crawler browser-automation comment-scraping crawlers data-engineering automation
2 sources
- readme: https://github.com/NanmiCoder/MediaCrawler · fetched 2026-08-28 · ce19cc73de8c
- homepage: https://nanmicoder.github.io/MediaCrawler/ · fetched 2026-08-28 · 426846138610
Member repositories
| Repository | Role | Health v2 |
|---|---|---|
| NanmiCoder/MediaCrawler | main | 73 |
For agents
markdown · JSON · MCP: product_card(name="NanmiCoder/MediaCrawler")
Data as of 2026-08-30T08:39:29.467469+00:00 · Report a problem