# NanmiCoder/MediaCrawler

小红书笔记 | 评论爬虫、抖音视频 | 评论爬虫、快手视频 | 评论爬虫、B 站视频 ｜ 评论爬虫、微博帖子 ｜ 评论爬虫、百度贴吧帖子 ｜ 百度贴吧评论回复爬虫  | 知乎问答文章｜评论爬虫

Repository: https://github.com/NanmiCoder/MediaCrawler
Canonical: https://ross.abutalabs.com/products/mediacrawler
Homepage: https://nanmicoder.github.io/MediaCrawler/
Language: Python
License: NOASSERTION
License Family: other
Last push: 2026-08-14T08:19:00+00:00

## Health v2 (maintenance only)
Score: 73/100 (v2, computed 2026-09-02T17:46:02.011165+00:00)
- activity 97, release rhythm 35, longevity 84
- inputs: {"age_days": 1181, "days_push": 19, "days_rel": null, "gap_med": null, "n_releases_24m": 0}
- flags: no_releases, no_license
- formula: round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10)

## Adoption (not part of the score)
Stars 63826, forks 12418 (observed 2026-08-28T04:12:19.175360+00:00)

## What it is
MediaCrawler is a Python-based multi-platform social media crawler that scrapes notes, videos, posts, and comments from Xiaohongshu, Douyin, Kuaishou, Bilibili, Weibo, Baidu Tieba, and Zhihu. It uses Playwright browser automation with preserved login sessions to obtain signature parameters without reverse-engineering encryption algorithms.

## Use cases
- scrape xiaohongshu notes and comments by keyword
- collect douyin video comments for research
- crawl bilibili video comments and replies
- harvest weibo posts and second-level comments
- export social media data to csv, , sqlite, or mysql
- generate comment word clouds from scraped data
- crawl a specific creator's profile posts

## When to choose
- you need posts and comments from Chinese social media platforms without writing JS reverse-engineering code
- you want keyword search, post detail, and creator page crawling in one tool
- you need flexible storage options like CSV, JSON, SQLite, or MySQL

## When to avoid
- you need commercial or large-scale scraping - the project explicitly forbids commercial use and mass crawling
- you need platforms outside its supported list like Twitter or Instagram
- your environment cannot run Playwright browsers or Node.js for signature generation

## Facets
- artifact type: cli-tool
- maturity: active
- function: web-scraping, data-generation, search-engine
- domain: crawlers, social-media
- platform: python, cross-platform, cli
- tags: playwright, xiaohongshu, douyin, kuaishou, bilibili, weibo, zhihu, baidu-tieba, social-media-crawler, browser-automation, comment-scraping, crawlers, data-engineering, automation

## Member repositories
- NanmiCoder/MediaCrawler (main) score 73

## Provenance
- Observed fields: from GitHub, fetched 2026-08-28T04:12:19.175360+00:00.
- Health v2: computed from the inputs above; adoption is never an input.
- Inferred fields (summary, facets, guidance): AI-extracted, prompt v1, taxonomy v1, on 2026-08-29T16:17:26.313336+00:00, confidence not recorded.
  - readme: https://github.com/NanmiCoder/MediaCrawler (fetched 2026-08-28T04:12:19.175360+00:00, sha ce19cc73de8c)
  - homepage: https://nanmicoder.github.io/MediaCrawler/ (fetched 2026-08-28T17:56:02.328251+00:00, sha 426846138610)
- Data as of 2026-08-30T08:39:29.467469+00:00.