codemayq/chinese-chatbot-corpus resource

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

4194 stars · 777 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

A curated collection and unified processing pipeline for publicly available Chinese chit-chat conversation corpora, aggregating eight sources (Douban, Weibo, PTT, Qingyun, subtitles, Tieba, Xiaohuangji, ChatterBot) into standardized TSV query-answer pairs. It provides a Python script that downloads, converts traditional characters, and normalizes all corpora in one run.

Use cases

• download chinese chatbot training data
• get cleaned chinese conversation corpus for seq2seq
• train a chinese chit-chat dialogue model
• prepare query answer pairs for retrieval chatbot
• unify multiple chinese dialogue datasets into one format
• find open chinese small-talk corpus for nlp research

When to choose

• you need ready-to-use Chinese casual conversation data for training or fine-tuning a chatbot
• you want to avoid manually collecting and reformatting many heterogeneous Chinese dialogue sources
• you need TSV query-answer pairs for retrieval or generation models

When to avoid

• you need task-oriented or domain-specific dialogue data rather than casual chit-chat
• you require strictly cleaned, noise-free data - several sources contain noise and inappropriate content
• you need commercial-use guarantees - the project only aggregates third-party corpora with original licenses

Facets

dataset · maturity maintenance

nlp data-generation etl chatbots machine-learning large-language-models python cli chinese-language conversation-corpus chatbot-training-data text-normalization open-dataset natural-language-processing

Member repositories

For agents

markdown · JSON · MCP: product_card(name="codemayq/chinese-chatbot-corpus")