brightmart/nlp_chinese_corpus resource

Health v2 · maintenance only

Adoption not part of the score

9908 stars · 1553 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

A collection of large-scale Chinese NLP corpora including Wikipedia entries, news articles, encyclopedia Q&A, community Q&A, and Chinese-English translation pairs. It provides millions of cleaned text records in JSON format for pretraining language models, building word vectors, and other Chinese NLP tasks.

Use cases

• download large chinese corpus for pretraining
• train chinese word embeddings
• get chinese question-answering dataset
• find chinese-english parallel sentences for translation
• build chinese language model training data
• chinese text classification corpus

When to choose

• you need millions of Chinese text records for pretraining or word vectors
• you want ready-to-use JSON corpora for Chinese NLP research
• you need Chinese-English translation pairs at scale

When to avoid

• you need non-Chinese language corpora
• you need continuously updated real-time data rather than static snapshots
• you need labeled task-specific datasets beyond QA and translation

Facets

dataset · maturity maintenance

nlp machine-learning data-science machine-learning large-language-models python cross-platform chinese-corpus chinese-nlp pretraining-data word2vec question-answering machine-translation text-classification wiki-corpus news-corpus natural-language-processing

Member repositories

For agents

markdown · JSON · MCP: product_card(name="brightmart/nlp_chinese_corpus")