ymcui/Chinese-BERT-wwm

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

10223 stars · 1381 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

A collection of Chinese pre-trained language models (BERT-wwm, BERT-wwm-ext, RoBERTa-wwm-ext, RBT3, etc.) built with Whole Word Masking, released by HFL. Models are loadable via Hugging Face Transformers and TensorFlow 2.

Use cases

• fine-tune a Chinese BERT model for text classification
• get Chinese sentence embeddings for semantic search
• named entity recognition on Chinese text
• compare Chinese pre-trained models on CLUE benchmarks
• download a small Chinese transformer model for production NLP

When to choose

• you need well-established Chinese encoder models with published benchmark results
• you want whole word masking variants of BERT/RoBERTa for Chinese tasks
• you need small models like RBT3 for low-latency Chinese NLP

When to avoid

• you need a generative large language model rather than an encoder
• you work with non-Chinese languages primarily
• you need the latest pre-training techniques like LERT or MacBERT (see sibling projects)

Facets

library · maturity maintenance

machine-learning nlp llm-training machine-learning large-language-models python cross-platform bert whole-word-masking chinese-nlp pretrained-language-models roberta huggingface-transformers natural-language-processing tensorflow

Member repositories

For agents

markdown · JSON · MCP: product_card(name="ymcui/Chinese-BERT-wwm")