charent/ChatLM-mini-Chinese resource

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

1728 stars · 192 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

ChatLM-Chinese-0.2B is a small (0.2B parameter) Chinese conversational language model with fully open-sourced training pipeline code covering data cleaning, tokenizer training, pretraining, SFT instruction tuning, and DPO/RLHF preference optimization. It is built on the HuggingFace ecosystem and includes a fine-tuning example for triple information extraction.

Use cases

• train a small chinese chat model from scratch
• learn the full llm training pipeline including pretraining sft and rlhf
• fine-tune a small model for triple information extraction
• run a chat model on low vram consumer hardware
• preprocess and deduplicate large chinese text datasets
• experiment with dpo preference optimization using lora

When to choose

• you want to learn or reproduce the end-to-end process of training a language model from scratch
• you need a tiny chinese chat model that runs on 4GB vram or less
• you want open reference code for data cleaning, tokenizer training, SFT, and DPO
• you need a base for fine-tuning small downstream NLP tasks like information extraction

When to avoid

• you need state-of-the-art chinese language understanding or generation quality
• you want a production-ready chatbot with strong reasoning abilities
• you need multilingual or english-focused capabilities
• you want a plug-and-play model without touching training code

Facets

learning-resource · maturity maintenance

llm-training llm-inference chatbot nlp machine-learning large-language-models machine-learning chatbots education python chinese-language-model small-language-model pretraining sft dpo rlhf t5 huggingface information-extraction from-scratch-training natural-language-processing gpu linux

Member repositories

For agents

markdown · JSON · MCP: product_card(name="charent/ChatLM-mini-Chinese")