MiuLab/Taiwan-LLM resource

Health v2 · maintenance only

Adoption not part of the score

1426 stars · 119 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

A collection of Traditional Mandarin large language models (Taiwan-LLM / TAME) built on the Llama-3 architecture, fine-tuned on Traditional Mandarin and English corpora for Taiwanese culture and domains. The repository provides model weights, fine-tuning configs for Axolotl, evaluation papers, and an online chat demo.

Use cases

• fine-tune a Traditional Mandarin chat model on my own Taiwan-specific data
• get a Llama-3-based LLM that understands Traditional Mandarin and Taiwanese context
• run a Traditional Mandarin NLP benchmark to compare Chinese-language models
• deploy a chatbot that speaks Traditional Mandarin for Taiwan users
• adapt an open LLM to legal or medical text in Traditional Mandarin
• train a mixture-of-experts model for multilingual Traditional Mandarin and English tasks

When to choose

• you need strong Traditional Mandarin (Taiwan) language understanding or generation
• you want open Apache-2.0 licensed Llama-3-based weights to fine-tune or self-host
• you are benchmarking Chinese-language LLMs against Taiwan-specific NLP tasks
• you need a starting point for Axolotl or NVIDIA NeMo fine-tuning pipelines

When to avoid

• you need Simplified Chinese or mainland-China-specific language models
• you want a ready-to-use hosted API without managing your own inference
• you lack GPU resources and only need a small lightweight model
• you need non-Chinese multilingual coverage beyond English and Mandarin

Facets

learning-resource · maturity active

llm-training nlp machine-learning chatbot large-language-models artificial-intelligence python cloud traditional-mandarin taiwan llama-3 fine-tuning axolotl nemo-framework mixture-of-experts chinese-language-model model-weights benchmarking natural-language-processing gpu docker

Member repositories

For agents

markdown · JSON · MCP: product_card(name="MiuLab/Taiwan-LLM")