bbruceyuan/LLMs-Zero-to-Hero resource

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

2278 stars · 155 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

A Chinese-language tutorial series and accompanying book that teaches large language models by building them from scratch in Jupyter notebooks, inspired by Andrej Karpathy's Zero to Hero style. It covers pre-training, SFT, DPO, RLHF, MoE architectures, multimodal models, and deployment with runnable code and video lectures.

Use cases

• learn how large language models work by implementing them from scratch
• train a mini GPT from zero on a single consumer GPU
• understand LLM fine-tuning techniques like SFT, DPO, and RLHF
• build a transformer and MoE model without relying on transformers library
• find a structured hands-on LLM course with videos and notebooks
• learn LLM deployment, inference optimization, and quantization

When to choose

• you want to deeply understand LLM internals by writing every line yourself rather than calling APIs
• you prefer Chinese-language tutorials with video walkthroughs and runnable notebooks
• you have a single RTX 3090/4090 and want to train small models end to end

When to avoid

• you just want to use LLM APIs or the transformers library in production
• you need English-only learning materials
• you need a production-ready training framework rather than educational code

Facets

learning-resource · maturity active

llm-training machine-learning deep-learning large-language-models deep-learning tutorials education python jupyter-notebooks hands-on karpathy-style pretraining fine-tuning sft dpo rlhf chinese-content nanogpt gpu

Member repositories

For agents

markdown · JSON · MCP: product_card(name="bbruceyuan/LLMs-Zero-to-Hero")