resource: llm-training

250 resources, primary matches first, then adoption-weighted; health v2 shown.

Resource	Health v2	Stars	Maturity
rasbt/LLMs-from-scratch The official code repository for the book 'Build a Large Language Model (From Scratch)', containing step-by-step PyTorch implementations of…	73	103857	active
mlabonne/llm-course A free, structured course for learning about Large Language Models, organized into three parts: LLM Fundamentals, LLM Scientist, and LLM En…	59	82008	active
datawhalechina/hello-agents Hello-Agents is a free, open-source tutorial from the Datawhale community that teaches how to build AI-native intelligent agents from scrat…	73	75072	active
labmlai/annotated_deep_learning_paper_implementations A collection of 60+ annotated PyTorch implementations of deep learning research papers, including transformers, optimizers, GANs, diffusion…	61	67359	active
jingyaogong/minimind MiniMind is an open-source project that trains tiny (64M-parameter) large language models completely from scratch in pure PyTorch, covering…	62	55036	active
Lordog/dive-into-llms A free series of hands-on programming tutorials (in Chinese) for getting started with large language models, derived from Shanghai Jiao Ton…	36	50262	active
Made With ML Made With ML is an open-source course teaching how to design, develop, deploy, and iterate on production-grade machine learning application…	66	49233	active
datawhalechina/happy-llm Happy-LLM is a free, open-source Chinese-language tutorial by Datawhale that teaches large language model principles from scratch, covering…	70	33272	active
datawhalechina/self-llm A Chinese-language open-source tutorial guide (Datawhale) for deploying, using, and fine-tuning open-source large language models and multi…	71	31927	active
google-research/tuning_playbook A comprehensive guide from Google Research engineers on systematically maximizing deep learning model performance through disciplined hyper…	31	30297	stable
QwenLM/Qwen3 Qwen3 is a family of open-weight large language models from Alibaba's Qwen team, with instruct and thinking variants in multiple sizes. The…	53	27560	active
liguodongiot/llm-action A curated Chinese-language knowledge base covering large language model engineering, including training, fine-tuning, inference, compressio…	71	24958	active
datawhalechina/llm-cookbook A Chinese-language LLM developer tutorial based on Andrew Ng's large model course series, translated and adapted by Datawhale. It covers pr…	32	24590	active
zergtant/pytorch-handbook An open-source Chinese-language book (PyTorch Handbook) that helps beginners quickly get started with deep learning development and researc…	32	21678	active
fchollet/deep-learning-with-python-notebooks A collection of Jupyter notebooks containing the runnable code samples from the book 'Deep Learning with Python' (third edition, 2025) by F…	51	20273	active
stas00/ml-engineering An open-source 'open book' of methodologies, scripts, and step-by-step instructions for training, fine-tuning, and running inference on lar…	77	18739	active
meta-llama/llama-cookbook Meta's official collection of Jupyter notebook recipes and guides for building with the Llama model family, covering inference, fine-tuning…	63	18558	active
ZJU-LLMs/Foundations-of-LLMs An open-source Chinese-language textbook from Zhejiang University covering the foundations of large language models, including language mod…	49	17636	active
QwenLM/Qwen3-Coder Qwen3-Coder is a family of open-weight large language models specialized for coding and agentic coding tasks, including the 480B-A35B, 30B-…	58	16810	active
wdndev/llm_interview_note A curated Chinese-language study guide and interview question bank covering large language model fundamentals, architectures, training, and…	66	14963	active
NVIDIA/DeepLearningExamples A collection of state-of-the-art deep learning model training and deployment scripts from NVIDIA, organized by model and optimized for Tens…	32	14840	active
LlamaChinese/Llama-Chinese A Chinese-language open-source community hub for the Llama large language model ecosystem, aggregating learning resources, pretrained and f…	35	14738	active
RUCAIBox/LLMSurvey The official repository accompanying the survey paper 'A Survey of Large Language Models', collecting papers and resources on LLMs includin…	35	12206	active
MoonshotAI/Kimi-K2 Kimi K2 is Moonshot AI's open-weight mixture-of-experts large language model series with 1 trillion total parameters (32B activated), optim…	47	11105	active
aws/amazon-sagemaker-examples The official collection of example Jupyter notebooks from the Amazon SageMaker team demonstrating how to build, train, tune, deploy, and mo…	66	10980	active
FareedKhan-dev/train-llm-from-scratch An educational repository and tutorial that implements a transformer-based LLM entirely from scratch in plain PyTorch, covering the full pi…	65	9432	active
jzhang38/TinyLlama TinyLlama is an open-source project that pretrained a compact 1.1B-parameter Llama 2 architecture model on 3 trillion tokens, releasing che…	10	9019	stable
jingyaogong/minimind-v MiniMind-V is an open-source educational project that trains tiny (26M-200M parameter) vision-language models from scratch in pure PyTorch,…	61	8488	active
deepseek-ai/open-infra-index An index repository from DeepSeek AI cataloging their production-tested open-source AI infrastructure tools, including FlashMLA, DeepEP, De…	30	8059	active
Infrasys-AI/AIInfra AIInfra is an open-source Chinese-language course (text, slides, and videos) on AI infrastructure for large models, covering AI clusters, n…	49	8029	active
datawhalechina/so-large-lm An open-source Chinese-language tutorial series on large language model fundamentals, based on Stanford CS324 and Hung-yi Lee's generative …	68	7605	active
hijkzzz/Awesome-LLM-Strawberry A curated awesome-list of research papers, blogs, and projects focused on OpenAI o1 (Strawberry) and LLM reasoning techniques like chain-of…	48	6899	active
huggingface/smol-course A free, open-source course from Hugging Face on aligning small language models (SmolLM3, SmolVLM2) to specific use cases, covering instruct…	66	6731	active
nndl/llm-beginner A step-by-step beginner tutorial series (with a companion textbook) for learning large language models and agents through six progressive h…	79	6681	active
tatsu-lab/stanford_alpaca Stanford Alpaca is the code and 52K instruction-following dataset used to fine-tune LLaMA 7B into the Alpaca instruction-following model. I…	30	30247	maintenance
ufoym/deepo Deepo is a Dockerfile generator and collection of pre-built Docker images for setting up deep learning research environments. It composes m…	56	6276	active
OpenBMB/ToolBench ToolBench is an open-source platform for training, serving, and evaluating large language models on tool use, built around a large-scale in…	39	5732	active
KellerJordan/modded-nanogpt A collaborative speedrun project that trains a GPT-2 (124M) scale language model to 3.28 validation loss on FineWeb in under 75 seconds on …	67	5707	active
karpathy/build-nanogpt A step-by-step video lecture and companion code repository by Andrej Karpathy that builds a GPT-2 (124M) reproduction from an empty file, w…	24	5461	stable
PacktPublishing/LLM-Engineers-Handbook The official companion repository for the book 'LLM Engineer's Handbook' by Paul Iusztin and Maxime Labonne, containing Python code for bui…	60	5296	active
openai/parameter-golf An OpenAI-hosted challenge to train the best-performing language model that fits in a 16MB artifact and trains in under 10 minutes on 8xH10…	51	5174	active
rasbt/reasoning-from-scratch The official code repository for the book 'Build a Reasoning Model (From Scratch)' by Sebastian Raschka, containing step-by-step PyTorch im…	71	5070	active
datawhalechina/tiny-universe An open-source Chinese-language tutorial series ('Tiny-Universe') that teaches building large language model systems from scratch, covering…	55	5028	active
SylphAI-Inc/LLM-engineer-handbook A curated list of Large Language Model resources covering the full LLM lifecycle: pretraining, fine-tuning, serving, prompt management, and…	38	5023	active
huggingface/nanoVLM nanoVLM is a minimal, readable pure-PyTorch repository (~750 lines) for training and finetuning small Vision-Language Models, inspired by n…	43	4997	active
karpathy/ng-video-lecture The companion code repository for Andrej Karpathy's 'Neural Networks: Zero To Hero' video lecture on building a GPT model from scratch (nan…	31	4937	stable
changyeyu/LLM-RL-Visualized A curated collection of 100+ original SVG architecture diagrams explaining LLM, VLM, and reinforcement learning algorithms (RLHF, PPO, GRPO…	62	4819	active
nlp-with-transformers/notebooks A collection of Jupyter notebooks containing the example code from the O'Reilly book 'Natural Language Processing with Transformers'. The n…	70	4800	active
mlabonne/llm-datasets A curated list of datasets and tools for post-training large language models, covering supervised fine-tuning, preference, and reasoning da…	60	4757	active
origin-brain/beat-ai BeatAI is an open-source AI learning resource (with an accompanying website of regularly published articles) that teaches AI fundamentals f…	76	4702	active
afshinea/stanford-cme-295-transformers-large-language-models A multilingual VIP cheatsheet summarizing key concepts from Stanford's CME 295 Transformers & Large Language Models course, distributed as …	57	4656	active
Hoper-J/AI-Guide-and-Demos-zh_CN A Chinese-language step-by-step guide and demo code collection for getting started with AI and LLMs, covering API usage, local model deploy…	66	4465	active
opendilab/awesome-RLHF A curated, continually updated list of research papers, codebases, datasets, blogs, and books about Reinforcement Learning with Human Feedb…	68	4422	active
decodingai-magazine/llm-twin-course A free hands-on course (source code plus 12 lessons) that teaches how to build an end-to-end production-ready LLM and RAG system by creatin…	60	4385	active
datawhalechina/llms-from-scratch-cn A hands-on tutorial by Datawhale for building large language models from scratch in Python, covering tokenization, attention, pretraining, …	59	4337	active
HuaizhengZhang/AI-Infra-from-Zero-to-Hero A curated awesome-list of research papers, industry practices, and video tutorials on systems for machine learning, LLMs, and generative AI…	47	4309	active
esbatmop/MNBVC MNBVC is a massive, continuously growing open-source Chinese text corpus aiming to rival the scale of data used to train ChatGPT, including…	75	4267	active
walkinglabs/hands-on-modern-rl An open-source hands-on curriculum/book covering modern reinforcement learning, from MDPs and policy optimization (PPO) to LLM alignment (R…	78	4124	active
zyds/transformers-code A hands-on course repository with Jupyter Notebook code accompanying a video series (on Bilibili and YouTube) for learning Hugging Face Tra…	29	4053	active
skindhu/Build-A-Large-Language-Model-CN A Chinese translation of the book 'Build a Large Language Model (From Scratch)', hosted as an open-source online ebook covering GPT archite…	66	3980	active
yuanzhoulvpi2017/zero_nlp A Chinese-language NLP training framework and tutorial collection built on PyTorch and Hugging Face Transformers, covering fine-tuning of l…	47	3834	active
CalvinXKY/InfraTech A collection of Jupyter notebook tutorials and exercises covering AI infrastructure topics including PyTorch, vLLM/SGLang inference framewo…	59	3683	active
stanford-cs336/lectures Lecture materials for Stanford CS336 (Language Modeling from Scratch), including executable Python lectures and PDF slides. Executable lect…	58	3678	active
wyf3/llm_related A collection of Python implementations reproducing large language model algorithms, along with the author's learning notes. It serves as an…	64	3505	active
arman-bd/guppylm GuppyLM is a ~9M parameter language model trained from scratch to talk like a small fish, built as an educational project demonstrating the…	49	3435	active
DSXiangLi/DecryptPrompt A curated Chinese-language collection of LLM and prompt engineering resources, including open-source models, datasets, frameworks, and AIGC…	67	3434	active
Zjh-819/LLMDataHub A curated catalog (awesome list) of open-source datasets for training large language models, covering alignment/SFT, domain-specific, pretr…	30	3411	active
angelos-p/llm-from-scratch A hands-on workshop repository where learners write every component of a GPT training pipeline (tokenizer, transformer, training loop, gene…	50	3380	active
BBuf/how-to-optim-algorithm-in-cuda A curated collection of notes and hands-on code for optimizing algorithms on CUDA GPUs, covering handwritten kernels, CUTLASS/CuTe, Triton,…	98	3223	active
raiyanyahya/how-to-train-your-gpt A 12-chapter educational repository that teaches how to build, train, and run a modern LLaMA-style GPT language model from scratch in Pytho…	55	3152	active
Clouditera/SecGPT SecGPT is an open-source large language model purpose-built for cybersecurity, fine-tuned from Qwen2.5 and DeepSeek-R1 bases on a large cur…	39	3101	active
decodingai-magazine/second-brain-ai-assistant-course An open-source course by Decoding AI that teaches building a production-ready 'Second Brain' AI assistant using agentic RAG, LLMs, fine-tun…	55	3058	active
ashishpatel26/LLM-Finetuning A collection of Jupyter/Colab notebooks demonstrating efficient fine-tuning of large language models (Llama 2, Falcon, Guanaco) using LoRA …	44	2980	active
DLLXW/baby-llama2-chinese An educational Python repository for pretraining and SFT fine-tuning a small (92M-218M parameter) Chinese Llama2 model from scratch, runnab…	72	2923	active
EleutherAI/pythia EleutherAI's Pythia project: a suite of autoregressive transformer language models released with 154 training checkpoints each, plus code a…	56	2911	stable
MLNLP-World/LLMs-from-scratch-CN A Chinese translation of the popular 'LLMs-from-scratch' project by Sebastian Raschka, providing markdown notes and Jupyter notebooks for b…	56	2877	active
bbruceyuan/Hands-On-Large-Language-Models-CN A Chinese translation of the book 'Hands-On Large Language Models' by Jay Alammar and Maarten Grootendorst, with annotated Jupyter notebook…	64	2838	active
FurkanGozukara/Stable-Diffusion A curated collection of expert-level tutorials, guides, and notebooks on generative AI topics including Stable Diffusion, FLUX, SDXL, LoRA/…	74	2759	active
huggingface/cookbook A community-driven collection of Jupyter notebooks from Hugging Face demonstrating practical AI application building with open-source tools…	71	2711	active
qibin0506/Cortex Cortex is an open-source educational project that walks through building a large language model from scratch, covering the full training li…	63	2689	active
databrickslabs/dolly Dolly is Databricks' instruction-following large language model (dolly-v2-12b), fine-tuned from EleutherAI's Pythia-12b on a ~15k record in…	30	10805	maintenance
echonoshy/cgft-llm A hands-on tutorial series (in Chinese) for learning large language model technologies, with Jupyter Notebook code, written docs, and video…	60	2663	active
stanford-cs336/assignment1-basics The student starter code for Stanford CS336 Assignment 1, where learners implement language model basics (tokenizer, transformer, training …	57	2652	active
InterviewReady/ai-engineering-resources A curated collection of research papers and blog posts to help software engineers transition into AI engineering. It organizes foundational…	43	2633	active
GoogleCloudPlatform/asl-ml-immersion A collection of Jupyter notebooks, code samples, and labs from Google Cloud's Advanced Solutions Lab covering machine learning, MLOps, and …	87	2596	active
mbzuai-oryx/Awesome-LLM-Post-training A curated awesome-list and survey companion collecting papers, code, benchmarks, and resources on LLM post-training methodologies, organize…	63	2526	active
TsinghuaC3I/Awesome-RL-for-LRMs A curated awesome-list accompanying the survey paper 'A Survey of Reinforcement Learning for Large Reasoning Models' from Tsinghua Universi…	57	2482	active
ANative-Lab/Awesome-Self-Evolving-Agents A curated awesome-list accompanying an arXiv survey on self-evolving AI agents, cataloguing papers and open-source frameworks for agent opt…	56	2458	active
Exorust/TorchLeet TorchLeet is a collection of 65 PyTorch practice problems drawn from real ML/AI interviews at companies like Google, Meta, and Anthropic, d…	65	2430	active
minitorch/minitorch Minitorch is a student-built deep learning framework suite where learners implement a mini PyTorch-like tensor library with autograd, opera…	23	2402	active
nlpxucan/WizardLM The WizardLM family of instruction-tuned large language models (WizardLM, WizardCoder, WizardMath) built with the Evol-Instruct data evolut…	31	9483	maintenance
hamzafarooq/building-llm-applications-from-scratch Open-sourced course materials (code and slides) for building LLM-powered applications from scratch, covering transformer architecture, retr…	39	2390	active
jingyaogong/minimind-o MiniMind-O is an open-source educational project that implements a tiny (~0.1B parameter) end-to-end Omni model from scratch in PyTorch, ha…	57	2384	active
adithya-s-k/AI-Engineering.academy AI Engineering Academy is an open-source educational resource offering structured learning paths for applied AI, covering prompt engineerin…	58	2377	active
natolambert/rlhf-book An open-source textbook on Reinforcement Learning from Human Feedback (RLHF) and LLM post-training, available online and in print, with com…	89	2345	active
open-thoughts/open-thoughts OpenThoughts is a community project curating fully open datasets for training reasoning models, including OpenThoughts3-1.2M and OpenThinke…	45	2323	active
bbruceyuan/LLMs-Zero-to-Hero A Chinese-language tutorial series and accompanying book that teaches large language models by building them from scratch in Jupyter notebo…	65	2278	active
AmberLJC/LLMSys-PaperList A curated list of academic papers, tutorials, and projects on Large Language Model systems, covering training, serving, agentic systems, an…	71	2233	active
FoundationAgents/awesome-foundation-agents A curated awesome-list of papers, repositories, and blogs on the path toward Foundation Agents, accompanying the 'Advances and Challenges i…	35	2210	active
aburkov/theLMbook The official companion repository for The Hundred-Page Language Models Book by Andriy Burkov, containing complete Python/PyTorch implementa…	44	2179	active