aburkov/theLMbook resource

Health v2 · maintenance only

Flags: no_license

Adoption not part of the score

2179 stars · 368 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

The official companion repository for The Hundred-Page Language Models Book by Andriy Burkov, containing complete Python/PyTorch implementations and Jupyter notebooks for each chapter. It teaches language models step by step, from count-based methods through RNNs to modern transformers and LLM finetuning.

Use cases

• learn how large language models work from scratch
• implement language models in PyTorch with guided notebooks
• study the math behind transformers and RNNs
• learn prompt engineering and LLM finetuning
• progress from machine learning basics to modern LLM architectures
• find hands-on code examples for a language models book

When to choose

• you want a concise, math-grounded introduction to language models with runnable code
• you prefer building understanding incrementally from simple models to transformers
• you are a developer, data scientist, or ML engineer new to LLMs

When to avoid

• you need a production-ready LLM library or framework rather than educational material
• you want exhaustive, state-of-the-art coverage beyond a hundred-page treatment
• you need a licensed, reusable codebase - the repo has no license

Facets

learning-resource · maturity active

machine-learning deep-learning llm-training prompt-engineering nlp large-language-models machine-learning deep-learning tutorials education python book jupyter-notebooks pytorch language-models educational companion-code natural-language-processing

Member repositories

For agents

markdown · JSON · MCP: product_card(name="aburkov/theLMbook")