karpathy/nn-zero-to-hero resource

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

24128 stars · 3531 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

A free video course by Andrej Karpathy teaching neural networks from the basics up to building GPT-style language models, with accompanying Jupyter notebooks and exercises. It covers backpropagation, MLPs, BatchNorm, and Transformer language models through hands-on coding.

Use cases

• learn how backpropagation works from scratch
• build a neural network without using a framework
• understand how GPT-style language models are trained
• study character-level language modeling with makemore
• practice deep learning fundamentals with exercises
• learn PyTorch tensor basics for training models

When to choose

• you want a from-first-principles introduction to neural networks and backpropagation
• you learn best by coding along with video lectures and notebooks
• you want to understand the internals of language models like GPT before using high-level libraries

When to avoid

• you need a production-ready training framework rather than educational code
• you already need advanced topics like distributed training or large-scale LLM fine-tuning
• you prefer text-only documentation without video lectures

Facets

learning-resource · maturity stable

machine-learning deep-learning nlp deep-learning machine-learning tutorials python neural-networks backpropagation course jupyter-notebooks language-modeling transformers youtube-videos natural-language-processing

Member repositories

For agents

markdown · JSON · MCP: product_card(name="karpathy/nn-zero-to-hero")