karpathy/ng-video-lecture resource

Health v2 · maintenance only

Flags: no_releases no_license

Adoption not part of the score

4937 stars · 1352 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

The companion code repository for Andrej Karpathy's 'Neural Networks: Zero To Hero' video lecture on building a GPT model from scratch (nanoGPT). It is meant for learners to follow along, hack on, and walk through the git history of a minimal GPT implementation.

Use cases

• learn how a GPT transformer is implemented from scratch
• follow along with a video lecture on building nanoGPT
• study the git history of a minimal GPT codebase
• hack on a small educational GPT implementation
• understand transformer training basics in Python

When to choose

• you want educational, minimal GPT code tied to a lecture
• you prefer learning by reading and modifying a small codebase

When to avoid

• you need a production-ready or well-optimized GPT implementation
• you need model initialization best practices not covered in this code
• you need a maintained library with a license file and releases

Facets

learning-resource · maturity stable

machine-learning deep-learning llm-training deep-learning large-language-models tutorials education python gpt transformer nanogpt educational-code video-lecture pytorch

Member repositories

For agents

markdown · JSON · MCP: product_card(name="karpathy/ng-video-lecture")