harvardnlp/annotated-transformer resource

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

7459 stars · 1564 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

An annotated, line-by-line Jupyter notebook implementation of the 'Attention Is All You Need' Transformer paper from Harvard NLP. It pairs explanatory prose with working PyTorch code to teach the Transformer architecture.

Use cases

• learn how the transformer architecture works
• understand self-attention with code
• study an annotated implementation of the attention is all you need paper
• teach deep learning concepts with a runnable notebook
• reference implementation of transformer encoder and decoder

When to choose

• you want to deeply understand the Transformer paper through code
• you prefer learning from annotated notebooks with explanations
• you need a minimal, readable PyTorch Transformer implementation

When to avoid

• you need a production-ready or optimized Transformer library
• you want pre-trained models or training pipelines
• you need features like tokenizers, distributed training, or model serving

Facets

learning-resource · maturity stable

deep-learning nlp machine-learning deep-learning tutorials python cross-platform annotated-implementation jupyter-notebook transformer-architecture educational attention-mechanism natural-language-processing

Member repositories

For agents

markdown · JSON · MCP: product_card(name="harvardnlp/annotated-transformer")