lucidrains/titans-pytorch

Health v2 · maintenance only

Adoption not part of the score

1980 stars · 208 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

An unofficial PyTorch implementation of the Titans architecture, a neural long-term memory module for transformers that learns to memorize at test time. It provides the NeuralMemory module and a MemoryAsContextTransformer for training and sampling.

Use cases

• implement the Titans neural memory architecture in pytorch
• train a transformer with long-term memory at test time
• experiment with memory-as-context transformer architectures
• research test-time training and linear attention memory
• build transformers that handle very long sequences

When to choose

• you want to experiment with or reproduce the Titans paper in PyTorch
• you need a drop-in neural memory module for custom transformer research
• you are exploring architectures beyond standard attention for long contexts

When to avoid

• you need a production-ready, officially supported LLM implementation
• you want a pretrained model rather than components to train yourself
• you need guaranteed fidelity to the paper since this is unofficial

Facets

library · maturity active

machine-learning deep-learning llm-training deep-learning large-language-models artificial-intelligence python transformers neural-memory test-time-training long-context research-implementation pytorch gpu

Member repositories

For agents

markdown · JSON · MCP: product_card(name="lucidrains/titans-pytorch")