tairov/llama2.mojo

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

2125 stars · 138 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

A single-file implementation of Llama 2 transformer inference written in pure Mojo, leveraging SIMD and vectorization for fast CPU inference. It outperforms llama2.c and llama.cpp on small Llama models and serves as a showcase of Mojo's performance capabilities.

Use cases

• run llama 2 inference locally on cpu
• benchmark mojo vs c and python llama2 implementations
• learn how transformer inference works in a single file
• experiment with simd vectorized matrix multiplication
• run tinyllama and stories models from the terminal

When to choose

• you want fast CPU inference of small Llama 2 models without GPU dependencies
• you are learning Mojo or studying optimized transformer inference code
• you want a minimal single-file LLM inference implementation

When to avoid

• you need production LLM serving with batching, quantization, or GPU support
• you need to run large models beyond ~1B parameters
• you require a stable long-term dependency, since it tracks Mojo nightly versions

Facets

cli-tool · maturity active

llm-inference machine-learning benchmarking large-language-models deep-learning performance developer-tools cli mojo llama2 simd vectorization single-file transformer cpu-inference educational macos linux cpu

Member repositories

For agents

markdown · JSON · MCP: product_card(name="tairov/llama2.mojo")