tekaratzas/RustGPT

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

3157 stars · 267 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

A transformer-based large language model implemented entirely in pure Rust with no external ML frameworks, using only ndarray for matrix operations. It is an educational toy project demonstrating pre-training, instruction tuning, and full backpropagation from scratch, not a production-grade LLM.

Use cases

• learn how transformers work under the hood
• implement an LLM from scratch in Rust
• study backpropagation and self-attention implementations
• run a tiny chat model without ML frameworks
• teach deep learning concepts with readable code

When to choose

• you want to understand LLM internals with clean, modular Rust code
• you need a dependency-light educational transformer implementation
• you prefer Rust over Python for learning ML fundamentals

When to avoid

• you need a production-grade or competitive LLM
• you want GPU-accelerated large-scale training
• you need a mature ecosystem of model weights and tooling

Facets

library · maturity active

llm-training llm-inference machine-learning deep-learning chatbot large-language-models deep-learning machine-learning education tutorials rust cross-platform transformer from-scratch no-ml-frameworks ndarray backpropagation self-attention adam-optimizer toy-project educational

Member repositories

For agents

markdown · JSON · MCP: product_card(name="tekaratzas/RustGPT")