Lightning-AI/lit-llama

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

6085 stars · 517 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

Lit-LLaMA is an independent, Apache 2.0-licensed implementation of the LLaMA language model built on nanoGPT, covering pre-training, fine-tuning (LoRA, LLaMA-Adapter), and inference with quantization support. The repository is no longer actively maintained and its successor is LitGPT.

Use cases

• pretrain a llama-style language model from scratch
• fine-tune llama with lora on consumer hardware
• run llama inference with 4-bit quantization
• open-source licensed llama implementation without gpl restrictions
• convert and evaluate llama checkpoints
• fine-tune llama with llama-adapter

When to choose

• you need a permissively licensed (Apache 2.0) LLaMA implementation for research or study
• you want a simple single-file model implementation to read and modify
• you need Int8 or GPTQ 4-bit quantized inference of LLaMA weights

When to avoid

• you want active maintenance, bug fixes, or support for LLaMA 2 and newer checkpoints - use LitGPT instead
• you need production-grade serving infrastructure rather than research code
• you require the latest optimizations or new model architectures

Facets

library · maturity abandoned

llm-training llm-inference machine-learning deep-learning large-language-models deep-learning machine-learning artificial-intelligence python windows llama nanogpt lora quantization fine-tuning apache-2.0 deprecated litgpt-successor gpu linux macos

Member repositories

For agents

markdown · JSON · MCP: product_card(name="Lightning-AI/lit-llama")