tloen/alpaca-lora

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

18899 stars · 2168 forks observed · 2026-10-01

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

A repository of scripts for reproducing Stanford Alpaca-style instruction tuning of LLaMA models using low-rank adaptation (LoRA) on consumer GPUs. It includes training, inference, and weight-export code built on Hugging Face PEFT and bitsandbytes, plus pretrained LoRA weights.

Use cases

• instruct-tune llama on a single consumer gpu
• fine-tune a large language model with lora
• run an alpaca-style chat model on a raspberry pi
• generate low-rank adapter weights for llama
• serve a fine-tuned llama model with a gradio interface
• merge lora weights into a base llama model

When to choose

• you want to instruction-tune a 7b-65b llama model cheaply with LoRA
• you need a minimal reference implementation of PEFT-based fine-tuning
• you want pretrained Alpaca LoRA weights for inference on limited hardware

When to avoid

• you need production-grade training infrastructure or multi-node training
• you want actively maintained support for newer model architectures
• you need a full fine-tuning pipeline rather than parameter-efficient adapters

Facets

library · maturity maintenance

llm-training llm-inference machine-learning deep-learning large-language-models machine-learning artificial-intelligence python cross-platform lora fine-tuning llama peft bitsandbytes consumer-hardware gradio jupyter-notebook gpu linux

Member repositories

For agents

markdown · JSON · MCP: product_card(name="tloen/alpaca-lora")