getumbrel/llama-gpt

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

10940 stars · 706 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

LlamaGPT is a self-hosted, offline ChatGPT-like chatbot powered by Llama 2 and Code Llama models via llama.cpp, with all data staying on the user's device. It ships as a Docker-deployable app with an OpenAI-compatible API and one-click install on umbrelOS home servers.

Use cases

• run a private chatgpt alternative on my own hardware
• self-host a local llm chatbot with no data leaving my device
• chat with llama 2 offline
• serve an openai-compatible api from a local model
• run code llama locally for coding help
• install a chatbot on my umbrel home server

When to choose

• you want a fully private, offline ChatGPT-like experience on your own hardware
• you run an umbrelOS home server and want one-click local AI
• you need an OpenAI-compatible API backed by a local Llama 2 or Code Llama model
• you have an M1/M2 Mac or Nvidia GPU and enough RAM for 7B-70B quantized models

When to avoid

• you need the latest models, custom model support, or frequent updates - the project appears in maintenance with limited recent activity
• you lack the RAM/GPU required for the quantized models
• you want multi-user or cloud-scale serving rather than a personal assistant
• you prefer actively developed alternatives like Ollama or Open WebUI

Facets

application · maturity maintenance

chatbot llm-inference self-hosted chat-interface api-framework large-language-models chatbots artificial-intelligence self-hosted privacy self-hosted llama-2 code-llama llama-cpp offline-ai local-llm openai-compatible-api umbrel docker macos linux web-server kubernetes gpu

Member repositories

For agents

markdown · JSON · MCP: product_card(name="getumbrel/llama-gpt")