liltom-eth/llama2-webui
Run any Llama 2 locally with gradio UI on GPU or CPU from anywhere (Linux/Windows/Mac). Use `llama2-wrapper` as your local llama2 backend for Generative Agents/Apps. observed · 2026-10-20
Health v2 · maintenance only
20/100
- Activity 0
- Release rhythm 8
- Longevity 85
How is this computed?
round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10) — computed 2026-10-22. Adoption (stars, forks) is never an input.
- gap_med: n/a
- age_days: 1190
- days_rel: n/a
- days_push: 943
- n_releases_24m: 0
Adoption not part of the score
1934 stars · 197 forks observed · 2026-10-20
What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded
A Gradio-based web UI for running Llama 2 models (7B/13B/70B, GPTQ, GGML, GGUF, CodeLlama) locally on GPU or CPU across Linux, Windows, and Mac. It also ships llama2-wrapper, a Python backend for integrating Llama 2 into generative agent apps, plus an OpenAI-compatible API server.
Use cases
- run llama 2 locally with a chat ui
- serve llama2 on cpu or mac without gpu
- use llama2 as backend for generative agents
- run an openai-compatible api on local llama2 models
- run quantized 4-bit or 8-bit llama2 models
- try code llama in a browser playground
When to choose
- you want a simple local web UI for Llama 2 variants on any OS
- you need a Python wrapper to embed Llama 2 in your own apps
- you want OpenAI API compatibility with local models
When to avoid
- you need multi-user production serving with high throughput
- you want broader model support beyond Llama 2 family
- you need an actively developed feature-rich UI like newer alternatives
Facets
application · maturity maintenance
llm-inference chat-interface web-framework sdk large-language-models artificial-intelligence self-hosted developer-tools windows python cross-platform cli llama-2 gradio llama-cpp gptq gguf openai-compatible-api local-inference chatbot-ui linux macos gpu
1 source
- readme: https://github.com/liltom-eth/llama2-webui · fetched 2026-10-20 · c1789d9e5eb1
Member repositories
| Repository | Role | Health v2 |
|---|---|---|
| liltom-eth/llama2-webui | main | 20 |
For agents
markdown · JSON · MCP: product_card(name="liltom-eth/llama2-webui")
Data as of 2026-10-19T08:05:51.212177+00:00 · Report a problem