liltom-eth/llama2-webui

Health v2 · maintenance only

Adoption not part of the score

1937 stars · 199 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

A Gradio-based web UI for running Llama 2 models (7B/13B/70B, GPTQ, GGML, GGUF, CodeLlama) locally on GPU or CPU across Linux, Windows, and Mac. It also ships llama2-wrapper, a Python backend for integrating Llama 2 into generative agent apps, plus an OpenAI-compatible API server.

Use cases

• run llama 2 locally with a chat ui
• serve llama2 on cpu or mac without gpu
• use llama2 as backend for generative agents
• run an openai-compatible api on local llama2 models
• run quantized 4-bit or 8-bit llama2 models
• try code llama in a browser playground

When to choose

• you want a simple local web UI for Llama 2 variants on any OS
• you need a Python wrapper to embed Llama 2 in your own apps
• you want OpenAI API compatibility with local models

When to avoid

• you need multi-user production serving with high throughput
• you want broader model support beyond Llama 2 family
• you need an actively developed feature-rich UI like newer alternatives

Facets

application · maturity maintenance

llm-inference chat-interface web-framework sdk large-language-models artificial-intelligence self-hosted developer-tools windows python cross-platform cli llama-2 gradio llama-cpp gptq gguf openai-compatible-api local-inference chatbot-ui linux macos gpu

Member repositories

For agents

markdown · JSON · MCP: product_card(name="liltom-eth/llama2-webui")