abi/secret-llama

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

2678 stars · 169 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

Secret Llama is a fully private LLM chatbot that runs entirely in the browser with no server or installation required, powered by the WebLLM inference engine. It supports open source models like Llama 3, Mistral, and TinyLlama via WebGPU, works offline, and never sends conversation data off the user's machine.

Use cases

• chat with an llm without any data leaving my computer
• run llama 3 or mistral locally in the browser
• use a chatgpt-like interface offline with no install
• private ai chatbot with no server
• test open source llm models in chrome with webgpu
• self-host-free local llm chat for sensitive conversations

When to choose

• privacy is paramount and no data should leave the device
• you want zero installation and no server setup
• you need an offline-capable chatbot in a modern browser
• you want a simple ChatGPT-style UI for open source models

When to avoid

• you need the largest or newest models beyond browser RAM limits
• your browser lacks WebGPU support
• you need multi-user or server-side features
• maximum inference speed on GPU hardware is required

Facets

application · maturity active

llm-inference chatbot chat-interface wasm large-language-models artificial-intelligence chatbots privacy web-development browser cross-platform webgpu in-browser-llm no-server offline react webllm local-inference web-server

Member repositories

For agents

markdown · JSON · MCP: product_card(name="abi/secret-llama")