mozilla-ai/llamafile

Health v2 · maintenance only

Flags: no_license

Adoption not part of the score

25694 stars · 1574 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

llamafile is a Mozilla project that packages llama.cpp (and whisper.cpp for whisperfile) with Cosmopolitan Libc into single-file executables that bundle an LLM and run it locally on most OSes and CPU architectures with no installation. It provides a chat UI, local API server, and speech-to-text transcription/translation in one portable file.

Use cases

• run a local llm with a single file
• distribute an open-source model as one executable
• chat with an llm offline without installing anything
• transcribe audio to text locally
• serve a local llm api on any os
• run llm inference on a raspberry pi

When to choose

• you want zero-install, cross-platform local LLM or speech-to-text execution
• you need to distribute a model plus runtime as one portable file
• you want local inference with no data leaving the machine

When to avoid

• you need the latest llama.cpp features or fine-grained control (use llama.cpp directly)
• you require multi-GPU or large-scale production serving
• you need a Python/JS library API rather than a standalone executable

Facets

application · maturity active

llm-inference speech-recognition http-server cli chat-interface large-language-models artificial-intelligence speech-processing self-hosted cross-platform windows bsd cross-platform cli single-file-executable gguf llama-cpp whisper-cpp cosmopolitan-libc local-ai no-installation whisperfile linux macos web-server gpu

Member repositories

For agents

markdown · JSON · MCP: product_card(name="mozilla-ai/llamafile")