HazyResearch/minions

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

1350 stars · 151 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

Minions is a communication protocol and Python framework that lets small on-device LLMs collaborate with frontier cloud LLMs to cut cloud inference costs while preserving quality. It includes demo apps, a CLI, a WebGPU app, and an end-to-end encrypted Secure Minions Chat variant.

Use cases

• reduce cloud LLM API costs by processing long contexts locally
• run a local small model that orchestrates a frontier cloud model
• build privacy-preserving chat where sensitive data never leaves the device
• experiment with local-remote LLM collaboration protocols from the research paper
• estimate inference costs across local and cloud model combinations
• run a demo chat app combining Ollama and cloud providers like OpenAI

When to choose

• you want to lower LLM costs by offloading long-context work to an on-device model
• privacy matters and you want sensitive context processed locally
• you want to reproduce or build on the Minions research protocol
• you have a capable local machine and access to at least one cloud LLM API

When to avoid

• you have no local hardware able to run a small model
• you need a production-ready, battle-tested inference framework
• you only want a simple cloud API wrapper without local models
• you need Python 3.13 support

Facets

framework · maturity active

llm-inference agent-framework rag chatbot cli large-language-models artificial-intelligence privacy developer-tools python cli on-device-llm cloud-llm cost-optimization local-remote-collaboration ollama secure-chat end-to-end-encryption ai-agents macos linux docker

Member repositories

For agents

markdown · JSON · MCP: product_card(name="HazyResearch/minions")