karpathy/llm-council

Health v2 · maintenance only

Flags: no_releases no_license

Adoption not part of the score

24369 stars · 4300 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

A local web app that sends a user's question to multiple LLMs via OpenRouter, has them anonymously review and rank each other's answers, and uses a Chairman model to synthesize a final response. It was built as a fun weekend hack by Andrej Karpathy and is explicitly provided as-is without support.

Use cases

• compare answers from multiple LLMs side by side
• get a second opinion on hard questions from several AI models
• have LLMs review and rank each other's responses
• run a local ChatGPT-like interface backed by multiple providers
• evaluate which LLM gives the most accurate and insightful answers
• aggregate multiple model opinions into one final answer

When to choose

• you want to query several frontier LLMs at once and compare their answers
• you want anonymized cross-review between models to reduce single-model bias
• you want a self-hosted, hackable ChatGPT-style UI you can modify with an LLM
• you already have an OpenRouter API key and credits

When to avoid

• you need a supported, maintained product with bug fixes and features
• you want a single fast/cheap LLM response rather than multi-model fan-out
• you can't use OpenRouter or don't want to pay per-query API costs
• you need production-grade security, auth, or deployment support

Facets

application · maturity maintenance

llm-inference chat-interface web-framework http-client large-language-models artificial-intelligence web-development developer-tools python self-hosted cross-platform openrouter multi-llm llm-comparison peer-review ensemble chatgpt-alternative fastapi react nodejs web-server

Member repositories

For agents

markdown · JSON · MCP: product_card(name="karpathy/llm-council")