mnfst/manifest

Health v2 · maintenance only

Adoption not part of the score

7481 stars · 502 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

Manifest is an open-source LLM gateway and router that lets AI agents and apps reach all their model providers through one OpenAI- and Anthropic-compatible endpoint. It adds routing with fallbacks, spend limits, on-the-fly request repair (Autofix), and per-request cost and token observability, deployable via Docker or a hosted cloud.

Use cases

• route agent LLM calls through one endpoint across multiple providers
• add fallbacks when a model or provider fails or is rate-limited
• track token usage and dollar cost per agent or harness
• use ChatGPT/Claude/Gemini subscriptions and BYOK keys behind one gateway
• self-host an LLM proxy with spend caps and budget alerts
• auto-repair malformed LLM requests that fail with 4xx errors
• connect local models and custom endpoints to agent harnesses

When to choose

• you run AI agents that need reliable multi-provider LLM access with fallbacks
• you want self-hosted cost tracking and spend limits for LLM calls
• you want to pool subscriptions, API keys, and local models behind one OpenAI-compatible URL
• you need request logs and observability for every provider attempt

When to avoid

• you need model training, fine-tuning, or hosting rather than routing
• you want a client-side SDK only without a gateway service
• you need a lightweight proxy with no dashboard or billing features
• you require team features like SSO on a free plan

Facets

service · maturity active

llm-inference api-gateway monitoring rate-limiting middleware large-language-models developer-tools self-hosted apis self-hosted cloud llm-gateway llm-router autofix byok cost-tracking token-tracking openai-compatible anthropic-compatible fallback-routing observability ai-agents docker web-server nodejs

Member repositories

For agents

markdown · JSON · MCP: product_card(name="mnfst/manifest")