yym68686/uni-api

Health v2 · maintenance only

Adoption not part of the score

1257 stars · 156 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

uni-api is a self-hosted Python service that unifies management of multiple LLM provider APIs behind a single OpenAI-compatible endpoint. It converts requests to/from providers like OpenAI, Anthropic, Gemini, Vertex, Azure, AWS, and OpenRouter, with load balancing, automatic retry, channel cooling, and fine-grained API key permissions configured via a YAML file.

Use cases

• unify multiple llm api keys behind one openai-compatible endpoint
• load balance requests across several llm providers
• convert anthropic and gemini apis to openai format
• self-host a personal llm api gateway without a frontend
• rotate and retry across llm api channels automatically
• control which models each api key can access
• use one base url for claude, gpt, and gemini in developer tools

When to choose

• you want a lightweight, config-file-only LLM gateway for personal use
• you need to mix providers (OpenAI, Anthropic, Gemini, AWS, Azure) behind one OpenAI-format API
• you need weighted or round-robin load balancing across channels and keys
• you prefer no web dashboard and pure YAML configuration

When to avoid

• you need a full commercial LLM gateway with a web UI, billing, and team management
• you only use a single provider and don't need unification
• you need features like fine-tuning management or model hosting

Facets

service · maturity active

api-gateway llm-inference proxy middleware configuration-management large-language-models artificial-intelligence apis self-hosted backend self-hosted python cross-platform openai-compatible llm-gateway api-unification load-balancing channel-management no-frontend yaml-config docker web-server

Member repositories

For agents

markdown · JSON · MCP: product_card(name="yym68686/uni-api")