Portkey-AI/gateway
A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API. observed · 2026-08-28
Health v2 · maintenance only
76/100
- Activity 84
- Release rhythm 65
- Longevity 79
How is this computed?
round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10) — computed 2026-09-02. Adoption (stars, forks) is never an input.
- gap_med: 6
- age_days: 1106
- days_rel: 233
- days_push: 100
- n_releases_24m: 50
Adoption not part of the score
12837 stars · 1269 forks observed · 2026-08-28
What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded
Portkey AI Gateway is an open-source, TypeScript-based AI gateway that routes requests to 1,600+ LLMs across many providers through a single fast, OpenAI-compatible API. It includes integrated guardrails, automatic retries, fallbacks, load balancing, caching, and MCP gateway support, and can be self-hosted or used hosted.
Use cases
- route requests to multiple LLM providers through one API
- add fallbacks and retries to avoid LLM downtime
- load balance across LLM providers
- apply guardrails to AI model inputs and outputs
- self-host an LLM gateway with caching and rate limiting
- connect MCP servers through a gateway
- switch between OpenAI, Anthropic, and other models without code changes
When to choose
- you use multiple LLM providers and want a single unified API
- you need production reliability features like retries, fallbacks, and load balancing
- you want guardrails and governance over AI traffic
- you need a lightweight, self-hostable gateway with sub-millisecond overhead
When to avoid
- you only call a single LLM provider directly with no routing needs
- you need a full LLM observability or evaluation platform rather than a gateway
- your stack cannot run Node.js/TypeScript services
Facets
service · maturity active
api-gateway llm-inference middleware proxy rate-limiting caching mcp large-language-models artificial-intelligence apis developer-tools self-hosted cross-platform self-hosted cloud serverless llm-gateway model-routing guardrails fallbacks load-balancing openai-compatible llmops typescript ai-agents nodejs docker
2 sources
- readme: https://github.com/Portkey-AI/gateway · fetched 2026-08-28 · 921e1117a864
- homepage: https://portkey.ai/features/ai-gateway · fetched 2026-08-29 · 84b5d31353b9
Member repositories
| Repository | Role | Health v2 |
|---|---|---|
| Portkey-AI/gateway | main | 76 |
For agents
markdown · JSON · MCP: product_card(name="Portkey-AI/gateway")
Data as of 2026-08-30T08:39:29.467469+00:00 · Report a problem