# theopenco/llmgateway

Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.

Repository: https://github.com/theopenco/llmgateway
Canonical: https://ross.abutalabs.com/products/llmgateway
Homepage: https://llmgateway.io
Language: TypeScript
License: NOASSERTION
License Family: other
Topics: ai, llm, llms, typescript, ai-gateway, analytics, anthropic, api-key-management, claude, codex, enterprise, guardrails, inference, llm-gateway, llm-proxy, observability, openai, opencode, rate-limiting
Last push: 2026-08-26T17:58:15+00:00

## Health v2 (maintenance only)
Score: 86/100 (v2, computed 2026-09-03T02:20:16.233290+00:00)
- activity 99, release rhythm 99, longevity 36
- inputs: {"age_days": 508, "days_push": 7, "days_rel": 9, "gap_med": 6.0, "n_releases_24m": 15}
- flags: no_license
- formula: round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10)

## Adoption (not part of the score)
Stars 1576, forks 175 (observed 2026-08-28T04:05:06.005697+00:00)

## What it is
LLM Gateway is an open-source API gateway for large language models that sits between applications and 40+ LLM providers (OpenAI, Anthropic, Google, etc.) with an OpenAI-compatible unified API. It provides multi-provider routing with fallbacks, API key management, cost and usage analytics, caching, guardrails, and can be used hosted or self-hosted via Docker.

## Use cases
- route llm requests across multiple providers with one api
- track token usage and costs for openai and anthropic calls
- switch from openai to claude without changing code
- self-host an llm proxy gateway with docker
- add fallbacks and automatic provider failover for llm calls
- detect prompt injection and redact pii before hitting llms
- manage all my provider api keys in one dashboard
- compare model latency and cost across providers

## When to choose
- you need a unified OpenAI-compatible endpoint across many LLM providers
- you want cost, token, and latency analytics for LLM usage
- you need provider failover, routing, or rate limiting for LLM traffic
- you want guardrails like PII redaction and prompt-injection blocking
- you want to self-host an LLM gateway on your own infrastructure

## When to avoid
- you only call a single LLM provider and don't need routing or analytics
- you need to self-host model weights or run local inference — this proxies APIs, it doesn't serve models
- you need a lightweight in-process SDK rather than a gateway service
- you require an OSI-approved open-source license (license is custom/unclear)

## Facets
- artifact type: service
- maturity: active
- function: api-gateway, llm-inference, analytics, monitoring, rate-limiting, caching, security, middleware, self-hosted
- domain: large-language-models, artificial-intelligence, apis, developer-tools, analytics, security, self-hosted
- platform: self-hosted, cloud
- tags: llm-gateway, llm-proxy, openai-compatible, multi-provider, byok, guardrails, cost-tracking, api-key-management, observability, fallback-routing, docker, web-server, nodejs, typescript

## Member repositories
- theopenco/llmgateway (main) score 86

## Provenance
- Observed fields: from GitHub, fetched 2026-08-28T04:05:06.005697+00:00.
- Health v2: computed from the inputs above; adoption is never an input.
- Inferred fields (summary, facets, guidance): AI-extracted, prompt v1, taxonomy v1, on 2026-08-30T03:57:25.912077+00:00, confidence not recorded.
  - readme: https://github.com/theopenco/llmgateway (fetched 2026-08-28T04:05:06.005697+00:00, sha be5e4d34e25f)
  - homepage: https://llmgateway.io (fetched 2026-08-29T11:27:45.420622+00:00, sha ff1809a90015)
  - site_page: https://docs.llmgateway.io (fetched 2026-08-29T11:27:45.430267+00:00, sha 370d610d0052)
  - site_page: https://llmgateway.io/guides (fetched 2026-08-29T11:27:45.437198+00:00, sha 953b6b386740)
  - site_page: https://llmgateway.io/features/guardrails (fetched 2026-08-29T11:27:45.439303+00:00, sha b7d1b2d02a25)
  - site_page: https://llmgateway.io/features/unified-api-interface (fetched 2026-08-29T11:27:45.441098+00:00, sha 417d720fff2e)
  - site_page: https://llmgateway.io/features/multi-provider-support (fetched 2026-08-29T11:27:45.442909+00:00, sha 6cbf21a1d99a)
  - site_page: https://llmgateway.io/features/performance-monitoring (fetched 2026-08-29T11:27:45.444795+00:00, sha 6e89fed5fec8)
  - site_page: https://llmgateway.io/pricing (fetched 2026-08-29T11:27:45.432661+00:00, sha fcbcf0c09495)
  - site_page: https://llmgateway.io/changelog (fetched 2026-08-29T11:27:45.434652+00:00, sha d9d6f6512fb1)
- Data as of 2026-08-30T08:39:29.467469+00:00.