QuantumNous/new-api

Health v2 · maintenance only

Adoption not part of the score

46459 stars · 11026 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

New API is a self-hosted LLM gateway and AI asset management system that aggregates 30+ model providers behind a single unified endpoint. It cross-converts provider APIs into OpenAI-, Claude-, and Gemini-compatible formats while adding routing, authentication, usage analytics, and cost control.

Use cases

• expose all my LLM providers through one OpenAI-compatible endpoint
• self-host an AI gateway to manage API keys and quotas for a team
• convert Claude and Gemini models to OpenAI API format
• track token usage and costs across multiple AI providers
• load balance and failover between LLM providers
• resell or distribute model access with per-user keys and billing
• use one API base URL with tools like LangChain, Dify, or Open WebUI

When to choose

• you need a unified endpoint across many LLM providers
• you want self-hosted key management, quotas, and usage analytics
• you need protocol conversion between OpenAI, Claude, and Gemini formats
• you run a team or platform that shares model access with cost control

When to avoid

• you only call a single provider directly with no need for aggregation
• you need a fully managed cloud gateway with no self-hosting overhead
• your usage may conflict with upstream provider terms of service

Facets

service · maturity active

api-gateway llm-inference middleware auth analytics rate-limiting http-server large-language-models artificial-intelligence apis self-hosted developer-tools self-hosted go llm-gateway openai-compatible api-proxy model-aggregation cost-tracking channel-management claude gemini docker linux web-server

Member repositories

For agents

markdown · JSON · MCP: product_card(name="QuantumNous/new-api")