Ross ROSS = Recommend OSS · open-source software intelligence for agents

tbphp/gpt-load

Multi-channel AI proxy with intelligent key rotation. 智能密钥轮询的多渠道 AI 代理。 observed · 2026-08-28

github.com/tbphp/gpt-load · homepage · Go · MIT (permissive) observed · 2026-08-28

Health v2 · maintenance only

83/100

  • Activity 99
  • Release rhythm 91
  • Longevity 32
How is this computed?

round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10) — computed 2026-09-02. Adoption (stars, forks) is never an input.

  • gap_med: 6.0
  • age_days: 453
  • days_rel: 62
  • days_push: 7
  • n_releases_24m: 33

Full methodology

Adoption not part of the score

6290 stars · 674 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

GPT-Load is a high-performance, enterprise-grade AI API transparent proxy service built in Go that aggregates multiple AI providers (OpenAI, Google Gemini, Anthropic Claude) behind a unified API. It provides intelligent API key pool management with automatic rotation, load balancing, and a web-based admin dashboard with monitoring, deployable standalone via Docker or as a master/slave cluster.

Use cases

  • rotate multiple OpenAI API keys automatically to avoid rate limits
  • proxy OpenAI, Gemini, and Claude behind one unified endpoint
  • load balance LLM API requests across multiple providers
  • self-host an AI gateway with key pool management and monitoring
  • deploy a high-concurrency AI proxy cluster with master/slave architecture
  • track LLM API usage and request logs in a dashboard

When to choose

  • you need to manage many API keys across multiple AI providers with automatic failover
  • you want a transparent proxy that preserves native OpenAI/Gemini/Claude API formats
  • you need production-grade high-concurrency proxying with clustering and monitoring
  • you want a self-hosted alternative with a web admin UI and Docker deployment

When to avoid

  • you only use a single AI provider with one API key and no rate-limit issues
  • you need request transformation, routing rules, or advanced gateway features beyond transparent proxying
  • you want a fully managed cloud gateway rather than self-hosting with MySQL/Redis infrastructure

Facets

service · maturity active

proxy api-gateway http-server monitoring caching load-testing artificial-intelligence large-language-models apis self-hosted backend self-hosted windows go ai-gateway key-rotation openai-proxy gemini anthropic load-balancing transparent-proxy multi-channel devops docker linux macos web-server

7 sources

Member repositories

RepositoryRoleHealth v2
tbphp/gpt-loadmain83

For agents

markdown · JSON · MCP: product_card(name="tbphp/gpt-load")

Data as of 2026-08-30T08:39:29.467469+00:00 · Report a problem