astaxie/TokenHub

Health v2 · maintenance only

Flags: young

Adoption not part of the score

1237 stars · 152 forks observed · 2026-09-03

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

TokenHub is a self-hosted enterprise AI gateway written in Go that provides a governance layer over AI model access, including model routing, permission management, token quotas, and cost control. It is OpenAI-compatible and adds usage attribution, budget control, and provider bill reconciliation on top of simple provider fan-out.

Use cases

• unify access to multiple AI model providers behind one private gateway
• control which teams and projects can use which models and how many tokens
• route model requests by cost, performance, health, and fallback policy
• track and attribute AI token usage to users, teams, and applications
• reconcile internal AI usage against upstream provider bills
• reduce AI spend through caching, quotas, and smarter model selection

When to choose

• you need enterprise governance, budgets, and cost attribution for AI model usage across many teams
• you want a self-hosted, OpenAI-compatible gateway with routing and access control
• finance and platform teams need to explain and reconcile AI spend against provider invoices

When to avoid

• you only need a simple developer proxy to fan out requests to multiple providers without governance
• you want a fully managed cloud AI gateway rather than self-hosting
• your usage is a single developer or small team with no need for quotas or attribution

Facets

service · maturity active

api-gateway llm-inference auth rate-limiting monitoring analytics caching middleware large-language-models self-hosted developer-tools apis security self-hosted go cross-platform ai-gateway token-governance model-routing cost-optimization usage-attribution provider-reconciliation openai-compatible enterprise ai-agents docker web-server linux

Member repositories

For agents

markdown · JSON · MCP: product_card(name="astaxie/TokenHub")