ENTERPILOT/GoModel

Health v2 · maintenance only

Adoption not part of the score

1107 stars · 92 forks observed · 2026-09-03

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

GoModel is an open-source AI gateway and control plane written in Go that exposes a unified OpenAI-compatible and Anthropic-compatible API across providers like OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, and vLLM. It adds observability, response caching, guardrails, cost tracking, intelligent routing, failover, sticky sessions, and real-time usage logs, positioning itself as a production-ready LiteLLM alternative.

Use cases

• route LLM requests to multiple providers through one OpenAI-compatible endpoint
• track token usage and LLM spending per model, path, or user
• cache identical LLM responses to cut costs and latency
• add guardrails and audit paths to AI traffic
• fail over between LLM providers automatically
• swap model providers without changing application code
• self-host a LiteLLM alternative in Go
• debug AI calls with real-time request logs

When to choose

• you need a fast, resource-efficient self-hosted AI gateway in Go
• you want provider-agnostic LLM routing with cost tracking and observability
• you want OpenAI and Anthropic SDK compatibility against many backends
• you need caching, guardrails, and failover at the gateway layer

When to avoid

• you need a client-side SDK embedded in your app rather than a proxy service
• you require a long-proven enterprise gateway with a large community
• your stack is Python-centric and you prefer LiteLLM's Python ecosystem

Facets

service · maturity active

llm-inference proxy api-gateway caching monitoring analytics auth rate-limiting logging middleware large-language-models artificial-intelligence apis self-hosted developer-tools analytics backend windows self-hosted go cross-platform ai-gateway llm-gateway ai-proxy openai-compatible anthropic-compatible litellm-alternative cost-tracking guardrails intelligent-routing failover usage-tracking observability provider-routing response-caching ai-agents linux macos docker web-server

Member repositories

For agents

markdown · JSON · MCP: product_card(name="ENTERPILOT/GoModel")