bricks-cloud/BricksLLM

Health v2 · maintenance only

Adoption not part of the score

1226 stars · 97 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

BricksLLM is a cloud-native AI gateway written in Go that sits between applications and LLM providers like OpenAI, Anthropic, Azure OpenAI, and vLLM. It provides per-API-key rate limiting, cost control, usage analytics, PII detection and masking, caching, retries, and failover for putting LLMs into production.

Use cases

• set llm usage and cost limits per api key
• track llm usage per user and organization
• redact pii from llm requests
• add failover and retries between openai and azure openai
• rate limit llm api keys for students or pricing tiers
• self-host an llm api gateway with monitoring
• cache llm responses to cut costs

When to choose

• you need enterprise-grade per-key rate and cost limits for LLM traffic
• you want self-hosted control over LLM gateway privacy and PII masking
• you need failover, retries, and caching across multiple LLM providers
• you want per-user or per-environment LLM usage analytics

When to avoid

• you only need a simple proxy without rate limiting or cost control
• you want a fully managed SaaS gateway with a dashboard out of the box
• your stack requires providers not natively supported and you cannot write custom integrations

Facets

service · maturity active

api-gateway rate-limiting caching monitoring auth middleware proxy large-language-models artificial-intelligence apis security self-hosted analytics self-hosted go cloud llm-gateway cost-control pii-detection openai-proxy anthropic azure-openai vllm api-key-management failover docker linux

Member repositories

For agents

markdown · JSON · MCP: product_card(name="bricks-cloud/BricksLLM")