Ross ROSS = Recommend OSS · open-source software intelligence for agents

tashfeenahmed/freellmapi

7.4 billion tokens per month. 34 free LLM providers. 635 free model endpoints. All behind one /v1 endpoint, plus any custom OpenAI-compatible endpoint. Smart routing, automatic failover, encrypted keys. Personal experimentation only. observed · 2026-08-28

github.com/tashfeenahmed/freellmapi · homepage · TypeScript · MIT (permissive) observed · 2026-08-28

Health v2 · maintenance only

81/100

  • Activity 99
  • Release rhythm 99
  • Longevity 9

Flags: young

How is this computed?

round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10) — computed 2026-09-02. Adoption (stars, forks) is never an input.

  • gap_med: 1
  • age_days: 134
  • days_rel: 7
  • days_push: 7
  • n_releases_24m: 24

Full methodology

Adoption not part of the score

20682 stars · 2973 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

FreeLLMAPI is an open-source, self-hosted LLM gateway that aggregates free tiers from 34 providers (600+ free model endpoints) behind a single OpenAI-compatible /v1 endpoint. It provides smart routing, automatic failover on rate limits, per-key quota tracking, and encrypted key storage, with an optional paid live model-catalog feed.

Use cases

  • use free LLM APIs without juggling multiple provider keys
  • route coding agents like Claude Code, Codex, Aider, or Cline across free model tiers
  • automatically fail over to another provider when one is rate-limited
  • track usage to stay under each provider's free-tier caps
  • self-host an OpenAI-compatible gateway with keys kept local
  • experiment with frontier models like DeepSeek, Qwen, Gemini Flash, and Llama for free

When to choose

  • you want one OpenAI-compatible endpoint over many providers' free tiers
  • you need automatic failover and quota tracking across free LLM providers
  • you prefer self-hosting so provider keys stay on your machine
  • you want to point existing OpenAI SDK-based tools or coding agents at free models

When to avoid

  • you need production-grade SLAs or paid-tier reliability and throughput
  • you need the very latest model catalog without the 30-day free-tier delay and won't pay for Premium
  • you require providers or models not present in the free-tier catalog
  • your usage exceeds free-tier token caps and you'd be better served by a paid API directly

Facets

service · maturity active

llm-inference api-framework http-server middleware configuration-management developer-tools large-language-models artificial-intelligence developer-tools self-hosted apis self-hosted cross-platform cli openai-compatible llm-router free-tier api-gateway failover rate-limiting model-catalog coding-agents proxy docker nodejs web-server

6 sources

Member repositories

RepositoryRoleHealth v2
tashfeenahmed/freellmapimain81

For agents

markdown · JSON · MCP: product_card(name="tashfeenahmed/freellmapi")

Data as of 2026-08-30T08:39:29.467469+00:00 · Report a problem