Ross ROSS = Recommend OSS · open-source software intelligence for agents

tashfeenahmed/freellmapi

7.4 billion tokens per month. 34 free LLM providers. 635 free model endpoints. All behind one /v1 endpoint, plus any custom OpenAI-compatible endpoint. Smart routing, automatic failover, encrypted keys. Personal experimentation only. observed · 2026-10-11

github.com/tashfeenahmed/freellmapi · homepage · TypeScript · MIT (permissive) observed · 2026-10-11

Health v2 · maintenance only

82/100

  • Activity 99
  • Release rhythm 99
  • Longevity 13
How is this computed?

round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10) — computed 2026-10-21. Adoption (stars, forks) is never an input.

  • gap_med: 1
  • age_days: 182
  • days_rel: 10
  • days_push: 10
  • n_releases_24m: 46

Full methodology

Adoption not part of the score

32961 stars · 4554 forks observed · 2026-10-11

What it is AI-extracted, prompt v1, taxonomy v1, 2026-10-05, confidence 0.98

FreeLLMAPI is an open‑source, self‑hosted router that aggregates free tiers from dozens of LLM providers behind a single OpenAI‑compatible /v1 endpoint. It automatically selects the best available model, handles rate‑limit failover, and tracks usage to keep you under each provider's free quota.

Use cases

  • Access dozens of free LLM models with a single OpenAI‑compatible key
  • Build applications that need LLM inference without paying for API usage
  • Create a fail‑over capable LLM service that stays within free‑tier limits
  • Develop coding agents or chatbots that can switch between providers automatically
  • Run a local LLM gateway for privacy‑preserving AI workloads

When to choose

  • You want to use free LLM tiers without managing multiple API keys
  • You need automatic model selection and failover across providers
  • You prefer a self‑hosted solution that keeps provider keys on your machine
  • You are building prototypes or personal projects with zero inference cost

When to avoid

  • You require guaranteed SLA or enterprise‑grade support from a single provider
  • Your workload exceeds the combined free‑tier quotas
  • You need advanced features like fine‑tuning or private model hosting
  • You prefer a managed cloud service with built‑in monitoring and scaling

Facets

service · maturity active

api-gateway routing llm-inference artificial-intelligence large-language-models windows self-hosted openai-compatible free-tier multi-provider failover token-tracking premium-catalog self-hosted-router nodejs docker linux macos

6 sources

Member repositories

RepositoryRoleHealth v2
tashfeenahmed/freellmapimain82

For agents

markdown · JSON · MCP: product_card(name="tashfeenahmed/freellmapi")

Data as of 2026-10-19T08:05:51.212177+00:00 · Report a problem