Ross ROSS = Recommend OSS · open-source software intelligence for agents

llm-d

Achieve state of the art inference performance with modern accelerators on Kubernetes observed · 2026-10-21

github.com/llm-d/llm-d · homepage · Python · Apache-2.0 (permissive) observed · 2026-10-21

Health v2 · maintenance only

83/100

  • Activity 100
  • Release rhythm 88
  • Longevity 38
How is this computed?

round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10) — computed 2026-10-21. Adoption (stars, forks) is never an input.

  • gap_med: 34.0
  • age_days: 539
  • days_rel: 1
  • days_push: 0
  • n_releases_24m: 13

Full methodology

Adoption not part of the score

4891 stars · 867 forks observed · 2026-10-21

Summary

No AI-extracted summary yet.

Member repositories

RepositoryRoleHealth v2
llm-d/llm-dmain83
llm-d/llm-d-routerbackend87
llm-d/llm-d-kv-cacheplugin87
llm-d/llm-d-benchmarkexamples83
llm-d/llm-d-autoscalinginfra86

For agents

markdown · JSON · MCP: product_card(name="llm-d/llm-d")

Data as of 2026-10-19T08:05:51.212177+00:00 · Report a problem