Netflix/concurrency-limits

Health v2 · maintenance only

Adoption not part of the score

3598 stars · 327 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

A Java library that applies TCP congestion control concepts to automatically detect and enforce concurrency limits for services. It uses latency-based algorithms like Vegas and Gradient2 to adapt limits as systems scale, achieving optimal throughput and latency.

Use cases

• auto-detect concurrency limits for microservices
• gracefully shed excess load instead of falling over
• replace static RPS-based rate limits with adaptive concurrency limits
• prevent queue buildup and latency spikes under bursty traffic
• enforce per-service concurrency limits in auto-scaling distributed systems

When to choose

• you run auto-scaling services where static RPS limits go stale
• you need latency-aware adaptive load shedding in Java/JVM services
• you want congestion-control-inspired backoff using timeouts and rejected requests

When to avoid

• you need simple static token-bucket rate limiting
• you are not on the JVM and cannot port the concepts
• you need distributed global rate limiting across clusters rather than per-node limits

Facets

library · maturity active

rate-limiting concurrency middleware microservices performance backend jvm concurrency-limits load-shedding tcp-congestion-control adaptive-limits latency-based

Member repositories

For agents

markdown · JSON · MCP: product_card(name="Netflix/concurrency-limits")