karafka/karafka
Ruby and Rails efficient Kafka processing framework observed · 2026-10-19
Health v2 · maintenance only
97/100
- Activity 100
- Release rhythm 92
- Longevity 100
Flags: no_license
How is this computed?
round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10) — computed 2026-10-21. Adoption (stars, forks) is never an input.
- gap_med: 24.5
- age_days: 4100
- days_rel: 57
- days_push: 2
- n_releases_24m: 17
Adoption not part of the score
2252 stars · 187 forks observed · 2026-10-19
What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded
Karafka is a multi-threaded Ruby and Rails framework for efficiently consuming and producing Apache Kafka messages, built on librdkafka. It includes a built-in Web UI for monitoring, ActiveJob backend support, dead letter queues, batching, and tight Rails integration.
Use cases
- process kafka messages in a ruby on rails app
- build event-driven microservices with kafka in ruby
- run background jobs via kafka with activejob
- monitor kafka consumers with a web dashboard
- handle high-throughput event streams in ruby
- implement dead letter queue for failed kafka messages
- consume kafka topics in batches and insert into a database
When to choose
- you use Ruby or Rails and need production-ready Kafka consumption and production
- you want multithreaded, batch, and multi-process (swarm) processing with ordering guarantees
- you need built-in monitoring, Web UI, DLQ, and ActiveJob integration out of the box
When to avoid
- your stack is not Ruby (e.g., Python, Go, JVM - use native Kafka clients instead)
- you only need simple pub/sub without a framework layer
- you need advanced features like transactions, virtual partitions, or rate limiting without a Pro license
Facets
framework · maturity stable
message-queue streaming middleware monitoring web-framework cli workflow-automation backend web-development microservices developer-tools ruby self-hosted kafka apache-kafka event-streaming consumers producers activejob dead-letter-queue web-ui rails-integration background-jobs librdkafka multithreading messaging data-engineering linux macos docker
10 sources
- readme: https://github.com/karafka/karafka · fetched 2026-10-19 · 6785337bf715
- homepage: https://karafka.io · fetched 2026-08-29 · 555f32990b2c
- site_page: https://karafka.io/docs · fetched 2026-08-29 · 4dd267365c0c
- site_page: https://karafka.io/docs/Status · fetched 2026-08-29 · b9787e08e839
- site_page: https://karafka.io/docs/Basics-Getting-Started · fetched 2026-08-29 · d48a16e395ed
- site_page: https://karafka.io/docs/Web-UI-Features · fetched 2026-08-29 · 4d3ad6218a50
- site_page: https://karafka.io/docs/Consumer-Groups-Concurrency-and-Multithreading · fetched 2026-08-29 · 3b74e6fe182a
- site_page: https://karafka.io/docs/Infrastructure-Monitoring-and-Logging · fetched 2026-08-29 · 7b5e7e23ad0a
- site_page: https://karafka.io/docs/Basics-Consuming-Messages · fetched 2026-08-29 · cb72bbd0ce24
- site_page: https://karafka.io/docs/Consumer-Groups-Error-Handling-and-Back-Off-Policy · fetched 2026-08-29 · b221ab6301e3
Member repositories
| Repository | Role | Health v2 |
|---|---|---|
| karafka/karafka | main | 97 |
For agents
Data as of 2026-10-19T08:05:51.212177+00:00 · Report a problem