# karafka/karafka

Ruby and Rails efficient Kafka processing framework

Repository: https://github.com/karafka/karafka
Canonical: https://ross.abutalabs.com/products/karafka
Homepage: https://karafka.io
Language: Ruby
License: NOASSERTION
License Family: other
Topics: karafka-framework, kafka, kafka-client, kafka-clients, kafka-producer, kafka-consumer, apache-kafka, ruby, rails, kafka-ruby, ruby-on-rails, ruby-library, rubyonrails, events, active-job, activejob-backend, background-jobs, kafka-manager, kafka-monitor, opensource
Last push: 2026-08-26T08:25:21+00:00

## Health v2 (maintenance only)
Score: 99/100 (v2, computed 2026-09-02T17:46:02.011165+00:00)
- activity 99, release rhythm 99, longevity 100
- inputs: {"age_days": 4052, "days_push": 7, "days_rel": 9, "gap_med": 22.5, "n_releases_24m": 21}
- flags: no_license
- formula: round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10)

## Adoption (not part of the score)
Stars 2256, forks 188 (observed 2026-08-28T04:06:31.430617+00:00)

## What it is
Karafka is a multi-threaded Ruby and Rails framework for efficiently consuming and producing Apache Kafka messages, built on librdkafka. It includes a built-in Web UI for monitoring, ActiveJob backend support, dead letter queues, batching, and tight Rails integration.

## Use cases
- process kafka messages in a ruby on rails app
- build event-driven microservices with kafka in ruby
- run background jobs via kafka with activejob
- monitor kafka consumers with a web dashboard
- handle high-throughput event streams in ruby
- implement dead letter queue for failed kafka messages
- consume kafka topics in batches and insert into a database

## When to choose
- you use Ruby or Rails and need production-ready Kafka consumption and production
- you want multithreaded, batch, and multi-process (swarm) processing with ordering guarantees
- you need built-in monitoring, Web UI, DLQ, and ActiveJob integration out of the box

## When to avoid
- your stack is not Ruby (e.g., Python, Go, JVM - use native Kafka clients instead)
- you only need simple pub/sub without a framework layer
- you need advanced features like transactions, virtual partitions, or rate limiting without a Pro license

## Facets
- artifact type: framework
- maturity: stable
- function: message-queue, streaming, middleware, monitoring, web-framework, cli, workflow-automation
- domain: backend, web-development, microservices, developer-tools
- platform: ruby, self-hosted
- tags: kafka, apache-kafka, event-streaming, consumers, producers, activejob, dead-letter-queue, web-ui, rails-integration, background-jobs, librdkafka, multithreading, messaging, data-engineering, linux, macos, docker

## Member repositories
- karafka/karafka (main) score 99

## Provenance
- Observed fields: from GitHub, fetched 2026-08-28T04:06:31.430617+00:00.
- Health v2: computed from the inputs above; adoption is never an input.
- Inferred fields (summary, facets, guidance): AI-extracted, prompt v1, taxonomy v1, on 2026-08-30T02:43:42.725991+00:00, confidence not recorded.
  - readme: https://github.com/karafka/karafka (fetched 2026-08-28T04:06:31.430617+00:00, sha 6785337bf715)
  - homepage: https://karafka.io (fetched 2026-08-29T10:23:48.425440+00:00, sha 555f32990b2c)
  - site_page: https://karafka.io/docs (fetched 2026-08-29T10:23:48.428036+00:00, sha 4dd267365c0c)
  - site_page: https://karafka.io/docs/Status (fetched 2026-08-29T10:23:48.430022+00:00, sha b9787e08e839)
  - site_page: https://karafka.io/docs/Basics-Getting-Started (fetched 2026-08-29T10:23:48.432171+00:00, sha d48a16e395ed)
  - site_page: https://karafka.io/docs/Web-UI-Features (fetched 2026-08-29T10:23:48.435002+00:00, sha 4d3ad6218a50)
  - site_page: https://karafka.io/docs/Consumer-Groups-Concurrency-and-Multithreading (fetched 2026-08-29T10:23:48.437187+00:00, sha 3b74e6fe182a)
  - site_page: https://karafka.io/docs/Infrastructure-Monitoring-and-Logging (fetched 2026-08-29T10:23:48.439381+00:00, sha 7b5e7e23ad0a)
  - site_page: https://karafka.io/docs/Basics-Consuming-Messages (fetched 2026-08-29T10:23:48.442214+00:00, sha cb72bbd0ce24)
  - site_page: https://karafka.io/docs/Consumer-Groups-Error-Handling-and-Back-Off-Policy (fetched 2026-08-29T10:23:48.444524+00:00, sha b221ab6301e3)
- Data as of 2026-08-30T08:39:29.467469+00:00.