karafka/karafka

Health v2 · maintenance only

Flags: no_license

Adoption not part of the score

2256 stars · 188 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

Karafka is a multi-threaded Ruby and Rails framework for efficiently consuming and producing Apache Kafka messages, built on librdkafka. It includes a built-in Web UI for monitoring, ActiveJob backend support, dead letter queues, batching, and tight Rails integration.

Use cases

• process kafka messages in a ruby on rails app
• build event-driven microservices with kafka in ruby
• run background jobs via kafka with activejob
• monitor kafka consumers with a web dashboard
• handle high-throughput event streams in ruby
• implement dead letter queue for failed kafka messages
• consume kafka topics in batches and insert into a database

When to choose

• you use Ruby or Rails and need production-ready Kafka consumption and production
• you want multithreaded, batch, and multi-process (swarm) processing with ordering guarantees
• you need built-in monitoring, Web UI, DLQ, and ActiveJob integration out of the box

When to avoid

• your stack is not Ruby (e.g., Python, Go, JVM - use native Kafka clients instead)
• you only need simple pub/sub without a framework layer
• you need advanced features like transactions, virtual partitions, or rate limiting without a Pro license

Facets

framework · maturity stable

message-queue streaming middleware monitoring web-framework cli workflow-automation backend web-development microservices developer-tools ruby self-hosted kafka apache-kafka event-streaming consumers producers activejob dead-letter-queue web-ui rails-integration background-jobs librdkafka multithreading messaging data-engineering linux macos docker

Member repositories

For agents

markdown · JSON · MCP: product_card(name="karafka/karafka")