apache/kafka

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

33632 stars · 15461 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

Apache Kafka is an open-source distributed event streaming platform for building high-performance data pipelines, streaming analytics, and data integration. It provides durable, fault-tolerant storage of event streams with built-in stream processing (Kafka Streams) and a Connect framework for integrating with external systems.

Use cases

• build high-throughput data pipelines between systems
• stream and process events in real time
• decouple microservices with a publish-subscribe event bus
• ingest and store application logs, metrics, and sensor data durably
• integrate event sources and sinks like Postgres, Elasticsearch, and S3
• run exactly-once stream processing with joins and aggregations
• handle trillions of messages per day across a scalable cluster

When to choose

• you need durable, ordered, fault-tolerant event storage at massive scale
• you want battle-tested infrastructure trusted by thousands of large organizations
• you need built-in stream processing and a wide ecosystem of connectors
• you require guaranteed ordering, zero message loss, or exactly-once semantics

When to avoid

• you only need simple point-to-point messaging or a lightweight task queue
• your team cannot operate a JVM-based distributed cluster
• your message volume is small and a database or simpler broker would suffice
• you need per-message complex querying rather than append-only streams

Facets

service · maturity stable

message-queue streaming etl data-science microservices big-data analytics jvm windows cloud self-hosted event-streaming pub-sub log-storage stream-processing kafka-connect kafka-streams exactly-once high-throughput data-engineering messaging real-time docker linux macos

Member repositories

For agents

markdown · JSON · MCP: product_card(name="apache/kafka")