Parsely/pykafka

Health v2 · maintenance only

Flags: archived

Adoption not part of the score

1120 stars · 222 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

PyKafka is a programmer-friendly Apache Kafka client for Python offering both high-level and low-level producer/consumer APIs, optionally accelerated by a C extension built on librdkafka. It aims to provide a JVM-client-like level of abstraction with a Pythonic API, supporting Kafka 0.8.2+ and Python 2.7+/3.4+/PyPy.

Use cases

• produce and consume messages from apache kafka in python
• stream events to a kafka topic with high throughput
• build a python consumer for a kafka event pipeline
• connect to kafka over TLS from python
• batch messages asynchronously for better kafka producer performance

When to choose

• you need a Kafka client with a Pythonic, JVM-like API
• you want optional librdkafka-backed performance via a C extension
• you need both simple sync and high-throughput async producers

When to avoid

• you need a client with recent Kafka feature support - the last release was in 2021
• you prefer the actively maintained confluent-kafka-python client
• you need Kafka versions or features beyond what PyKafka supports

Facets

library · maturity maintenance

message-queue database-driver streaming microservices developer-tools python cross-platform apache-kafka kafka-client librdkafka c-extension producer-consumer event-streaming messaging data-engineering linux macos

Member repositories

For agents

markdown · JSON · MCP: product_card(name="Parsely/pykafka")