quixio/quix-streams

Health v2 · maintenance only

Adoption not part of the score

1568 stars · 112 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

Quix Streams is a pure Python framework for building real-time data pipelines and event-driven applications on Apache Kafka using a Streaming DataFrame API. It provides fault-tolerant stateful processing, windowing, joins, serialization (JSON, Avro, Protobuf), and exactly-once guarantees without requiring server-side clusters.

Use cases

• process kafka streams in python
• build real-time data pipelines
• streaming etl from kafka topics
• stateful stream processing with windowing
• build event-driven microservices on kafka
• real-time feature engineering for machine learning
• transform kafka messages with pandas-like api

When to choose

• you want pure Python Kafka stream processing without Java wrappers
• you need stateful operations like windowing, joins, and group-by on streams
• you want a lightweight library with no server-side cluster to manage
• you need exactly-once processing guarantees via Kafka transactions

When to avoid

• you need a full cluster-based stream processing engine like Flink or Spark Streaming
• your data source is not Kafka and you don't want to write custom connectors
• you only need simple batch ETL rather than streaming

Facets

library · maturity active

streaming etl serialization message-queue data-science machine-learning big-data analytics machine-learning apis python cross-platform kafka stream-processing streaming-dataframes event-driven-architecture data-pipelines stateful-processing windowing exactly-once data-engineering real-time

Member repositories

For agents

markdown · JSON · MCP: product_card(name="quixio/quix-streams")