apache/flink

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

26294 stars · 14013 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

Apache Flink is an open-source distributed stream processing framework for stateful computations over unbounded and bounded data streams, with APIs in Java, Scala, Python, and SQL. It provides exactly-once guarantees, event-time processing, and runs on common cluster environments like YARN and Kubernetes.

Use cases

• process real-time event streams with exactly-once guarantees
• run continuous analytics queries on live data
• build ETL data pipelines between storage systems
• build event-driven applications with stateful processing
• run batch analytics on bounded datasets
• write streaming SQL jobs over Kafka topics
• implement complex event processing with windowing

When to choose

• you need low-latency, high-throughput stream processing with exactly-once semantics
• you need unified stream and batch processing in one engine
• you need event-time processing and flexible windowing over out-of-order data
• you want SQL on top of streaming and batch data
• you need large-scale stateful computations with incremental checkpoints

When to avoid

• you only need simple batch jobs where Spark or a data warehouse is simpler
• you need lightweight single-node data processing without a cluster
• your team has no JVM experience and prefers pure Python tooling
• you need ad-hoc analytics rather than continuously running jobs

Facets

framework · maturity stable

streaming etl data-science machine-learning big-data microservices analytics jvm python cloud stream-processing batch-processing event-time exactly-once stateful-computation dataflow apache sql data-engineering real-time docker kubernetes

Member repositories

For agents

markdown · JSON · MCP: product_card(name="apache/flink")