# numaproj/numaflow

Kubernetes-native platform to run massively parallel data/streaming jobs

Repository: https://github.com/numaproj/numaflow
Canonical: https://ross.abutalabs.com/products/numaflow
Homepage: https://numaflow.numaproj.io
Language: Rust
License: Apache-2.0
License Family: permissive
Topics: kubernetes, stream-processing, data-processing, k8s, pipeline, map-reduce, hacktoberfest
Last push: 2026-08-26T18:54:45+00:00

## Health v2 (maintenance only)
Score: 98/100 (v2, computed 2026-09-03T02:20:16.233290+00:00)
- activity 99, release rhythm 96, longevity 100
- inputs: {"age_days": 1566, "days_push": 7, "days_rel": 26, "gap_med": 23.0, "n_releases_24m": 27}
- flags: none
- formula: round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10)

## Adoption (not part of the score)
Stars 2825, forks 171 (observed 2026-08-28T04:07:24.134679+00:00)

## What it is
Numaflow is a Kubernetes-native, serverless platform for running massively parallel data and streaming processing jobs. It lets developers build event-driven pipelines with sources, sinks, and user-defined functions in any language, with auto-scaling and exactly-once semantics.

## Use cases
- process kafka events in real time on kubernetes
- run streaming data pipelines with auto-scaling
- real-time analytics on event streams
- run ml inference on streaming data
- build event-driven applications with exactly-once guarantees
- run map-reduce style jobs on kubernetes
- write pipeline processing steps in python or go

## When to choose
- you already run workloads on Kubernetes and want declarative streaming pipelines
- you need independent auto-scaling per pipeline stage with back-pressure
- you want language-agnostic user-defined functions (Python, Go, Java, Rust)
- you need exactly-once or at-least-once processing guarantees for streaming data

## When to avoid
- you have no Kubernetes cluster and only need simple batch ETL
- you need strict message ordering guarantees
- you want a fully managed cloud streaming service rather than self-hosted infrastructure
- your project cannot tolerate occasional breaking changes between minor releases

## Facets
- artifact type: framework
- maturity: active
- function: streaming, etl, workflow-automation, microservices, deployment
- domain: microservices, big-data, cloud-computing
- platform: cloud, self-hosted, go, rust, python, jvm
- tags: stream-processing, event-driven, serverless, map-reduce, auto-scaling, exactly-once, kubernetes-operator, data-pipeline, data-engineering, real-time, containers, kubernetes, docker

## Member repositories
- numaproj/numaflow (main) score 98

## Provenance
- Observed fields: from GitHub, fetched 2026-08-28T04:07:24.134679+00:00.
- Health v2: computed from the inputs above; adoption is never an input.
- Inferred fields (summary, facets, guidance): AI-extracted, prompt v1, taxonomy v1, on 2026-08-29T18:48:42.529379+00:00, confidence not recorded.
  - readme: https://github.com/numaproj/numaflow (fetched 2026-08-28T04:07:24.134679+00:00, sha 8cd8cc216923)
  - homepage: https://numaflow.numaproj.io (fetched 2026-08-29T09:53:39.744920+00:00, sha 5df7dfa9284e)
  - site_page: https://numaflow.numaproj.io/getting-started/prerequisites-and-installation (fetched 2026-08-29T09:53:39.750398+00:00, sha 666f6f07d191)
  - site_page: https://numaflow.numaproj.io/getting-started/monovertex (fetched 2026-08-29T09:53:39.752257+00:00, sha 8eb84470ca3a)
  - site_page: https://numaflow.numaproj.io/getting-started/pipeline (fetched 2026-08-29T09:53:39.754114+00:00, sha 3d0af3ea543d)
  - site_page: https://numaflow.numaproj.io/getting-started/whats-next (fetched 2026-08-29T09:53:39.755950+00:00, sha ba804ac38004)
  - site_page: https://numaflow.numaproj.io/user-guide/sdks/features (fetched 2026-08-29T09:53:39.757517+00:00, sha d1c776b2a101)
  - site_page: https://numaflow.numaproj.io/user-guide/FAQ (fetched 2026-08-29T09:53:39.759737+00:00, sha d54082547d15)
  - site_page: https://numaflow.numaproj.io/operations/installation (fetched 2026-08-29T09:53:39.761465+00:00, sha d30adac90e5d)
  - site_page: https://numaflow.numaproj.io/operations/releases (fetched 2026-08-29T09:53:39.748491+00:00, sha fc54504788e6)
- Data as of 2026-08-30T08:39:29.467469+00:00.