TimelyDataflow/differential-dataflow
An implementation of differential dataflow using timely dataflow on Rust. observed · 2026-08-28
Health v2 · maintenance only
93/100
- Activity 99
- Release rhythm 81
- Longevity 100
How is this computed?
round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10) — computed 2026-09-03. Adoption (stars, forks) is never an input.
- gap_med: 0
- age_days: 4138
- days_rel: 49
- days_push: 7
- n_releases_24m: 64
Adoption not part of the score
2998 stars · 210 forks observed · 2026-08-28
What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded
A Rust library implementing differential dataflow on top of timely dataflow, enabling data-parallel programs that efficiently process large data collections and rapidly respond to arbitrary input changes. Programs are written as functional transformations (map, filter, join, reduce, iterate) that incrementally update outputs as inputs change.
Use cases
- incrementally update query results as input data changes
- compute graph analytics like reachability on dynamically changing graphs
- process large streaming datasets with low-latency updates
- build data-parallel pipelines with joins and iterative computations
- implement real-time analytics that respond to arbitrary collection changes
When to avoid
- you only need simple batch processing without incremental updates
- you prefer higher-level SQL or streaming engines over low-level dataflow programming
- your team is not comfortable with Rust and functional dataflow semantics
Facets
library · maturity active
streaming data-science etl big-data microservices rust cross-platform dataflow incremental-computation data-parallel timely-dataflow data-engineering algorithms
2 sources
- readme: https://github.com/TimelyDataflow/differential-dataflow · fetched 2026-08-28 · 5c7eeffb62fb
- registry_crates: https://crates.io/api/v1/crates/differential-dataflow · fetched 2026-08-29 · c7c30a158d8f
Member repositories
| Repository | Role | Health v2 |
|---|---|---|
| TimelyDataflow/differential-dataflow | main | 93 |
For agents
markdown · JSON · MCP: product_card(name="TimelyDataflow/differential-dataflow")
Data as of 2026-08-30T08:39:29.467469+00:00 · Report a problem