Pathway Live Data Framework
Some data may be outdated — see provenance labels.
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG. observed · 2026-09-24
Health v2 · maintenance only
94/100
- Activity 96
- Release rhythm 88
- Longevity 100
Flags: no_license
How is this computed?
round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10) — computed 2026-10-21. Adoption (stars, forks) is never an input.
- gap_med: 13.0
- age_days: 1423
- days_rel: 80
- days_push: 27
- n_releases_24m: 41
Adoption not part of the score
62243 stars · 1685 forks observed · 2026-09-24
What it is AI-extracted, prompt v1, taxonomy v1, 2026-09-21, confidence 0.97
Pathway is a Python ETL framework designed for stream processing, real-time analytics, and building LLM pipelines. It provides a high‑level API to create both batch and continuous data pipelines that can feed live AI applications.
Use cases
- process streaming sensor data and generate real‑time dashboards
- build LLM‑powered chatbots that query live data sources without a vector database
- run continuous ETL jobs that combine batch and incremental updates for analytics
- create RAG pipelines that retrieve up‑to‑date information from Kafka streams
- integrate Python ML libraries into a live data processing workflow
When to choose
- You need a unified framework for both batch and streaming ETL in Python.
- Your application relies on real‑time data updates for LLM or RAG use cases.
- You want tight integration with popular Python ML libraries and easy deployment.
When to avoid
- You require a low‑level, language‑agnostic streaming engine (e.g., Java/Scala).
- Your project is limited to static, offline data processing only.
- You need a fully managed cloud service rather than a self‑hosted library.
Facets
library · maturity active
etl streaming llm-inference rag machine-learning large-language-models python windows real-time-analytics kafka batch-processing data-pipelines live-data data-engineering retrieval-augmented-generation linux macos
4 sources
- readme: https://github.com/pathwaycom/pathway · fetched 2026-09-24 · 916027a95e48
- homepage: https://pathway.com · fetched 2026-09-07 · d76d0c1c995b
- registry_pypi: https://pypi.org/pypi/pathway/json · fetched 2026-09-07 · bf7718a5f4f0
- registry_pypi: https://pypi.org/pypi/llm-app/json · fetched 2026-09-07 · f8f5de1d1b28
Member repositories
| Repository | Role | Health v2 |
|---|---|---|
| pathwaycom/pathway | main | 94 |
| pathwaycom/llm-app | examples | 66 |
| pathwaycom/pathway-benchmarks | examples | 70 |
| pathwaycom/cookiecutter-pathway | examples | 65 |
For agents
markdown · JSON · MCP: product_card(name="pathwaycom/pathway")
Data as of 2026-10-19T08:05:51.212177+00:00 · Report a problem