dagster-io/dagster

Health v2 · maintenance only

Adoption not part of the score

16067 stars · 2262 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

Dagster is an open-source Python data orchestration platform for developing, producing, and observing data assets, with integrated lineage, scheduling, and observability. It provides a declarative asset-based programming model, a web UI, a CLI, and a managed cloud offering (Dagster+).

Use cases

• orchestrate etl pipelines with dependencies and scheduling
• build and monitor data assets with lineage and freshness tracking
• schedule and backfill dbt model runs
• automate machine learning pipelines and mlops workflows
• observe data pipeline health and failures from a ui
• migrate airflow dags to an asset-based orchestrator

When to choose

• you need asset-centric orchestration with lineage, observability, and testability in Python
• you want to schedule and monitor dbt, Airbyte, Spark, or warehouse pipelines in one platform
• your team wants a modern alternative to Airflow with a strong developer experience

When to avoid

• you need a lightweight cron-style scheduler without a platform or UI
• your workflows are not data-centric and a simple task queue suffices
• you cannot adopt Python as your orchestration language

Facets

framework · maturity active

workflow-automation etl scheduling monitoring data-science developer-tools cli web-framework data-science analytics big-data machine-learning developer-tools python cloud self-hosted cross-platform data-orchestration data-pipelines assets lineage scheduler mlops elt observability dagster declarative-pipelines data-engineering automation docker kubernetes

Member repositories

For agents

markdown · JSON · MCP: product_card(name="dagster-io/dagster")