PrefectHQ/prefect

Health v2 · maintenance only

Adoption not part of the score

23693 stars · 2483 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

Prefect is an open-source workflow orchestration framework that turns Python functions into production-grade data pipelines using decorators like @flow and @task. It provides scheduling, retries, caching, state tracking, event-driven automations, and a real-time UI, with a self-hosted server or managed Prefect Cloud for monitoring deployments.

Use cases

• orchestrate data pipelines in python
• replace cron jobs with scheduled workflows
• add retries and caching to python scripts
• schedule and monitor etl jobs
• build ml training and inference pipelines
• trigger workflows from external events
• self-host a workflow orchestration engine
• run data workflows on kubernetes

When to choose

• you want to elevate python scripts into production workflows with minimal code
• you need dynamic, data-driven pipelines without yaml or dsls
• you want built-in scheduling, retries, caching, and observability out of the box
• you need to run workflows anywhere python runs, from local to kubernetes
• you prefer a pythonic alternative to airflow

When to avoid

• you need a language-agnostic orchestrator for non-python codebases
• your workflows are simple enough for plain cron or shell scripts
• you require strict dag definitions defined statically before runtime
• you want a fully managed service without any self-hosted component

Facets

framework · maturity stable

workflow-automation scheduling monitoring etl developer-tools data-science machine-learning developer-tools python cross-platform self-hosted cloud orchestration data-pipelines mlops data-ops observability durable-execution event-driven retry-logic task-caching airflow-alternative data-engineering automation docker kubernetes

Member repositories

For agents

markdown · JSON · MCP: product_card(name="PrefectHQ/prefect")