OpenLineage/OpenLineage

Health v2 · maintenance only

Adoption not part of the score

2626 stars · 520 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

OpenLineage is an open standard and framework for collecting data lineage metadata, defining a generic model of jobs, runs, and datasets with extensible facets. It ships client libraries (notably openlineage-java) and integrations with tools like Spark, Airflow, dbt, and Flink that emit lineage events to configurable backends such as Marquez.

Use cases

• track data lineage across spark and airflow pipelines
• collect metadata about datasets and jobs automatically
• trace root cause of data pipeline failures
• standardize lineage event collection across data tools
• visualize dependencies between jobs and datasets
• instrument dbt and flink jobs with lineage metadata

When to choose

• you need consistent lineage metadata across multiple pipeline tools
• you want an open, vendor-neutral lineage standard with extensible facets
• you're building a data catalog or observability backend that consumes lineage events

When to avoid

• you only need a single-tool lineage view already provided natively
• you need full column-level lineage out of the box without custom facets
• you want a turnkey UI rather than a collection standard (pair it with Marquez or similar)

Facets

framework · maturity active

monitoring etl analytics sdk api-framework big-data analytics developer-tools apis jvm python cross-platform self-hosted data-lineage metadata-collection open-standard data-observability openapi-spec data-pipelines data-engineering docker

Member repositories

For agents

markdown · JSON · MCP: product_card(name="OpenLineage/OpenLineage")