MARQUEZ-DETAIL

OpenLineage reference lineage backend.

Definition

Marquez stores jobs, datasets, runs, facets. PostgreSQL backend, Java + Dropwizard. React UI. Receives OpenLineage events via REST. Donated to LF AI & Data 2020 ; native Airflow, dbt, Spark integration.

Origin

Open-sourced by WeWork in 2018 ; joined LF AI & Data 2020.

Example in context

An EDI Airflow pipeline sends OpenLineage events to Marquez — lineage visualisation from EDIFACT → fact_invoice.

Related terms

• OpenLineage — standard.