Public Preview of Airflow/OpenLineage Support in Microsoft Purview
Published Nov 16 2023 09:30 AM 3,145 Views

Microsoft Purview now provides an endpoint that supports collecting lineage from Apache Airflow via integration with OpenLineage, an open framework for data lineage collection and analysis. This capability is now in public preview. This endpoint accepts OpenLineage payloads (assets & lineage) in the Data Map. The capability is available via both UX and API. 

 

Arpitha_Dhanapathi_0-1699052960214.png

 

Teams across Microsoft and OpenLineage community have partnered closely on this effort. The work has also laid the foundation to integrate asset and lineage information from more data sources that support OpenLineage (such as Spark, dbt etc.). We would like to thank the OpenLineage community for a great collaboration. 

 

Get started today! 

Version history
Last update:
‎Nov 16 2023 09:30 AM
Updated by: