Flowlets and Change Feed now GA in Azure Data Factory

Published Mar 25 2022 11:12 PM 3,058 Views
Microsoft

Azure Data Factory and Azure Synapse Analytics introduced 2 exciting new features in mapping data flows recently that we have announced as generally available this week!

 

Flowlets: Create reusable portions of data flow logic that you can share in other pipelines as inline transformations. Flowlets enable ETL jobs to be composed of custom or common logic components.

 

 

flowlet-context-multi.png

 

Change Feed connectors are available in data flow source transformations for Cosmos DB, Blob store, ADLS Gen1, ADLS Gen2, and CDM. By simply checking the box shown below, you can tell ADF to manage a checkpoint automatically for you and only read the latest rows that were updated or inserted since the last pipeline run.

 

MarkKromer_1-1648274293160.png

 

 

 

 

Co-Authors
Version history
Last update:
‎Mar 25 2022 11:20 PM
Updated by: