Azure Data Factory and Azure Synapse Analytics introduced 2 exciting new features in mapping data flows recently that we have announced as generally available this week!
Flowlets: Create reusable portions of data flow logic that you can share in other pipelines as inline transformations. Flowlets enable ETL jobs to be composed of custom or common logic components.
Change Feed connectors are available in data flow source transformations for Cosmos DB, Blob store, ADLS Gen1, ADLS Gen2, and CDM. By simply checking the box shown below, you can tell ADF to manage a checkpoint automatically for you and only read the latest rows that were updated or inserted since the last pipeline run.
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.