Blog Post

Azure Data Factory Blog
17 MIN READ

Metadata Driven Pipelines for Dynamic Full and Incremental Processing in Azure SQL

Marc_Bushong's avatar
Marc_Bushong
Icon for Microsoft rankMicrosoft
Sep 28, 2023
Developing ETLs/ELTs can be a complex process when you add in business logic, large amounts of data, and the high volume of table data that needs to be moved from source to target. This is especially...
Updated Sep 28, 2023
Version 1.0
azure data factory
Azure ETL
Big Data Analytics
Copy Activity
metadata driven architecture
JoachimEH's avatar
JoachimEH
Copper Contributor
Nov 21, 2023

Marc_Bushong , thank you for the great explanation. Would it be possible for you to share the .json payload from the 3 Azure Data Factory pipelines? That would be such a big help for others who wish to implement your template!