Forum Discussion

Krishnamohan1837's avatar
Krishnamohan1837
Copper Contributor
Apr 07, 2022

Incrementally Load data from Azure SQL DB to ADLS Gen2 without WaterMarking with Partitioning

 

I want to incrementally load data from Azure SQL Database to Azure ADLS Gen2 without watermarking i.e., I do not have any control on Azure SQL Database apart from using the linked service and table

Also the folder structure in ADLS is YYYY/MM which comes from one of the column of Azure SQL Database. 

 

Added two sources(SQL, ADLS) to DataFlows, created a derived Column Transformation to split YYYYMM column in SQL to YYYY and MM. 

Now I want to take this YYYY and MM columns into ADLS source and search in respective YYYY, MM folders. How do I achieve it . Below is the screenshot

 

Tzvia or anyone else

 

  • Hey, can you please help me to understand why did you tag me ?

Resources