Forum Discussion
Krishnamohan1837
Apr 07, 2022Copper Contributor
Incrementally Load data from Azure SQL DB to ADLS Gen2 without WaterMarking with Partitioning
I want to incrementally load data from Azure SQL Database to Azure ADLS Gen2 without watermarking i.e., I do not have any control on Azure SQL Database apart from using the linked service and table
Also the folder structure in ADLS is YYYY/MM which comes from one of the column of Azure SQL Database.
Added two sources(SQL, ADLS) to DataFlows, created a derived Column Transformation to split YYYYMM column in SQL to YYYY and MM.
Now I want to take this YYYY and MM columns into ADLS source and search in respective YYYY, MM folders. How do I achieve it . Below is the screenshot
Tzvia or anyone else
- Tzvia
Microsoft
Hey, can you please help me to understand why did you tag me ?