Forum Discussion

Santhi1982's avatar
Santhi1982
Copper Contributor
Oct 25, 2023

ADF - Dynamically load all excel files from blog storage to Azure SQL DB

Hi,

 

I have some 10+ excel files in azure storage container. I want to load these files dynamically. For each of these files , the sheetname is going to be different. I can maintain sheetname details in a separate azure sql table 'ExcelDetails'.

 

How do I read all files dynamically and match with table data to fetch sheetname, and load the data into sql.

Also I want to control the pipeline runs, maintain activity runs in a table 'etlControlTable' and run pipelines activities only for 'non processed files'.

 

I am not sure how to go about this.  Waht all activities and the flow in pipeline?

Please guide me.

No RepliesBe the first to reply

Resources