Forum Discussion
Santhi1982
Oct 25, 2023Copper Contributor
ADF - Dynamically load all excel files from blog storage to Azure SQL DB
Hi,
I have some 10+ excel files in azure storage container. I want to load these files dynamically. For each of these files , the sheetname is going to be different. I can maintain sheetname details in a separate azure sql table 'ExcelDetails'.
How do I read all files dynamically and match with table data to fetch sheetname, and load the data into sql.
Also I want to control the pipeline runs, maintain activity runs in a table 'etlControlTable' and run pipelines activities only for 'non processed files'.
I am not sure how to go about this. Waht all activities and the flow in pipeline?
Please guide me.
No RepliesBe the first to reply