Forum Discussion
ADF - data connect from blob to Azure SQL
Hi All,
I have a scenario, I have a multiple excel files (4 files) in storage blob and need to upload in SQL in 4 different table (I have 4 tables for staging and 4 tables for master table) . I have created the stored procedure in SQL for those 4 files.
Can anyone help me with the ADF process to upload automatically on regular basis.
Thanks
Shruthi96 I'm supposing the files contain records and you would like to insert records in SQL, not the files themselves.
In this case, a simple COPY activity will do the work and you can create a trigger for each new file created in blob storage.
DennesTorres , Yes I am looking through parametrizing the data. I dont want to create dataset for each file for source and sink file.
Shruthi96 You can create parameters in a dataset. In this case the parameter could be the filename/table name
You can create a table in SQL to hold the file name/table name relation. Than you use a lookup activity to read this data, foreach activity to repeat the copy activity for each file and fill the dataset parameters.
This requires your files to follow some pattern. If they are completely different from each other and from the tables this may not work. However, there are only 4 files, right? It's not that difficult to make 8 datasets.
