Forum Discussion
ADF - data connect from blob to Azure SQL
Shruthi96 I'm supposing the files contain records and you would like to insert records in SQL, not the files themselves.
In this case, a simple COPY activity will do the work and you can create a trigger for each new file created in blob storage.
DennesTorres , Yes I am looking through parametrizing the data. I dont want to create dataset for each file for source and sink file.
- DennesTorresJan 04, 2021MVP
Shruthi96 You can create parameters in a dataset. In this case the parameter could be the filename/table name
You can create a table in SQL to hold the file name/table name relation. Than you use a lookup activity to read this data, foreach activity to repeat the copy activity for each file and fill the dataset parameters.
This requires your files to follow some pattern. If they are completely different from each other and from the tables this may not work. However, there are only 4 files, right? It's not that difficult to make 8 datasets.- Shruthi96Jan 10, 2021Copper Contributor
DennesTorres Thank you, i think this solution will work. Will try and reply you thanks.