Forum Discussion

Shruthi96's avatar
Shruthi96
Copper Contributor
Dec 24, 2020

ADF - data connect from blob to Azure SQL

Hi All,    I have a scenario, I have a multiple excel files (4 files) in storage blob and need to upload in SQL in 4 different table (I have 4 tables  for staging and 4 tables for master table) . I...
Azure Data Integration
Copy Activity
Shruthi96's avatar
Shruthi96
Copper Contributor
Jan 04, 2021

DennesTorres , Yes I am looking through parametrizing the data.  I dont want to create dataset for each  file for source and sink file. 

DennesTorres's avatar
DennesTorres
MVP
Jan 04, 2021

Shruthi96 You can create parameters in a dataset. In this case the parameter could be the filename/table name

 

You can create a table in SQL to hold the file name/table name relation. Than you use a lookup activity to read this data, foreach activity to repeat the copy activity for each file and fill the dataset parameters.

This requires your files to follow some pattern. If they are completely different from each other and from the tables this may not work. However, there are only 4 files, right? It's not that difficult to make 8 datasets.

 

 

  • Shruthi96's avatar
    Shruthi96
    Copper Contributor
    Jan 10, 2021

    DennesTorres  Thank you, i think this solution will work.  Will try and reply you thanks. 

     

Resources