Need an advice on Data ingestio techniques

Copper Contributor

Hi All,


Our requirement to store multiple xml files data into Azure cloud and size of all the data is around 50 GB for 2 weeks.  Files will be coming in decompressed '.gz' format and we will be storing them into Azure blob storage after decompressing it using azure function. Then we are planning to run ADF on blob storage to store this data into SQL DW.


We really want to store this data in such a way (currently we are planning to use Azure SQL DW) so that user can query data and analyse in efficient way.


Any help would be really appreciated.





0 Replies