Forum Discussion

Vivekvp's avatar
Vivekvp
Brass Contributor
Jul 29, 2022

Take files from multiple folders and put them into one folder in a Blob?

Hello,

 

We have an api that copies files from another cloud.  The issue is it creates new folders for the files with a date and time nomenclatures.  So in a day I am getting new folders with files every hour.  Over the course of a month - hundreds of folders.

 

Each of the files in the folders have the same extension (ie. .txt).

 

Since we have no control over the source cloud, is there a way I can use something like Data Factory on the current blob storage and say something like

 

Copy all files with *.txt from every folder and put it in the folder called AllFiles?

 

I found this to do it once:

 

azcopy copy 'https://mysourceaccount.blob.core.windows.net/mycontainer' 'https://mydestinationaccount.blob.core.windows.net/mycontainer' --recursive

 

but can I automate this with ADF?

 

Did that make sense or is more clarification needed?

 

Thoughts?

 

Thanks,

 

V

 

 

No RepliesBe the first to reply