Forum Discussion
load last modified files from subfolders in dataflow
I have the following directory structure on an Azure container: -Main_Folder
-2021-01
-file1.parquet
-2021-02
-file2.parquet
-file3.parquet where the Data is partitioned by yea...
Resolved. Check this link if you are interested in the solution.
https://stackoverflow.com/questions/67903842/how-to-load-data-from-last-modified-files-within-one-day-from-subfolders-azure-d
https://stackoverflow.com/questions/67903842/how-to-load-data-from-last-modified-files-within-one-day-from-subfolders-azure-d