azure data factory v2
3 TopicsScheduled trigger is running 1second early
A scheduled trigger configured to execute every 10 minutes exhibits an issue where one of the six runs in every hour executes 1 second earlier than the expected schedule. This inconsistency impacts the timing accuracy of the trigger. My query is why is it running 1 second early? Due to this we are having issues skipping of few Jobs scheduled during that time.46Views0likes0CommentsADF copy data with pagination headers not allowing dynamic filename for sink.
ADF copy data with pagination headers not allowing dynamic filename for sink. In my ADF pipeline there is a single copy data activity with pagination headers to use pagination by using cursor parameter from body. But the source is working for api request but the sink is not allowing dynamic filenames and only storing single file with all data instead of multiple files based on cursor231Views0likes0Commentsfilter out certain pattern date files
Hi, I want to filter out certain pattern date files in a particular folder and copy those files into data lake storage. filenames in source folder: EDL_infy_20201201_wex.csv EDL_infy_20201202_wex.csv EDL_infy_20201203_wex.csv EDL_infy_20201204_wex.csv EDL_infy_20201205_wex.csv EDL_infy_20201206_wex.csv EDL_infy_20201207_wex.csv EDL_infy_20201208_wex.csv EDL_infy_20201209_wex.csv EDL_infy_20201210_wex.csv EDL_infy_20201211_wex.csv EDL_infy_20201212_wex.csv EDL_infy_20201213_wex.csv EDL_infy_20201214_wex.csv EDL_infy_20201215_wex.csv EDL_infy_20201216_wex.csv and so on.. requirement is copy date pattern files from 20201201 to 20201210 into target folder. I used getmetadata activity and lookup and foreach activity i tried but not full fill the solution..can you please help me out. Thanks, Subba675Views0likes0Comments