Oct 06 2021 07:39 AM
I created 4 similar data pipelines (only different data sources).
step1: copy data to database
step2: copy data to the archived folder
step3: delete the source data
All of the results show OK and the last steps were implemented, but when I check the archived folder, only step2 of data_V2 was implemented. I compared the setting for V2 and others and didn't find the difference, which makes me much confused. If there is some problem in step2 for other data pipelines, why do the results show OK, and why the final step could be implemented?
Oct 06 2021 12:20 PM