Forum Discussion
Issue with Auto Setting for Copy Parallelism in ADF Copy Activity
Hello everyone, I've been utilizing Azure Data Factory (ADF) and noticed the option to set the degree of copy parallelism in a copy activity, which can significantly enhance performance when copying...
Hello,
not sure if I can help, only some insights:
In my experience, the "Auto" option does not always maximize parallelism effectively. It often defaults to conservative/safe settings to avoid overwhelming the target system.
Also, if you copy from blob storage, you need to have the data split into multiple files so that it can be read in parallel. And maybe try to scale the DIUs up.
For more insights maybe enable logging in the ADF.
Best regards!