Forum Discussion
copy data fails - best practice?
Hi Everyone, We have the need to start to copy (some) data from various inhouse sql database tables to an Azure online database. So far what I have done, to keep the updates times to a minimum, is ...
Hi,
Split the load (partitioned copy)
- Partition by date, ID range, or another stable key.
- Use copy data activities in parallel with filters (WHERE clause) on the source query.
Use a staging (Intermediate) location via Azure Blob Storage
ADF/Synapse usually performs better when doing:
- SQL Server > Azure Blob (Parquet or CSV)
- Then Blob > Azure SQL Database