Hi, I am a BA doing a large data migration into a COTS product using a SQL backend. The migration is being done using SQL scripting only. Every time I run the scripts in the DEV environment it takes longer and longer to execute. For example, scripts that were originally taking 2 minutes are now taking half an hour. Scripts that were taking 2 1/2 hours are now taking 10 hours etc. I have some scripts which were taking 10 hours which I am now too afraid to execute because of how long they are likely to take. These scripts originally all worked fine, yet I am now getting failures. If I execute against a small batch it is fine, but a larger batch and it fails. It has to be the size of the batch - however the large batches worked fine originally. So everything points to the SQL server not coping with the size.
I am very concerned that I am not going to be able to get past my DEV environment because everything is taking exponentially more hours to execute, so it is taking longer and longer to find each error and investigate. Each error I do find is completely minor and easily fixed, but it is taking me days and days to locate them in the first place.
I have suggested to the in-house DBA that there may be an issue with SQL Statistics and log files and asked him to investigate at least truncating the log files. I have absolutely no visibility of what he has done, however he has said that he has made 'configuration changes' yet there is no reduction in the amount of time it takes to execute these scripts.
Is there anything specific that you could recommend that I ask him to look at?
Thankyou!
Elizabeth