A new technical note about http://sqlcat.com/technicalnotes/archive/2010/08/18/increasing-throughput-of-pipelines-by-splitting-synchronous-transformations-into-multiple-tasks.aspx has been posted on the http://sqlcat.com/ . It’s something you want to consider when you’re using synchronous transforms (like Derived Column, or Data Convert) to perform actions on a large number of columns. It seemed like black magic at first, but if you consider the http://blogs.msdn.com/b/michen/archive/2007/06/11/katmai-ssis-data-flow-improvements.aspx , it starts to make sense. Also note that because the performance increase is a result of these threading changes, you won’t see this same performance increase if you’re using SSIS 2005. I’m going to have to start adding this one to my list of performance patterns…
http://sqlcat.com/technicalnotes/archive/2010/08/18/increasing-throughput-of-pipelines-by-splitting-synchronous-transformations-into-multiple-tasks.aspx
by
Sedat Yogurtcuoglu, Henk van der Valk, and Thomas Kejser
Here are some screen caps from the white paper.
Before:
http://sqlcat.com/blogs/technicalnotes/image_053616FF.png
After:
http://sqlcat.com/blogs/technicalnotes/image_5412C85F.png
