First published on MSDN on Aug 20, 2010
A new technical note about
splitting up transforms to increase performance
has been posted on the
SQLCAT site
. It’s something you want to consider when you’re using synchronous transforms (like Derived Column, or Data Convert) to perform actions on a large number of columns. It seemed like black magic at first, but if you consider the
data flow threading changes that were made in 2008
, it starts to make sense. Also note that because the performance increase is a result of these threading changes, you won’t see this same performance increase if you’re using SSIS 2005. I’m going to have to start adding this one to my list of performance patterns…
Increasing Throughput of Pipelines by Splitting Synchronous Transformations into Multiple Tasks...
by
Sedat Yogurtcuoglu, Henk van der Valk, and Thomas Kejser
Here are some screen caps from the white paper.
Before:
After:
