I'm building a bank reconciliation process where I'm leveraging SSIS to import, transform and insert data into a database. I had a command timeout error at the transformation segment (Derived Column methods). At first was it difficult to determine
(Ambigious SSIS errors), but in the end was easy to resolve. I simply increased the timeout duration.
Being a developer, I find this to be bad practice as the application should be optimized as much as possible prior to making a timeout adjustment. An ideal method would have been to cache more data prior to calling the database command, so the data
is available for processing and not keeping the command open unnecessarily.
I'm relatively new to SSIS, but have been unable to determine a method to remove the transformation bottleneck. I could do it easily enough with customized .NET code, but I'd prefer not to do that.
My question - There must be a method in SSIS that buffers the data originating from the transformation prior to calling my INSERT to database method?
View Complete Post