I have 10 text files which are on average of 6
GB in size. Out of those 10, 4 files average up to 10 GB in size.
We have 10 SSIS packages which loads those text files onto 2 staging tables. Each 5 of them loads 1 table.
Inside the package, its only a flat file source, data conversion for all columns from source, and write into the destination table.
And this process takes around 5 hours to complete. the size of 2 tables after the load completes is 60 M and 40 M each.
The other thing which I have observed is all the packages are scheduled through one schedule and the schedule
have 10 diff sql server jobs( for 10 packages). Does it have an impact on the processing time ,as all these jobs will be
View Complete Post