In my data flow I use a Lookup component to check if the row already exists in the data warehouse. I insert the row in the No Match output path and update in the Match path.
In the initial load it is a waiste to have a lookup for each row - I know the rows are not there. Is there a way to skip the lookup?
Ideal case (As I see it):
Initial load - No lookup which also means no index on business key in destination table, giving faster inserts as well
Diff load (Dest table might have 2 mill rows) - Lookup on index of business key
I have set a variable to Inital load - but I can't see how I can use the Conditional split - because I can find no way for 2 paths to point to the task after my lookup.
Hope someone can help.
View Complete Post