I have a package that imports data from a file to a SQL Server destination. My file has duplicate rows on the primary key column. This will cause the package to fail, since the table will not allow insertion of duplicate primary keys. I use ole db destination
task . To this task, i have set error redirection so that any error that causes the rows that can cause error to be redirected. I am facing a different problem due to this property, i have set my ole db destination -- data access as table or view - fast load.
If i run the package, all my rows fail insertion into my table and get redirected to my error output file. However if i change my data access mode -- table or view, this package runs and only the duplicate row gets redirected to the error file.
I am not very clear with this scenario. Can anyone please advise?. Since the input data is very high -- more than 5 million rows. The table or view data access mode will make the data insert very slow.
Please correct me if there is anything wrong,.
View Complete Post