i have a dimension table containing about 20 millions records, and i would like to perform an SCD transform(both type 1 and type 2) on that dimension. the problem is that the column of SCD type 1 alway changes its value, so there will be nearly 20 millions(size
of the input dataset) update statements executed one by one, which has a very very low performance.
any suggestions will be appreciated.
Interested in BI related technologies
View Complete Post