Environment - Production System - SQL 2008(2000 compatibility)
BI System - SQL 2008 R2
We are currently extracting data from a production system on a nightly basis.
One of the tables contains massive amount of information. We extract a 90 day window and the method we are using is extract to raw file and then we import the raw file to a staging database.
The tables contains +- 360 columns which is all used in the BI Warehouse.
The raw file amounts to about 9 Gigs of data.
This extraction process takes from 2:30 to 4:00 hours. This is almost halve the evening and the ETL process is starting to take to long.
We recently upgraded the hardware so lack of hardware power is not the issue.
Is there another way of moving the data accross which will be more efficient and take less time?
Any assistance would be appreciated.
View Complete Post