i have a project which will receive a large XML file from client via upload to web application, file about 0.5 gb (200,000 records), and i need to check the data and add to database any NEW records (unfortunately i wont get an incremental update file, it will include all data previously added).
i will likely do this using a web service but wondered what other options i had. i was considering if sql server had capabilities to do this, above what i intended with having a stored procedure take the parsed data from my asp.net app.
Considerations are speed of processing and simplicity of database updating.
also is there a way to "kick off" this web service/app when the file is uploaded by the client? Or is it best/easier to just include the database processing in same module as does the save to server directory?
im likely going to archive each file after data been stored for a short time before deleting.
View Complete Post