Please start any new threads on our new
site at https://forums.sqlteam.com. We've got lots of great SQL Server
experts to answer whatever question you can come up with.
| Author |
Topic |
|
knuckle05
Starting Member
1 Post |
 Posted - 2009-04-14 : 16:18:47
|
| Hi All,I've been mandated to move daily batches from one large SQL 2005 database to another system which needs to receive the data in text file format, and fixed length fields.The data consists of Accounts and Transactions and the plan is to do an initial LARGE dump of data for the first batch and then going forward, to only pass NEW transactions and DELTA changes to the Account information as there are millions of accounts and it would be senseless to re-import the account data every night.Anyhow, the steps needed are:1) Extract data from source DB to staging area2) Manipulate data and re-format according to DESTINATION system's data format which is text files and fixed field length3) Import formatted data and process it.4) Determine what to do with any records that failed to import.I'm simply looking for advice on various ways to approach this problem. For ex:- Should I do everything in SQL Server, including all logic needed for creating the destination fixed length files?- Or, perhaps build some sort of .NET utility that I can provide an XML configuration file that would define how the destination data files should be built.Any advice is very much appreciated.Thanks,Mike |
|
|
|
|
|
Advice for data extraction project