Please start any new threads on our new
site at https://forums.sqlteam.com. We've got lots of great SQL Server
experts to answer whatever question you can come up with.
| Author |
Topic |
|
tooba
Posting Yak Master
224 Posts |
 Posted - 2015-02-09 : 12:16:43
|
| Hi All, I would like to know, what would be the best practice here, My SSIS Package is very simple, but I would like to use/keep best practice. My Source is FLAT FILE (the data around, 2 million, Package runs once a day at 3:00 am)Destination is SQL Table. First Option:- Retrieve the data from flat file and do some transformation as needed and dump the data into SQL Table.Second Option:- Retrieve the data from Flat File and do some transformation as needed and dump the data into Staging SQL Table and then from Staging to Target SQL Table. My questions are1) Which option is best and why..2) Which Option is fast.Need advise/thoughts from SSIS Gurus.Thanks in advance. |
|
|
gbritton
Master Smack Fu Yak Hacker
2780 Posts |
Posted - 2015-02-09 : 13:28:14
|
| 1) best option is to stage the data first. That way you get it into a controlled environment (Sql Server). Also, if the next step (loading to the destination table) fails for any reason, you don't have to re-stage the data.2) Both options can be fast, but certainly staging first then loading involves an extra step and an extra pass through the data. However, for ETL jobs (Extract, Transform, Load) you want correctness first and performance second. |
 |
|
|
|
|
|
SSIS Advise.