Please start any new threads on our new site at https://forums.sqlteam.com. We've got lots of great SQL Server experts to answer whatever question you can come up with.

 All Forums
 SQL Server 2000 Forums
 Import/Export (DTS) and Replication (2000)
 DTS Import - 80 million records

Author  Topic 

deride
Starting Member

1 Post

Posted - 2005-03-17 : 06:01:22
Hello all,

We are trying to import a text file with 80 million records using DTS on SQL Server 2000 and after a lot of processing, DTS import fails. the message we get is :
Error string: Error creating file mapping view: Not enough storage is available to process this command. Error source: Microsoft Data Transformation Services Flat File Rowset Provider Help file: DTSFFile.hlp Help context: 0 DTSRun OnError: DTSStep_DTSDataPumpTask_1, Error = -2147008507 (80074005) Error string: Error creating file mapping view: Not enough... Process Exit Code 1. The step failed.

We have tried to increase the size of the transaction log.. but still it is a problem.
Has anyone had this problem? What is the solution? is there some DB setting that can solve this problem

jen
Master Smack Fu Yak Hacker

4110 Posts

Posted - 2005-03-17 : 06:05:42
can you divide the text file into smaller batches? then set recovery model to simple and file growth for log file to unrestricted?

--------------------
keeping it simple...
Go to Top of Page

robvolk
Most Valuable Yak

15732 Posts

Posted - 2005-03-17 : 07:36:27
bcp or BULK INSERT can do this with no problem.
Go to Top of Page

mfemenel
Professor Frink

1421 Posts

Posted - 2005-03-17 : 09:00:22
You might also consider setting your recovery model to bulk logged if you're chewing up disk space trying to insert that many records. Check out BOL for full details so you know what you're getting yourself into.

Mike
"oh, that monkey is going to pay"
Go to Top of Page

Michael Valentine Jones
Yak DBA Kernel (pronounced Colonel)

7020 Posts

Posted - 2005-03-17 : 10:31:47

On the Datapump Properties, Option tab, set the Insert batch size to a fairly small value, say 50,000. If you leave it at the default value of 0, it tries to insert everything in one tranaaction. If your database is in Full recovery mode, make sure that transaction log backups are running at short intervals, say every 5-10 minutes, to prevent the transaction log from filling the disk.




CODO ERGO SUM
Go to Top of Page
   

- Advertisement -