Please start any new threads on our new site at https://forums.sqlteam.com. We've got lots of great SQL Server experts to answer whatever question you can come up with.

 All Forums
 SQL Server 2000 Forums
 SQL Server Development (2000)
 Insufficient Memory in Processing large XML files

Author  Topic 

AskSQLTeam
Ask SQLTeam Question

0 Posts

Posted - 2004-02-25 : 07:37:04
Glenn writes "Good day SQL Guru's

SCENARIO:

1. I have an stored procedure that executes an DLL

2.a.
The DLL (created in VB6.0) opens a XML file and and transfer it contents into a string variable.

2.b.

I try to execute a sp that the paramaeter is the string variable in the 2.a.

Is there a way that I can open the XML file directly in the SQL 2000?

When the XML files is not too large, I dont have problems with insufficient memory. When the XML file size reaches to 18MB, it will throw an error in the SQL server log "INSUFFICIENT MEMORY".

But when I try to restart the SQL Server service and try to process the XML again, it works.

How can I correct this problem w/o restarting the SQL Server service?

The server specs has 1.5GB Memory and 4 processors.

P.S. Thanks in advance."

Merkin
Funky Drop Bear Fearing SQL Dude!

4970 Posts

Posted - 2004-02-25 : 08:27:01
Ouch.
The best answer I could give you is, don't feed SQL Server an 18mb XML file as a string
I'd beef up your VB6 app to parse the XML as a DOM document and work with that. Get VB to make the necessary calls to SQL Server.


Damian
Go to Top of Page

ehorn
Master Smack Fu Yak Hacker

1632 Posts

Posted - 2004-02-25 : 09:31:39
quote:
But when I try to restart the SQL Server service and try to process the XML again, it works.
How can I correct this problem w/o restarting the SQL Server service?

Is it possible the dll has a memory leak?
Go to Top of Page

gds_78
Starting Member

6 Posts

Posted - 2004-02-26 : 02:53:54
To Ehorn,

How can I determined if my VB created DLL has a memory leak? I already set the object variables to Nothing and set the string variables to empty before the method exits.

To Merkin,
Is there a way I can open an XML file in the SQL 2000?

gds that smiles
Go to Top of Page

nfsoft
Starting Member

36 Posts

Posted - 2004-02-26 : 05:45:39
Go to the taskmanager and take a look at te process resources consum of the dll.
But in my opinion XML is the problem.

Nuno Ferreira
Go to Top of Page

Merkin
Funky Drop Bear Fearing SQL Dude!

4970 Posts

Posted - 2004-02-26 : 06:16:57
If it's a dll then SQL Server will be running it.

I stand by my first post gds, write an app that opens the XML externally to SQL Server.



Damian
Go to Top of Page

gds_78
Starting Member

6 Posts

Posted - 2004-03-01 : 19:52:17
Will DBCC DROPCLEANBUFFERS solve this problem?

gds that smiles
Go to Top of Page

tkizer
Almighty SQL Goddess

38200 Posts

Posted - 2004-03-01 : 19:55:10
quote:
Originally posted by gds_78

Will DBCC DROPCLEANBUFFERS solve this problem?

gds that smiles



No. I would suggest doing what Merkin says.

Tara
Go to Top of Page

byrmol
Shed Building SQL Farmer

1591 Posts

Posted - 2004-03-01 : 20:03:01
I have had a similar problem and we went with using a XSL to convert to CSV and then bulk load...


DavidM

"SQL-3 is an abomination.."
Go to Top of Page
   

- Advertisement -