Please start any new threads on our new site at https://forums.sqlteam.com. We've got lots of great SQL Server experts to answer whatever question you can come up with.

 All Forums
 Site Related Forums
 The Yak Corral
 Huge Table

Author  Topic 

acollins74
Yak Posting Veteran

82 Posts

Posted - 2009-08-11 : 09:32:22

I always smile to see what different people define to be a huge table.

This is my hugetable
Table Name #Records Reserved (KB)
dbo.hugeTable 0 34,955,072


Whats make a table huge for you?

Michael Valentine Jones
Yak DBA Kernel (pronounced Colonel)

7020 Posts

Posted - 2009-08-11 : 10:48:44
quote:
Originally posted by acollins74


I always smile to see what different people define to be a huge table.

This is my hugetable
Table Name #Records Reserved (KB)
dbo.hugeTable 0 34,955,072


Whats make a table huge for you?



Zero rows using 34 GB of space? Sounds like you have some problems. Does the table have a clustered index?





CODO ERGO SUM
Go to Top of Page

acollins74
Yak Posting Veteran

82 Posts

Posted - 2009-08-11 : 11:18:31
There’s no doubt i got problems but they don't have anything to do with my fictitious heap example.
I just threw that out there to get the thread started.

I commonly read people start their questions with, I have a huge table with 1 million rows and I need to do this task. It’s like straight outta Austin Powers. Years ago this forum would joke them hard but we're all soft now. MJV, am I alone on remembering how harsh this forum used to be on newcomers or anybody for that matter, with slack questions. Flash back 5 years, this place was terrifying but it made me less of a poster and more of a researcher. I'm better for it now.
Go to Top of Page

jezemine
Master Smack Fu Yak Hacker

2886 Posts

Posted - 2009-08-11 : 11:20:23
it's huge if bcp.exe can't export the entire table without barfing.

https://connect.microsoft.com/SQLServer/feedback/ViewFeedback.aspx?FeedbackID=329821


elsasoft.org
Go to Top of Page

X002548
Not Just a Number

15586 Posts

Posted - 2009-08-11 : 12:28:09
quote:
Originally posted by acollins74

There’s no doubt i got problems but they don't have anything to do with my fictitious heap example.
I just threw that out there to get the thread started.

I commonly read people start their questions with, I have a huge table with 1 million rows and I need to do this task. It’s like straight outta Austin Powers. Years ago this forum would joke them hard but we're all soft now. MJV, am I alone on remembering how harsh this forum used to be on newcomers or anybody for that matter, with slack questions. Flash back 5 years, this place was terrifying but it made me less of a poster and more of a researcher. I'm better for it now.





Good for you...but I don't remember it that way



Brett

8-)

Hint: Want your questions answered fast? Follow the direction in this link
http://weblogs.sqlteam.com/brettk/archive/2005/05/25/5276.aspx

Add yourself!
http://www.frappr.com/sqlteam



Go to Top of Page

tkizer
Almighty SQL Goddess

38200 Posts

Posted - 2009-08-11 : 13:44:08
I think the biggest table that I have is 600 million rows in an OLTP database. I know other DBAs at my work have systems with billions of rows.

Tara Kizer
Microsoft MVP for Windows Server System - SQL Server
http://weblogs.sqlteam.com/tarad/

Subscribe to my blog

"Let's begin with the premise that everything you've done up until this point is wrong."
Go to Top of Page

robvolk
Most Valuable Yak

15732 Posts

Posted - 2009-08-11 : 13:54:45
I feel inadequate, my largest production tables are about 100 million rows.

Although we had a logging system we retired that had over 1 billion rows in a single table. It was polling sysprocesses every minute and dumping the results in a table for about a year before we realized it was still running.
Go to Top of Page

X002548
Not Just a Number

15586 Posts

Posted - 2009-08-11 : 15:28:08
quote:
Originally posted by robvolk

I feel inadequate, my largest production tables are about 100 million rows.



Table envy?



Brett

8-)

Hint: Want your questions answered fast? Follow the direction in this link
http://weblogs.sqlteam.com/brettk/archive/2005/05/25/5276.aspx

Add yourself!
http://www.frappr.com/sqlteam



Go to Top of Page

jezemine
Master Smack Fu Yak Hacker

2886 Posts

Posted - 2009-08-11 : 15:45:19
actually my company is looking for someone at the moment that is at ease with large tables:

http://www.inrix.com/careers.asp




elsasoft.org
Go to Top of Page

TG
Master Smack Fu Yak Hacker

6065 Posts

Posted - 2009-08-11 : 15:53:49
I'm quite comfortable with large tables - I can accidentally DROP one of any size :) Should I just show up or do you want to go through the formality of resumes and interviews?

Be One with the Optimizer
TG
Go to Top of Page

jezemine
Master Smack Fu Yak Hacker

2886 Posts

Posted - 2009-08-11 : 16:07:29
dropping is easy. but can you write a trigger that loops through all the rows using a triply nested cursor?


elsasoft.org
Go to Top of Page

DonAtWork
Master Smack Fu Yak Hacker

2167 Posts

Posted - 2009-08-12 : 13:10:07
Not Enterprisy™ enough. Need more convoluted relations and such first.

http://weblogs.sqlteam.com/jeffs/archive/2008/05/13/question-needed-not-answer.aspx
How to ask: http://weblogs.sqlteam.com/brettk/archive/2005/05/25.aspx

For ultra basic questions, follow these links.
http://www.sql-tutorial.net/
http://www.firstsql.com/tutor.htm
http://www.w3schools.com/sql/default.asp
Go to Top of Page

webfred
Master Smack Fu Yak Hacker

8781 Posts

Posted - 2009-08-12 : 18:13:04
HUGE is in the eye of the beholder.


No, you're never too old to Yak'n'Roll if you're too young to die.
Go to Top of Page

Transact Charlie
Master Smack Fu Yak Hacker

3451 Posts

Posted - 2009-08-13 : 04:14:51
I'm surprised no one else has done this yet!

Here is my HUGE table


CREATE TABLE HUGE (
[Id] INT
)


Now it might be tiny but no one could argue that it is not a HUGE table.


Charlie
===============================================================
Msg 3903, Level 16, State 1, Line 1736
The ROLLBACK TRANSACTION request has no corresponding BEGIN TRANSACTION
Go to Top of Page

Transact Charlie
Master Smack Fu Yak Hacker

3451 Posts

Posted - 2009-08-13 : 04:17:15
quote:
Originally posted by jezemine

it's huge if bcp.exe can't export the entire table without barfing.

https://connect.microsoft.com/SQLServer/feedback/ViewFeedback.aspx?FeedbackID=329821


elsasoft.org


Love the comment at the bottom of that article. It is spot on.


Charlie
===============================================================
Msg 3903, Level 16, State 1, Line 1736
The ROLLBACK TRANSACTION request has no corresponding BEGIN TRANSACTION
Go to Top of Page

waterduck
Aged Yak Warrior

982 Posts

Posted - 2009-08-13 : 05:11:55
[code]CREATE TABLE VERY_HUGE (
[Id] SMALLINT
)[/code]
bigger than yours table~~~


Hope can help...but advise to wait pros with confirmation...
Go to Top of Page

Transact Charlie
Master Smack Fu Yak Hacker

3451 Posts

Posted - 2009-08-13 : 05:25:36
bigger, AND smaller. Nice one


Charlie
===============================================================
Msg 3903, Level 16, State 1, Line 1736
The ROLLBACK TRANSACTION request has no corresponding BEGIN TRANSACTION
Go to Top of Page

robvolk
Most Valuable Yak

15732 Posts

Posted - 2009-08-13 : 07:41:53
[code]CREATE TABLE GOOGLEPLEX_ROWCOUNT (
ID bit NOT NULL PRIMARY KEY)[/code]I just thought of a new paradigm: a table definition that's larger than the data it can possibly contain.
Go to Top of Page

Lumbago
Norsk Yak Master

3271 Posts

Posted - 2009-08-13 : 08:00:43
Hey jez, that actually sounds like a cool job...always enjoyed working with large chunks of data. We have a single table with close to 500 mill records in it and growing with about 10 mill rows per month. The bad part is that it's in MySQL and when you try to delete even a few thousand rows everything just goes totally ballistic.

Partitioning rules!

- Lumbago
Go to Top of Page

jezemine
Master Smack Fu Yak Hacker

2886 Posts

Posted - 2009-08-13 : 12:43:32
biggest table I've had to deal with had 8 * 10^9 rows. Had to bcp it out to move somewhere else, and ran into that max_int bug in bcp.


elsasoft.org
Go to Top of Page

dinakar
Master Smack Fu Yak Hacker

2507 Posts

Posted - 2009-08-13 : 13:15:11
I once worked on a database that ran out of integer values.. with about 900 mill rows. We had to create a new table with bigint and migrate the data.

Dinakar Nethi
************************
Life is short. Enjoy it.
************************
http://weblogs.sqlteam.com/dinakar/
Go to Top of Page
    Next Page

- Advertisement -