Please start any new threads on our new
site at https://forums.sqlteam.com. We've got lots of great SQL Server
experts to answer whatever question you can come up with.
| Author |
Topic |
|
DBriles
Starting Member
9 Posts |
 Posted - 2007-05-10 : 13:12:07
|
| We recently restored a database from a...windows 2000 x86 sp4sql 2000 enterprise x86 sp4 stand-aloneall drives hosting sql databases are SAN attached, write-caching is enabledserver, to a...windows 2003 enterprise x64 sp1SQL 2005 enterprise x64 sp2 2-node active/passiveall drives hosting sql databases are SAN attached, write-caching is enabledserver.We are experiencing data corruption on different tables in different databases. So far, we have always been able to quickly resolve the issue by simply running a DBCC DBREINDEX against the table. However, we are unable to resolve the issue with the latest occurrence. Any help would be greatly appreciated. Here is the output (or partial output in some cases) of various commands:DBCC CHECKDB ('DATABASE_NM')DBCC results for 'main_notes'.Msg 8961, Level 16, State 1, Line 1Table error: Object ID 434100587, index ID 1, partition ID 72057594146521088, alloc unit ID 71804568277286912 (type LOB data). The off-row data node at page (1:2487), slot 0, text ID 3788411843723132928 does not match its reference from page (1:34174), slot 0.Msg 8961, Level 16, State 1, Line 1Table error: Object ID 434100587, index ID 1, partition ID 72057594146521088, alloc unit ID 71804568277286912 (type LOB data). The off-row data node at page (1:2487), slot 2, text ID 341442560 does not match its reference from page (1:2487), slot 0.Msg 8929, Level 16, State 1, Line 1Object ID 434100587, index ID 1, partition ID 72057594146521088, alloc unit ID 72057594151239680 (type In-row data): Errors found in off-row data with ID 341442560 owned by data record identified by RID = (1:34174:0)There are 1 rows in 1 pages for object "main_notes".CHECKDB found 0 allocation errors and 3 consistency errors in table 'main_notes' (object ID 434100587).** NOTE ** Index_ID 1 is the clustered index which is on a single-column PK of int type.DBCC CHECKTABLE ('Main_Notes')DBCC results for 'main_notes'.Msg 8961, Level 16, State 1, Line 2Table error: Object ID 434100587, index ID 1, partition ID 72057594146521088, alloc unit ID 71804568277286912 (type LOB data). The off-row data node at page (1:2487), slot 0, text ID 3788411843723132928 does not match its reference from page (1:34174), slot 0.Msg 8961, Level 16, State 1, Line 2Table error: Object ID 434100587, index ID 1, partition ID 72057594146521088, alloc unit ID 71804568277286912 (type LOB data). The off-row data node at page (1:2487), slot 2, text ID 341442560 does not match its reference from page (1:2487), slot 0.Msg 8929, Level 16, State 1, Line 2Object ID 434100587, index ID 1, partition ID 72057594146521088, alloc unit ID 72057594151239680 (type In-row data): Errors found in off-row data with ID 341442560 owned by data record identified by RID = (1:34174:0)There are 1 rows in 1 pages for object "main_notes".CHECKTABLE found 0 allocation errors and 3 consistency errors in table 'main_notes' (object ID 434100587).repair_allow_data_loss is the minimum repair level for the errors found by DBCC CHECKTABLE (DATABASE_NM.dbo.main_notes).DBCC execution completed. If DBCC printed error messages, contact your system administrator.DBCC PAGE (F00115_Chase_TPP, 1, 2487, 1)DBCC execution completed. If DBCC printed error messages, contact your system administrator.DBCC PAGE (F00115_Chase_TPP, 1, 34174, 1)DBCC execution completed. If DBCC printed error messages, contact your system administrator.DBCC DBREINDEX ('Main_Notes')DBCC execution completed. If DBCC printed error messages, contact your system administrator.UPDATE STATISTICS Main_Notes WITH FULLSCANCommand(s) completed successfully.select * from main_notesMsg 7105, Level 22, State 6, Line 1The Database ID 17, Page (1:2487), slot 0 for LOB data type node does not exist. This is usually caused by transactions that can read uncommitted data on a data page. Run DBCC CHECKTABLE.select * from main_notes (nolock)Msg 601, Level 12, State 3, Line 1Could not continue scan with NOLOCK due to data movement. |
|
|
mcrowley
Aged Yak Warrior
771 Posts |
Posted - 2007-05-10 : 16:09:04
|
| With the fact that this is recurring, I would say you have a hardware problem somewhere. That will have to be fixed, or you will be facing this problem over and over. Get your server people into those event logs, and look for errors. There may even be errors in the SQL Server error log when these happened (usually error 823). As for the data, it looks like just the text/image data for main_notes has been lost. You can likely restore this database to another machine (perhaps a test machine), and transfer the one record over. That is assuming that there is supposed to be only one record in the main_notes table. |
 |
|
|
DBriles
Starting Member
9 Posts |
Posted - 2007-05-10 : 16:38:29
|
| Agreed. We have combed the logs with both our system and san engineers. Unfortunately, nothing has been found so far to aid us in addressing the issue. We do have an open case with MS, who has a ton of various logs/dumps/etc. of ours currently being analyzed. Still no word though after 3+ days.I assumed as well this single record had been lost. Retrieving it from backup has already been successfully tested so we are not concerned about data loss.Thanks for taking the time to reply. |
|
|
|
Kristen
Test
22859 Posts |
Posted - 2007-05-11 : 04:33:44
|
| I doubt it is relevant, but have you changed the Compatibility mode after restore to SQL2005 - so that the system is running Native 2005, rather than 2000-Compatibility? (From memory that means changing it from 80 to 90).My thinking is that a 2000-Compatibility database MIGHT encounter some obscure bug due to potentially less testing / user experience than a 2005-Native database. (If you haven't there are implications for QA testing before actually throwing the switch!)But I'm only thinking out loud really ...Kristen |
|
|
|
paulrandal
Yak with Vast SQL Skills
899 Posts |
Posted - 2007-05-11 : 19:33:43
|
| If you want to see the output from DBCC PAGE on the console, you need to turn on TF 3604 first.I suspect you have issues with the SAN and the write caching. Please install SQLIOSim (see http://support.microsoft.com/kb/231619) and use it to stress your IO subsystem to expose errors.Paul RandalPrincipal Lead Program Manager, Microsoft SQL Server Core Storage Engine(Legalese: This posting is provided "AS IS" with no warranties, and confers no rights.)http://blogs.msdn.com/sqlserverstorageengine/default.aspx |
|
|
|
DBriles
Starting Member
9 Posts |
Posted - 2007-05-14 : 10:08:36
|
| Thank you Paul. We will run the tool on our system today. In the mean time, here is the results from the 1st DBCC PAGE statement. I have cut out the portion that is our data due to confidentiality reasons.DBCC PAGE (F00115_Chase_TPP, 1, 2487, 1)PAGE: (1:2487)BUFFER:BUF @0x000000089AFFAF80bpage = 0x000000089AEBE000 bhash = 0x0000000000000000 bpageno = (1:2487)bdbid = 17 breferences = 0 bUse1 = 6333bstat = 0x3c00009 blog = 0x21212159 bnext = 0x0000000000000000PAGE HEADER:Page @0x000000089AEBE000m_pageId = (1:2487) m_headerVersion = 1 m_type = 3m_typeFlagBits = 0x0 m_level = 0 m_flagBits = 0x8000m_objId (AllocUnitId.idObj) = 434100587 m_indexId (AllocUnitId.idInd) = 255Metadata: AllocUnitId = 71804568277286912 Metadata: PartitionId = 72057594150256640 Metadata: IndexId = 1Metadata: ObjectId = 434100587 m_prevPage = (0:0) m_nextPage = (0:0)pminlen = 0 m_slotCnt = 4 m_freeCnt = 4458m_freeData = 5485 m_reservedCnt = 1563 m_lsn = (20018:2902:58)m_xactReserved = 1563 m_xdesId = (0:2878653) m_ghostRecCnt = 0m_tornBits = 32770 Allocation StatusGAM (1:2) = ALLOCATED SGAM (1:3) = ALLOCATED PFS (1:1) = 0x61 MIXED_EXT ALLOCATED 50_PCT_FULL DIFF (1:6) = CHANGEDML (1:7) = NOT MIN_LOGGED DATA:Slot 0, Offset 0x14c5, Length 84, DumpStyle BYTERecord Type = BLOB_FRAGMENT Record Attributes = Memory Dump @0x0000000034B3D4C50000000000000000: 08005400 00000000 80249334 05000500 † 0000000000000010: 01000000 00000000 b5060000 b7090000 † 0000000000000020: 01000200 ff000000 30fc9234 00000000 † 0000000000000030: b835ee13 00000000 00000000 03000000 † 0000000000000040: 01000000 00000000 00000000 00000000 † 0000000000000050: d0e1c9b6 ††††††††††††††††††††††††††††.... Slot 1, Offset 0x731, Length 1731, DumpStyle BYTERecord Type = BLOB_FRAGMENT Record Attributes = Memory Dump @0x0000000034B3C7310000000000000000: 0800c306 00004c20 00000000 03004173 † 0000000000000010: 20706572 206f7572 20636f6e 76657273 † 0000000000000020: 6174696f 6e206561 726c6965 722c2070 † 0000000000000030: 6c656173 65207365 65206265 6c6f7720 † 0000000000000040: 666f7220 61206c69 7374206f 66207468 † 0000000000000050: 65206c65 76656c73 20696e20 74686520 † 0000000000000060: 74686972 64207061 72747920 63617365 † 0000000000000070: 626f6f6b 20746861 74206172 65207072 † 0000000000000080: 6f647563 74696f6e 20726561 64792e20 † 0000000000000090: 20492068 61766520 6578636c 75646564 † 00000000000000A0: 20616c6c 206f6620 74686520 6c657665 † 00000000000000B0: 6c732074 68617420 636f6e74 61696e20 † 00000000000000C0: 6120636f 7079206f 66207468 65207072 † 00000000000000D0: 6f647563 74696f6e 2c20736f 20746861 † 00000000000000E0: 7420796f 7520646f 6e277420 73656e64 † 00000000000000F0: 20746865 2073616d 65207468 696e6720 † 0000000000000100: 74776963 652e0d0a 0d0a506c 65617365 † 0000000000000110: 206c6574 206d6520 6b6e6f77 20696620 † 0000000000000120: 796f7520 6e656564 20616e79 20616464 † 0000000000000130: 6974696f 6e616c20 696e666f 726d6174 † 0000000000000140: 696f6e2e 200d0a0d 0a416e67 656c6f20 † 0000000000000150: 0d0a0d0a 0d0a496e 64697669 6475616c † 0000000000000160: 730d0a53 756c6c69 76616e20 2d2d2667 † 0000000000000170: 743b2030 3030312f 54303031 2f303030 † 0000000000000180: 310d0a2a 4e656174 6f6e202d 2d266774 † 0000000000000190: 3b203030 30312f54 3030392f 30303032 † 00000000000001A0: 0d0a2a4b 6f6e7374 616d202d 2d266774 † 00000000000001B0: 3b203030 30312f54 3031302f 30303032 † 00000000000001C0: 0d0a2a42 6a6f726b 6d616e20 2d2d2667 † 00000000000001D0: 743b2030 3030312f 54303131 2f303030 † 00000000000001E0: 320d0a2a 5765696e 626c6174 74202d2d † 00000000000001F0: 2667743b 20303030 312f5430 31322f30 † 0000000000000200: 3030320d 0a2a5765 69736665 6c647420 † 0000000000000210: 2d2d2667 743b2030 3030312f 54303134 † 0000000000000220: 2f303030 320d0a2a 4f617465 73202d2d † 0000000000000230: 2667743b 20303030 312f5430 31352f30 † 0000000000000240: 3030320d 0a43616c 6966202d 2d266774 † 0000000000000250: 3b203030 30312f54 3031372f 30303032 † 0000000000000260: 0d0a4672 69657320 2d2d2667 743b2030 † 0000000000000270: 3030312f 54303138 2f303030 320d0a42 † 0000000000000280: 61726f6e 202d2d26 67743b20 30303031 † 0000000000000290: 2f543031 392f3030 30320d0a 4261726f † 00000000000002A0: 6e202d2d 2667743b 20303030 312f5430 † 00000000000002B0: 31392f30 3030330d 0a537472 6f6d202d † 00000000000002C0: 2d266774 3b203030 30312f54 3032302f † 00000000000002D0: 30303032 0d0a546f 706f6c20 2d2d2667 † 00000000000002E0: 743b2030 3030312f 54303231 2f303030 † 00000000000002F0: 320d0a4e 69737365 6e202d2d 2667743b † 0000000000000300: 20303030 312f5430 32322f30 3030320d † 0000000000000310: 0a506574 7269202d 2d266774 3b203030 † 0000000000000320: 30312f54 3032332f 30303031 0d0a4669 † 0000000000000330: 747a6765 72616c64 202d2d26 67743b20 † 0000000000000340: 30303031 2f543032 342f3030 30320d0a † 0000000000000350: 42726573 616c6965 72202d2d 2667743b † 0000000000000360: 20303030 312f5430 32352f30 30303120 † 0000000000000370: 0d0a0d0a 4e423a20 54686520 2a20696e † 0000000000000380: 64696361 74657320 74686174 20746865 † 0000000000000390: 72652069 73206120 636f7079 206f6620 † 00000000000003A0: 74686520 70726f64 75637469 6f6e2061 † 00000000000003B0: 7420616e 6f746865 72207375 626c6576 † 00000000000003C0: 656c2074 68617420 77617320 696e7465 † 00000000000003D0: 6e74696f 6e616c6c 79206578 636c7564 † 00000000000003E0: 65642066 726f6d20 74686973 206c6973 † 00000000000003F0: 74207369 6e636520 69742069 73206120 † 0000000000000400: 6475706c 69636174 652e0d0a 0d0a456e † 0000000000000410: 74697469 65730d0a 2a2a5244 20436c69 † 0000000000000420: 6e696361 6c205265 73656172 6368202d † 0000000000000430: 2d266774 3b203030 30322f54 3030322f † 0000000000000440: 30303031 200d0a2a 2a524420 436c696e † 0000000000000450: 6963616c 20526573 65617263 68202d2d † 0000000000000460: 2667743b 20303030 322f5430 30332f30 † 0000000000000470: 30303120 0d0a2a2a 52442043 6c696e69 † 0000000000000480: 63616c20 52657365 61726368 202d2d26 † 0000000000000490: 67743b20 30303032 2f543030 342f3030 † 00000000000004A0: 3031200d 0a2a2a52 4420436c 696e6963 † 00000000000004B0: 616c2052 65736561 72636820 2d2d2667 † 00000000000004C0: 743b2030 3030322f 54303035 2f303030 † 00000000000004D0: 31200d0a 2a2a5244 20436c69 6e696361 † 00000000000004E0: 6c205265 73656172 6368202d 2d266774 † 00000000000004F0: 3b203030 30322f54 3030362f 30303031 † 0000000000000500: 200d0a2a 2a524420 436c696e 6963616c † 0000000000000510: 20526573 65617263 68202d2d 2667743b † 0000000000000520: 20303030 322f5430 30372f30 30303120 † 0000000000000530: 0d0a2a2a 54657861 73204865 61727420 † 0000000000000540: 496e7374 69747574 65202d2d 2667743b † 0000000000000550: 20303030 322f5430 30382f30 30303120 † 0000000000000560: 0d0a4f67 696c7679 202d2d26 67743b20 † 0000000000000570: 30303032 2f543030 392f3030 31202868 † 0000000000000580: 6173206e 6f742062 65656e20 6d696772 † 0000000000000590: 61746564 2066726f 6d204368 61736520 † 00000000000005A0: 79657429 200d0a49 4d53202d 2d266774 † 00000000000005B0: 3b203030 30322f54 3031362f 30303032 † 00000000000005C0: 200d0a4e 6974726f 4d656420 2d2d2667 † 00000000000005D0: 743b2030 3030322f 54303138 2f303030 † 00000000000005E0: 31200d0a 46444120 2d2d2667 743b2030 † 00000000000005F0: 3030322f 54303233 2f5b414c 4c205355 † 0000000000000600: 424c4556 454c535d 200d0a4e 454a4d20 † 0000000000000610: 2d2d2667 743b2030 3030322f 54303234 † 0000000000000620: 2f5b414c 4c205355 424c4556 454c535d † 0000000000000630: 200d0a0d 0a4e423a 20546865 202a2a20 † 0000000000000640: 696e6469 63617465 73207072 6f647563 † 0000000000000650: 74696f6e 73207468 61742077 65726520 † 0000000000000660: 70726576 696f7573 6c79206f 6e6c7920 † 0000000000000670: 74686520 74686972 64207061 72747920 † 0000000000000680: 70726f64 75637469 6f6e7320 63617365 † 0000000000000690: 626f6f6b 20616e64 20776572 65206e6f † 00000000000006A0: 74207265 71756573 74656420 746f2062 † 00000000000006B0: 65206c6f 61646564 20627920 6d652e0d † 00000000000006C0: 0a0d0a†††††††††††††††††††††††††††††††... Slot 2, Offset 0xe02, Length 1731, DumpStyle BYTERecord Type = BLOB_FRAGMENT Record Attributes = Memory Dump @0x0000000034B3CE020000000000000000: 0800c306 00005a14 00000000 03004173 † 0000000000000010: 20706572 206f7572 20636f6e 76657273 † 0000000000000020: 6174696f 6e206561 726c6965 722c2070 † 0000000000000030: 6c656173 65207365 65206265 6c6f7720 † 0000000000000040: 666f7220 61206c69 7374206f 66207468 † 0000000000000050: 65206c65 76656c73 20696e20 74686520 † 0000000000000060: 74686972 64207061 72747920 63617365 † 0000000000000070: 626f6f6b 20746861 74206172 65207072 † 0000000000000080: 6f647563 74696f6e 20726561 64792e20 † 0000000000000090: 20492068 61766520 6578636c 75646564 † 00000000000000A0: 20616c6c 206f6620 74686520 6c657665 † 00000000000000B0: 6c732074 68617420 636f6e74 61696e20 † 00000000000000C0: 6120636f 7079206f 66207468 65207072 † 00000000000000D0: 6f647563 74696f6e 2c20736f 20746861 † 00000000000000E0: 7420796f 7520646f 6e277420 73656e64 † 00000000000000F0: 20746865 2073616d 65207468 696e6720 † 0000000000000100: 74776963 652e0d0a 0d0a506c 65617365 † 0000000000000110: 206c6574 206d6520 6b6e6f77 20696620 † 0000000000000120: 796f7520 6e656564 20616e79 20616464 † 0000000000000130: 6974696f 6e616c20 696e666f 726d6174 † 0000000000000140: 696f6e2e 200d0a0d 0a416e67 656c6f20 † 0000000000000150: 0d0a0d0a 0d0a496e 64697669 6475616c † 0000000000000160: 730d0a53 756c6c69 76616e20 2d2d2667 † 0000000000000170: 743b2030 3030312f 54303031 2f303030 † 0000000000000180: 310d0a2a 4e656174 6f6e202d 2d266774 † 0000000000000190: 3b203030 30312f54 3030392f 30303032 † 00000000000001A0: 0d0a2a4b 6f6e7374 616d202d 2d266774 † 00000000000001B0: 3b203030 30312f54 3031302f 30303032 † 00000000000001C0: 0d0a2a42 6a6f726b 6d616e20 2d2d2667 † 00000000000001D0: 743b2030 3030312f 54303131 2f303030 † 00000000000001E0: 320d0a2a 5765696e 626c6174 74202d2d † 00000000000001F0: 2667743b 20303030 312f5430 31322f30 † 0000000000000200: 3030320d 0a2a5765 69736665 6c647420 † 0000000000000210: 2d2d2667 743b2030 3030312f 54303134 † 0000000000000220: 2f303030 320d0a2a 4f617465 73202d2d † 0000000000000230: 2667743b 20303030 312f5430 31352f30 † 0000000000000240: 3030320d 0a43616c 6966202d 2d266774 † 0000000000000250: 3b203030 30312f54 3031372f 30303032 † 0000000000000260: 0d0a4672 69657320 2d2d2667 743b2030 † 0000000000000270: 3030312f 54303138 2f303030 320d0a42 † 0000000000000280: 61726f6e 202d2d26 67743b20 30303031 † 0000000000000290: 2f543031 392f3030 30320d0a 4261726f † 00000000000002A0: 6e202d2d 2667743b 20303030 312f5430 † 00000000000002B0: 31392f30 3030330d 0a537472 6f6d202d † 00000000000002C0: 2d266774 3b203030 30312f54 3032302f † 00000000000002D0: 30303032 0d0a546f 706f6c20 2d2d2667 † 00000000000002E0: 743b2030 3030312f 54303231 2f303030 † 00000000000002F0: 320d0a4e 69737365 6e202d2d 2667743b † 0000000000000300: 20303030 312f5430 32322f30 3030320d † 0000000000000310: 0a506574 7269202d 2d266774 3b203030 † 0000000000000320: 30312f54 3032332f 30303031 0d0a4669 † 0000000000000330: 747a6765 72616c64 202d2d26 67743b20 † 0000000000000340: 30303031 2f543032 342f3030 30320d0a † 0000000000000350: 42726573 616c6965 72202d2d 2667743b † 0000000000000360: 20303030 312f5430 32352f30 30303120 † 0000000000000370: 0d0a0d0a 4e423a20 54686520 2a20696e † 0000000000000380: 64696361 74657320 74686174 20746865 † 0000000000000390: 72652069 73206120 636f7079 206f6620 † 00000000000003A0: 74686520 70726f64 75637469 6f6e2061 † 00000000000003B0: 7420616e 6f746865 72207375 626c6576 † 00000000000003C0: 656c2074 68617420 77617320 696e7465 † 00000000000003D0: 6e74696f 6e616c6c 79206578 636c7564 † 00000000000003E0: 65642066 726f6d20 74686973 206c6973 † 00000000000003F0: 74207369 6e636520 69742069 73206120 † 0000000000000400: 6475706c 69636174 652e0d0a 0d0a456e † 0000000000000410: 74697469 65730d0a 2a2a5244 20436c69 † 0000000000000420: 6e696361 6c205265 73656172 6368202d † 0000000000000430: 2d266774 3b203030 30322f54 3030322f † 0000000000000440: 30303031 200d0a2a 2a524420 436c696e † 0000000000000450: 6963616c 20526573 65617263 68202d2d † 0000000000000460: 2667743b 20303030 322f5430 30332f30 † 0000000000000470: 30303120 0d0a2a2a 52442043 6c696e69 † 0000000000000480: 63616c20 52657365 61726368 202d2d26 † 0000000000000490: 67743b20 30303032 2f543030 342f3030 † 00000000000004A0: 3031200d 0a2a2a52 4420436c 696e6963 † 00000000000004B0: 616c2052 65736561 72636820 2d2d2667 † 00000000000004C0: 743b2030 3030322f 54303035 2f303030 † 00000000000004D0: 31200d0a 2a2a5244 20436c69 6e696361 † 00000000000004E0: 6c205265 73656172 6368202d 2d266774 † 00000000000004F0: 3b203030 30322f54 3030362f 30303031 † 0000000000000500: 200d0a2a 2a524420 436c696e 6963616c † 0000000000000510: 20526573 65617263 68202d2d 2667743b † 0000000000000520: 20303030 322f5430 30372f30 30303120 † 0000000000000530: 0d0a2a2a 54657861 73204865 61727420 † 0000000000000540: 496e7374 69747574 65202d2d 2667743b † 0000000000000550: 20303030 322f5430 30382f30 30303120 † 0000000000000560: 0d0a4f67 696c7679 202d2d26 67743b20 † 0000000000000570: 30303032 2f543030 392f3030 31202868 † 0000000000000580: 6173206e 6f742062 65656e20 6d696772 † 0000000000000590: 61746564 2066726f 6d204368 61736520 † 00000000000005A0: 79657429 200d0a49 4d53202d 2d266774 † 00000000000005B0: 3b203030 30322f54 3031362f 30303032 † 00000000000005C0: 200d0a4e 6974726f 4d656420 2d2d2667 † 00000000000005D0: 743b2030 3030322f 54303138 2f303030 † 00000000000005E0: 31200d0a 46444120 2d2d2667 743b2030 † 00000000000005F0: 3030322f 54303233 2f5b414c 4c205355 † 0000000000000600: 424c4556 454c535d 200d0a4e 454a4d20 † 0000000000000610: 2d2d2667 743b2030 3030322f 54303234 † 0000000000000620: 2f5b414c 4c205355 424c4556 454c535d † 0000000000000630: 200d0a0d 0a4e423a 20546865 202a2a20 † 0000000000000640: 696e6469 63617465 73207072 6f647563 † 0000000000000650: 74696f6e 73207468 61742077 65726520 † 0000000000000660: 70726576 696f7573 6c79206f 6e6c7920 † 0000000000000670: 74686520 74686972 64207061 72747920 † 0000000000000680: 70726f64 75637469 6f6e7320 63617365 † 0000000000000690: 626f6f6b 20616e64 20776572 65206e6f † 00000000000006A0: 74207265 71756573 74656420 746f2062 † 00000000000006B0: 65206c6f 61646564 20627920 6d652e0d † 00000000000006C0: 0a0d0a†††††††††††††††††††††††††††††††... Slot 3, Offset 0x1519, Length 84, DumpStyle BYTERecord Type = BLOB_FRAGMENT Record Attributes = Memory Dump @0x0000000034B3D5190000000000000000: 08005400 00004c20 00000000 05000500 † 0000000000000010: 01000000 00000000 b5060000 b7090000 † 0000000000000020: 01000100 ff000000 30fc9234 00000000 † 0000000000000030: b835ee13 00000000 00000000 03000000 † 0000000000000040: 01000000 00000000 00000000 00000000 † 0000000000000050: d0e1c9b6 ††††††††††††††††††††††††††††.... DBCC execution completed. If DBCC printed error messages, contact your system administrator. |
|
|
|
DBriles
Starting Member
9 Posts |
Posted - 2007-05-14 : 12:34:02
|
| Paul,We ran the SQLIOSim (x64) utility on our server using the tool as is. The only settings I changed were the file locations... We put the .mdx files on the same drive/path we host our .mdf files on and the same drive/path for the .ldx files as our .ldf files. I looked at the output of sqliosim.log.xml for any errors or warnings and found none. What configuration settings can I modify to really ramp up the stress levels?Thanks. |
|
|
|
paulrandal
Yak with Vast SQL Skills
899 Posts |
|
|
DBriles
Starting Member
9 Posts |
Posted - 2007-05-15 : 11:38:42
|
| So far I've been unsuccessful in getting the SQLIOSIM utility to generate any errors. The last run was configured as you see below. Any suggestions on better ways to configure the utility to uncover hardware related issues that are causing us data corruption would be much appreciated. Thank you.Starting Microsoft SQL Server(c) Simulator Stress Test Version 9.00.1399.05Config file sqliosim.cfg.ini, error log sqliosim2_sp2.log.xmlCPUCount = 8, Affinity = 0, IOAffinity = 0, MaxMemory = 46283 MB, StopOnError = Yes, TestCycles = 1, TestCycleDuration = 3600 s, CacheHitRatio = 10.00% NoBuffering = Yes, WriteThrough = Yes, UseScatterGather = Yes, ForceReadAhead = Yes, MaxOutstandingIO = 0, TargetIODuration = 100 msAllowIOBursts = Yes, DeleteFilesAtStartup = Yes, DeleteFilesAtShutdown = No, StampFiles = NoRandomUser: UserCount = 1000, JumpToNewRegionPercentage = 5.00%, MinIOChainLength = 50, MaxIOChainLength = 100, RandomUserReadWriteRatio = 90.00%RandomUser: MinLogPerBuffer = 64, MaxLogPerBuffer = 8192, RollbackChance = 1.00%, SleepAfter = 5 ms, YieldPercentage = 0.00%AuditUser: UserCount = 200, BuffersValidated = 64, DelayAfterCycles = 2, AuditDelay = 200 msReadAheadUser: UserCount = 1000, BuffersRAMin = 32, BuffersRAMax = 64, DelayAfterCycles = 2, RADelay = 200 msBulkUpdateUser: UserCount = 600, BuffersBUMin = 64, BuffersBUMax = 128, DelayAfterCycles = 2, BUDelay = 10 msShrinkUser: MinShrinkInterval = 120 s, MaxShrinkInterval = 600 s, MinExtends = 1, MaxExtends = 20 |
|
|
|
Jhalmans
Microsoft SQL Server Product Team
12 Posts |
Posted - 2007-05-15 : 12:32:31
|
| Your SQLIOSim configuration will generate a good deal of load, however it may take quite some for an error condition to occur. The best advice I have for you is to let the tool run longer to have more of a chance at fleshing out error conditions.This posting is provided "AS IS" with no warranties, and confers no rights |
|
|
|
DBriles
Starting Member
9 Posts |
Posted - 2007-05-15 : 17:34:11
|
| 4 hours this go, still no errors. Would running the tool longer likely produce anything different?FYI... Our SAN engineers gave the entire network a thorough review and found no issues. Our system engineers did find we could upgrade some of our firmware and bios to later versions (minor upgrades only), which we will do in the near future. We'll also test disabling the write caching. |
|
|
|
paulrandal
Yak with Vast SQL Skills
899 Posts |
Posted - 2007-05-15 : 18:17:49
|
| You're asking a question to which there's no sensible answer. If there's a random bug in some part of the IO subsystem setup, it may not show up for days - same as how you may run SQL Server for days on the h/w and not see any issues.Having run it for 4 hours without problems means that the h/w isn't flaky, but doesn't rule out or point to a h/w or s/w bug.My advice would be to enable page checksums, rebuild the indexes to get all the pages to have a page checksum (yes, this sucks I know) and continue running. If you see a corruption on a page and the page checksum isn't bad, you know its a s/w bug in SQL Server or a memory scribbler issue. If you see a page checksum failure, you then know its the IO subsystem.ThanksPaul RandalPrincipal Lead Program Manager, Microsoft SQL Server Core Storage Engine(Legalese: This posting is provided "AS IS" with no warranties, and confers no rights.)http://blogs.msdn.com/sqlserverstorageengine/default.aspx |
|
|
|
|
|
|
|
|
8961, 8929, 7105, 601 errors all on same table