LO56732: SERVER HANGS WHILE STARTING DOMINO SERVER

APAR status

• Closed as fixed if next.

Error description

• Server hangs while starting Domino Server with lots of 0x0256
  NSF buffer pool container semaphore and 0x0294 Directory manager
  queue semaphore.
  Steps to reproduce is unknown.
  
  *** Typical stack trace ***
  
  2010/11/05 03:23:05 ZE9 sq="0000002D" THREAD [0378:0002-0368]
  WAITING FOR SEM 0x0256 NSF buffer pool container (@0151C5F0)
  (OWNER=108C:1090) FOR 30000 ms
  
  ############################################################
  ### thread 1/2: [ nAdminP:  108c:  1090]
  ### FP=0x0012ec94, PC=0x7c97860c, SP=0x0012ec24
  ### stkbase=0x00130000, total stksize=20480, used stksize=5084
  ############################################################
   [ 1] 0x7c97860c ntdll.KiFastSystemCallRet+0
  (144,ffffffff,0,12ecd8)
   [ 2] 0x7c821c8d kernel32.WaitForSingleObject+18
  (144,ffffffff,12f265c,40000)
  @[ 3] 0x60098c76 nnotes.WaitOnNativeSemaphore@16+150
  (32,ffffffff,0,0)
  @[ 4] 0x600c5079 nnotes.OSWaitEvent@8+105 (12f265c,0)
  @[ 5] 0x601019d9 nnotes.OSCreateThread@16+89
  (6019cbd0,40000,0,0)
  @[ 6] 0x6019ce38 nnotes.AutoFDGAddToTermQueue+120
  (f0240078,1,141c2b4,0)
  @[ 7] 0x6019d0e9 nnotes.OSAutoFDGAcquireOSFD@12+569
  (f0240078,4,12ee94)
  @[ 8] 0x60843722 nnotes.TMPCONTWritePage@36+354
  (2,1,4000,2000,0,12ee7c,f10f10,ffffffff,0)
  @[ 9] 0x60030b09 nnotes.UBMEvictPage@16+457 (0,26000000,2000,0)
  @[10] 0x600a3339 nnotes.UBMMergeBuffers@28+409
  (12f23c,12f038,167e,0,0,12f008,f10f10)
  @[11] 0x60012183 nnotes.UBMClock@16+1251 (12f23c,167e,8,0)
  @[12] 0x60005076 nnotes.UBMPinExtended@8+486 (12f23c,0)
  @[13] 0x6000e7a2 nnotes.UBMPinA@44+98
  (1da5,1,31e,8000,0,12f270,f10f10,ffffffff,0,0,0)
  @[14] 0x600172ed nnotes.DbBucketPinBuffer@32+413
  (5f774,1,31e,0,0,12f2c4,f10f10,ffffffff)
  @[15] 0x6006f7f5 nnotes.DbForEachDocumentInBucket@24+357
  (12f774,18550a8,0,1854fec,0,12f4ac)
  @[16] 0x60070a2b nnotes.iSearchFill@8+1323 (2aa1,2aa2)
  @[17] 0x60070d9f nnotes.SearchFill@8+63 (2aa1,2aa2)
  @[18] 0x60058a28 nnotes.QueueFill@4+40 (2aa1)
  @[19] 0x60058996 nnotes.QueueGet@8+22 (2aa1,12f8a8)
  @[20] 0x6081cacd nnotes.NSFSearchExtended3@64+349
  (0,2aa0,0,0,0,12f8a0,f10f10,ffffffff,0,0,0,0,0,0,0,0)
  @[21] 0x6081cc30 nnotes.NSFSearchExtended2@48+64
  (7b,2aa0,0,0,0,12f8e8,f10f10,ffffffff,0,0,0,0)
  @[22] 0x6081cc76 nnotes.NSFSearchExtended@44+54
  (7b,2aa0,0,0,0,12f920,f10f10,ffffffff,0,0,0)
  @[23] 0x6081ccf1 nnotes.NSFSearch@36+49
  (7b,2aa0,0,8000,0,12f954,f10f10,ffffffff,0)
  @[24] 0x004027c2 nAdminP.AdminpRemoveInProgressNotes@8+178
  (1205d38,1)
  @[25] 0x00405738 nAdminP.AddInMain@12+2200 (400000,7b,b66014)
  @[26] 0x00468b3f nAdminP.NotesMain@8+47 (1,400000)
  @[27] 0x00468c74 nAdminP.notes_main+212 (0,0,0,1)
  @[28] 0x00468b66 nAdminP.main+22 (1,374b58,372968,472000)
  @[29] 0x00469bbb nAdminP.mainCRTStartup+323 (0,0,7ffdf000,0)
   [30] 0x7c82f23b kernel32.ProcessIdToSessionId+521
  (469a78,0,78746341,20)
  
  
  2010/11/05 03:36:03 ZE9 sq="00000072" THREAD [0FA0:0038-10B0]
  WAITING FOR WRITE LOCK ON RWSEM 0x0294 Directory manager queue
  semaphore (@015C7705) (R=0,W=1,WRITER=0378:0440,OWNER=0378:0440)
  FOR 30000 ms
  
  
  ############################################################
  ### thread 12/14: [  nevent:  0378:  0440]
  ### FP=0x050fcb8c, PC=0x7c97860c, SP=0x050fcb1c
  ### stkbase=0x05100000, total stksize=262144, used stksize=13540
  ############################################################
   [ 1] 0x7c97860c ntdll.KiFastSystemCallRet+0
  (1f8,7530,0,50fcbd0)
   [ 2] 0x7c821c8d kernel32.WaitForSingleObject+18
  (1f8,7530,1510069,151c2b6)
  @[ 3] 0x60098e73 nnotes.WaitOnNativeSemaphore@16+659
  (69,7530,0,0)
  @[ 4] 0x600de916 nnotes.WaitOnNativeSemaphoreCounted@12+22
  (1510069,151c2ba,0)
  @[ 5] 0x60008515 nnotes.OSLockWriteFRWSemInt@12+405
  (1510069,1,0)
  @[ 6] 0x60008370 nnotes.OSLockWriteFRWSem@4+16 (151c2b6)
  @[ 7] 0x60005fb8 nnotes.BUFLockContainerExtended@20+152
  (151c2b4,50fcc84,0,1,0)
  @[ 8] 0x60005f18 nnotes.BUFLockContainer@12+24
  (151c2b4,50fcc84,0)
  @[ 9] 0x6000688b nnotes.iNSFSlotUnPinWithHateInfo@16+107
  (50fcd50,60df04c0,1,0)
  @[10] 0x600066e4 nnotes.NSFSlotUnPinWithHateInfoCtx@16+212
  (50fcd50,60df04c0,1487785,0)
  @[11] 0x60008256 nnotes.NSFSlotUnPinCtx@12+22
  (50fcd50,60df04c0,1487785)
  @[12] 0x60008168 nnotes.BTExit@16+280
  (1ed1020,50fcd50,60df04c0,0)
  @[13] 0x60009c65 nnotes.BTReleaseDataCtx@12+117
  (1487762,50fcd50,60df04c0)
  @[14] 0x6008b1b5 nnotes.BTReleaseData@12+37 (1487762,0,60df04c0)
  @[15] 0x600882af nnotes.DbDirGetBlockByPath@16+287
  (50feac8,156cad5,156d74c,50fe458)
  @[16] 0x6079ef77 nnotes.NSFDbOpenExtended4@48+17767
  (445428,0,0,0,0,50fede8,f10f10,ffffffff,0,0,0,0)
  @[17] 0x600294c1 nnotes.NSFDbOpenExtended3@48+65
  (445428,0,0,0,0,50feec8,f10f10,ffffffff,0,0,0,0)
  @[18] 0x60071006 nnotes.NSFDbOpenExtended2@44+54
  (445428,0,0,0,0,50fef00,f10f10,ffffffff,0,0,0)
  @[19] 0x6008d0a6 nnotes.NSFDbOpenExtended@28+54
  (445428,0,0,0,0,50fef34,f10f10)
  @[20] 0x600a2a0a nnotes.NSFDbOpen@8+26 (445428,50ffd18)
  @[21] 0x0041c0a4 nevent.ScanView+1140
  (2a09930,fffffffb,50fff94,50ffe38)
  @[22] 0x0041df1f nevent.ScanMessagesView@16+95
  (2a09930,fffffffb,50fff94,50ffe38)
  @[23] 0x0041f5bf nevent.DDMBackgroundThread@4+1535 (0)
  @[24] 0x60101950 nnotes.ThreadWrapper@4+208 (0)
   [25] 0x7c82482f kernel32.GetModuleHandleA+223 (0,0,0,0)
  

Local fix

Problem summary

Problem conclusion

Temporary fix

Comments

• This APAR is associated with SPR# ANIA8BQ65X.
  

APAR Information

• APAR is sysrouted FROM one or more of the following:

• APAR is sysrouted TO one or more of the following:

Fix information

Applicable component levels

• R703 PSN

     UP