LO74689: DOMINO SERVER HANG ON HTTP WITH OSLOCKREADFRWSEM

APAR status

• Closed as fixed if next.

Error description

• Domino server hang on http task and all users can not connect to
  the server.
  In semdebug, most of the semaphores are READ LOCK semaphore
  0x030B, but each
  semaphore will terminate in 1-10 minutes.
  
  While NSD running, the collection semaphores are:
  
  2013-02-04 10:05:43 ZE8 sq="000002AF" THREAD [0244:001F-0FA8]
  WAITING FOR READ LOCK ON FRWSEM 0x030B Collection semaphore
  (@1128B7B0)  (R=20,W=0,WRITER=0000:0000,1STREADER=0244:0EF0) FOR
  30000 ms
  
  2013-02-04 10:05:48 ZE8 sq="000002B0" THREAD [0244:0031-0ED0]
  WAITING FOR READ LOCK ON FRWSEM 0x030B Collection semaphore
  (@1128B7B0)  (R=20,W=0,WRITER=0000:0000,1STREADER=0244:0EF0) FOR
  30000 ms
  
  2013-02-04 10:06:00 ZE8 sq="000002B1" THREAD [0244:002A-0F70]
  WAITING FOR READ LOCK ON FRWSEM 0x030B Collection semaphore
  (@1128B7B0)  (R=20,W=0,WRITER=0000:0000,1STREADER=0244:0EF0) FOR
  30000 ms
  
  2013-02-04 10:06:01 ZE8 sq="000002B4" THREAD [0244:0028-0E74]
  WAITING FOR READ LOCK ON FRWSEM 0x030B Collection semaphore
  (@1128B7B0)  (R=20,W=0,WRITER=0000:0000,1STREADER=0244:0EF0) FOR
  30000 ms
  
  
  Callstack for owner thread 0244:0EF0 is:
  
  ############################################################
  ### thread 97/145: [   nHTTP:  0244:  0ef0]
  ### FP=0x29ed8bd8, PC=0x78ee0a2a, SP=0x29ed8bd8
  ### stkbase=0x29ef0000, total stksize=4194304, used
  stksize=95272
  ############################################################
   [ 1] 0x78ee0a2a ntdll.ZwWaitForSingleObject+10
  (0,2344eae,2AE00000063,6)
   [ 2] 0x78d404bf kernel32.WaitForSingleObjectEx+223
  (147c,e309cb,0,2ca)
  @[ 3] 0x00e2ea18 nnotes.WaitOnNativeSemaphoreCounted+100
  (11290bd8,112a27d4,72c9ed7c,72c8d950)
  @[ 4] 0x00e2fbba nnotes.OSLockReadFRWSem+918
  (ff,2343f11,3A2000000FA,112a27b4)
  @[ 5] 0x0234316e nnotes.BUFLockContainer+126
  (3A2000000FA,176409,2AE00176409,112a27b4)
  @[ 6] 0x029a6c98 nnotes.iNSFSlotUnPinWithHateInfo+1120
  (176409,11290bd8,0,2343f05)
  @[ 7] 0x025831a9 nnotes.NSFSlotUnPinCtx+349
  (2AE00000063,176409,0,27be236)
  @[ 8] 0x0284d87e nnotes.BTExit+1102 (33A00000105,6,0,4bd80178)
  @[ 9] 0x02323518 nnotes.BTGetSubIndexCtx+2644
  (0,100009,4,11290790)
  @[10] 0x02c6874a nnotes.MoveToChild+778
  (4bd80178,2ca8594,0,98e6fbfe)
  @[11] 0x02c69365 nnotes.MovePreorder+345
  (4,100009,29eda400,6d)
  @[12] 0x02c5e69e nnotes.CollectionNavigate+2822
  (32,100009,ffffffff,27d)
  @[13] 0x02c31b21 nnotes.ReadEntriesInt+7573
  (1128b850,ef0,1085e288,e0aa6e)
  @[14] 0x02c2fd1e nnotes.ReadEntries+422
  (360a0012,100009,29edb150,1)
  @[15] 0x02c26bcb nnotes.NIFReadEntriesExt+1127
  (20102,0,0,e0aa6e)
  @[16] 0x184f3d18 nDBnotes.DBDColumn+488
  (1,e2dca5,0,10300003A2F)
  @[17] 0x184f19ab nDBnotes.DBDPerformFunction+1923
  (0,1e8009,29edb9ec,25800DFFC5A)
  @[18] 0x0238784e nnotes.DBDFunction+2138 (0,0,10000,545)
  @[19] 0x01d07246 nnotes.FallbackComputeExtension+1858
  (FF0000000000000,1f57934,1,29edbd90)
  @[20] 0x01ce93d0 nnotes.CompGeneralContext::ExtensionProc+1128
  (0,29edc770,ef0,111634d4)
  @[21] 0x01d0c92b nnotes.ExtensionProc::Execute+303
  (40f951c8,1cf5e04,40f94578,29edc5d0)
  @[22] 0x01cf57ec nnotes.AtFunctionNode::ComputeVariants+84
  (40f952f8,1ce2804,29edc5e0,40f94498)
  @[23] 0x01cf57c9 nnotes.AtFunctionNode::ComputeVariants+49
  (40f95360,40f94d88,29ede3c0,40f94d80)
  @[24] 0x01d1cd56 nnotes.AtIf::ComputeVariants+98
  (40f98950,40f95760,0,7000000002)
  @[25] 0x01cf6643
  nnotes.AssignmentExpressionNode::ComputeVariants+243
  (40f94e08,4b191240,4,dffbb9)
  @[26] 0x01cf6d64 nnotes.RootNode::ComputeVariants+108
  (40f9a708,2,4e180310,661)
  @[27] 0x01ce1eb1 nnotes.Compute::Eval+189
  (40f94498,40f93498,0,5c385e)
  @[28] 0x01cdfe34 nnotes.NSFComputeEvaluateExt+400
  (40f947be,40f989c0,29edf7b4,29ede180)
  @[29] 0x005c6169 ninotes.NFormula::Evaluate+217
  (29ede3c0,49a91a90,5,e2e332)
  @[30] 0x00433572 ninotes.CDtoHTMLtranslator::ProcessPopup+226
  (129ED0296,45c24e,29edfdac,29edfdac)
  @[31] 0x00432dab
  ninotes.CDtoHTMLtranslator::Process_CDHOTSPOTBEGIN+671
  (0,4dc718ce,4e180498,273213d)
  @[32] 0x0045d17d ninotes.CDtoHTMLtranslator::Run+1097
  (5efb6f88,330000a0,29edfec0,1)
  @[33] 0x005c0a47 ninotes.NForm::GenerateBodyHTML+471
  (29ee4898,ab6bc8,48257b05,12b121)
  @[34] 0x005bf8bd ninotes.NForm::GenerateHTML+889
  (29ee5338,29ee57c8,104155b0,2523673)
  @[35] 0x00665e78
  ninotes.CmdHandlerBase::GenerateEditablePage+320
  (29ee8800,e2ee69,8e,0)
  @[36] 0x004ce01a
  ninotes.CmdHandlerBase::HandleEditDocumentCmd+1830
  (aa6e44,2014cf4,8257B08000B1542,d9d3828)
  @[37] 0x004961a2 ninotes.CmdHandlerBase::PrivHandle+970
  (1,28eb4028,aa50d8,47a824)
  @[38] 0x00491dc7 ninotes.CmdHandler::PrivHandle+187
  (28eb8028,e28019,111fa388,973d018)
  @[39] 0x00684fab
  ninotes.CmdHandlerBase::HandleOpenDocumentCmd+4135
  (29eebde8,d9d3d18,0,6b52da)
  @[40] 0x0049626e ninotes.CmdHandlerBase::PrivHandle+1174
  (0,0,1,0)
  @[41] 0x00491dc7 ninotes.CmdHandler::PrivHandle+187
  (801,e0277a,94fb980,e2ee69)
  @[42] 0x00491f5d ninotes.CmdHandler::Handler+221
  (28eb4028,e2f8a2,28eaa150,62ef2c)
  @[43] 0x0047a8f7 ninotes.Cmd::Execute+35
  (29eecab8,53a316e8,28e88028,2)
  @[44] 0x0051a735 ninotes.InotesHTTPProcessRequestImpl+2097
  (53a30828,29eee1c0,FFFFFFFFFFFFFFE,6988f6)
  @[45] 0x00519ed3 ninotes.InotesHTTPProcessRequest+23
  (0,6988c1,FFFFFFFFFFFFFFE,53a30a38)
  @[46] 0x1002904e nhttpstack.HTInotesRequest::ProcessRequest+142
  (0,10037f00,29eee650,53a30a38)
  @[47] 0x1002011a
  nhttpstack.HTRequestExtContainer::ProcessRequest+942
  (29eee8a0,e2e332,28e83e90,28e83e98)
  @[48] 0x1003b9b1 nhttpstack.HTRequest::ProcessRequest+6217
  (0,78eec2d9,0,0)
  @[49] 0x10048573 nhttpstack.HTSession::StartRequest+2723
  (57310760,16b6a250,e094e0,0)
  @[50] 0x1005992a nhttpstack.HTWorkerThread::CheckForWork+914
  (16b6a250,10059f0c,FFFFFFFFFFFFFFE,e2e3b3)
  @[51] 0x10059509 nhttpstack.HTWorkerThread::ThreadMain+81
  (e094e0,0,e094e0,0)
  @[52] 0x10053133 nhttpstack.HTThreadBeginProc+67 (0,0,0,0)
  @[53] 0x00e0962a nnotes.ThreadWrapper+330 (0,0,0,29eeffa8)
   [54] 0x78d3b6da kernel32.BaseThreadStart+58 (0,0,0,0)
  

Local fix

Problem summary

• This APAR is closed as FIN. We have deferred the fix to a
   future release.
  

Problem conclusion

Temporary fix

Comments

• This APAR is associated with SPR# RSWG96E9PW.
  This APAR is closed as FIN. We have deferred the fix to a
   future release.
  

APAR Information

• APAR is sysrouted FROM one or more of the following:

• APAR is sysrouted TO one or more of the following:

Fix information

Applicable component levels