LO77762: SERVER CRASH WITH SMTP MEMORY ERRORS

APAR status

• Closed as fixed if next.

Error description

• Server crash on HTTP task with SMTP memory errors
  
  Env:
  ====
  Domino 8.5.3FP3HF476
  AIX 6.1
  
  
  Steps & Issue:
  ===========
  During the server crash 4 issues overlapped:
  1. LDAP/DNS service on which this server relies on were down
  from 6pm.
  It was observed that in such situation the CPU utilisation on
  Domino Page 4 of 25
  server increases by 30%.
  2. SMTP relay host the Domino server uses to sent outgoing mail
  was
  down from 6pm
  3. much higher CPU utilization on 3 tasks can be seen in nmon:
  http,
  domdsmc, smdreal (see nmon data)
  4. the http task was consuming memory on regular basis (see
  nmon data)
  
  The server eventually crashed on SMTP task reporting
  insufficient  memory.
  
  Crash Stack:
  ========
  ##################################
  ##### thread 21/33 :: http, pid=8061014, tid=18415755, ptid=1)
  ######
  ##################################
  [1] 0x09000000006094d0  _p_nsleep(??, ??) + 0x10
  [2] 0x090000000002b9c4  nsleep(??, ??) + 0xe4 Page 10 of 25
  [3] 0x0900000000154ce8  sleep(??) + 0x88
  [4] 0x09000000048f19b4  OSRunExternalScript(0xfffffffffffd280,
  0x100000001) + 0x2a8
  [5] 0x09000000048f1190  OSFaultCleanupExt(0x0, 0x100000001000,
  0x0, 0x0,
  0x0, 0x0) + 0x2b0
  [6] 0x09000000048f2da0  OSFaultCleanup(0x0, 0x100000001000,
  0x0) + 0x34
  [7] 0x0900000005984418  fatal_error(0xb0000000b,
  0xfffffffffffd970,
  0xfffffffffffd6c0) + 0x23c
  [8] <signal>
  [9] 0x0900000004a73c7c
  OSFreeBBlockRealExtended(0x700000005f34aa0,
  0x99d88400000000, 0x1227584c8, 0x5000000000, 0x100000001, 0x0)
  + 0x78
  [10] 0x0900000004a743b4  OSFreeBBlockReal(0x1099e0000000007,
  0x7bad8900000000, 0x1223f5868, 0x0, 0x100000001) + 0x38
  [11] 0x0900000004a76954  OSFreeBBlockAddr(0x1099e0000000007,
  0x7bad8900000000, 0x1223f5868, 0x0) + 0x2c
  [12] 0x09000000048b3750  OSLocalFree(0x1223f5878) + 0x120 Page
  11 of 25
  [13] 0x090000000941cea8
  INProcessNotesLocalMemory::Deallocate(void*)(0x1223f5878) +
  0x18
  [14] 0x090000000941ca00
  INProcessMemory::Deallocate(void*)(0x1223f5878)
  + 0x2c
  [15] 0x090000000941b428  operator delete(void*)(0x1223f5878) +
  0x3c
  [16] 0x0900000009743da4
  ShStringTable::~ShStringTable()(0x1223f5878,
  0x300000003) + 0x6c
  [17] 0x0900000009746208
  PtrArrayBase<ShStringTable,0>::DestroyContents()(0x113e309f0) +
  0x84
  [18] 0x09000000097467cc
  PtrArrayBase<ShStringTable,0>::Destroy()(0x113e309f0) + 0x24
  [19] 0x09000000097460bc
  PtrArrayBase<ShStringTable,0>::Destroy()(0x113e309f0) + 0x1c
  [20] 0x0900000009745a30
  PtrArrayBase<ShStringTable,0>::~PtrArrayBase()(0x113e309f0,
  0x0, 0x0) +
  0x48 Page 12 of 25
  [21] 0x0900000009745398
  PtrArray<ShStringTable>::~PtrArray()(0x113e309f0, 0x200000002,
  0x0) +
  0x60
  [22] 0x0900000009744038
  ShimmerPropertyStringTableImpl::~ShimmerPropertyStringTableImpl(
  )(0x113e
  307f8, 0x300000003) + 0x5c
  [23] 0x0900000009743f80  ShimmerPropertyStringTable::Term()() +
  0x24
  [24] 0x0900000009510f28  Haiku::Term()() + 0x50
  [25] 0x0900000009438530  InotesHTTPTerminate(0x0) + 0x70
  [26] 0x09000000020840d8
  HTInotesExtension::Terminate(int)(0x9001000a206e3a8, 0x0) +
  0xc4
  [27] 0x0900000002083fc8
  HTInotesExtension::Terminate()(0x9001000a206e3a8) + 0x14
  [28] 0x09000000020542d8
  HTProcessExtContainer::Terminate()(0x9001000a206e300) + 0x44
  [29] 0x0900000002026bb4 Page 13 of 25
  HTControlBlock::TerminateExtensions(int)(0x9001000a2063c80,
  0x0) + 0x28
  [30] 0x0900000002026810
  HTControlBlock::TermClass(int)(0x9001000a2063c80, 0x0) + 0x74
  [31] 0x09000000020b7478  HTServerStop(int)(0x0) + 0x1c
  [32] 0x09000000020b66e0  HTAddInMain(0x2000000020, 0x100000001,
  
  0x110018658) + 0x320
  [33] 0x0000000100000c58  AddInMain(0x2000000020, 0x100000001,
  0x110018658) + 0x28
  [34] 0x0000000100000b90  NotesMain(0x100000001, 0x110018658) +
  0x58
  [35] 0x00000001000008e4  notes_main(0x0, 0x0, 0x0, 0x100000001,
  
  0x110018658) + 0xfc
  [36] 0x0000000100000290  __start() + 0x98
  
  It's a similar stack as recorded in SPR # MJBG8BG274, but it
  was fixed in Domino 8.5.2FP3 and 8.5.3.
  
  SMTP Server Error: Insufficient memory - INetTask Pool
  

Local fix

Problem summary

• This APAR is closed as FIN. We have deferred the fix to a
   future release.
  

Problem conclusion

Temporary fix

Comments

• This APAR is associated with SPR# GAKI9D6KFY.
  This APAR is closed as FIN. We have deferred the fix to a
   future release.
  

APAR Information

• APAR is sysrouted FROM one or more of the following:

• APAR is sysrouted TO one or more of the following:

Fix information

Applicable component levels

• R853 PSN

     UP