PI64306: OOM ON BUSINESS RULES

3.0.0-FTM-CPS-MP-fp0015
3.0.0-FTM-Check-MP-fp0015
3.0.0-FTM-ACH-MP-fp0015

APAR status

• Closed as program error.

Error description

• The Business Rules Server will crash with an out of memory error
  after loading server large database tables.  These LATs are not
  being released from memory.
  
  The heapdump will show the following:
  |- 647,951,416 (66.06%) [32] 70 class
  com/ibm/paydir/server/system/ServerManager 0x9014c558
                 |- 646,246,072 (65.88%) [32] 71 class
  com/ibm/paydir/server/manager/DataManager 0x90015938
                    |- 646,243,752 (65.88%) [24] 1
  java/util/Vector 0x903c1868
                       |- 646,243,728 (65.88%) [1,296] 221 array
  of java/lang/Object 0xb6d77078
                          |- 318,302,320 (32.45%) [48] 4
  com/ibm/paydir/server/task/BinTableData 0x903c6188
                          |- 318,302,304 (32.45%) [48] 4
  com/ibm/paydir/server/task/BinTableData 0x9037bc98
  
  The javacore could have a thread in the following:
  "JMS Subscriber" J9VMThread:0x357C8800, j9thread_t:0x3569AD08,
  java/lang/Thread:0xA37F50A0, state:R, prio=5
  3XMTHREADINFO3           Java callstack:
  at
  com/ibm/paydir/utilities/table/PayDrBinTable.LoadTable(PayDrBinT
  able.java:1615)
  at
  com/ibm/paydir/utilities/table/PayDrBinTable.LoadTable(PayDrBinT
  able.java:220)
  at
  com/ibm/paydir/utilities/table/PayDrBinTable.PayDrBinTbl_Load(Pa
  yDrBinTable.java:174)
  at
  com/ibm/paydir/utilities/table/OrderedTable.loadInit(OrderedTabl
  e.java:177)
  at
  com/ibm/paydir/server/task/BinTableData.<init>(BinTableData.java
  :79)
  

Local fix

• Customer could run the "refresh workflows" command to remove the
  old LATs from memory
  
  Another option would be to have a large enough heapsize where
  the Busines Rules Server could be restarted off hours to release
  the memory
  

Problem summary

Problem conclusion

• Refreshed Data Table which are not used and free up some memory.
  

Temporary fix

Comments

APAR Information

• APAR is sysrouted FROM one or more of the following:

• APAR is sysrouted TO one or more of the following:

Fix information

• Fixed component name

  CHECK SERVICES

• Fixed component ID

  5725S7730

Applicable component levels

• R300 PSN

     UP

• R301 PSN

     UP