IT14727: DEVICE SERVER OUTOFMEMORY DURING SVC PROBE TASK OF PERSISTING DATAPATHS

IBM Spectrum Control V5.2.10 (May 2016)
IBM Spectrum Control V5.2.10.1 (July 2016)
IBM Spectrum Control V5.2.11 (August 2016)
IBM Spectrum Control V5.2.12 (November 2016)
IBM Spectrum Control V5.2.13 (March 2017)
IBM Spectrum Control V5.2.14 (May 2017)
IBM Spectrum Control V5.2.15 (August 2017)
IBM Spectrum Control V5.2.15.2 (November 2017)
IBM Spectrum Control V5.2.16 (March 2018)
IBM Spectrum Control V5.2.17 (May 2018)

APAR status

• Closed as program error.

Error description

• SVC probes observed to hang, which drives up memory usage and
  causes the device server to encounter an OutOfMemory condition.
  The resulting heap dump file contains StackOverflowError
  Exceptions.
  In the probe logs SVCs report a high number of datapaths, which
  might be the reason for the large number of mapper-instances:
  SVC-2145-xxx_SVC1-IBM (0000020xxxxxxxxx) with xxxxx datapath
  instances and
  SVC-2145-xxx_SVC2-IBM (0000020xxxxxxxxx) with xxxxx datapath
  instances
  HWNEP0001I Successfully persisted 8 rcrelationship instances.
  HWN021719I Perform collection post process tasks for storage
  system.
  Device server trace logs will show messaging similar to this
  during the execution of the SVC probe job:
  (TPC/wlp/usr/servers/deviceServer/logs/trace.log)
  [ge Monitor] ERROR [config.KCConfig]- Uncaught exception
  occurred in thread KC File Change Monitor
  java.lang.OutOfMemoryError: Java heap space
      at java.io.File.list(File.java:1128) ˜[?:1.7.0]
      at java.io.File.listFiles(File.java:1292) ˜[?:1.7.0]
      at
  org.apache.commons.io.monitor.FileAlterationObserver.listFiles(F
  ileAlterationObserver.java:431) ˜[KC.war:2.4]
      at
  org.apache.commons.io.monitor.FileAlterationObserver.checkAndNot
  ify(FileAlterationObserver.java:304) ˜[KC.war:2.4]
      at
  org.apache.commons.io.monitor.FileAlterationMonitor.run(FileAlte
  rationMonitor.java:182) ˜[KC.war:2.4]
      at java.lang.Thread.run(Thread.java:809) [?:1.7.0]
  RECREATE STEPS:
  Execute SVC probe in 5.2.9 against SVC with a large amount of
  datapaths configured.
  ________________________________________________________________
  DB2 Version used for Server:    N/A
  The defect is against component:   5608TPC00
  Server/Manager build/release (TPC):   5.2.9
  ________________________________________________________________
  Problem as described by customer:   SVC probe jobs hang
  Initial customer impact (low/med/high): high
  

Local fix

• Apply fix when available
  

Problem summary

• ****************************************************************
  * USERS AFFECTED:                                              *
  * IBM Spectrum Control 5.2.8 and 5.2.9 users with more than    *
  * 2500 datapaths for a storage system.                         *
  ****************************************************************
  * PROBLEM DESCRIPTION:                                         *
  * See ERROR DESCRIPTION.                                       *
  ****************************************************************
  * RECOMMENDATION:                                              *
  * Apply fix maintenance when available.                        *
  ****************************************************************
  

Problem conclusion

• The fix for this APAR is targeted for the following maintenance
  package:
  
  | refresh pack | 5.2-TIV-TPC-RP0010 - target 2Q16
  
  Fixed in IBM Spectrum Control 5.2.10.
  
  http://www.ibm.com/support/docview.wss?&uid=swg21320822
  
  The target dates for future refresh packs do not represent a
  formal commitment by IBM. The dates are subject to change
  without notice.
  

Temporary fix

Comments

APAR Information

• APAR is sysrouted FROM one or more of the following:

• APAR is sysrouted TO one or more of the following:

Modules/Macros

• STORAGE
  

Fix information

• Fixed component name

  TPC ADVANCED

• Fixed component ID

  5608TPCA0

Applicable component levels

• R528 PSY

     UP

• R529 PSY

     UP