IT14263: IBM SPECTRUM CONTROL PROBES AGAINST SVC/STORWIZE/FLASHSYSTEMS STORAGE SUBSYSTEMS MAY HANG IN LARGE ENVIRONMENT.

IBM Spectrum Control V5.2.10 (May 2016)
IBM Spectrum Control V5.2.10.1 (July 2016)
IBM Spectrum Control V5.2.11 (August 2016)
IBM Spectrum Control V5.2.12 (November 2016)
IBM Spectrum Control V5.2.13 (March 2017)
IBM Spectrum Control V5.2.14 (May 2017)
IBM Spectrum Control V5.2.15 (August 2017)
IBM Spectrum Control V5.2.15.2 (November 2017)
IBM Spectrum Control V5.2.16 (March 2018)
IBM Spectrum Control V5.2.17 (May 2018)

APAR status

• Closed as program error.

Error description

• In a environment with many SVC/Storwize/FlashSystems storage
  subsystems , it's possible to meet a hang situation due to high
  workload and wrong synchronization of the SVC event thread.
  This can be seen in the Java stack trace for the blocked
  threads:
  
  Waiting for Monitor Lock on
  com/ibm/tpc/monitor/SVCEventListener@0x00000000A6C3B0D8
  Java stack :
  at
  com/ibm/tpc/monitor/SVCEventListener.getCachedEventsData(SVCEven
  tListener.java:134)
  at
  com/ibm/tpc/monitor/NAPIEventProcessor.startEventPollWithEP(NAPI
  EventProcessor.java:645)
  at
  com/ibm/tpc/monitor/NAPIEventProcessor.run(NAPIEventProcessor.ja
  va:474)
  And many threads blocked with this description :
  Waiting for Monitor Lock on
  java/util/Hashtable@0x00000000A5287FF0
  at
  com/ibm/tpc/monitor/NAPIEventProcessor.notifyProbeStarted(NAPIEv
  entProcessor.java:931)
  at
  com/ibm/tpc/disk/collection/NAPIProbeDispatcherBase.process(NAPI
  ProbeDispatcherBase.java:240)
  at
  com/ibm/tpc/disk/collection/DiskProbeDispatcher.process(DiskProb
  eDispatcher.java:171)
  at com/ibm/tpc/Router.perform(Router.java:1111)
  at com/ibm/tpc/Router.perform(Router.java:612)
  at
  com/ibm/tpc/discovery/ProcessProcessor.process(ProcessProcessor.
  java:71)
  at
  com/ibm/tpc/infrastructure/threads/TPCThread.run(TPCThread.java:
  262)
  
  The following symptoms can be seen:
  - Running a new probe will indicate there is already one
  running.
  - Trying to open the probe log in the WEB-GUI will fail saying
  the probe job file doesn't exist.
  

Local fix

Problem summary

• ****************************************************************
  * USERS AFFECTED:                                              *
  * IBM Spectrum Control 5.2.8 and 5.2.9 users with SVC,         *
  * Storwize or FlashSystems storage.                            *
  ****************************************************************
  * PROBLEM DESCRIPTION:                                         *
  * See ERROR DESCRIPTION.                                       *
  ****************************************************************
  * RECOMMENDATION:                                              *
  * Apply fix maintenance when available.                        *
  ****************************************************************
  

Problem conclusion

• The fix for this APAR is targeted for the following maintenance
  package:
  
  | refresh pack | 5.2-TIV-TPC-RP0010 - target 2Q16
  
  Fixed in IBM Spectrum Control 5.2.10.
  
  http://www.ibm.com/support/docview.wss?&uid=swg21320822
  
  The target dates for future refresh packs do not represent a
  formal commitment by IBM. The dates are subject to change
  without notice.
  
  | MDVREGR 5.2-TIV-TPC-RP0008 |
  | MDVREGR 5.2-TIV-TPC-RP0009 |
  

Temporary fix

Comments

APAR Information

• APAR is sysrouted FROM one or more of the following:

• APAR is sysrouted TO one or more of the following:

Modules/Macros

• STORAGE
  

Fix information

• Fixed component name

  TPC ADVANCED

• Fixed component ID

  5608TPCA0

Applicable component levels

• R528 PSY

     UP

• R529 PSY

     UP