IBM Support

II14645: HIGH CPU, HIGH ECSA USAGE, SPIN LOOPS IN RSM. OCCURS WITH DB2 V10, AND AN OEM PRODUCT (SEE SCRATCH PAD) USING IARCP64

Subscribe to this APAR

By subscribing, you receive periodic emails alerting you to the status of the APAR, along with a link to the fix after it becomes available. You can track this item individually or track all items by product.

Notify me when this APAR changes.

Notify me when an APAR for this component changes.

 

APAR status

  • INTRAN

Error description

  • Upon migrating to DB2 V10 along with an OEM monitor product V5.0
(see scratch pad), the OEM product created 10s' of thousands of
high virtual private memory objects, via the IARCP64 interface
for creating 64bit cell pools.

When the OEM product attempted to clean up the cell pool(s) via
IARCP64 DELETE, spin loops and performance delays resulted,
affecting other components including, but not limited to, VTAM
and TCPIP.

Below is a sample image from the SYSTEM TRACE table showing the
issuance of the IARCP64 DELETE, followed by RSM's internal
issuance of the IARV64 (automatic), followed by other CPU's then
beginning to be affected by spin loops and performaance delays.

04-01AC 009BE900  PC ... IARCP64 DELETE caller @ 00_188F97

04-01AC 009BE900  PC     ...  Storage  Obtain
04-01AC 009BE900  SSRV   132  Storage  Obtain   08:15:52.389233
04-01AC 009BE900  PR     ...
04-01AC 009BE900  SUSP        00000000 00000000 08:15:52.389235
04-01AC 009BE900  DSP         00000001 00000000 08:15:52.389236
04-01AC 009BE900  PC     ...  IarV64
04-01AC 009BE900  SUSP        00000000 00000000 08:15:52.389239
04-01AC 009BE900  DSP         00000001 00000000 08:15:52.389473
04-01AC 009BE900  PC     ...  LocAscb
04-01AC 009BE900  PR     ...

A little more than a second later we see other CPUs begin to
ected by this, followed by an SSRV from RSM's IarV64 Detach in
4.

07 01AC 009BE240  SPIN LKX/S  08000000 00000000 08:15:53.438058
00 0034 009CED90  SPIN RI/S   80000001 00FAC100 08:15:53.438118
01 0006 009FCC68  SPIN RI/S   80000001 00000000 08:15:53.616804
0A 0001 051C5480  SPIN LKX/S  80000000 00000000 08:15:54.131919
08 00B0 03FE7600  SPIN LKX/S  80000001 00000000 08:15:54.131927
0B 00C6 009FE050  SPIN LKX/S  00000001 00000000 08:15:54.132906
05 0058 009FE050  SPIN LKX/S  00000001 00000000 08:15:54.132906
06 00B9 009FE050  SPIN LKX/S  00000001 00000000 08:15:54.132907
09 00D0 009FE050  SPIN LKX/S  00000001 00000000 08:15:54.132907
03 00E2 009FE050  SPIN LKX/S  80000005 00000000 08:15:54.132914
02 0025 0098D988  SPIN LKX/S  00000000 00000000 08:15:54.133766
04 ******** TIME-GAP OF OVER 00000003 SECS.     08:15:55.505938
04 01AC 009BE900  SSRV            IarV64 Detach 08:15:55.505938

The SSRV IARV64 Detach is the indication that the IARV64 issued
by RSM has completed, but the delays are the result of 10's of
thousands of Memory Objects having to be processed.  More than
75,000 memory objects (private) were seen in one of these
instances.

A temporary circumvention is to stop/restart the OEM product,
but a fix has been provided by the OEM (see scratch pad).

Local fix

  • Stop/Restart the OEM monitor product

Problem summary

  • 



Problem conclusion


    

  • 



Temporary fix


    

  • 



Comments


    

  • 



APAR Information




    

  • APAR number
    II14645
    • 

  • Reported component name
    V2 LIB INFO ITE
    • 

  • Reported component ID
    INFOV2LIB
    • 

  • Reported release
    001
    • 

  • Status
    INTRAN  
    • 

  • PE
    NoPE
    • 

  • HIPER
    NoHIPER
    • 

  • Special Attention
    NoSpecatt
    • 

  • Submitted date
    2012-05-14
    • 

  • Closed date
    • 

  • Last modified date
    2012-05-15
    • 





    

  • APAR is sysrouted FROM one or more of the following:
    

    • 

  • APAR is sysrouted TO one or more of the following:
    

    • 



Fix information


    



Applicable component levels


    








      
              
                            

              

              [{"Business Unit":{"code":"BU054","label":"Systems w\/TPS"},"Product":{"code":"SG19N","label":"APARs - OS\/390 environment"},"Component":"","ARM Category":[],"Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"001","Edition":"","Line of Business":{"code":"","label":""}},{"Business Unit":{"code":"BU054","label":"Systems w\/TPS"},"Product":{"code":"SG19M","label":"APARs - z\/OS environment"},"Component":"","ARM Category":[],"Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"001","Edition":"","Line of Business":{"code":"","label":""}},{"Business Unit":{"code":null,"label":null},"Product":{"code":"SG19O","label":"APARs - MVS environment"},"Component":"","ARM Category":[],"Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"001","Edition":"","Line of Business":{"code":"","label":""}},{"Business Unit":{"code":"BU054","label":"Systems w\/TPS"},"Product":{"code":"SSSN3L","label":"z\/OS Communications Server"},"Component":"","ARM Category":[],"Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"001","Edition":"","Line of Business":{"code":"LOB35","label":"Mainframe SW"}}]
              

                                                                    

          
 
        

      

    

      

        

          

            
Document Information


            

            


                        

            Modified date:
            

            15 May 2012
            

            
                      

        


        

        


      

    

  



    

  

  
    
            

          
Page Feedback