IBM Support

IT12871: LOAD HITTING OUT OF MEMORY ERROR IN SOME SPECIFIC POINT MAY LEAD TO AN INSTANCE CRASH.

Subscribe

You can track all active APARs for this component.

 

APAR status

  • Closed as fixed if next.

Error description

  • This APAR addresses 2 specific LOAD crashes that occur when LOAD
    fails very early in a specific place in its codepath.  The
    failure is typically out of memory, which is a
    configuration/tuning or usage issue (e.g. starting too many
    concurrent LOADs at the same time) that need to be addressed so
    that LOAD will not fail at those early point.  Nonetheless if we
    hit these 2 failures LOAD should fail gracefully instead of
    crash.
    
    
    (1) db2diag.log has these entries
    
    2015-08-21-11.39.56.625889-300 I15913948A604        LEVEL: Error
    PID     : 20840488             TID : 37859          PROC :
    db2sysc 0
    INSTANCE: db2inst1             NODE : 000           DB   :
    DB2MYDB
    APPHDL  : 0-7659               APPID:
    157.157.157.157.40585.150821163850
    AUTHID  : DBAMYID              HOSTNAME: host1111.ibm.com
    EDUID   : 37859                EDUNAME: db2agent (PRSDEV) 0
    FUNCTION: DB2 UDB, database utilities, sqluReportErrToDiag,
    probe:0
    DATA #1 : String, 107 bytes
    LOADID: 37859.2015-08-21-11.38.51.241917.0 (10;41)
     , -1961951227, 0, Detected in file:sqluvld.C, Line:9232
    
    2015-08-21-11.39.56.626433-300 I15914553A604        LEVEL: Error
    PID     : 20840488             TID : 37859          PROC :
    db2sysc 0
    INSTANCE: db2inst1             NODE : 000           DB   :
    DB2MYDB
    APPHDL  : 0-7659               APPID:
    157.157.157.157.40585.150821163850
    AUTHID  : DBAMYID              HOSTNAME: host1111.ibm.com
    EDUID   : 37859                EDUNAME: db2agent (PRSDEV) 0
    FUNCTION: DB2 UDB, database utilities, sqluReportErrToDiag,
    probe:0
    DATA #1 : String, 107 bytes
    LOADID: 37859.2015-08-21-11.38.51.241917.0 (10;41)
     , -1961951227, 0, Detected in file:sqluvld.C, Line:1381
    
    
    and stack trace in the trap file is like this (may vary with
    different platforms)
    
    Signal #11 (SIGSEGV): si_addr is 0x0000000000000000, si_code is
    0x00000033 (SEGV_ACCERR:Invalid permissions for mapped object.)
    
    0x09000000098492EC
    sqluvload__FPUcT1P9SQLP_LSN8P7sqlubmhUcP26sqluCLoadRequestDescri
    ptorP13SQLUVLCB_TYPEPi + 0xCFC
    0x0900000009846334
    @161@call_sqluvload__FP8sqeAgentP12SQLB_GLOBALSP26sqluCLoadReque
    stDescriptorP20SQLU_LOADAPI_LOAD_CBiT5PiT7 + 0x184
    0x0900000009845B78
    sqluLoadPartition__FP8sqeAgentP26sqluCLoadRequestDescriptoriN23P
    iT6 + 0x6C4
    ...
    
    
    
    (2) db2diag.log has these entries
    
    2015-08-21-11.39.56.285888-300 I15795397A497        LEVEL: Error
    PID     : 20840488             TID : 139303         PROC :
    db2sysc 0
    INSTANCE: db2inst1             NODE : 000
    HOSTNAME: host1111.ibm.com
    EDUID   : 139303               EDUNAME: db2lurex 0
    FUNCTION: DB2 UDB, database utilities, sqluReportErrToDiag,
    probe:0
    DATA #1 : String, 138 bytes
    LOADID: 63470.2015-08-21-11.38.18.081108.0 (64;4)
    Cannot allocate sqeAgent:  , 0, ffffffff8b0f0005, Detected in
    file:sqluedus.C, Line:1408
    
    2015-08-21-11.39.56.286268-300 I15795895A645        LEVEL: Error
    PID     : 20840488             TID : 139303         PROC :
    db2sysc 0
    INSTANCE: db2inst1             NODE : 000
    HOSTNAME: host1111.ibm.com
    EDUID   : 139303               EDUNAME: db2lurex 0
    FUNCTION: DB2 UDB, database utilities, sqluCEdu::iInitialize,
    probe:2490
    MESSAGE : ZRC=0x8B0F0005=-1961951227=SQLO_NOMEM_UTILH
              "No memory available in 'Backup/Restore/Util Heap'"
              DIA8327C No memory available in the utility heap.
    DATA #1 : LOADID, PD_TYPE_LOADID, 49 bytes
    LOADID: 63470.2015-08-21-11.38.18.081108.0 (64;4)
    DATA #2 : File name, 10 bytes
    sqluedus.C
    
    2015-08-21-11.39.56.287284-300 I15796541A657        LEVEL: Error
    PID     : 20840488             TID : 139303         PROC :
    db2sysc 0
    INSTANCE: db2inst1             NODE : 000
    HOSTNAME: host1111.ibm.com
    EDUID   : 139303               EDUNAME: db2lurex 0
    FUNCTION: DB2 UDB, database utilities,
    sqluCUserExit::iInitialize, probe:2166
    MESSAGE : ZRC=0x8B0F0005=-1961951227=SQLO_NOMEM_UTILH
              "No memory available in 'Backup/Restore/Util Heap'"
              DIA8327C No memory available in the utility heap.
    DATA #1 : LOADID, PD_TYPE_LOADID, 49 bytes
    LOADID: 63470.2015-08-21-11.38.18.081108.0 (64;4)
    DATA #2 : File name, 17 bytes
    sqlusUserExitSA.C
    
    2015-08-21-11.39.56.287966-300 I15797199A641        LEVEL: Error
    PID     : 20840488             TID : 139303         PROC :
    db2sysc 0
    INSTANCE: db2inst1             NODE : 000
    HOSTNAME: host1111.ibm.com
    EDUID   : 139303               EDUNAME: db2lurex 0
    FUNCTION: DB2 UDB, database utilities, sqluLoadEDUDriver,
    probe:2717
    MESSAGE : ZRC=0x8B0F0005=-1961951227=SQLO_NOMEM_UTILH
              "No memory available in 'Backup/Restore/Util Heap'"
              DIA8327C No memory available in the utility heap.
    DATA #1 : LOADID, PD_TYPE_LOADID, 49 bytes
    LOADID: 63470.2015-08-21-11.38.18.081108.0 (64;4)
    DATA #2 : File name, 10 bytes
    sqluedus.C
    
    2015-08-21-11.39.56.288738-300 I15797841A1289       LEVEL: Error
    PID     : 20840488             TID : 139303         PROC :
    db2sysc 0
    INSTANCE: db2inst1             NODE : 000
    HOSTNAME: host1111.ibm.com
    EDUID   : 139303               EDUNAME: db2lurex 0
    FUNCTION: DB2 UDB, database utilities, sqluCUserExit::iCleanUp,
    probe:2293
    MESSAGE : ZRC=0x8015006D=-2146107283=SQLU_CA_BUILT
              "SQLCA has already been built"
    DATA #1 : LOADID, PD_TYPE_LOADID, 49 bytes
    LOADID: 63470.2015-08-21-11.38.18.081108.0 (64;4)
    DATA #2 : SQLCA, PD_DB2_TYPE_SQLCA, 136 bytes
    0x000000013B43A448 : 0000 0000 0000 0000 0000 0000 FFFF F80A
    ................
    0x000000013B43A458 : 0000 0000 0000 0000 0000 0000 0000 0000
    ................
    0x000000013B43A468 : 0000 0000 0000 0000 0000 0000 0000 0000
    ................
    0x000000013B43A478 : 0000 0000 0000 0000 0000 0000 0000 0000
    ................
    0x000000013B43A488 : 0000 0000 0000 0000 0000 0000 0000 0000
    ................
    0x000000013B43A498 : 0000 0000 0000 0000 5351 4C55 5552 4558
    ........SQLUUREX
    0x000000013B43A4A8 : 8015 006D 0000 0000 0000 0000 0000 0000
    ...m............
    0x000000013B43A4B8 : 0000 0000 0000 0000 0000 0000 0000 0000
    ................
    0x000000013B43A4C8 : 0000 0000 0000 0000
    ........
    
    2015-08-21-11.39.57.803193-300 I16752402A434        LEVEL:
    Warning
    PID     : 20840488             TID : 139303         PROC :
    db2sysc 0
    INSTANCE: db2inst1             NODE : 000
    HOSTNAME: host1111.ibm.com
    EDUID   : 139303               EDUNAME: db2lurex 0
    FUNCTION: DB2 UDB, RAS/PD component,
    pdEDUIsInDB2KernelOperation, probe:600
    DATA #1 : String, 35 bytes
     iCleanUp__22sqlusCUserExitSubAgent
    DATA #2 : String, 4 bytes
    sqlu
    
    
    and stack trace in the trap file is like this (may vary with
    different platforms) (Note: analysis indicates
    sqlusCUserExitSubAgent::iCleanUp() calls
    sqluCSubAgent::iCleanUp() which dereferences a NULL
    m_pStaticData.   sqluCSubAgent::iCleanUp() may or may not show
    up in the stack due to compiler optimization)
    
    0x0900000006F23814 iCleanUp__22sqlusCUserExitSubAgentFv + 0x114
    0x0900000006F24478 iCleanUp__13sqluCUserExitFi + 0x450
    0x0900000007804CBC sqluLoadEDUDriver__FPUcUi + 0x3D8
    0x0900000009BF477C sqloEDUEntry + 0x4A8
    

Local fix

  • Adjust configuration/tuning/usage so that LOAD will not fail
    with out of memory at those early points.
    

Problem summary

  • ****************************************************************
    * USERS AFFECTED:                                              *
    * ALL                                                          *
    ****************************************************************
    * PROBLEM DESCRIPTION:                                         *
    * See Error Description                                        *
    ****************************************************************
    * RECOMMENDATION:                                              *
    * See SYSROUTE APARs to see where this APAR is addressed       *
    ****************************************************************
    

Problem conclusion

Temporary fix

Comments

APAR Information

  • APAR number

    IT12871

  • Reported component name

    DB2 FOR LUW

  • Reported component ID

    DB2FORLUW

  • Reported release

    A50

  • Status

    CLOSED FIN

  • PE

    NoPE

  • HIPER

    NoHIPER

  • Special Attention

    NoSpecatt / Xsystem

  • Submitted date

    2015-12-20

  • Closed date

    2017-05-09

  • Last modified date

    2017-05-09

  • APAR is sysrouted FROM one or more of the following:

  • APAR is sysrouted TO one or more of the following:

Fix information

Applicable component levels

  • RA50 PSN

       UP

[{"Business Unit":{"code":"BU048","label":"IBM Software"},"Product":{"code":"SSEPGG","label":"DB2 for Linux, UNIX and Windows"},"Component":"","ARM Category":[],"Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"10.5","Edition":"","Line of Business":{"code":"LOB10","label":"Data and AI"}}]

Document Information

Modified date:
09 May 2017