IBM Support

PH24714: SQL0973N NOT ENOUGH STORAGE AVAILABLE IN THE "BIGSQL IO" HEAP RESULTS IN HANG OR SUBSEQUENT SQL5199N ERRORS

Subscribe

You can track all active APARs for this component.

 

APAR status

  • Closed as fixed if next.

Error description

  • Big SQL hits an out of memory (OOM) condition.
.
This OOM is triggered by a slow leak where the java side runs
out of memory after many queries or scans.  Each scan leaves
a small object that stays on the heap without getting garbage
collected.  The main symptom is seeing a significant amount
of ThreadGroup objects (for example, in one case, more than 2
million objects) as the top consumers in the java heap dump.
.
The following stack trace is observed in db2diag.log
file:
.
java.lang.OutOfMemoryError: Java heap space
 at
parquet.hadoop.ParquetFileReader$ConsecutiveChunkList.readAll(Pa
rquetFileR
eader.java:755)
 at
parquet.hadoop.ParquetFileReader.readNextRowGroup(ParquetFileRea
der.java:494)
 at com.ibm.biginsights.bigsql
.dfsrw.reader.parquet.DfsVectorizedParquetRecordReader.checkEndO
fRowGroup(DfsVectorizedParquetRecordReader.java:440)
 at com.ibm
.biginsights.bigsql.dfsrw.reader.parquet.DfsVectorizedParquetRec
ordReader.nextBatch(DfsVectorizedParquetRecordReader.java:411)
at
com.ibm.biginsights.bigsql.dfsrw.reader.parquet.DfsVectorizedPar
quetRecordReader.next(DfsVectorizedParquetRecordReader.java:340)
 at
com.ibm.biginsights.bigsql.dfsrw.reader.parquet.DfsParquetSplit2
Batch.split2Batch(DfsParquetSplit2Batch.java:98)
 at
com.ibm.biginsights.bigsql.dfsrw.jaro.DfsSplitManager$SplitRunna
ble.run(DfsSplitManager.java:123)
 at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExec
utor.java:1160)
 at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExe
cutor.java:635)
 at java.lang.Thread.run(Thread.java:785)
 at
com.ibm.biginsights.bigsql.dfsrw.jaro.DfsSplit2BatchThread.run(D
fsSplit2BatchThread.java:58)

Local fix

  • 



Problem summary


    

  • Please see problem description.

    



Problem conclusion


    

  • 



Temporary fix


    

  • 



Comments


    

  • 



APAR Information




    

  • APAR number
    PH24714
    • 

  • Reported component name
    IBM BIG SQL
    • 

  • Reported component ID
    5737E7400
    • 

  • Reported release
    504
    • 

  • Status
    CLOSED  FIN
    • 

  • PE
    NoPE
    • 

  • HIPER
    NoHIPER
    • 

  • Special Attention
    NoSpecatt / Xsystem
    • 

  • Submitted date
    2020-04-22
    • 

  • Closed date
    2020-09-09
    • 

  • Last modified date
    2020-09-09
    • 





    

  • APAR is sysrouted FROM one or more of the following:
    

    • 

  • APAR is sysrouted TO one or more of the following:
    

    • 



Fix information


    



Applicable component levels


    








      
              
                            

              

              [{"Line of Business":{"code":"LOB10","label":"Data and AI"},"Business Unit":{"code":"BU059","label":"IBM Software w\/o TPS"},"Product":{"code":"SSCRJT","label":"IBM Db2 Big SQL"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"504"}]
              

                                                                    

          
 
        

      

    

      

        

          

            
Document Information


            

            


                        

            Modified date:
            

            10 September 2020
            

            
                      

        


        

        


      

    

  



    

  

  
    
            

          
Page Feedback