IBM Support

MA46307 - SQL-RUN-WAIT SQL SELECT QUERIES HANG. THE JOBS REMAINED IN END
STATUS. TASKINFO SHOWS A QGA-QUGATE WAIT OBJECT.

Subscribe to this APAR

By subscribing, you receive periodic emails alerting you to the status of the APAR, along with a link to the fix after it becomes available. You can track this item individually or track all items by product.

Notify me when this APAR changes.

Notify me when an APAR for this component changes.

 APAR (Authorized Program Analysis Report)

Abstract

SQL-RUN-WAIT SQL SELECT QUERIES HANG. THE JOBS REMAINED IN END
STATUS. TASKINFO SHOWS A QGA-QUGATE WAIT OBJECT.

Error Description

SELECT Queries hang, the jobs remained in END status. No        
joblog, no call stack available.                                
                                                               
TASKINFO showed                                                
Last dispatch timebase: 0009BAF64330594A (negative 'SinceRun'  
means task ran after this)                                      
***Dumping task (at breakpoint) on current logical processor    
TDE=B00150000FA70000 Name=MSTHREAD:QDBSRV12 QSYS 341851        
SinceRun=000:00:07.811351 CPU=000:00:00.057580 Pri=C0          
tdescr=004 WaitObject=C0DC5FE265000900 QQu-QuQueue              
WaitCaller=FFFFFFFFF76A8E8C module rirsServiceBreakpoint+0x46C  
InitialTDE=B00140000EBBB000                                    
REG1=C84FAF3EB2FFEEC0 NIA=FFFFFFFFFF6C0B24 module              
SkRefCount+0xC84                                                
..................... LR=FFFFFFFFFF6C0AE8 module                
SkRefCount+0xC48                                                
ISF=C84FAF3EB2FFEEC0 NIA=FFFFFFFFFF6C0B28 module                
SkRefCount+0xC88                                                
ISF=C84FAF3EB2FFF000 NIA=FFFFFFFFFCCC39CC module DbpmQds+0xCF8C
ISF=C84FAF3EB2FFF0C0 NIA=FFFFFFFFC9E39BDC module                
DbpmDataSource+0xCC1C                                          
ISF=C84FAF3EB2FFF120 NIA=FFFFFFFFC9E30D94 module                
DbpmDataSource+0x3DD4                                          
ISF=C84FAF3EB2FFF1A0 NIA=FFFFFFFFFCC5BDF8 module                
DbpmReadOnlyQuery+0x12D98                                      
ISF=C84FAF3EB2FFF300 NIA=FFFFFFFFFBCDFEB4 module                
DbopRunTimeInfo+0x574                                          
ISF=C84FAF3EB2FFF3E0 NIA=FFFFFFFFFBCE03AC module                
DbopRunTimeInfo+0xA6C                                          
ISF=C84FAF3EB2FFF460 NIA=FFFFFFFFCD818EB0 module                
DbServerBase+0xA30                                              
ISF=C84FAF3EB2FFF520 NIA=FFFFFFFFCD8192EC module                
DbServerBase+0xE6C                                              
ISF=C84FAF3EB2FFF680 NIA=FFFFFFFFCD7D8F10 module                
DbAsyncCall+0x1790                                              
ISF=C84FAF3EB2FFF840 NIA=FFFFFFFFFD21AD28 module dbmaint+0x1938
ISF=C84FAF3EB2FFF960 NIA=FFFFFFFFFF0050E8 module #cfmir+0xE8    
ISF=C84FAF3EB2FFFA20 NIA=FFFFFFFFFF0D1658 module cfscv0a+0x148  
ISF=EFDD9410FDFFFC60 NIA=02F4192AD500387C srvpgm                
QSYS/QQQOOOUPCL-QQQOOOUPCL:DbopThreadMain__FP14DbopThreadParm+0x
FC Stmt#=3                                                      
ISF=EFDD9410FDFFFDA0 NIA=1C66B184B400B36C srvpgm                
QSYS/QLESPI-QLECRTTH:LE_Create_Thread2__FP12crtth_parm_t+0x21C  
Stmt#=20                                                        
ISF=EFDD9410FDFFFEE0 NIA=FFFFFFFFFFFF81D0 module #cfcblat+0x1D0
ISF=C84FAF3EB2FFFA80 NIA=FFFFFFFFFE1A12B8 module                
AiUpcallPortalMach+0xC8                                        
ISF=C84FAF3EB2FFFCC0 NIA=FFFFFFFFC227D934 module                
pminitiatethread+0x2C24                                        
ISF=C84FAF3EB2FFFF20 NIA=0000000000000000 Not valid instruction
address                                                        
Stack unwind complete                                          
                                                               
The wait object gate show it was locked by DbopPlanSubCache    

Problem Summary

****************************************************************
* PROBLEM: (MA46307) Licensed Program = 5770999 for i 7.1,     *
*                                        i 7.2, and i 7.3      *
*           Job Hang Requiring an IPL to Recover               *
****************************************************************
* USERS AFFECTED: All IBM i operating system users.            *
****************************************************************
* RECOMMENDATION: Apply LIC PTF MF63507 for i 7.1.             *
*                 Apply LIC PTF MF63459 for i 7.2.             *
*                 Apply LIC PTF MF63506 for i 7.3.             *
****************************************************************
SELECT Queries hang, the jobs remained in END status. No joblog,
no call stack available.                                        
                                                               
TASKINFO showed                                                
Last dispatch timebase: 0009BAF64330594A (negative 'SinceRun'  
means task ran after this)                                      
***Dumping task (at breakpoint) on current logical processor    
TDE=B00150000FA70000 Name=MSTHREAD:QDBSRV12 QSYS 341851        
SinceRun=000:00:07.811351 CPU=000:00:00.057580 Pri=C0 tdescr=004
WaitObject=C0DC5FE265000900 QQu-QuQueue                        
WaitCaller=FFFFFFFFF76A8E8C module rirsServiceBreakpoint+0x46C  
InitialTDE=B00140000EBBB000                                    
REG1=C84FAF3EB2FFEEC0 NIA=FFFFFFFFFF6C0B24 module              
SkRefCount+0xC84                                                
..................... LR=FFFFFFFFFF6C0AE8 module                
SkRefCount+0xC48                                                
ISF=C84FAF3EB2FFEEC0 NIA=FFFFFFFFFF6C0B28 module                
SkRefCount+0xC88                                                
ISF=C84FAF3EB2FFF000 NIA=FFFFFFFFFCCC39CC module DbpmQds+0xCF8C
ISF=C84FAF3EB2FFF0C0 NIA=FFFFFFFFC9E39BDC module                
DbpmDataSource+0xCC1C                                          
ISF=C84FAF3EB2FFF120 NIA=FFFFFFFFC9E30D94 module                
DbpmDataSource+0x3DD4                                          
ISF=C84FAF3EB2FFF1A0 NIA=FFFFFFFFFCC5BDF8 module                
DbpmReadOnlyQuery+0x12D98                                      
ISF=C84FAF3EB2FFF300 NIA=FFFFFFFFFBCDFEB4 module                
DbopRunTimeInfo+0x574                                          
ISF=C84FAF3EB2FFF3E0 NIA=FFFFFFFFFBCE03AC module                
DbopRunTimeInfo+0xA6C                                          
ISF=C84FAF3EB2FFF460 NIA=FFFFFFFFCD818EB0 module                
DbServerBase+0xA30                                              
ISF=C84FAF3EB2FFF520 NIA=FFFFFFFFCD8192EC module                
DbServerBase+0xE6C                                              
ISF=C84FAF3EB2FFF680 NIA=FFFFFFFFCD7D8F10 module                
DbAsyncCall+0x1790                                              
ISF=C84FAF3EB2FFF840 NIA=FFFFFFFFFD21AD28 module dbmaint+0x1938
ISF=C84FAF3EB2FFF960 NIA=FFFFFFFFFF0050E8 module #cfmir+0xE8    
ISF=C84FAF3EB2FFFA20 NIA=FFFFFFFFFF0D1658 module cfscv0a+0x148  
ISF=EFDD9410FDFFFC60 NIA=02F4192AD500387C srvpgm                
QSYS/QQQOOOUPCL-QQQOOOUPCL:DbopThreadMain__FP14DbopThreadParm+0x
FC Stmt#=3                                                      
ISF=EFDD9410FDFFFDA0 NIA=1C66B184B400B36C srvpgm                
QSYS/QLESPI-QLECRTTH:LE_Create_Thread2__FP12crtth_parm_t+0x21C  
Stmt#=20                                                        
ISF=EFDD9410FDFFFEE0 NIA=FFFFFFFFFFFF81D0 module #cfcblat+0x1D0
ISF=C84FAF3EB2FFFA80 NIA=FFFFFFFFFE1A12B8 module                
AiUpcallPortalMach+0xC8                                        
ISF=C84FAF3EB2FFFCC0 NIA=FFFFFFFFC227D934 module                
pminitiatethread+0x2C24                                        
ISF=C84FAF3EB2FFFF20 NIA=0000000000000000 Not valid instruction
address                                                        
Stack unwind complete                                          

Problem Conclusion

During the processing of the cancellation of an SMP query a    
cancellable wait may be entered briefly.  If the executing job  
is ended, then a resource in the query execution object (QEO)  
may remain held.  When that QEO is destroyed in a QDBSRVnn      
thread, it may result in that thread hanging on the stacks      
posted below.  If this happens enough times, all of the server  
threads may become hung in different objects in this state.  At
that point, without any server threads to perform normal SQE    
work, new queries may begin to hang.                            
                                                               
The fix associated with this defect is to ensure that the      
resource is released in this situation.                        

Temporary Fix

                       *********                                
                       * HIPER *                                
                       *********                                

Comments

Circumvention


PTFs Available

R710 MF63507 PTF Cover Letter   7192
R720 MF63459 PTF Cover Letter   7290
R730 MF63506 PTF Cover Letter   7283

Affected Modules

         
         

Affected Publications

Summary Information

Status............................................ CLOSED PER
HIPER........................................... Yes
Component.................................. 9400DG3DB
Failing Module.......................... RCHMGR
Reported Release................... R720
Duplicate Of..............................




System i Support

IBM disclaims all warranties, whether express or implied, including, but not limited to, the implied warranties of merchantability and fitness for a particular purpose. By furnishing this document, IBM grants no licenses to any related patents or copyrights. Copyright © 1996,1997,1998, 1999, 2000, 2001, 2002, 2003, 2004, 2005, 2006, 2007, 2008, 2009, 2010, 2011, 2012, 2013, 2014, 2015, 2016, 2017 IBM Corporation. Any trademarks and product or brand names referenced in this document are the property of their respective owners. Consult the Terms of use link for trademark information

[{"Business Unit":{"code":"BU054","label":"Systems w\/TPS"},"Product":{"code":"SG15Q","label":"APARs - OS\/400 General"},"Component":"","ARM Category":[],"Platform":[{"code":"PF012","label":"IBM i"}],"Version":"V7R1M0;V7R2M0;V7R3M0","Edition":"","Line of Business":{"code":"","label":""}},{"Business Unit":{"code":"BU054","label":"Systems w\/TPS"},"Product":{"code":"SG16C","label":"APARs - IBM i 7.1 environment"},"Component":"","ARM Category":[],"Platform":[{"code":"PF012","label":"IBM i"}],"Version":"V7R1M0;V7R2M0;V7R3M0","Edition":"","Line of Business":{"code":"","label":""}},{"Business Unit":{"code":"BU054","label":"Systems w\/TPS"},"Product":{"code":"SG16E","label":"APARs - IBM i 7.2 environment"},"Component":"","ARM Category":[],"Platform":[{"code":"PF012","label":"IBM i"}],"Version":"V7R1M0;V7R2M0;V7R3M0","Edition":"","Line of Business":{"code":"","label":""}},{"Business Unit":{"code":"BU054","label":"Systems w\/TPS"},"Product":{"code":"SG16G","label":"APARs - IBM i 7.3 environment"},"Component":"","ARM Category":[],"Platform":[{"code":"PF012","label":"IBM i"}],"Version":"V7R1M0;V7R2M0;V7R3M0","Edition":"","Line of Business":{"code":"","label":""}}]

Document Information

Modified date:
28 October 2017