IBM Support

JR61272: JOB ABORTS WITH JAVA CORE IF PARTITIONED WRITE BATCH SIZE>1 AND BATCHMECHANISM IS THE DEFAULT MULTIROWINSERT WITH HIVE CONNECTOR

Subscribe to this APAR

By subscribing, you receive periodic emails alerting you to the status of the APAR, along with a link to the fix after it becomes available. You can track this item individually or track all items by product.

Notify me when this APAR changes.

Notify me when an APAR for this component changes.

 

APAR status

  • Closed as program error.

Error description

  • Job aborts with java core if partitioned write, batch size > 1
and BatchMechanism is the default multiRowInsert with Hive
connector.
The exception in the logs can be observed:

java.sql.SQLException: [IBM][Hive JDBC Driver]The requested
parameter metadata is not available for the current statement.
 at com.ibm.isf.jdbc.hivebase.ddcj.a(Unknown Source)
 at com.ibm.isf.jdbc.hivebase.ddcj.a(Unknown Source)
 at com.ibm.isf.jdbc.hivebase.ddcj.a(Unknown Source)
 at com.ibm.isf.jdbc.hivebase.dddp.b(Unknown Source)
 at com.ibm.isf.jdbc.hivebase.dddm.getParameterType(Unknown
Source)
 at
com.ibm.is.cc.hive.HiveRecordDataSetConsumer.setupOperation(Hive
RecordDataSetConsumer.java:1777)
 at
com.ibm.is.cc.hive.HiveRecordDataSetConsumer.prepare(HiveRecordD
ataSetConsumer.java:2074)
 at
com.ibm.is.cc.hive.HiveBigBufferRecordDataSetConsumer.prepare(Hi
veBigBufferRecordDataSetConsumer.java:210)

Local fix

  • set BatchMechanism=nativeBatch property in connection URL

Problem summary

  • ****************************************************************
USERS AFFECTED:
Users using Hive connector with partitioned writes
****************************************************************
PROBLEM DESCRIPTION:
Job aborts with java core if partitioned write, batch size > 1
and BatchMechanism is the default multiRowInsert with Hive
connector. The exception in the logs can be observed:
java.sql.SQLException: [IBM][Hive JDBC Driver]The requested
parameter metadata is not available for the current statement.
at com.ibm.isf.jdbc.hivebase.ddcj.a(Unknown Source)
at ibm.ibm.isf.jdbc.hivebase.ddcj.a(Unknown Source)
at com.ibm.isf.jdbc.hivebase.ddcj.a(Unknown Source)
at com.ibm.isf.jdbc.hivebase.dddp.b(Unknown Source)
at com.ibm.isf.jdbc.hivebase.dddm.getParameterType(Unknown
Source)
at
com.ibm.is.cc.hive.HiveRecordDataSetConsumer.setupOperation(Hive
RecordDataSetConsumer.java:1777)
at
com.ibm.is.cc.hive.HiveRecordDataSetConsumer.prepare(HiveRecordD
ataSetConsumer.java:2074)
at
com.ibm.is.cc.hive.HiveBigBufferRecordDataSetConsumer.prepare(Hi
veBigBufferRecordDataSetConsumer.java:210)
****************************************************************
RECOMMENDATION
Install patch JR61272
****************************************************************

Problem conclusion

  • Hive connector code has been altered to support partitioned
writes and generated SQL

Temporary fix

  • 



Comments


    

  • 



APAR Information




    

  • APAR number
    JR61272
    • 

  • Reported component name
    WIS DATASTAGE
    • 

  • Reported component ID
    5724Q36DS
    • 

  • Reported release
    B70
    • 

  • Status
    CLOSED  PER
    • 

  • PE
    NoPE
    • 

  • HIPER
    NoHIPER
    • 

  • Special Attention
    NoSpecatt / Xsystem
    • 

  • Submitted date
    2019-07-10
    • 

  • Closed date
    2019-10-18
    • 

  • Last modified date
    2019-10-18
    • 





    

  • APAR is sysrouted FROM one or more of the following:
    

    • 

  • APAR is sysrouted TO one or more of the following:
    

    • 



Fix information


    

  • Fixed component name
    WIS DATASTAGE
    • 

  • Fixed component ID
    5724Q36DS
    • 



Applicable component levels


    

  • RB50  PSY
       UP
    • 

  • RB70  PSY
       UP
    • 

  • RB71  PSY
       UP
    • 








      
              
                            

              

              [{"Business Unit":{"code":"BU059","label":"IBM Software w\/o TPS"},"Product":{"code":"SSVSEF","label":"IBM InfoSphere DataStage"},"Component":"","ARM Category":[],"Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"11.7","Edition":"","Line of Business":{"code":"LOB10","label":"Data and AI"}}]
              

                                                                    

          
 
        

      

    

      

        

          

            
Document Information


            

            


                        

            Modified date:
            

            18 October 2019
            

            
                      

        


        

        


      

    

  



    

  

  
    
            

          
Page Feedback