PI78044: EXPORT OF HIVE TABLES FAILS WITH DATA GREATER THAN 32 MB FAILS

APAR status

• Closed as fixed if next.

Error description

• While attempting to export a Hive table which has more than 32
  MB of Data in Hive 1.2.1, the following two JIRAs may be
  encountered:
  https://issues.apache.org/jira/browse/HIVE-11607
  https://issues.apache.org/jira/browse/HIVE-11820
  
  Symptoms include:
  java.io.IOException: Cannot get DistCp constructor:
  org.apache.hadoop.tools.DistCp.<init>()
   at
  org.apache.hadoop.hive.shims.Hadoop23Shims.runDistCp(Hadoop23Shi
  ms.java:1160)
   at
  org.apache.hadoop.hive.common.FileUtils.copy(FileUtils.java:553)
   at
  org.apache.hadoop.hive.ql.exec.CopyTask.execute(CopyTask.java:82
  )
  
  and
  
  2015-09-14 21:44:16,817 ERROR [main]: exec.Task
  (SessionState.java:printError(960)) - Failed with exception
  Skip CRC is valid only with update options
  java.lang.IllegalArgumentException: Skip CRC is valid only with
  update options
  
  being reported
  

Local fix

• Request Special Build for BigInsights 4.1 from IBM detailing
  this APAR.
  Fixed in BI 4.2 (Hive 1.2.1-IBM-19)
  

Problem summary

• Fixed in IBM IOP 4.2 (hive.1.2.1-IBM-19)
  

Problem conclusion

Temporary fix

Comments

APAR Information

• APAR is sysrouted FROM one or more of the following:

• APAR is sysrouted TO one or more of the following:

Modules/Macros

• Hive
  

Fix information

Applicable component levels

• R420 PSY

     UP