PI37627: USE UNSUPPORTED DATA TYPE WITH PARQUET TABLES BREAKS BIGR.

APAR status

• Closed as program error.

Error description

• This is the error in BigR:
  
  bfdrive <-
  bigr.frame(dataSource="BIGSQL",dataPath="drive_parquet.drive_eve
  nt_fact");
  Error: BigR[.bigr.jdbc.query.helper]: Error code : -1, SQLState
  : 02001
  Caused by : originating expression ends at hcat (line: 1078,
  column: 36): java.lang.UnsupportedOperationException: Timestamp
  type not implemented
   originating expression ends at hcat (line: 1078, column: 36)
          at com.ibm.jaql.lang.expr.core.Expr.iter(Expr.java:920)
          at
  com.ibm.jaql.lang.expr.core.BindingExpr.iterRaw(BindingExpr.java
  :282)
          at com.ibm.jaql.lang.expr.core.Expr.iter(Expr.java:901)
          at
  com.ibm.jaql.lang.expr.core.FilterExpr.iterRaw(FilterExpr.java:3
  62)
          at com.ibm.jaql.lang.expr.core.Expr.iter(Expr.java:901)
          at
  com.ibm.jaql.lang.expr.top.QueryExpr.iterRaw(QueryExpr.java:115)
          at com.ibm.jaql.lang.expr.core.Expr.iter(Expr.java:901)
          at
  com.ibm.jaql.lang.ParsedJaql.iter(ParsedJaql.java:241)
          at
  com.ibm.biginsights.bigsql.jdbc.driver.service.JaqlQueryProcesso
  r.execute2(JaqlQueryProcessor.java:121)
          at
  com.ibm.biginsights.bigsql.jdbc.driver.service.JaqlQueryProcesso
  r.execute(JaqlQueryProcessor.java:88)
  
  In the bigsql.log,  this is the exception:
  
  Caused by: java.lang.UnsupportedOperationException: Timestamp
  type not implemented
          at
  parquet.hive.convert.HiveSchemaConverter.convertType(HiveSchemaC
  onverter.java:91)
          at
  parquet.hive.convert.HiveSchemaConverter.convertType(HiveSchemaC
  onverter.java:70)
          at
  parquet.hive.convert.HiveSchemaConverter.convertTypes(HiveSchema
  Converter.java:63)
          at
  parquet.hive.convert.HiveSchemaConverter.convert(HiveSchemaConve
  rter.java:50)
          at
  parquet.hive.serde.ParquetHiveSerDe.initialize(ParquetHiveSerDe.
  java:120)
          at
  com.seagate.atlas.updates.UpdSerde.initialize(UpdSerde.java:162)
  
          at
  org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(
  MetaStoreUtils.java:218)
          at
  org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_fi
  elds(HiveMetaStore.java:2483)
  
  This was due to custom SerDe that customer is using doesn't
  support the timestamp data type.  Therefore, JaQL is failing
  and hence the error in BigR.
  
  RTC defect 91419 has created to track this issue.
  

Local fix

Problem summary

• See Error Description
  

Problem conclusion

• This problem is fixed in Version 3.0.0.1+customer fix and later
  fix packs
  

Temporary fix

Comments

APAR Information

• APAR is sysrouted FROM one or more of the following:

• APAR is sysrouted TO one or more of the following:

Fix information

• Fixed component name

  INFO BIGINSIGHT

• Fixed component ID

  5725C0900

Applicable component levels

• R300 PSY

     UP