IBM Support

File connector using NativeHDFS fails with java.lang.NoSuchMethodError: org/apache/parquet/io/api/Binary.fromCharSequence(Ljava/lang/CharSequence;)

Troubleshooting


Problem

Writing parquet format file using NativeHDFS fails with  java.lang.NoSuchMethodError: org/apache/parquet/io/api/Binary.fromCharSequence(Ljava/lang/CharSequence;)

Symptom

Error in job log such as

File_Connector_0,0: java.lang.NoSuchMethodError: org/apache/parquet/io/api/Binary.fromCharSequence(Ljava/lang/CharSequence;)Lorg/apache/parquet/io/api/Binary; (loaded from file:/opt/cloudera/parquet/hive-exec-2.1.1.jar by sun.misc.Launcher$AppClassLoader@ddeca4c4) called from class org.apache.parquet.avro.AvroWriteSupport (loaded from file:/opt/cloudera/parquet/parquet-avro-1.9.0.jar by sun.misc.Launcher$AppClassLoader@ddeca4c4).
at org.apache.parquet.avro.AvroWriteSupport.fromAvroString (AvroWriteSupport.java: 367)
at org.apache.parquet.avro.AvroWriteSupport.writeValueWithoutConversion (AvroWriteSupport.java: 342)
at org.apache.parquet.avro.AvroWriteSupport.writeValue (AvroWriteSupport.java: 274)
at org.apache.parquet.avro.AvroWriteSupport.writeRecordFields (AvroWriteSupport.java: 187)
at org.apache.parquet.avro.AvroWriteSupport.write (AvroWriteSupport.java: 161)
at org.apache.parquet.hadoop.InternalParquetRecordWriter.write (InternalParquetRecordWriter.java: 121)
at org.apache.parquet.hadoop.ParquetWriter.write (ParquetWriter.java: 288)
at com.ibm.iis.jis.utilities.parquetds19.ParquetBuilder.write (ParquetBuilder.java: 460)
at com.ibm.iis.jis.utilities.dochandler.impl.OutputBuilder.write (OutputBuilder.java: 94)
at com.ibm.iis.cc.filesystem.FileSystem.writeFile (FileSystem.java: 948)
at com.ibm.iis.cc.filesystem.FileSystem.process (FileSystem.java: 827)
at com.ibm.is.cc.javastage.connector.CC_JavaAdapter.run (CC_JavaAdapter.java: 444)

Document Location

Worldwide

[{"Business Unit":{"code":"BU048","label":"IBM Software"},"Product":{"code":"SSZJPZ","label":"IBM InfoSphere Information Server"},"Component":"DataStage","Platform":[{"code":"PF016","label":"Linux"}],"Version":"11.7;11.7.1","Edition":"","Line of Business":{"code":"LOB76","label":"Data Platform"}}]

Log InLog in to view more of this document

This document has the abstract of a technical article that is available to authorized users once you have logged on. Please use Log in button above to access the full document. After log in, if you do not have the right authorization for this document, there will be instructions on what to do next.

Document Information

Modified date:
25 April 2025

UID

ibm10964678

Page Feedback