IBM Support

DataStage BDFS stage gets error 255 connecting to remote hadoop/hdfs server

Troubleshooting


Problem

DataStage job with the Big Data File System (BDFS) stage fails with following error when attempting connection to remote hadoop file system via local BigInsights client: Message: BDFS_0,0: Unable to connect to hdfs host myhost.domain.com on port 50111: Unknown error 255.

Symptom


Examples of some other error messages and exceptions associated with HDFS unknown error 255:

Write of hdfs file failed: Unknown error 255.

Unable to connect to hdfs host 153.11.11.161 on port 8020: Unknown error 255.

SEVERE: PriviledgedActionException as:testdata
cause:java.io.IOException: Call to myhost12.mydomain.com/153.11.22.150:50111 failed on local
exception: java.io.EOFException
at org.apache.hadoop.ipc.Client.wrapException(Client.java:1129)
at org.apache.hadoop.ipc.Client.call(Client.java:1097)
at $Proxy1.getProtocolVersion(Unknown Source)
at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:411)
at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:325)
...
Caused by: java.io.EOFException

Exception in thread "main" java.io.IOException: Could not get block locations. Source file "/user/testdata/testfile.dat" - Aborting...
at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.processDatanodeError
at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$2200

DataStreamer Exception: java.nio.channels.UnresolvedAddressException
at sun.nio.ch.Net.checkAddress(Net.java:29)


Note that when an exception is passed back to DataStage job from HDFS library routines, the each line of exception stay trace may be logged as a separate DataStage event message, so a single exception as shown above may be spread out over many messages in the log file rather than appearing exactly as above.

[{"Product":{"code":"SSVSEF","label":"IBM InfoSphere DataStage"},"Business Unit":{"code":"BU048","label":"IBM Software"},"Component":"--","Platform":[{"code":"PF016","label":"Linux"}],"Version":"9.1;8.7","Edition":"","Line of Business":{"code":"LOB76","label":"Data Platform"}}]

Log InLog in to view more of this document

This document has the abstract of a technical article that is available to authorized users once you have logged on. Please use Log in button above to access the full document. After log in, if you do not have the right authorization for this document, there will be instructions on what to do next.

Document Information

Modified date:
25 April 2025

UID

swg21632839

Page Feedback