Question & Answer
Why do InfoSphere Streams HDFS operators fail to connect to Hadoop?
There are three scenarios when Streams is an external client and the explicit namenode URL is not visible.
- A private network,
- a public network with a namenode high availability,
When the explicit namenode URL is not visible you must use the webhdfs schema with a credential file as explained in the hdfsUri and credFile sections of:
- () as HDFS2FileSink_1 = HDFS2FileSink(Tuple_out0 as inPort0Alias)
file : "/user/biadmin/StreamsTst.txt" ;
hdfsUser : "<ValidUser>" ;
hdfsUri : "webhdfs://<host:port>" ;
credFile : "<path>/credfile.txt" ;
16 June 2018