Topic
  • 3 replies
  • Latest Post - ‏2013-12-26T17:39:17Z by lmontani
willthrash
willthrash
1 Post

Pinned topic BigInsights Enterprise Edition 2.1.0.1 install failure

‏2013-11-12T14:06:01Z |

My BigInsights install is successful until it fails at:

 

[INFO] @localhost - Deploy ... hdm, force
[INFO] @localhost - Deploy ... ihc-conf@localhost, force
[INFO] @localhost - Deploy ... ihc, force
[INFO] Progress - 25%
[ERROR] @localhost - java.lang.Exception
at com.ibm.xap.mgmt.util.TaskRunner.run(TaskRunner.java:65)
at com.ibm.xap.mgmt.hdm.HadoopMgmtFacade.deploy(HadoopMgmtFacade.java:389)
at com.ibm.xap.mgmt.hdm.HadoopMgmtFacade.deploy(HadoopMgmtFacade.java:414)
at com.ibm.xap.mgmt.hdm.HadoopMgmtFacade.deployForceAll(HadoopMgmtFacade.java:364)
at com.ibm.xap.mgmt.hdm.HadoopMgmtCmdline.run(HadoopMgmtCmdline.java:110)
at com.ibm.xap.mgmt.hdm.HadoopMgmtCmdline.main(HadoopMgmtCmdline.java:36)

java.io.IOException: Failed to deploy ihc to localhost:/opt/ibm/biginsights/IHC, please check login shell on this node, if it s not bash, try edit /etc/passwd or use chsh to change to bash Detail error: null
at com.ibm.xap.mgmt.hdm.DeployTask.deployPackage(DeployTask.java:200)
at com.ibm.xap.mgmt.hdm.DeployTask.doTask(DeployTask.java:80)
at com.ibm.xap.mgmt.util.Task.run(Task.java:77)
at com.ibm.xap.mgmt.util.TaskRunner$1.run(TaskRunner.java:52)
com.ibm.xap.mgmt.DeployException: -- localhost=255 (java.io.IOException: Failed to deploy ihc to localhost:/opt/ibm/biginsights/IHC, please check login shell on this node, if it s not bash, try edit /etc/passwd or use chsh to change to bash Detail error: null
at com.ibm.xap.mgmt.hdm.DeployTask.deployPackage(DeployTask.java:200)
at com.ibm.xap.mgmt.hdm.DeployTask.doTask(DeployTask.java:80)
at com.ibm.xap.mgmt.util.Task.run(Task.java:77)
at com.ibm.xap.mgmt.util.TaskRunner$1.run(TaskRunner.java:52)
)
at com.ibm.xap.mgmt.hdm.HadoopMgmtFacade.calculateResult(HadoopMgmtFacade.java:2356)
at com.ibm.xap.mgmt.hdm.HadoopMgmtFacade.calculateResult(HadoopMgmtFacade.java:2305)
at com.ibm.xap.mgmt.hdm.HadoopMgmtFacade.deploy(HadoopMgmtFacade.java:390)
at com.ibm.xap.mgmt.hdm.HadoopMgmtFacade.deploy(HadoopMgmtFacade.java:414)
at com.ibm.xap.mgmt.hdm.HadoopMgmtFacade.deployForceAll(HadoopMgmtFacade.java:364)
at com.ibm.xap.mgmt.hdm.HadoopMgmtCmdline.run(HadoopMgmtCmdline.java:110)
at com.ibm.xap.mgmt.hdm.HadoopMgmtCmdline.main(HadoopMgmtCmdline.java:36)
[FATAL] deploy failed

----------------

bash is the default shell for all users.  Any ideas on where to look would be appreciated.

 

Thanks,

 

Will

 

 

  • YangWeiWei
    YangWeiWei
    72 Posts

    Re: BigInsights Enterprise Edition 2.1.0.1 install failure

    ‏2013-11-13T05:10:33Z  

    Hi

    Is this single node install ? can you attach the full install log ?

  • varunvarun
    varunvarun
    1 Post

    Re: BigInsights Enterprise Edition 2.1.0.1 install failure

    ‏2013-11-29T08:00:11Z  

    i am facing the same error !
    REASON: Command: /opt/ibm/biginsights/bin/ addnode.sh hadoop 10.0.0.14,password
    [INFO] DeployCmdline - [ IBM InfoSphere BigInsights QuickStart Edition ]
    [INFO] Prerequisite check - Proceeding mandatory check to verify if
    given credentials are correct to access cluster nodes : [10.0.0.14]
    [INFO] Prerequisite check - Node Access : OK
    [INFO] Prerequisite check - Ignore checking port connectivity
    [INFO] Prerequisite check - Ignore checking NFS/VIP for HA
    [INFO] @10.0.0.14 - 10.0.0.14->10.0.0.14 : valid
    [INFO] Prerequisite check - Hostname/ip check - succeed
    [INFO] @10.0.0.14 - 50075 : port available
    [INFO] @10.0.0.14 - 50060 : port available
    [INFO] Prerequisite check - Ports check - succeed
    [INFO] @10.0.0.14 - OS - Red Hat Enterprise Linux Server release 5.5
    (Tikanga) Kernel \r on an \m : supported
    [INFO] @10.0.0.14 - the pid_max value is ok
    [INFO] @10.0.0.14 - the ip_local_port_range value is ok
    [INFO] Prerequisite check - Server configuration check - succeed
    [INFO] @10.0.0.14 - Check directory - /hadoop/hdfs/data
    [INFO] @10.0.0.14 - Check disk - /dev/sda1
    [INFO] @10.0.0.14 - Free space of /dev/sda1 is 13G
    [INFO] @10.0.0.14 - Check minimal disk space requirement for
    biginsights installation
    [INFO] @10.0.0.14 - Check disk usage of BIGINSIGHTS_HOME : /opt/ibm/biginsights
    [INFO] @10.0.0.14 - Free space of /dev/sda1 is 13G
    [INFO] @10.0.0.14 - 10.30GB free space required, 13.00GB space available
    [INFO] Prerequisite check - Disk space check - succeed
    [INFO] @10.0.0.14 - Check directory - /hadoop/hdfs/data
    [INFO] @10.0.0.14 - Check disk - /dev/sda1
    [INFO] @10.0.0.14 - Free space of /dev/sda1 is 13G
    [INFO] @10.0.0.14 - Check datanode disk space requirement
    [INFO] @10.0.0.14 - 1.70GB free space required, 13.00GB space available
    [INFO] Prerequisite check - Datanode disk space check - succeed
    [INFO] @10.0.0.14 - Program - scp,zip,bash,tar,ssh,unzip : installed
    [INFO] Prerequisite check - Required software/libraries Check - succeed
    [INFO] DeployManager - Check SSH setup on []
    [INFO] Deployer - Start to add [10.0.0.14] biginsights cluster, setup
    acount, SSH, directories etc.
    [INFO] Deployer - Configuring SSH
    [INFO] Cluster - Setup biginsights admin user/group, setup passwordless SSH
    [INFO] @10.0.0.14 - root@10.0.0.14 s password:
    RHEL
    Added existing user biadmin to group biadmin
    SSH pub key appended to /home/biadmin/.ssh/authorized_ keys
    Skip ID file generation as they exist
    [INFO] Cluster - Check biginsights admin passwordless SSH setup
    [INFO] @10.0.0.14 - OK, password-less SSH has setup
    [INFO] @10.0.0.14 - OK, group biadmin exists
    [INFO] DupHostDefender - Add other known names to ~/.ssh/known_hosts.
    [INFO] Deployer - Configuring directories
    [INFO] @10.0.0.14 - root@10.0.0.14 s password:
    [INFO] Deployer - Deploying JDK/Hadoop
    [INFO] Cluster - Repack ... /opt/ibm/biginsights/hdm/ todeploy/hdm.tar.gz
    [INFO] HadoopConf - Hadoop conf saved to
    /opt/ibm/biginsights/hdm/ hadoop-conf-staging
    [INFO] Cluster - Repack ... /opt/ibm/biginsights/hdm/ todeploy/ihc-conf.tar.gz
    [INFO] Cluster - Repack ...
    /opt/ibm/biginsights/hdm/ todeploy/ihc-conf.tar.gz@10.0. 0.14
    [INFO] Cluster - Repack ...
    /opt/ibm/biginsights/hdm/ todeploy/ihc-conf.tar.gz@bivm
    [INFO] @10.0.0.14 - Deploy ... hdm, force
    [INFO] @10.0.0.14 - Deploy ... ihc-conf@10.0.0.14, force
    [INFO] @10.0.0.14 - Deploy ... ihc, force
    java.io.IOException: Broken pipe
    at java.io.FileOutputStream. writeBytes(Native Method)
    at java.io.FileOutputStream. write(FileOutputStream.java: 276)
    at java.io.BufferedOutputStream. write(BufferedOutputStream. java:116)
    at com.ibm.xap.mgmt.util.IOUtil. dump(IOUtil.java:179)
    at com.ibm.xap.mgmt.util.IOUtil. dump(IOUtil.java:139)
    at com.ibm.xap.mgmt.util.IOUtil. dump(IOUtil.java:123)
    at com.ibm.xap.mgmt.util.Code$2. run(Code.java:637)
    [ERROR] @10.0.0.14 - java.lang.Exception
    at com.ibm.xap.mgmt.util. TaskRunner.run(TaskRunner. java:65)
    at com.ibm.xap.mgmt.hdm. HadoopMgmtFacade.deploy( HadoopMgmtFacade.java:389)
    at com.ibm.xap.mgmt.hdm. HadoopMgmtFacade.deploy( HadoopMgmtFacade.java:414)
    at com.ibm.xap.mgmt.hdm. HadoopMgmtFacade. deployForceAll( HadoopMgmtFacade.java:364)
    at com.ibm.xap.mgmt.hdm. HadoopMgmtFacade. addManagedNodes( HadoopMgmtFacade.java:1247)
    at com.ibm.xap.mgmt. DeployManager.addNodes( DeployManager.java:1887)
    at com.ibm.xap.mgmt. DeployCmdline.runCommand( DeployCmdline.java:266)
    at com.ibm.xap.mgmt. DeployCmdline.run( DeployCmdline.java:105)
    at com.ibm.xap.mgmt. DeployCmdline.main( DeployCmdline.java:67)

    java.io.IOException: Failed to deploy ihc to
    10.0.0.14:/opt/ibm/ biginsights/IHC, please check login shell on this
    node, if it s not bash, try edit /etc/passwd or use chsh to change to
    bash Detail error: null
    at com.ibm.xap.mgmt.hdm. DeployTask.deployPackage( DeployTask.java:200)
    at com.ibm.xap.mgmt.hdm. DeployTask.doTask(DeployTask. java:80)
    at com.ibm.xap.mgmt.util.Task. run(Task.java:77)
    at com.ibm.xap.mgmt.util. TaskRunner$1.run(TaskRunner. java:52)
    [ERROR] Deployer - Failed to add new cluster nodes [10.0.0.14]
    [INFO] HadoopConf - Hadoop conf saved to
    /opt/ibm/biginsights/hdm/ hadoop-conf-staging
    [ERROR] DeployManager -
    [ERROR] DeployManager - OPERATION ERROR -- Add hadoop nodes [10.0.0.14]:
    [ERROR] DeployManager - ------------------------------ -------------------------
    [ERROR] DeployManager - hadoop failed
    com.ibm.xap.mgmt. DeployException: Unable to finish node provision --
    10.0.0.14=255 (java.io.IOException: Failed to deploy ihc to
    10.0.0.14:/opt/ibm/ biginsights/IHC, please check login shell on this
    node, if it s not bash, try edit /etc/passwd or use chsh to change to
    bash Detail error: null
    at com.ibm.xap.mgmt.hdm. DeployTask.deployPackage( DeployTask.java:200)
    at com.ibm.xap.mgmt.hdm. DeployTask.doTask(DeployTask. java:80)
    at com.ibm.xap.mgmt.util.Task. run(Task.java:77)
    at com.ibm.xap.mgmt.util. TaskRunner$1.run(TaskRunner. java:52)
    )
    at com.ibm.xap.mgmt. DeployManager.addNodes( DeployManager.java:1891)
    at com.ibm.xap.mgmt. DeployCmdline.runCommand( DeployCmdline.java:266)
    at com.ibm.xap.mgmt. DeployCmdline.run( DeployCmdline.java:105)
    at com.ibm.xap.mgmt. DeployCmdline.main( DeployCmdline.java:67)
    [ERROR] DeployManager - Add hadoop nodes; SUCCEEDED components: [];
    FAILED components: [hadoop]; Consumes : 0ms
    Error exit.

    this error turns up when i am adding data nodes to create a cluster.

    please somebody help us in resolving this error.

  • lmontani
    lmontani
    3 Posts

    Re: BigInsights Enterprise Edition 2.1.0.1 install failure

    ‏2013-12-26T17:39:17Z  

    i am facing the same error !
    REASON: Command: /opt/ibm/biginsights/bin/ addnode.sh hadoop 10.0.0.14,password
    [INFO] DeployCmdline - [ IBM InfoSphere BigInsights QuickStart Edition ]
    [INFO] Prerequisite check - Proceeding mandatory check to verify if
    given credentials are correct to access cluster nodes : [10.0.0.14]
    [INFO] Prerequisite check - Node Access : OK
    [INFO] Prerequisite check - Ignore checking port connectivity
    [INFO] Prerequisite check - Ignore checking NFS/VIP for HA
    [INFO] @10.0.0.14 - 10.0.0.14->10.0.0.14 : valid
    [INFO] Prerequisite check - Hostname/ip check - succeed
    [INFO] @10.0.0.14 - 50075 : port available
    [INFO] @10.0.0.14 - 50060 : port available
    [INFO] Prerequisite check - Ports check - succeed
    [INFO] @10.0.0.14 - OS - Red Hat Enterprise Linux Server release 5.5
    (Tikanga) Kernel \r on an \m : supported
    [INFO] @10.0.0.14 - the pid_max value is ok
    [INFO] @10.0.0.14 - the ip_local_port_range value is ok
    [INFO] Prerequisite check - Server configuration check - succeed
    [INFO] @10.0.0.14 - Check directory - /hadoop/hdfs/data
    [INFO] @10.0.0.14 - Check disk - /dev/sda1
    [INFO] @10.0.0.14 - Free space of /dev/sda1 is 13G
    [INFO] @10.0.0.14 - Check minimal disk space requirement for
    biginsights installation
    [INFO] @10.0.0.14 - Check disk usage of BIGINSIGHTS_HOME : /opt/ibm/biginsights
    [INFO] @10.0.0.14 - Free space of /dev/sda1 is 13G
    [INFO] @10.0.0.14 - 10.30GB free space required, 13.00GB space available
    [INFO] Prerequisite check - Disk space check - succeed
    [INFO] @10.0.0.14 - Check directory - /hadoop/hdfs/data
    [INFO] @10.0.0.14 - Check disk - /dev/sda1
    [INFO] @10.0.0.14 - Free space of /dev/sda1 is 13G
    [INFO] @10.0.0.14 - Check datanode disk space requirement
    [INFO] @10.0.0.14 - 1.70GB free space required, 13.00GB space available
    [INFO] Prerequisite check - Datanode disk space check - succeed
    [INFO] @10.0.0.14 - Program - scp,zip,bash,tar,ssh,unzip : installed
    [INFO] Prerequisite check - Required software/libraries Check - succeed
    [INFO] DeployManager - Check SSH setup on []
    [INFO] Deployer - Start to add [10.0.0.14] biginsights cluster, setup
    acount, SSH, directories etc.
    [INFO] Deployer - Configuring SSH
    [INFO] Cluster - Setup biginsights admin user/group, setup passwordless SSH
    [INFO] @10.0.0.14 - root@10.0.0.14 s password:
    RHEL
    Added existing user biadmin to group biadmin
    SSH pub key appended to /home/biadmin/.ssh/authorized_ keys
    Skip ID file generation as they exist
    [INFO] Cluster - Check biginsights admin passwordless SSH setup
    [INFO] @10.0.0.14 - OK, password-less SSH has setup
    [INFO] @10.0.0.14 - OK, group biadmin exists
    [INFO] DupHostDefender - Add other known names to ~/.ssh/known_hosts.
    [INFO] Deployer - Configuring directories
    [INFO] @10.0.0.14 - root@10.0.0.14 s password:
    [INFO] Deployer - Deploying JDK/Hadoop
    [INFO] Cluster - Repack ... /opt/ibm/biginsights/hdm/ todeploy/hdm.tar.gz
    [INFO] HadoopConf - Hadoop conf saved to
    /opt/ibm/biginsights/hdm/ hadoop-conf-staging
    [INFO] Cluster - Repack ... /opt/ibm/biginsights/hdm/ todeploy/ihc-conf.tar.gz
    [INFO] Cluster - Repack ...
    /opt/ibm/biginsights/hdm/ todeploy/ihc-conf.tar.gz@10.0. 0.14
    [INFO] Cluster - Repack ...
    /opt/ibm/biginsights/hdm/ todeploy/ihc-conf.tar.gz@bivm
    [INFO] @10.0.0.14 - Deploy ... hdm, force
    [INFO] @10.0.0.14 - Deploy ... ihc-conf@10.0.0.14, force
    [INFO] @10.0.0.14 - Deploy ... ihc, force
    java.io.IOException: Broken pipe
    at java.io.FileOutputStream. writeBytes(Native Method)
    at java.io.FileOutputStream. write(FileOutputStream.java: 276)
    at java.io.BufferedOutputStream. write(BufferedOutputStream. java:116)
    at com.ibm.xap.mgmt.util.IOUtil. dump(IOUtil.java:179)
    at com.ibm.xap.mgmt.util.IOUtil. dump(IOUtil.java:139)
    at com.ibm.xap.mgmt.util.IOUtil. dump(IOUtil.java:123)
    at com.ibm.xap.mgmt.util.Code$2. run(Code.java:637)
    [ERROR] @10.0.0.14 - java.lang.Exception
    at com.ibm.xap.mgmt.util. TaskRunner.run(TaskRunner. java:65)
    at com.ibm.xap.mgmt.hdm. HadoopMgmtFacade.deploy( HadoopMgmtFacade.java:389)
    at com.ibm.xap.mgmt.hdm. HadoopMgmtFacade.deploy( HadoopMgmtFacade.java:414)
    at com.ibm.xap.mgmt.hdm. HadoopMgmtFacade. deployForceAll( HadoopMgmtFacade.java:364)
    at com.ibm.xap.mgmt.hdm. HadoopMgmtFacade. addManagedNodes( HadoopMgmtFacade.java:1247)
    at com.ibm.xap.mgmt. DeployManager.addNodes( DeployManager.java:1887)
    at com.ibm.xap.mgmt. DeployCmdline.runCommand( DeployCmdline.java:266)
    at com.ibm.xap.mgmt. DeployCmdline.run( DeployCmdline.java:105)
    at com.ibm.xap.mgmt. DeployCmdline.main( DeployCmdline.java:67)

    java.io.IOException: Failed to deploy ihc to
    10.0.0.14:/opt/ibm/ biginsights/IHC, please check login shell on this
    node, if it s not bash, try edit /etc/passwd or use chsh to change to
    bash Detail error: null
    at com.ibm.xap.mgmt.hdm. DeployTask.deployPackage( DeployTask.java:200)
    at com.ibm.xap.mgmt.hdm. DeployTask.doTask(DeployTask. java:80)
    at com.ibm.xap.mgmt.util.Task. run(Task.java:77)
    at com.ibm.xap.mgmt.util. TaskRunner$1.run(TaskRunner. java:52)
    [ERROR] Deployer - Failed to add new cluster nodes [10.0.0.14]
    [INFO] HadoopConf - Hadoop conf saved to
    /opt/ibm/biginsights/hdm/ hadoop-conf-staging
    [ERROR] DeployManager -
    [ERROR] DeployManager - OPERATION ERROR -- Add hadoop nodes [10.0.0.14]:
    [ERROR] DeployManager - ------------------------------ -------------------------
    [ERROR] DeployManager - hadoop failed
    com.ibm.xap.mgmt. DeployException: Unable to finish node provision --
    10.0.0.14=255 (java.io.IOException: Failed to deploy ihc to
    10.0.0.14:/opt/ibm/ biginsights/IHC, please check login shell on this
    node, if it s not bash, try edit /etc/passwd or use chsh to change to
    bash Detail error: null
    at com.ibm.xap.mgmt.hdm. DeployTask.deployPackage( DeployTask.java:200)
    at com.ibm.xap.mgmt.hdm. DeployTask.doTask(DeployTask. java:80)
    at com.ibm.xap.mgmt.util.Task. run(Task.java:77)
    at com.ibm.xap.mgmt.util. TaskRunner$1.run(TaskRunner. java:52)
    )
    at com.ibm.xap.mgmt. DeployManager.addNodes( DeployManager.java:1891)
    at com.ibm.xap.mgmt. DeployCmdline.runCommand( DeployCmdline.java:266)
    at com.ibm.xap.mgmt. DeployCmdline.run( DeployCmdline.java:105)
    at com.ibm.xap.mgmt. DeployCmdline.main( DeployCmdline.java:67)
    [ERROR] DeployManager - Add hadoop nodes; SUCCEEDED components: [];
    FAILED components: [hadoop]; Consumes : 0ms
    Error exit.

    this error turns up when i am adding data nodes to create a cluster.

    please somebody help us in resolving this error.

    have you found a solution to this error? I have the same issue when I add a new node to the cluster. Tks