Topic
  • 3 replies
  • Latest Post - ‏2015-04-26T19:55:02Z by MaheshSoms
Tryingit
Tryingit
1 Post

Pinned topic addnode.sh failed

‏2013-07-31T07:01:23Z |

I'm using IBM InfoSphere BigInsights QuickStart Edition v2.1.0.0 on IBM's BigInsights VM image.

When I tried to add hadoop node I got the following error:

biadmin@bivm0:/opt/ibm/biginsights/bin => addnode.sh hadoop bivm2,password,/vmrack2,/HDFS
[INFO] DeployCmdline - [ IBM InfoSphere BigInsights QuickStart Edition ]
[INFO] Prerequisite check - Proceeding mandatory check to verify if given credentials are correct to access cluster nodes : [bivm2]
[INFO] Prerequisite check - Node Access : OK
[INFO] Prerequisite check - Ignore checking port connectivity
[INFO] Prerequisite check - Ignore checking NFS/VIP for HA
[INFO] @bivm2 - bivm2->172.20.168.233 : valid
[INFO] Progress - 1%
[INFO] Prerequisite check - Hostname/ip check - succeed
[INFO] @bivm2 - 50075 : port available
[INFO] @bivm2 - 50060 : port available
[INFO] Progress - 2%
[INFO] Prerequisite check - Ports check - succeed
[INFO] @bivm2 - OS - Red Hat Enterprise Linux Server release 5.5 (Tikanga) Kernel \r on an \m : supported
[INFO] Progress - 3%
[INFO] Prerequisite check - Server configuration check - succeed
[ERROR] Prerequisite check - Disk space check - failed on bivm2
[ERROR] Prerequisite check - 255 -- java.io.IOException: exit code: 2 -- "/data1/opt/ibm/biginsights/hdm/bin/_ssh-remote.exp" "{xor}Lz4sLCgwLTs=" "ssh" "-o" "NumberOfPasswordPrompts=1" "root@bivm2" "/tmp/cal-diskOfDir-bivm2.sh <%= dfsDataDir %>"
root@bivm2's password:
bash: -c: line 0: syntax error near unexpected token `newline'
bash: -c: line 0: `/tmp/cal-diskOfDir-bivm2.sh <%= dfsDataDir %>'

        at com.ibm.xap.mgmt.util.ExecUtil.exec(ExecUtil.java:101)
        at com.ibm.xap.mgmt.hdm.AccountSshSetup.runAsRootRemote(AccountSshSetup.java:746)
        at com.ibm.xap.mgmt.hdm.AccountSshSetup.runAsRootRemote(AccountSshSetup.java:735)
        at com.ibm.xap.mgmt.hdm.AccountSshSetup.runAsRootRemote(AccountSshSetup.java:707)
        at com.ibm.xap.mgmt.hdm.BaseTask.runCmdRemote(BaseTask.java:134)
        at com.ibm.xap.mgmt.hdm.CheckDiskTask.getDiskWrittenTo(CheckDiskTask.java:110)
        at com.ibm.xap.mgmt.hdm.CheckDiskTask.checkOrGetFreeSpaceForDatanode(CheckDiskTask.java:195)
        at com.ibm.xap.mgmt.hdm.CheckDiskTask.doTask(CheckDiskTask.java:176)
        at com.ibm.xap.mgmt.util.Task.run(Task.java:77)
        at com.ibm.xap.mgmt.util.TaskRunner$1.run(TaskRunner.java:52)

[INFO] Progress - 4%
[ERROR] Prerequisite check - Datanode disk space check - failed on bivm2
[ERROR] Prerequisite check - 255 -- java.io.IOException: exit code: 2 -- "/data1/opt/ibm/biginsights/hdm/bin/_ssh-remote.exp" "{xor}Lz4sLCgwLTs=" "ssh" "-o" "NumberOfPasswordPrompts=1" "root@bivm2" "/tmp/cal-diskOfDir-bivm2.sh <%= dfsDataDir %>"
The authenticity of host 'bivm2 (172.20.168.233)' can't be established.
RSA key fingerprint is 7d:3e:bc:25:6e:f6:92:f8:35:87:fb:35:4d:98:bc:45.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added 'bivm2,172.20.168.233' (RSA) to the list of known hosts.
root@bivm2's password:
bash: -c: line 0: syntax error near unexpected token `newline'
bash: -c: line 0: `/tmp/cal-diskOfDir-bivm2.sh <%= dfsDataDir %>'

        at com.ibm.xap.mgmt.util.ExecUtil.exec(ExecUtil.java:101)
        at com.ibm.xap.mgmt.hdm.AccountSshSetup.runAsRootRemote(AccountSshSetup.java:746)
        at com.ibm.xap.mgmt.hdm.AccountSshSetup.runAsRootRemote(AccountSshSetup.java:735)
        at com.ibm.xap.mgmt.hdm.AccountSshSetup.runAsRootRemote(AccountSshSetup.java:707)
        at com.ibm.xap.mgmt.hdm.BaseTask.runCmdRemote(BaseTask.java:134)
        at com.ibm.xap.mgmt.hdm.CheckDiskTask.getDiskWrittenTo(CheckDiskTask.java:110)
        at com.ibm.xap.mgmt.hdm.CheckDiskTask.checkOrGetFreeSpaceForDatanode(CheckDiskTask.java:195)
        at com.ibm.xap.mgmt.hdm.CheckDiskTask.doTask(CheckDiskTask.java:176)
        at com.ibm.xap.mgmt.util.Task.run(Task.java:77)
        at com.ibm.xap.mgmt.util.TaskRunner$1.run(TaskRunner.java:52)

[INFO] @bivm2 - Program - scp,zip,bash,tar,ssh,unzip : installed
[INFO] Progress - 5%
[INFO] Prerequisite check - Required software/libraries Check - succeed

 

I traced the 'addnode.sh' script and I could see the command line parameters ('hadoop bivm2,password,/vmrack2,/HDFS') had definitely been conveyed to the Java class. It seems the Java problem doesn't interpret the last parameter '/HDFS' correctly. Hence I got that 'bash shell error'.

 

Has anyone been able to add nodes to on the Quick Start version? Or did I do something wrong?

Cheers

  • nanodata
    nanodata
    2 Posts

    Re: addnode.sh failed

    ‏2013-09-23T20:29:56Z  

    I'm facing the same issue when installing. Does anybody have a resolution on this ?

  • nanodata
    nanodata
    2 Posts

    Re: addnode.sh failed

    ‏2013-09-24T18:29:01Z  

    I figured out how to bypass this disk space check as a workaround

     

    Look for script enableOrDisablePrecheker.sh under <rooot>/biginsights-enterprise-linux64_b20130821_1818/installer/bin

    ./enableOrDisablePrechecker.sh disable disk.space

    That should take care of it. There are other options as well in case you run into isuses.

    NAME
      enableOrDisablePrechecker.sh - enable or disable install pre-checks
     
    SYNOPSIS
      enableOrDisablePrechecker.sh [OPTION] ITEM[,ITEM]...
      enableOrDisablePrechecker.sh [OPTION] all
     
    OPTIONS
      enable - enable one or more prechecks
      disable - disable one or more precheck
      status - view current status
     
    DESCRIPTION
      Each installation precheck item can be enabled or disabled, supported item names are
      * service.port - check service ports be used by biginsights services
      * selinux - check if SELINUX option is disabled on all biginsights nodes
      * disk.space - check if available disk space applies for minimal installation requirement
      * os.dist - check operation system
      * host.nameorip - check host names or ip addresses are correct and reachable
      * port.connectivity - check basic TCP connectivity on certain ports from client to server
      * software.dependencies - check software dependencies are installed, e.g ssh, scp
     

     

  • MaheshSoms
    MaheshSoms
    1 Post

    Re: addnode.sh failed

    ‏2015-04-26T19:55:02Z  
    • nanodata
    • ‏2013-09-24T18:29:01Z

    I figured out how to bypass this disk space check as a workaround

     

    Look for script enableOrDisablePrecheker.sh under <rooot>/biginsights-enterprise-linux64_b20130821_1818/installer/bin

    ./enableOrDisablePrechecker.sh disable disk.space

    That should take care of it. There are other options as well in case you run into isuses.

    NAME
      enableOrDisablePrechecker.sh - enable or disable install pre-checks
     
    SYNOPSIS
      enableOrDisablePrechecker.sh [OPTION] ITEM[,ITEM]...
      enableOrDisablePrechecker.sh [OPTION] all
     
    OPTIONS
      enable - enable one or more prechecks
      disable - disable one or more precheck
      status - view current status
     
    DESCRIPTION
      Each installation precheck item can be enabled or disabled, supported item names are
      * service.port - check service ports be used by biginsights services
      * selinux - check if SELINUX option is disabled on all biginsights nodes
      * disk.space - check if available disk space applies for minimal installation requirement
      * os.dist - check operation system
      * host.nameorip - check host names or ip addresses are correct and reachable
      * port.connectivity - check basic TCP connectivity on certain ports from client to server
      * software.dependencies - check software dependencies are installed, e.g ssh, scp
     

     

    Thank you nanodata
                                                           I was facing the same problem. I got my prechecker disabled with the command  /biginsights-enterprise-linux64_b20130821_1818/installer/bin

    ./enableOrDisablePrechecker.sh disable all