Topic
IC4NOTICE: developerWorks Community will be offline May 29-30, 2015 while we upgrade to the latest version of IBM Connections. For more information, read our upgrade FAQ.
6 replies Latest Post - ‏2013-09-16T16:13:34Z by sprawesh
sprawesh
sprawesh
4 Posts
ACCEPTED ANSWER

Pinned topic BigInsight 2.1 Hadoop error

‏2013-09-12T18:59:30Z |

I have tried couple of times to start hadoop components using the command "./start-all.sh". But, each time it was not successful. I get the following message as final result from terminal:

[ERROR] DeployManager - Start; SUCCEEDED components: [zookeeper, derby, hive, hbase, bigsql, oozie, orchestrator, console, httpfs]; FAILED components: [hadoop];

Please given me suggesstions to fix this problem.

Thanks,

shankar

  • DiLi
    DiLi
    69 Posts
    ACCEPTED ANSWER

    Re: BigInsight 2.1 Hadoop error

    ‏2013-09-12T19:05:35Z  in response to sprawesh

    Could you please provide the full command line output of start-all.sh? also,the full command line output of ./start.sh hadoop, ./status.sh hadoop

    • sprawesh
      sprawesh
      4 Posts
      ACCEPTED ANSWER

      Re: BigInsight 2.1 Hadoop error

      ‏2013-09-12T19:44:58Z  in response to DiLi

      Please see the attached files.

      --shankar

       

      • DiLi
        DiLi
        69 Posts
        ACCEPTED ANSWER

        Re: BigInsight 2.1 Hadoop error

        ‏2013-09-13T19:34:57Z  in response to sprawesh

        Hello Shankar,

        The status-hadoop.sh text shows "HDFS is out of service because number of available datanodes:[0] is less than dfs.replication.min:[1]"
        This could be the reason why hadoop couldn't start. can you check whether your cluster is running out of harddrive space? When the datanode is running of harddrive space, namenode may choose to skip starting that datanode. Your cluster has replication set to be 1, and there were no data nodes left available for namenode to start...

         

        • sprawesh
          sprawesh
          4 Posts
          ACCEPTED ANSWER

          Re: BigInsight 2.1 Hadoop error

          ‏2013-09-13T21:16:45Z  in response to DiLi

          Hi DiLi,

          Thanks for your help.

          There is plenty of space on the cluster. I have attached the screenshot of details of available space.

          --shankar

           

          Attachments

          • CarpLi
            CarpLi
            3 Posts
            ACCEPTED ANSWER

            Re: BigInsight 2.1 Hadoop error

            ‏2013-09-16T12:22:58Z  in response to sprawesh

            Hi Shankar,

            From the hadoop status log, we could observe message like "java.io.IOException: NameNode is not formatted", so please try below steps:

            1) Run "stop.sh hadoop"

            2) Run "hadoop namenode -format", and input "Y" when it asks

            3) Run "start.sh hadoop"

            Please let me know if still any issue observed.

            Best  Regards,
            Carp

            Updated on 2013-09-16T12:23:47Z at 2013-09-16T12:23:47Z by CarpLi
            • sprawesh
              sprawesh
              4 Posts
              ACCEPTED ANSWER

              Re: BigInsight 2.1 Hadoop error

              ‏2013-09-16T16:13:34Z  in response to CarpLi

              Hi Carp,

              The same problem still exists. The please the attached file for output.

              Thanks,

              shankar

              Attachments

              Updated on 2013-09-16T16:15:18Z at 2013-09-16T16:15:18Z by sprawesh