Topic
  • 6 replies
  • Latest Post - ‏2013-09-16T16:13:34Z by sprawesh
sprawesh
sprawesh
4 Posts

Pinned topic BigInsight 2.1 Hadoop error

‏2013-09-12T18:59:30Z |

I have tried couple of times to start hadoop components using the command "./start-all.sh". But, each time it was not successful. I get the following message as final result from terminal:

[ERROR] DeployManager - Start; SUCCEEDED components: [zookeeper, derby, hive, hbase, bigsql, oozie, orchestrator, console, httpfs]; FAILED components: [hadoop];

Please given me suggesstions to fix this problem.

Thanks,

shankar

  • DiLi
    DiLi
    69 Posts

    Re: BigInsight 2.1 Hadoop error

    ‏2013-09-12T19:05:35Z  

    Could you please provide the full command line output of start-all.sh? also,the full command line output of ./start.sh hadoop, ./status.sh hadoop

  • sprawesh
    sprawesh
    4 Posts

    Re: BigInsight 2.1 Hadoop error

    ‏2013-09-12T19:44:58Z  
    • DiLi
    • ‏2013-09-12T19:05:35Z

    Could you please provide the full command line output of start-all.sh? also,the full command line output of ./start.sh hadoop, ./status.sh hadoop

    Please see the attached files.

    --shankar

     

  • DiLi
    DiLi
    69 Posts

    Re: BigInsight 2.1 Hadoop error

    ‏2013-09-13T19:34:57Z  
    • sprawesh
    • ‏2013-09-12T19:44:58Z

    Please see the attached files.

    --shankar

     

    Hello Shankar,

    The status-hadoop.sh text shows "HDFS is out of service because number of available datanodes:[0] is less than dfs.replication.min:[1]"
    This could be the reason why hadoop couldn't start. can you check whether your cluster is running out of harddrive space? When the datanode is running of harddrive space, namenode may choose to skip starting that datanode. Your cluster has replication set to be 1, and there were no data nodes left available for namenode to start...

     

  • sprawesh
    sprawesh
    4 Posts

    Re: BigInsight 2.1 Hadoop error

    ‏2013-09-13T21:16:45Z  
    • DiLi
    • ‏2013-09-13T19:34:57Z

    Hello Shankar,

    The status-hadoop.sh text shows "HDFS is out of service because number of available datanodes:[0] is less than dfs.replication.min:[1]"
    This could be the reason why hadoop couldn't start. can you check whether your cluster is running out of harddrive space? When the datanode is running of harddrive space, namenode may choose to skip starting that datanode. Your cluster has replication set to be 1, and there were no data nodes left available for namenode to start...

     

    Hi DiLi,

    Thanks for your help.

    There is plenty of space on the cluster. I have attached the screenshot of details of available space.

    --shankar

     

    Attachments

  • CarpLi
    CarpLi
    3 Posts

    Re: BigInsight 2.1 Hadoop error

    ‏2013-09-16T12:22:58Z  
    • sprawesh
    • ‏2013-09-13T21:16:45Z

    Hi DiLi,

    Thanks for your help.

    There is plenty of space on the cluster. I have attached the screenshot of details of available space.

    --shankar

     

    Hi Shankar,

    From the hadoop status log, we could observe message like "java.io.IOException: NameNode is not formatted", so please try below steps:

    1) Run "stop.sh hadoop"

    2) Run "hadoop namenode -format", and input "Y" when it asks

    3) Run "start.sh hadoop"

    Please let me know if still any issue observed.

    Best  Regards,
    Carp

    Updated on 2013-09-16T12:23:47Z at 2013-09-16T12:23:47Z by CarpLi
  • sprawesh
    sprawesh
    4 Posts

    Re: BigInsight 2.1 Hadoop error

    ‏2013-09-16T16:13:34Z  
    • CarpLi
    • ‏2013-09-16T12:22:58Z

    Hi Shankar,

    From the hadoop status log, we could observe message like "java.io.IOException: NameNode is not formatted", so please try below steps:

    1) Run "stop.sh hadoop"

    2) Run "hadoop namenode -format", and input "Y" when it asks

    3) Run "start.sh hadoop"

    Please let me know if still any issue observed.

    Best  Regards,
    Carp

    Hi Carp,

    The same problem still exists. The please the attached file for output.

    Thanks,

    shankar

    Attachments

    Updated on 2013-09-16T16:15:18Z at 2013-09-16T16:15:18Z by sprawesh