Topic
  • 2 replies
  • Latest Post - ‏2013-06-30T19:58:24Z by ICloudIt
ICloudIt
ICloudIt
11 Posts

Pinned topic Unable to run wordcount sample program

‏2013-06-27T06:08:48Z |

Hello,

I installed Biginsights ver 2.1. Deployed Word count application. While running the app, I get following error in Hadoop Log.

There is no configuration file

/biginsights/var/bi-task-controller-conf/taskcontroller.cfg

Where is that configured?

 

Thanks for your help.

 

 

 

 

Error initializing attempt_201306262106_0001_m_000001_0:
java.io.IOException: Job initialization failed (24) with output: Configuration file /biginsights/var/bi-task-controller-conf/taskcontroller.cfg not found.

        at org.apache.hadoop.mapred.LinuxTaskController.initializeJob(LinuxTaskController.java:193)
        at org.apache.hadoop.mapred.TaskTracker$4.run(TaskTracker.java:1331)
        at java.security.AccessController.doPrivileged(AccessController.java:310)
        at javax.security.auth.Subject.doAs(Subject.java:573)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1149)
        at org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1306)
        at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1221)
        at org.apache.hadoop.mapred.TaskTracker$5.run(TaskTracker.java:2581)
        at java.lang.Thread.run(Thread.java:738)
Caused by: org.apache.hadoop.util.Shell$ExitCodeException: 
        at org.apache.hadoop.util.Shell.runCommand(Shell.java:255)
        at org.apache.hadoop.util.Shell.run(Shell.java:182)
        at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:375)
        at org.apache.hadoop.mapred.LinuxTaskController.initializeJob(LinuxTaskController.java:186)
        ... 8 more

Error initializing attempt_201306262106_0001_m_000001_1:
java.io.IOException: Job initialization failed (24) with output: Configuration file /biginsights/var/bi-task-controller-conf/taskcontroller.cfg not found.

        at org.apache.hadoop.mapred.LinuxTaskController.initializeJob(LinuxTaskController.java:193)
        at org.apache.hadoop.mapred.TaskTracker$4.run(TaskTracker.java:1331)
        at java.security.AccessController.doPrivileged(AccessController.java:310)
        at javax.security.auth.Subject.doAs(Subject.java:573)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1149)
        at org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1306)
        at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1221)
        at org.apache.hadoop.mapred.TaskTracker$5.run(TaskTracker.java:2581)
        at java.lang.Thread.run(Thread.java:738)
Caused by: org.apache.hadoop.util.Shell$ExitCodeException: 
        at org.apache.hadoop.util.Shell.runCommand(Shell.java:255)
        at org.apache.hadoop.util.Shell.run(Shell.java:182)
        at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:375)
        at org.apache.hadoop.mapred.LinuxTaskController.initializeJob(LinuxTaskController.java:186)
        ... 8 more

 

 

 

  • YangWeiWei
    YangWeiWei
    72 Posts

    Re: Unable to run wordcount sample program

    ‏2013-06-27T06:16:39Z  

    This is controlled by an environment variable $HADOOP_SECURITY_CONF_DIR, you can log in as biginsights admin user, then try 

    echo $HADOOP_SECURITY_CONF_DIR

    this env var is exported from $BIGINSIGHTS_HOME/conf/biginsights-env.sh, the default value is /var/bi-task-controller-conf. If you happened to change the value to /biginsights/var/bi-task-controller-conf/taskcontroller.cfg but the file is configured to /var/bi-task-controller-conf/taskcontroller.cfg, I think you can resolve this by copying the taskcontroller.cfg to the location

  • ICloudIt
    ICloudIt
    11 Posts

    Re: Unable to run wordcount sample program

    ‏2013-06-30T19:58:24Z  

    This is controlled by an environment variable $HADOOP_SECURITY_CONF_DIR, you can log in as biginsights admin user, then try 

    echo $HADOOP_SECURITY_CONF_DIR

    this env var is exported from $BIGINSIGHTS_HOME/conf/biginsights-env.sh, the default value is /var/bi-task-controller-conf. If you happened to change the value to /biginsights/var/bi-task-controller-conf/taskcontroller.cfg but the file is configured to /var/bi-task-controller-conf/taskcontroller.cfg, I think you can resolve this by copying the taskcontroller.cfg to the location

    Thansk, Yang.

    It seems that that you can change the install path using installer. Hence, I reinstalled with the suggested default paths, and it worked.

    Thanks.

    -Shiv