Topic
  • 3 replies
  • Latest Post - ‏2013-07-20T23:59:00Z by scheemalapati
quan1111
quan1111
2 Posts

Pinned topic BigInSights basic: [ERROR] DeployManager - console failed

‏2013-07-17T02:42:13Z |

when I  was installing   the  biginsights,  i   have   this  message

***************************************************************************************

13/07/16 20:11:22 INFO namenode.NameNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG:   host = localhost.localdomain/127.0.0.1
STARTUP_MSG:   args = [-format]
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build = git://dasani.svl.ibm.com/ on branch (no branch) -r af8437f228d2c35f7445843bb5994d658c8a5446; compiled by 'jenkins' on Thu Nov 15 01:58:17 PST 2012
************************************************************/
Re-format filesystem in /hadoop/hdfs/name ? (Y or N) 13/07/16 20:11:22 INFO util.GSet: VM type       = 64-bit
13/07/16 20:11:22 INFO util.GSet: 2% max memory = 20.0 MB
13/07/16 20:11:22 INFO util.GSet: capacity      = 2^21 = 2097152 entries
13/07/16 20:11:22 INFO util.GSet: recommended=2097152, actual=2097152
13/07/16 20:11:22 INFO namenode.FSNamesystem: fsOwner=biadmin
13/07/16 20:11:22 INFO namenode.FSNamesystem: supergroup=supergroup
13/07/16 20:11:22 INFO namenode.FSNamesystem: isPermissionEnabled=true
13/07/16 20:11:22 INFO namenode.FSNamesystem: dfs.block.invalidate.limit=100
13/07/16 20:11:22 INFO namenode.FSNamesystem: isAccessTokenEnabled=false accessKeyUpdateInterval=0 min(s), accessTokenLifetime=0 min(s)
13/07/16 20:11:22 INFO namenode.FSEditLog: dfs.namenode.edits.toleration.length = -1
13/07/16 20:11:22 INFO namenode.NameNode: Caching file names occuring more than 10 times
13/07/16 20:11:23 INFO common.Storage: Image file of size 113 saved in 0 seconds.
13/07/16 20:11:24 INFO namenode.FSEditLog: closing edit log: position=4, editlog=/hadoop/hdfs/name/current/edits
13/07/16 20:11:24 INFO namenode.FSEditLog: close success: truncate to 4, editlog=/hadoop/hdfs/name/current/edits
13/07/16 20:11:24 INFO common.Storage: Storage directory /hadoop/hdfs/name has been successfully formatted.
13/07/16 20:11:24 INFO namenode.NameNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at localhost.localdomain/127.0.0.1
************************************************************/
[INFO] Deployer - Change the permission of hadoop.tmp.dir /var/ibm/biginsights/hadoop/tmp
[INFO] Deployer - Update hadoop-env.sh
[INFO] Deployer - Update mapping variables in hadoop configuration based on ibm-hadoop.properties
[INFO] Deployer - Get memory string: MemTotal: 1974584 kB
[INFO] Cluster - Number of slave nodes : 1.0
[INFO] Cluster - mapred.submit.replication : 1
[INFO] Cluster - Update hadoop daemon heap size
[INFO] Deployer - Use default task controller
[INFO] HadoopConf - Hadoop conf saved to /opt/ibm/biginsights/hdm/hadoop-conf-staging
[INFO] Cluster - Repack ... /opt/ibm/biginsights/hdm/todeploy/hdm.tar.gz
[INFO] HadoopConf - Hadoop conf saved to /opt/ibm/biginsights/hdm/hadoop-conf-staging
[INFO] Cluster - Repack ... /opt/ibm/biginsights/hdm/todeploy/ihc-conf.tar.gz
[INFO] Cluster - Repack ... /opt/ibm/biginsights/hdm/todeploy/ihc-conf.tar.gz@localhost.localdomain
[INFO] @localhost.localdomain - Deploy ... hdm
[INFO] @localhost.localdomain - Deploy ... ihc-conf@localhost.localdomain
[INFO] @localhost.localdomain - Packages all up-to-date, after deploy [hdm, ihc-conf]
[INFO] @localhost.localdomain - Packages all up-to-date
[INFO] @localhost.localdomain - namenode started, pid 9000
[INFO] @localhost.localdomain - secondarynamenode started, pid 9186
[INFO] @localhost.localdomain - datanode started, pid 9417
[INFO] Progress - 49%
[INFO] Deployer - Waiting for Namenode to exit safe mode...
[INFO] Deployer - HDFS cluster started successfully
[INFO] @localhost.localdomain - jobtracker started, pid 9706
[INFO] @localhost.localdomain - tasktracker started, pid 9887
[INFO] Progress - 51%
[INFO] Deployer - MapReduce cluster started successfully
[INFO] @localhost.localdomain - hadoop installed
[INFO] Progress - Install derby
[INFO] @localhost.localdomain - derby installed
[INFO] @localhost.localdomain - derby started, pid 10765
[INFO] Progress - 55%
[INFO] Progress - Install jaql
[INFO] @localhost.localdomain - jaql installed
[INFO] Progress - 59%
[INFO] Progress - Install hive
[INFO] @localhost.localdomain - hive library deployed
[INFO] @localhost.localdomain - hive installed
[WARN] Deployer - Failed to create private credstore file hive_keystore_pwd.prop in HDFS
[INFO] Progress - 63%
[INFO] Progress - Install pig
[INFO] @localhost.localdomain - pig installed
[INFO] Progress - 68%
[INFO] Progress - Install lucene
[INFO] @localhost.localdomain - lucene installed
[INFO] Progress - 72%
[INFO] Progress - Install hbase
[INFO] Deployer - deploying library hbase
[INFO] Deployer - Found hase jar file : /opt/ibm/biginsights/hbase/hbase-0.94.0-security.jar
[INFO] Deployer - Found zookeeper jar file : /opt/ibm/biginsights/hbase/lib/zookeeper-3.4.3.jar
[INFO] Deployer - Symlink hbase.jar to overlay or BI jar files @localhost.localdomain
[INFO] Deployer - Create symlink for lib/zookeeper.jar file to reference overlay or BI jar files @localhost.localdomain
[INFO] @localhost.localdomain - hbase installed
[INFO] Deployer - check zookeeper services, make sure zookeeper service it started before start hbase service
[INFO] @localhost.localdomain - hbase-master(active) started
[INFO] @localhost.localdomain - hbase-regionserver started
[INFO] Deployer - hbase service started
[INFO] Progress - 76%
[INFO] Progress - Install flume
[INFO] @localhost.localdomain - flume installed
[INFO] Progress - 80%
[INFO] Progress - Install hcatalog
[INFO] @localhost.localdomain - Deploy ... hcatalog
[INFO] @localhost.localdomain - hcatalog installed
[INFO] Cluster - Repack ... /opt/ibm/biginsights/hdm/components/hcatalog/todeploy/hcatalog-conf.tar.gz
[INFO] @localhost.localdomain - Deploy ... hcatalog-conf, force
[INFO] @localhost.localdomain - Packages all up-to-date, after deploy [hcatalog-conf]
[INFO] Progress - 84%
[INFO] Progress - Install sqoop
[INFO] @localhost.localdomain - Deploy ... sqoop
[INFO] @localhost.localdomain - sqoop installed
[INFO] Progress - 88%
[INFO] Progress - Install oozie
[INFO] Deployer - deploying library oozie
[INFO] @localhost.localdomain - oozie installed
[INFO] Deployer - Update biginsights-oozie.properties succeed.
[INFO] Progress - 92%
[INFO] Progress - Install jaqlserver
[INFO] @localhost.localdomain - jaqlserver installed
[INFO] Progress - 96%
[INFO] Progress - Install console
[INFO] Deployer - Initialize biginsights console properties, saved in /opt/ibm/biginsights/hdm/components/console/biginsights-mc.properties
[INFO] Progress - 97%
[INFO] Deployer - Create hadoop proxy users and groups. ( flat-file security )
[INFO] Deployer - Ignored.
[INFO] Deployer - Unpacking biginsights console war file.
[INFO] Progress - 98%
[INFO] Deployer - Updating /opt/ibm/biginsights/console/consolewartmp/WEB-INF/geronimo-web.xml
[INFO] Progress - 99%
[INFO] Deployer - Biginsights Enterprise Edition : [ false ]
[INFO] Deployer - Configure HTTPS : [ false ]
[INFO] Deployer - Secure type : [  ]
[INFO] WasceConfiguration - Configure wasce ports
[INFO] WasceConfiguration - HTTPPort : [ 8080 ]
[INFO] WasceConfiguration - HTTPSPort : [ 8443 ]
[INFO] WasceConfiguration - PortOffset : [ 0 ]
[INFO] Progress - 100%
[INFO] Deployer - Deploying  web console into wasce server
[INFO] Deployer - Updating /opt/ibm/biginsights/console/wasce/var/config/config.xml
[ERROR] DeployManager -
[ERROR] DeployManager - OPERATION ERROR -- Install [hdm, zookeeper, data-compression, hadoop, derby, jaql, hive, pig, lucene, hbase, flume, hcatalog, sqoop, oozie, jaqlserver, console]:
[ERROR] DeployManager - -------------------------------------------------------
[INFO] DeployManager - hdm succeeded -- localhost.localdomain=0 (scp -r /opt/ibm/biginsights/hdm/components/shared/shared-lib localhost.localdomain:/opt/ibm/biginsights/lib)
[INFO] DeployManager - zookeeper succeeded -- localhost.localdomain=0
[INFO] DeployManager - data-compression succeeded -- localhost.localdomain=0
[INFO] DeployManager - hadoop succeeded -- localhost.localdomain=0
[INFO] DeployManager - derby succeeded -- localhost.localdomain=0
[INFO] DeployManager - jaql succeeded -- localhost.localdomain=0
[INFO] DeployManager - hive succeeded -- localhost.localdomain=0
[INFO] DeployManager - pig succeeded -- localhost.localdomain=0
[INFO] DeployManager - lucene succeeded -- localhost.localdomain=0
[INFO] DeployManager - hbase succeeded -- localhost.localdomain=0
[INFO] DeployManager - flume succeeded -- localhost.localdomain=0
[INFO] DeployManager - hcatalog succeeded -- localhost.localdomain=0
[INFO] DeployManager - sqoop succeeded -- localhost.localdomain=0
[INFO] DeployManager - oozie succeeded -- localhost.localdomain=0
[INFO] DeployManager - jaqlserver succeeded -- localhost.localdomain=0
[ERROR] DeployManager - console failed
com.ibm.xap.mgmt.DeployException: console install failed -- localhost.localdomain=-1 (com.ibm.xap.mgmt.util.TimeoutException: Timeout when executing process, timeout = 300000
    at com.ibm.xap.mgmt.util.Code.exec(Code.java:707)
    at com.ibm.xap.mgmt.util.ExecUtil.exec(ExecUtil.java:84)
    at com.ibm.xap.mgmt.util.ExecUtil.exec(ExecUtil.java:40)
    at com.ibm.xap.mgmt.console.MgmtConsoleDeployer.addNode(MgmtConsoleDeployer.java:472)
    at com.ibm.xap.mgmt.console.MgmtConsoleDeployer.access$000(MgmtConsoleDeployer.java:75)
    at com.ibm.xap.mgmt.console.MgmtConsoleDeployer$1.doTask(MgmtConsoleDeployer.java:217)
    at com.ibm.xap.mgmt.util.Task.run(Task.java:77)
    at com.ibm.xap.mgmt.util.TaskRunner$1.run(TaskRunner.java:52)
)
    at com.ibm.xap.mgmt.console.MgmtConsoleDeployer.installConfig(MgmtConsoleDeployer.java:236)
    at com.ibm.xap.mgmt.DeployManager$InstallThread.doInstall(DeployManager.java:2380)
    at com.ibm.xap.mgmt.DeployManager$InstallThread.work(DeployManager.java:2415)
    at com.ibm.xap.mgmt.DeployManager$WorkerThread.run(DeployManager.java:2332)
[ERROR] DeployManager - Install; SUCCEEDED components: [hdm, zookeeper, data-compression, hadoop, derby, jaql, hive, pig, lucene, hbase, flume, hcatalog, sqoop, oozie, jaqlserver]; FAILED components: [console]; Consumes : 665332ms
Error exit.
[INFO] Progress - Start services
[INFO] Progress - 0%
[INFO] Progress - Start zookeeper
[INFO] @localhost.localdomain - zookeeper already running, pid 22178
[INFO] Deployer - zookeeper service started
[INFO] Progress - 6%
[INFO] Progress - Start hadoop
[INFO] @localhost.localdomain - namenode already running, pid 9000
[INFO] @localhost.localdomain - secondarynamenode already running, pid 9186
[INFO] @localhost.localdomain - datanode already running, pid 9417
[INFO] Progress - 9%
[INFO] Deployer - Waiting for Namenode to exit safe mode...
[INFO] Deployer - HDFS cluster started successfully
[INFO] @localhost.localdomain - jobtracker already running, pid 9706
[INFO] @localhost.localdomain - tasktracker already running, pid 9887
[INFO] Progress - 13%
[INFO] Deployer - MapReduce cluster started successfully
[INFO] Progress - Start derby
[INFO] @localhost.localdomain - derby already running, pid 10765
[INFO] Progress - 19%
[INFO] Progress - Start hive
[INFO] @localhost.localdomain - derby already running, pid 10765
[INFO] @localhost.localdomain - hive-web-interface started, pid 23743
[INFO] @localhost.localdomain - hive-server started, pid 24036
[INFO] Progress - 25%
[INFO] Progress - Start hbase
[INFO] Deployer - check zookeeper services, make sure zookeeper service it started before start hbase service
[INFO] @localhost.localdomain - hbase-master(active) already running, pid 13664
[INFO] @localhost.localdomain - hbase-regionserver already running, pid 13750
[INFO] Deployer - hbase service started
[INFO] Progress - 31%
[INFO] Progress - Start flume
[INFO] @localhost.localdomain - flume-master started, pid 24902
[INFO] @localhost.localdomain - flume-node started, pid 25249
[INFO] Progress - 38%
[INFO] Progress - Start oozie
[INFO] @localhost.localdomain - oozie started
[INFO] Progress - 44%
[INFO] Progress - Start jaqlserver
[INFO] @localhost.localdomain - jaqlserver started
[INFO] Progress - 50%
[INFO] DeployManager - Start; SUCCEEDED components: [zookeeper, hadoop, derby, hive, hbase, flume, oozie, jaqlserver]; Consumes : 132934ms
[INFO] Progress - Verifying BigInsights installation
[INFO] Progress - 50%
[INFO] Progress - Validate hadoop
[INFO] Deployer - Running Hadoop terasort example
[INFO] Progress - 75%
[INFO] Progress - Validate hbase
[INFO] @localhost.localdomain - hbase-regionserver started
[WARN] Deployer - terminate healthcheck hbase thread
[INFO] Progress - 100%
[ERROR] DeployManager -
[ERROR] DeployManager - OPERATION ERROR -- Validate [hadoop, hbase]:
[ERROR] DeployManager - -------------------------------------------------------
[ERROR] DeployManager - hadoop failed
com.ibm.xap.mgmt.util.TimeoutException: Timeout when executing process, timeout = 300000
    at com.ibm.xap.mgmt.util.Code.exec(Code.java:707)
    at com.ibm.xap.mgmt.util.ExecUtil.exec(ExecUtil.java:84)
    at com.ibm.xap.mgmt.util.ExecUtil.exec(ExecUtil.java:40)
    at com.ibm.xap.mgmt.hdm.HadoopDeployer.healthCheck(HadoopDeployer.java:679)
    at com.ibm.xap.mgmt.DeployManager$HealthCheckThread.work(DeployManager.java:2568)
    at com.ibm.xap.mgmt.DeployManager$WorkerThread.run(DeployManager.java:2332)
[ERROR] DeployManager - hbase failed
java.lang.RuntimeException: Failed to healthcheck hbase from api using reflection, because Timeout while trying to healthchek hbase from hbase api using reflection
    at com.ibm.xap.mgmt.hbase.HBaseDeployer.healthCheck(HBaseDeployer.java:1530)
    at com.ibm.xap.mgmt.DeployManager$HealthCheckThread.work(DeployManager.java:2568)
    at com.ibm.xap.mgmt.DeployManager$WorkerThread.run(DeployManager.java:2332)
[ERROR] DeployManager - Validate; SUCCEEDED components: []; FAILED components: [hadoop, hbase]; Consumes : 661191ms
Error exit.
[FATAL] Failed to install BigInsights component(s)

 

********************************************************************

 

 

how   can  i   solve  this  problem?

and    is    the  url  of  the   console   http://localhost:8080/BigInsights/console/NodeAdministration.jsp?

Updated on 2013-07-17T02:53:17Z at 2013-07-17T02:53:17Z by quan1111
  • YangWeiWei
    YangWeiWei
    72 Posts

    Re: BigInSights basic: [ERROR] DeployManager - console failed

    ‏2013-07-17T03:11:43Z  

    Could you please check if there is any error message in /var/ibm/biginsights/console/logs/message.log ( or server.out , I cannot recall the name ); also please check the log /var/ibm/biginsights/hadoop/logs/hadoop-biadmin-namenodexx.log

  • quan1111
    quan1111
    2 Posts

    Re: BigInSights basic: [ERROR] DeployManager - console failed

    ‏2013-07-17T13:03:28Z  

    Could you please check if there is any error message in /var/ibm/biginsights/console/logs/message.log ( or server.out , I cannot recall the name ); also please check the log /var/ibm/biginsights/hadoop/logs/hadoop-biadmin-namenodexx.log

    thank you  for  your  help,

    there is no error  in   /var/ibm/biginsights/console/logs/message.log.

    i  found that   i   can   start   all    service  except  console;so  i  just  want   to   install  console  ;   but   how  can  i  do  it?

  • scheemalapati
    scheemalapati
    4 Posts

    Re: BigInSights basic: [ERROR] DeployManager - console failed

    ‏2013-07-20T23:59:00Z  
    • quan1111
    • ‏2013-07-17T13:03:28Z

    thank you  for  your  help,

    there is no error  in   /var/ibm/biginsights/console/logs/message.log.

    i  found that   i   can   start   all    service  except  console;so  i  just  want   to   install  console  ;   but   how  can  i  do  it?

    Hi Looking at your log as to where it failed, see if editing the /etc/hosts with just this line helps. It did fix the issue for me and went beyond the deploying console. Seems like there is domain resolution issue.

    127.0.0.1   localhost localhost.localdomain

    Regards

    Srinivas