Topic
3 replies Latest Post - ‏2014-05-30T16:09:30Z by P144_Timur_Nurullaev
SystemAdmin
SystemAdmin
603 Posts
ACCEPTED ANSWER

Pinned topic BI 2.0 with GPFS failed

‏2013-03-28T09:03:44Z |
I was trying to install BigInsights 2.0 EE with GPFS instead of HDFS.
For install.xml and install log, I will only post the parts related to GPFS.

1) What version of Linux is being used?
SLES 11 SP1
2) Type of install being done? (HDFS vs GPFS)
GPFS
3) The following logs:
A) fullinstall.xml
<general>
......
<file-system>gpfs</file-system>
<shared-directory/>
</general>
......
<hadoop>
<general>
<cache-directory>/hadoop/mapred/local</cache-directory>
<log-directory>var/ibm/biginsights/hadoop/logs</log-directory>
<mapred-system-directory>/hadoop/mapred/system</mapred-system-directory>
</general>
<hdfs>
<configure>false</configure>
</hdfs>
<namenode>
<node/>
<namenode-port/>
<namenode-http-port/>
<name-directory/>
</namenode>
<jobtracker>
<node>xxxxxx(my server name)</node>
<jobtracker-port>9001</jobtracker-port>
<jobtracker-http-port>50030</jobtracker-http-port>
<jmx-port>8006</jmx-port>
</jobtracker>
<!-- Since it is gpfs, secondarynamenode is not needed. -->
<secondarynamenode>
<node/>
<secondarynamenode-http-port/>
<data-directory-2nn/>
</secondarynamenode>
<!-- Since it is gpfs, datanode is not needed. -->
<datanode>
<selection-type>Unassigned</selection-type>
<nodes/>
<datanode-port/>
<datanode-ipc-port/>
<datanode-http-port/>
<tasktracker-http-port>50060</tasktracker-http-port>
<data-directory/>
<datanode-jmx-port>8007</datanode-jmx-port>
</datanode>
</hadoop>
......
<node-list>
<node>
<name-or-ip>xxxxx(my server name)</name-or-ip>
<password>{xor}</password>
<rack/>
<hdfs-data-directory/>
<gpfs-node-designation>quorum</gpfs-node-designation>
<gpfs-admin-node>xxxxx(my server name)</gpfs-admin-node>
<gpfs-rawdisk-list>/dev/sdb /dev/sdc</gpfs-rawdisk-list>
</node>
<node>
<name-or-ip>xxxxx(my server name)</name-or-ip>
<password>{xor}</password>
<rack/>
<hdfs-data-directory/>
<gpfs-node-designation>quorum</gpfs-node-designation>
<gpfs-admin-node>xxxxx(my server name)</gpfs-admin-node>
<gpfs-rawdisk-list>/dev/sdb /dev/sdc</gpfs-rawdisk-list>
</node>
......
<GPFS>
<install>true</install>
<cluster>
<cluster-name>bigpfs</cluster-name>
<primary-configuration-server>c596n21</primary-configuration-server>
<secondary-configuration-server>c596n22</secondary-configuration-server>
<use-privileged-port>false</use-privileged-port>
<tsc-tcp-port>1191</tsc-tcp-port>
</cluster>
<file-system>
<default-metadata-replication>2</default-metadata-replication>
<max-metadata-replication>3</max-metadata-replication>
<default-data-replication>2</default-data-replication>
<max-data-replication>3</max-data-replication>
<block-allocation>hcluster</block-allocation>
<block-group-factor>128</block-group-factor>
<write-affinity-depth>1</write-affinity-depth>
<striping-method>failureGroupRoundRobin</striping-method>
<failuregroup-maskbits>8</failuregroup-maskbits>
<estimated-cluster-size>32</estimated-cluster-size>
<mount-point>/mnt/bigpfs/</mount-point>
<tmp-fileset>tmp</tmp-fileset>
<log-fileset>log</log-fileset>
</file-system>
</GPFS>
B) install-*.log (ex: install_2011-12-05T06.59.02.871_PST.log)
......
WARN Deployer - Failed to create /tmp directory in GPFS, try to execute "$HADOOP_HOME/bin/hadoop dfs -mkdir /tmp" manually if it doesn't exist
WARN Deployer - Failed to modify access authority in GPFS, try to execute "$HADOOP_HOME/bin/hadoop dfs -chmod a+w /tmp" manually
......
Error: MetaException(message:Got exception: java.io.IOException unable to retrieve GPFS details; GPFS may not have been started)
......
ERROR DeployManager - Install; SUCCEEDED components: hdm, gpfs, gpfs-connector, guardiumproxy, zookeeper, data-compression, scheduler, adaptivemapred, sftp, text-analytics, derby, jaql, pig, lucene, hbase, flume, ei, machine-learning, hcatalog, sqoop, bigsql, bigindex, httpfs, jaqlserver, console, eclipsetooling; FAILED components: hadoop, hive, oozie, orchestrator, sheets, monitoring; Consumes : 1905006ms

C) SecurityRealmPlan.xml
Note: All of these files will be located in the directory where you untarred the installation tarball.
Updated on 2013-03-28T09:20:33Z at 2013-03-28T09:20:33Z by SystemAdmin
  • SystemAdmin
    SystemAdmin
    603 Posts
    ACCEPTED ANSWER

    Re: BI 2.0 with GPFS failed

    ‏2013-03-28T09:20:33Z  in response to SystemAdmin
    Any thoughts on that? Looks like BI didn't recognize GPFS installed by BI itself.
    Sorry that I didn't how to setup the text format. The post looks messy...
    Many thanks.
    • YEKT_Zdenka_Spoljaric
      14 Posts
      ACCEPTED ANSWER

      Re: BI 2.0 with GPFS failed

      ‏2013-08-01T01:23:29Z  in response to SystemAdmin

      Hi

      Did you manage to install BI with GPFS ?

       

      I am at the moment in  the preparation phase for the Install of the BigInsights over the already installed GPFS ... I would really appreciate any input which could be beneficial to me ...

      Cheers

  • P144_Timur_Nurullaev
    3 Posts
    ACCEPTED ANSWER

    Re: BI 2.0 with GPFS failed

    ‏2014-05-30T16:09:30Z  in response to SystemAdmin

    I have a similar error, have installed BI 2.1.1 over GPFS, when I run the command under non-root user (biadmin)  see the Bad connection to FS. command aborted. exception: unable to login.

    Has this error been resolved ?