Topic
  • 20 replies
  • Latest Post - ‏2012-10-23T19:17:02Z by jwill20
ROBG
ROBG
5 Posts

Pinned topic Biginsights install keeps failing on Derby

‏2012-04-20T12:05:28Z |
Installing Biginsights 3.0 on Redhat keeps failing at the same point :
ERROR DeployManager - derby failed <com.ibm.xap.mgmt.ConfigurationException: Failed to save /opt/ibm/biginsights/hdm/components/derby/conf/biderby.properties>com.ibm.xap.mgmt.ConfigurationException: Failed to save /opt/ibm/biginsights/hdm/components/derby/conf/biderby.properties
at com.ibm.xap.mgmt.commoncatalog.CommonCatalogDeployer.saveConf(CommonCatalogDeployer.java:298)
at com.ibm.xap.mgmt.commoncatalog.CommonCatalogDeployer.installInitialize(CommonCatalogDeployer.java:85)
at com.ibm.xap.mgmt.DeployManager$InstallThread.work(DeployManager.java:1963)
at com.ibm.xap.mgmt.DeployManager$WorkerThread.run(DeployManager.java:1935)
Caused by: java.io.FileNotFoundException: /opt/ibm/biginsights/hdm/components/derby/conf/biderby.properties (No such file or directory)
at java.io.FileOutputStream.<init>(FileOutputStream.java:190)
at java.io.FileOutputStream.<init>(FileOutputStream.java:142)
at com.ibm.xap.mgmt.util.IOUtil.writeFile(IOUtil.java:327)
at com.ibm.xap.mgmt.util.IOUtil.writeFile(IOUtil.java:343)
at com.ibm.xap.mgmt.hdm.PropertiesIO.writeProperties(PropertiesIO.java:91)
at com.ibm.xap.mgmt.commoncatalog.CommonCatalogDeployer.saveConf(CommonCatalogDeployer.java:296)
... 3 more

When looking in the Derby directory i only see the binary after the failed install..

Any ideas?, is this a known installer failure?

Thanks,
Updated on 2012-10-23T19:17:02Z at 2012-10-23T19:17:02Z by jwill20
  • SystemAdmin
    SystemAdmin
    603 Posts

    Re: Biginsights install keeps failing on Derby

    ‏2012-04-20T16:16:28Z  
    Hi Rob,

    I have not seen this issue before.

    Please attach complete logs listed in the following technote:

    http://www-01.ibm.com/support/docview.wss?uid=swg21503478

    Also, are you installing Enterprise or Basic edition of BigInsights?

    Thank you,
    Zach
  • jwill20
    jwill20
    12 Posts

    Re: Biginsights install keeps failing on Derby

    ‏2012-10-07T11:19:46Z  
    Hi Rob,

    I have not seen this issue before.

    Please attach complete logs listed in the following technote:

    http://www-01.ibm.com/support/docview.wss?uid=swg21503478

    Also, are you installing Enterprise or Basic edition of BigInsights?

    Thank you,
    Zach
    I have the same exact problem installing BigInsights V1.4. Derby fails - then Hive and Sheets because of that.

    Linux = Redhat Enterprise Linux Server 5.5
    Took all defaults - assuming this means HDFS
    Installing Entrprise version. I got the product off of the Extreme Leverage site.

    I cannot find SecurityRealmPlan.xml anywhere.

    Looks like I only have one attachment. Here is the fullinstall.xml
    *******************************************************************
    <?xml version="1.0" encoding="UTF-8"?>
    <cluster-configuration>
    <operation>install</operation>
    <vendor>ibm</vendor>
    <general>
    <biginsights-install-directory>opt/ibm/biginsights</biginsights-install-directory>
    <biginsights-data-log-directory>var/ibm/biginsights</biginsights-data-log-directory>
    <directory-prefix>/data</directory-prefix>
    <overwrite>false</overwrite>
    <file-system>hdfs</file-system>
    <shared-directory/>
    </general>
    <ssh>
    <configure>configure_ssh</configure>
    <auth-method/>
    <password>{xor}KzoyL2sxMCg=</password>
    <biadmin-userid>biadmin</biadmin-userid>
    <biadmin-groupid>biadmin</biadmin-groupid>
    <biadmin-password>{xor}Lz4sLChvLTs=</biadmin-password>
    <current-user-password>{xor}</current-user-password>
    </ssh>
    <Console>
    <node>localhost.localdomain</node>
    <https>false</https>
    <management-console-port>8080</management-console-port>
    </Console>
    <Jaql-server>
    <configure>true</configure>
    <node>localhost.localdomain</node>
    <jaql-server-port>8200</jaql-server-port>
    </Jaql-server>
    <Jaql>
    <configure>true</configure>
    <log-directory>var/ibm/biginsights/jaql/logs</log-directory>
    </Jaql>
    <Derby>
    <configure>true</configure>
    <node>localhost.localdomain</node>
    <backup-node/>
    <port>1528</port>
    </Derby>
    <hadoop>
    <general>
    <cache-directory>hadoop/mapred/local</cache-directory>
    <log-directory>var/ibm/biginsights/hadoop/logs</log-directory>
    <mapred-system-directory>/hadoop/mapred/system</mapred-system-directory>
    </general>
    <hdfs>
    <configure>true</configure>
    </hdfs>
    <namenode>
    <node>localhost.localdomain</node>
    <namenode-port>9000</namenode-port>
    <namenode-http-port>50070</namenode-http-port>
    <name-directory>hadoop/hdfs/name</name-directory>
    </namenode>
    <jobtracker>
    <node>localhost.localdomain</node>
    <jobtracker-port>9001</jobtracker-port>
    <jobtracker-http-port>50030</jobtracker-http-port>
    </jobtracker>
    <secondarynamenode>
    <node>localhost.localdomain</node>
    <secondarynamenode-http-port>50090</secondarynamenode-http-port>
    <data-directory-2nn>hadoop/hdfs/namesecondary</data-directory-2nn>
    </secondarynamenode>
    <datanode>
    <selection-type>All</selection-type>
    <nodes/>
    <datanode-port>50010</datanode-port>
    <datanode-ipc-port>50020</datanode-ipc-port>
    <datanode-http-port>50075</datanode-http-port>
    <tasktracker-http-port>50060</tasktracker-http-port>
    <data-directory>hadoop/hdfs/data</data-directory>
    </datanode>
    </hadoop>
    <Avro>
    <configure>true</configure>
    </Avro>
    <Hive>
    <configure>true</configure>
    <hwi-node>localhost.localdomain</hwi-node>
    <query-directory>var/ibm/biginsights/hive/query</query-directory>
    <log-directory>var/ibm/biginsights/hive/logs</log-directory>
    <hwi-port>9999</hwi-port>
    <server-port>10000</server-port>
    </Hive>
    <Lucene>
    <configure>true</configure>
    </Lucene>
    <Pig>
    <configure>true</configure>
    <log-directory>var/ibm/biginsights/pig/logs</log-directory>
    </Pig>
    <Oozie>
    <configure>true</configure>
    <node>localhost.localdomain</node>
    <oozie-port>8280</oozie-port>
    </Oozie>
    <Zookeeper>
    <configure>true</configure>
    <nodes>localhost.localdomain</nodes>
    <data-directory>var/ibm/biginsights/zookeeper/data</data-directory>
    <log-directory>var/ibm/biginsights/zookeeper/logs</log-directory>
    <client-port>2181</client-port>
    <time-interval>2000</time-interval>
    <init-limit>5</init-limit>
    <sync-limit>2</sync-limit>
    </Zookeeper>
    <HBase>
    <configure>true</configure>
    <zookeeper-mode>shared</zookeeper-mode>
    <master-nodes>localhost.localdomain</master-nodes>
    <install-mode>fully</install-mode>
    <region-nodes>localhost.localdomain</region-nodes>
    <root-directory>/hbase</root-directory>
    <log-directory>var/ibm/biginsights/hbase/logs</log-directory>
    <master-port>60000</master-port>
    <master-ui-port>60010</master-ui-port>
    <regionserver-port>60020</regionserver-port>
    <regionserver-ui-port>60030</regionserver-ui-port>
    </HBase>
    <Flume>
    <configure>true</configure>
    <zookeeper-mode>shared</zookeeper-mode>
    <master-nodes>localhost.localdomain</master-nodes>
    <nodes>localhost.localdomain</nodes>
    <pid-directory>var/ibm/biginsights/flume/pids</pid-directory>
    <log-directory>var/ibm/biginsights/flume/logs</log-directory>
    </Flume>
    <node-list>
    <node>
    <name-or-ip>localhost.localdomain</name-or-ip>
    <password>{xor}</password>
    <rack/>
    <hdfs-data-directory>hadoop/hdfs/data</hdfs-data-directory>
    <gpfs-node-designation/>
    <gpfs-admin-node/>
    <gpfs-rawdisk-list/>
    </node>
    </node-list>
    <GPFS>
    <install>false</install>
    <cluster>
    <cluster-name>bigpfs</cluster-name>
    <primary-configuration-server/>
    <secondary-configuration-server/>
    </cluster>
    <file-system>
    <default-metadata-replication>1</default-metadata-replication>
    <max-metadata-replication>3</max-metadata-replication>
    <default-data-replication>1</default-data-replication>
    <max-data-replication>3</max-data-replication>
    <block-allocation>hcluster</block-allocation>
    <block-group-factor>128</block-group-factor>
    <write-affinity-depth>1</write-affinity-depth>
    <striping-method>failureGroupRoundRobin</striping-method>
    <failuregroup-maskbits>8</failuregroup-maskbits>
    <estimated-cluster-size>32</estimated-cluster-size>
    <mount-point/>
    <tmp-fileset>tmp</tmp-fileset>
    <log-fileset>log</log-fileset>
    </file-system>
    </GPFS>
    <enterprise>
    <Orchestrator>
    <configure>true</configure>
    <node>localhost.localdomain</node>
    <port>8888</port>
    </Orchestrator>
    </enterprise>
    <TaskController>
    <directory>/var/bi-task-controller-conf</directory>
    <groups>*</groups>
    <hosts>*</hosts>
    </TaskController>
    </cluster-configuration>
  • SystemAdmin
    SystemAdmin
    603 Posts

    Re: Biginsights install keeps failing on Derby

    ‏2012-10-08T17:04:55Z  
    • jwill20
    • ‏2012-10-07T11:19:46Z
    I have the same exact problem installing BigInsights V1.4. Derby fails - then Hive and Sheets because of that.

    Linux = Redhat Enterprise Linux Server 5.5
    Took all defaults - assuming this means HDFS
    Installing Entrprise version. I got the product off of the Extreme Leverage site.

    I cannot find SecurityRealmPlan.xml anywhere.

    Looks like I only have one attachment. Here is the fullinstall.xml
    *******************************************************************
    <?xml version="1.0" encoding="UTF-8"?>
    <cluster-configuration>
    <operation>install</operation>
    <vendor>ibm</vendor>
    <general>
    <biginsights-install-directory>opt/ibm/biginsights</biginsights-install-directory>
    <biginsights-data-log-directory>var/ibm/biginsights</biginsights-data-log-directory>
    <directory-prefix>/data</directory-prefix>
    <overwrite>false</overwrite>
    <file-system>hdfs</file-system>
    <shared-directory/>
    </general>
    <ssh>
    <configure>configure_ssh</configure>
    <auth-method/>
    <password>{xor}KzoyL2sxMCg=</password>
    <biadmin-userid>biadmin</biadmin-userid>
    <biadmin-groupid>biadmin</biadmin-groupid>
    <biadmin-password>{xor}Lz4sLChvLTs=</biadmin-password>
    <current-user-password>{xor}</current-user-password>
    </ssh>
    <Console>
    <node>localhost.localdomain</node>
    <https>false</https>
    <management-console-port>8080</management-console-port>
    </Console>
    <Jaql-server>
    <configure>true</configure>
    <node>localhost.localdomain</node>
    <jaql-server-port>8200</jaql-server-port>
    </Jaql-server>
    <Jaql>
    <configure>true</configure>
    <log-directory>var/ibm/biginsights/jaql/logs</log-directory>
    </Jaql>
    <Derby>
    <configure>true</configure>
    <node>localhost.localdomain</node>
    <backup-node/>
    <port>1528</port>
    </Derby>
    <hadoop>
    <general>
    <cache-directory>hadoop/mapred/local</cache-directory>
    <log-directory>var/ibm/biginsights/hadoop/logs</log-directory>
    <mapred-system-directory>/hadoop/mapred/system</mapred-system-directory>
    </general>
    <hdfs>
    <configure>true</configure>
    </hdfs>
    <namenode>
    <node>localhost.localdomain</node>
    <namenode-port>9000</namenode-port>
    <namenode-http-port>50070</namenode-http-port>
    <name-directory>hadoop/hdfs/name</name-directory>
    </namenode>
    <jobtracker>
    <node>localhost.localdomain</node>
    <jobtracker-port>9001</jobtracker-port>
    <jobtracker-http-port>50030</jobtracker-http-port>
    </jobtracker>
    <secondarynamenode>
    <node>localhost.localdomain</node>
    <secondarynamenode-http-port>50090</secondarynamenode-http-port>
    <data-directory-2nn>hadoop/hdfs/namesecondary</data-directory-2nn>
    </secondarynamenode>
    <datanode>
    <selection-type>All</selection-type>
    <nodes/>
    <datanode-port>50010</datanode-port>
    <datanode-ipc-port>50020</datanode-ipc-port>
    <datanode-http-port>50075</datanode-http-port>
    <tasktracker-http-port>50060</tasktracker-http-port>
    <data-directory>hadoop/hdfs/data</data-directory>
    </datanode>
    </hadoop>
    <Avro>
    <configure>true</configure>
    </Avro>
    <Hive>
    <configure>true</configure>
    <hwi-node>localhost.localdomain</hwi-node>
    <query-directory>var/ibm/biginsights/hive/query</query-directory>
    <log-directory>var/ibm/biginsights/hive/logs</log-directory>
    <hwi-port>9999</hwi-port>
    <server-port>10000</server-port>
    </Hive>
    <Lucene>
    <configure>true</configure>
    </Lucene>
    <Pig>
    <configure>true</configure>
    <log-directory>var/ibm/biginsights/pig/logs</log-directory>
    </Pig>
    <Oozie>
    <configure>true</configure>
    <node>localhost.localdomain</node>
    <oozie-port>8280</oozie-port>
    </Oozie>
    <Zookeeper>
    <configure>true</configure>
    <nodes>localhost.localdomain</nodes>
    <data-directory>var/ibm/biginsights/zookeeper/data</data-directory>
    <log-directory>var/ibm/biginsights/zookeeper/logs</log-directory>
    <client-port>2181</client-port>
    <time-interval>2000</time-interval>
    <init-limit>5</init-limit>
    <sync-limit>2</sync-limit>
    </Zookeeper>
    <HBase>
    <configure>true</configure>
    <zookeeper-mode>shared</zookeeper-mode>
    <master-nodes>localhost.localdomain</master-nodes>
    <install-mode>fully</install-mode>
    <region-nodes>localhost.localdomain</region-nodes>
    <root-directory>/hbase</root-directory>
    <log-directory>var/ibm/biginsights/hbase/logs</log-directory>
    <master-port>60000</master-port>
    <master-ui-port>60010</master-ui-port>
    <regionserver-port>60020</regionserver-port>
    <regionserver-ui-port>60030</regionserver-ui-port>
    </HBase>
    <Flume>
    <configure>true</configure>
    <zookeeper-mode>shared</zookeeper-mode>
    <master-nodes>localhost.localdomain</master-nodes>
    <nodes>localhost.localdomain</nodes>
    <pid-directory>var/ibm/biginsights/flume/pids</pid-directory>
    <log-directory>var/ibm/biginsights/flume/logs</log-directory>
    </Flume>
    <node-list>
    <node>
    <name-or-ip>localhost.localdomain</name-or-ip>
    <password>{xor}</password>
    <rack/>
    <hdfs-data-directory>hadoop/hdfs/data</hdfs-data-directory>
    <gpfs-node-designation/>
    <gpfs-admin-node/>
    <gpfs-rawdisk-list/>
    </node>
    </node-list>
    <GPFS>
    <install>false</install>
    <cluster>
    <cluster-name>bigpfs</cluster-name>
    <primary-configuration-server/>
    <secondary-configuration-server/>
    </cluster>
    <file-system>
    <default-metadata-replication>1</default-metadata-replication>
    <max-metadata-replication>3</max-metadata-replication>
    <default-data-replication>1</default-data-replication>
    <max-data-replication>3</max-data-replication>
    <block-allocation>hcluster</block-allocation>
    <block-group-factor>128</block-group-factor>
    <write-affinity-depth>1</write-affinity-depth>
    <striping-method>failureGroupRoundRobin</striping-method>
    <failuregroup-maskbits>8</failuregroup-maskbits>
    <estimated-cluster-size>32</estimated-cluster-size>
    <mount-point/>
    <tmp-fileset>tmp</tmp-fileset>
    <log-fileset>log</log-fileset>
    </file-system>
    </GPFS>
    <enterprise>
    <Orchestrator>
    <configure>true</configure>
    <node>localhost.localdomain</node>
    <port>8888</port>
    </Orchestrator>
    </enterprise>
    <TaskController>
    <directory>/var/bi-task-controller-conf</directory>
    <groups>*</groups>
    <hosts>*</hosts>
    </TaskController>
    </cluster-configuration>
    Hi,

    In the attached installation log I see references to localhost.localdomain (hostname).

    BigInsights can only be installed on a system configured with a static IP.

    Please specify static IP/ actual hostname in /etc/hosts, re-run the installer using the actual host and see if it helps with the problem.

    If problem still persists, please attach the new install.log and we can take a look.

    Thanks,

    Zach
  • jwill20
    jwill20
    12 Posts

    Re: Biginsights install keeps failing on Derby

    ‏2012-10-08T19:32:11Z  
    Hi,

    In the attached installation log I see references to localhost.localdomain (hostname).

    BigInsights can only be installed on a system configured with a static IP.

    Please specify static IP/ actual hostname in /etc/hosts, re-run the installer using the actual host and see if it helps with the problem.

    If problem still persists, please attach the new install.log and we can take a look.

    Thanks,

    Zach
    Thanks for the help Zach. After adding an entry in /etc/hosts I get the same results. Here is the new log.

    More background - I got this image from the IM download site pre-installed with 1.2. I later uninstalled 1.2 and then installed 1.3. Worked fine. Now I was in the process of going from 1.3 to 1.4. I don't recall ever having to touch /etc/hosts for the last install.

    Here are two commands and results:
    hostname
    biginsights

    cat /etc/hosts
    127.0.0.1 localhost.localdomain localhost
    192.168.136.132 biginsights biginsights
  • SystemAdmin
    SystemAdmin
    603 Posts

    Re: Biginsights install keeps failing on Derby

    ‏2012-10-08T20:38:55Z  
    • jwill20
    • ‏2012-10-08T19:32:11Z
    Thanks for the help Zach. After adding an entry in /etc/hosts I get the same results. Here is the new log.

    More background - I got this image from the IM download site pre-installed with 1.2. I later uninstalled 1.2 and then installed 1.3. Worked fine. Now I was in the process of going from 1.3 to 1.4. I don't recall ever having to touch /etc/hosts for the last install.

    Here are two commands and results:
    hostname
    biginsights

    cat /etc/hosts
    127.0.0.1 localhost.localdomain localhost
    192.168.136.132 biginsights biginsights
    Hi,

    Before I contact development for help, let's try one more thing.

    In the new log, I have noticed the following:

    INFO MgmtConfInitializer - localhost is NameNode
    INFO MgmtConfInitializer - localhost is Secondary NameNode
    INFO MgmtConfInitializer - localhost is JobTracker
    INFO MgmtConfInitializer - localhost is DataNode

    Still localhost is being used/referenced.

    When you go through installer prompts, please make sure to specify 'biginsights' as your node.

    See if this change helps with the issue you're having. If not, please once again, attach the new log.

    Thanks,

    Zach
  • jwill20
    jwill20
    12 Posts

    Re: Biginsights install keeps failing on Derby

    ‏2012-10-08T21:21:27Z  
    Hi,

    Before I contact development for help, let's try one more thing.

    In the new log, I have noticed the following:

    INFO MgmtConfInitializer - localhost is NameNode
    INFO MgmtConfInitializer - localhost is Secondary NameNode
    INFO MgmtConfInitializer - localhost is JobTracker
    INFO MgmtConfInitializer - localhost is DataNode

    Still localhost is being used/referenced.

    When you go through installer prompts, please make sure to specify 'biginsights' as your node.

    See if this change helps with the issue you're having. If not, please once again, attach the new log.

    Thanks,

    Zach
    I don't get any prompts for the node/hostname. And I only see localhost on the Summary pages. Those fields are read only.

    BTW - I'm doing a pseudo install. I will try again with a "normal" one node cluster install and see what happens there.
  • SystemAdmin
    SystemAdmin
    603 Posts

    Re: Biginsights install keeps failing on Derby

    ‏2012-10-08T22:04:49Z  
    • jwill20
    • ‏2012-10-08T21:21:27Z
    I don't get any prompts for the node/hostname. And I only see localhost on the Summary pages. Those fields are read only.

    BTW - I'm doing a pseudo install. I will try again with a "normal" one node cluster install and see what happens there.
    Hi,

    I am guessing it automatically picks up localhost, since it's the first one listed in /etc/hosts.
    Please try regular install with one node option, and you will be prompted to specify your server.
    Let us know the results!

    Thanks,

    Zach
  • jwill20
    jwill20
    12 Posts

    Re: Biginsights install keeps failing on Derby

    ‏2012-10-08T22:29:25Z  
    Hi,

    I am guessing it automatically picks up localhost, since it's the first one listed in /etc/hosts.
    Please try regular install with one node option, and you will be prompted to specify your server.
    Let us know the results!

    Thanks,

    Zach
    I get the same errors (derby/hive/sheets fail) when doing a 1 node install. Here I do get to specify the node names. I used bihost this time. bihost was populated in the text boxes. I didn't have to change anything. BTW - it also allows me to choose HDFS. Pseudo mode does not ask about the file system.

    Log attached.
  • SystemAdmin
    SystemAdmin
    603 Posts

    Re: Biginsights install keeps failing on Derby

    ‏2012-10-08T22:45:20Z  
    • jwill20
    • ‏2012-10-08T22:29:25Z
    I get the same errors (derby/hive/sheets fail) when doing a 1 node install. Here I do get to specify the node names. I used bihost this time. bihost was populated in the text boxes. I didn't have to change anything. BTW - it also allows me to choose HDFS. Pseudo mode does not ask about the file system.

    Log attached.
    Thanks for testing. I will ask development to check the log.
  • SystemAdmin
    SystemAdmin
    603 Posts

    Re: Biginsights install keeps failing on Derby

    ‏2012-10-09T16:31:59Z  
    Thanks for testing. I will ask development to check the log.
    Hi,

    Development asked me to send them the answers to the following questions.
    1. the version is BI v1.4 Enterprise edition <-- I think the answer is Yes (?)
    2. both a pseudo install and 1-node cluster install got this error <-- I think the answer is Yes (?)
    3. Is it a upgrade from 1.3 to 1.4 or installing 1.4 on a clean env? <-- Are you using upgrade option or simply installing on top of V1.3?

    You may also want to try the following approach.

    1. Uninstall BigInsights v1.3 and manually remove the left over directories as described in the following technote:

    http://www-01.ibm.com/support/docview.wss?uid=swg21593340

    2. Install cleanly. This may fix the issue. If possible save the snapshot of the VM image from the time it had the issue.

    Please post your answers, and I will forward them to our dev.

    Thanks,

    Zach
  • jwill20
    jwill20
    12 Posts

    Re: Biginsights install keeps failing on Derby

    ‏2012-10-10T13:39:54Z  
    Hi,

    Development asked me to send them the answers to the following questions.
    1. the version is BI v1.4 Enterprise edition <-- I think the answer is Yes (?)
    2. both a pseudo install and 1-node cluster install got this error <-- I think the answer is Yes (?)
    3. Is it a upgrade from 1.3 to 1.4 or installing 1.4 on a clean env? <-- Are you using upgrade option or simply installing on top of V1.3?

    You may also want to try the following approach.

    1. Uninstall BigInsights v1.3 and manually remove the left over directories as described in the following technote:

    http://www-01.ibm.com/support/docview.wss?uid=swg21593340

    2. Install cleanly. This may fix the issue. If possible save the snapshot of the VM image from the time it had the issue.

    Please post your answers, and I will forward them to our dev.

    Thanks,

    Zach
    1. Version BI v1.4 Enterprise edition <-- Yes
    2. Yes - both pseudo and 1 node get same errors.
    3. I ran the uninstall for 1.3. This worked fine and all directories were deleted. After the install of 1.4 failed I reverted to a snapshot that was right before I installed 1.3. This was also the point in time after a clean uninstall of 1.2. This is where I am at. System is right after a clean uninstall of 1.2 but the 1.4 install does not work.

    I can save the state of the vmware image.

    I see in the log the following message - "Caused by: java.io.FileNotFoundException: /data/opt/ibm/biginsights/hdm/components/derby/conf/biderby.properties "

    Isn't that the problem? A missing file?

    Thanks - Jim
  • SystemAdmin
    SystemAdmin
    603 Posts

    Re: Biginsights install keeps failing on Derby

    ‏2012-10-10T16:59:01Z  
    • jwill20
    • ‏2012-10-10T13:39:54Z
    1. Version BI v1.4 Enterprise edition <-- Yes
    2. Yes - both pseudo and 1 node get same errors.
    3. I ran the uninstall for 1.3. This worked fine and all directories were deleted. After the install of 1.4 failed I reverted to a snapshot that was right before I installed 1.3. This was also the point in time after a clean uninstall of 1.2. This is where I am at. System is right after a clean uninstall of 1.2 but the 1.4 install does not work.

    I can save the state of the vmware image.

    I see in the log the following message - "Caused by: java.io.FileNotFoundException: /data/opt/ibm/biginsights/hdm/components/derby/conf/biderby.properties "

    Isn't that the problem? A missing file?

    Thanks - Jim
    Hi Jim,

    Thanks for providing the answers.
    We will investigate and get back to you as soon as we have any news.

    --Zach
  • SystemAdmin
    SystemAdmin
    603 Posts

    Re: Biginsights install keeps failing on Derby

    ‏2012-10-15T17:08:44Z  
    Hi Jim,

    Thanks for providing the answers.
    We will investigate and get back to you as soon as we have any news.

    --Zach
    Jim,

    I'm sorry about the delay with the answer. Our dev tried the installation scenario, but they were not able to recreate the issue.

    Please provide your answers to the following questions, so we can investigate further:

    "1. What's the platform of the node? <-- Redhat v??
    2. Before the installation, does the file /data/opt/ibm/biginsights/hdm/components/derby/conf/biderby.properties exist?
    3. After the installation, (no matter pass or fail), what's the authority of of /data/opt/ibm/biginsights/hdm/components/derby/conf ?"

    Thank you,

    Zach
  • jwill20
    jwill20
    12 Posts

    Re: Biginsights install keeps failing on Derby

    ‏2012-10-15T18:56:48Z  
    Jim,

    I'm sorry about the delay with the answer. Our dev tried the installation scenario, but they were not able to recreate the issue.

    Please provide your answers to the following questions, so we can investigate further:

    "1. What's the platform of the node? <-- Redhat v??
    2. Before the installation, does the file /data/opt/ibm/biginsights/hdm/components/derby/conf/biderby.properties exist?
    3. After the installation, (no matter pass or fail), what's the authority of of /data/opt/ibm/biginsights/hdm/components/derby/conf ?"

    Thank you,

    Zach
    Hi Zach - here are my answers:

    1. Redhat Enterprise Linux V5.5
    2. Before install /data/opt is empty
    3. After install...
    there is no conf directory
  • jwill20
    jwill20
    12 Posts

    Re: Biginsights install keeps failing on Derby

    ‏2012-10-15T19:02:48Z  
    • jwill20
    • ‏2012-10-15T18:56:48Z
    Hi Zach - here are my answers:

    1. Redhat Enterprise Linux V5.5
    2. Before install /data/opt is empty
    3. After install...
    there is no conf directory
    Hit Post by mistake. Here is the rest of the answer for Q3.

    a. There is no conf directory under derby - there is only a "binary" directory.
    b. All files/directories are owned by biadmin
    c. Most everything is 755
    d. I'm installing as root. biadmin does not exist before the install. There is an hdpadmin from 1.2.
    e. Sending screen shot of the permissions
    Thanks
    Jim
  • SystemAdmin
    SystemAdmin
    603 Posts

    Re: Biginsights install keeps failing on Derby

    ‏2012-10-16T06:42:50Z  
    • jwill20
    • ‏2012-10-15T19:02:48Z
    Hit Post by mistake. Here is the rest of the answer for Q3.

    a. There is no conf directory under derby - there is only a "binary" directory.
    b. All files/directories are owned by biadmin
    c. Most everything is 755
    d. I'm installing as root. biadmin does not exist before the install. There is an hdpadmin from 1.2.
    e. Sending screen shot of the permissions
    Thanks
    Jim
    Hi, Jim
    The reason of this failure is missing "conf" directory in BIGINSIGHTS_HOME/hdm/components/derby.

    This directory should be empty and exist in INSTALL_HOME/installer/hdm/components/derby/. ( INSTALL_HOME is the parent directory of the installation build, similar like /opt/ibm/builds/biginsights-enterprise-linux64_b20120604_2018 )

    Here is a workaround
    1. clean up current environment.
    make sure BIGINSIGHTS_HOME and BIGINSIGHTS_VAR are empty
    2. check "conf" directory in INSTALL_HOME/installer/hdm/components/derby/
    if it's there, please create it manually with current user ( the one to launch the start.sh )
    mkdir INSTALL_HOME/installer/hdm/components/derby/conf
    3. install BI v1.4

    Thanks,
    Bing
  • jwill20
    jwill20
    12 Posts

    Re: Biginsights install keeps failing on Derby

    ‏2012-10-16T15:25:12Z  
    Hi, Jim
    The reason of this failure is missing "conf" directory in BIGINSIGHTS_HOME/hdm/components/derby.

    This directory should be empty and exist in INSTALL_HOME/installer/hdm/components/derby/. ( INSTALL_HOME is the parent directory of the installation build, similar like /opt/ibm/builds/biginsights-enterprise-linux64_b20120604_2018 )

    Here is a workaround
    1. clean up current environment.
    make sure BIGINSIGHTS_HOME and BIGINSIGHTS_VAR are empty
    2. check "conf" directory in INSTALL_HOME/installer/hdm/components/derby/
    if it's there, please create it manually with current user ( the one to launch the start.sh )
    mkdir INSTALL_HOME/installer/hdm/components/derby/conf
    3. install BI v1.4

    Thanks,
    Bing
    OK - this fixed the problem. I had used Archive Manager to unpack the downloads and for some reason it does not create the derby/conf directory. Have you guys had any problems with Archive Manager? Is there something better?

    FYI - I had two other install issues after the conf directory one.
    1. The first one died on Sheets. Seemed to have something to do with memory, so I bumped up the memory and it got past that.
    2. The next install worked but the Flume verification failed. I found in the InfoCenter what to do about that and all is good now.

    Bottom line - V1.4 is installed. Thanks for all the help. When does V2.0 come out :-)
  • SystemAdmin
    SystemAdmin
    603 Posts

    Re: Biginsights install keeps failing on Derby

    ‏2012-10-16T16:21:51Z  
    • jwill20
    • ‏2012-10-16T15:25:12Z
    OK - this fixed the problem. I had used Archive Manager to unpack the downloads and for some reason it does not create the derby/conf directory. Have you guys had any problems with Archive Manager? Is there something better?

    FYI - I had two other install issues after the conf directory one.
    1. The first one died on Sheets. Seemed to have something to do with memory, so I bumped up the memory and it got past that.
    2. The next install worked but the Flume verification failed. I found in the InfoCenter what to do about that and all is good now.

    Bottom line - V1.4 is installed. Thanks for all the help. When does V2.0 come out :-)
    Jim, thanks for the good news, and Bing thanks for all your help with this issue!

    I have never heard of this issue with "archive manager" from any other users. For my own installs, I use gzip/tar commands, and they seems to work fine.

    Thanks,

    Zach
  • Stan
    Stan
    9 Posts

    Re: Biginsights install keeps failing on Derby

    ‏2012-10-23T18:10:16Z  
    Seems to be an Archive Manager (aka File-Roller) bug with empty directories. I guess this is why some software distributions include an empty file called: deleteme or ignorethisfile in empty directories:

    URL: https://bugs.launchpad.net/ubuntu/+source/file-roller/+bug/349183

    Bug Description
    .Binary package hint: file-roller
    1- mkdir -p a b
    2- touch a/c.txt
    3- create an archive containing both directories (tried with zip and tar.gz)
    only the a directory is added to the archive the empty b isn't. Also tried with
    the command line utilities of zip, tar, rar and it works fine with them.
    ProblemType: Bug
    Architecture: i386
    DistroRelease: Ubuntu 8.10
    ExecutablePath: /usr/bin/file-roller
    Package: file-roller 2.24.1-0ubuntu2
    ProcEnviron:
    SHELL=/bin/bash
    PATH=/home/username/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games
    LANG=en_CA.UTF-8
    SourcePackage: file-roller
    Uname: Linux 2.6.27-11-generic i686
  • jwill20
    jwill20
    12 Posts

    Re: Biginsights install keeps failing on Derby

    ‏2012-10-23T19:17:02Z  
    • Stan
    • ‏2012-10-23T18:10:16Z
    Seems to be an Archive Manager (aka File-Roller) bug with empty directories. I guess this is why some software distributions include an empty file called: deleteme or ignorethisfile in empty directories:

    URL: https://bugs.launchpad.net/ubuntu/+source/file-roller/+bug/349183

    Bug Description
    .Binary package hint: file-roller
    1- mkdir -p a b
    2- touch a/c.txt
    3- create an archive containing both directories (tried with zip and tar.gz)
    only the a directory is added to the archive the empty b isn't. Also tried with
    the command line utilities of zip, tar, rar and it works fine with them.
    ProblemType: Bug
    Architecture: i386
    DistroRelease: Ubuntu 8.10
    ExecutablePath: /usr/bin/file-roller
    Package: file-roller 2.24.1-0ubuntu2
    ProcEnviron:
    SHELL=/bin/bash
    PATH=/home/username/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games
    LANG=en_CA.UTF-8
    SourcePackage: file-roller
    Uname: Linux 2.6.27-11-generic i686
    Thanks for letting me know Stan.

    Jim