Installing Biginsights 3.0 on Redhat keeps failing at the same point :
ERROR DeployManager - derby failed <com.ibm.xap.mgmt.ConfigurationException: Failed to save /opt/ibm/biginsights/hdm/components/derby/conf/biderby.properties>com.ibm.xap.mgmt.ConfigurationException: Failed to save /opt/ibm/biginsights/hdm/components/derby/conf/biderby.properties
Caused by: java.io.FileNotFoundException: /opt/ibm/biginsights/hdm/components/derby/conf/biderby.properties (No such file or directory)
... 3 more
When looking in the Derby directory i only see the binary after the failed install..
Any ideas?, is this a known installer failure?
This topic has been locked.
20 replies Latest Post - 2012-10-23T19:17:02Z by jwill20
Pinned topic Biginsights install keeps failing on Derby
Answered question This question has been answered.
Unanswered question This question has not been answered yet.
Updated on 2012-10-23T19:17:02Z at 2012-10-23T19:17:02Z by jwill20
Re: Biginsights install keeps failing on Derby2012-04-20T16:16:28Z in response to ROBGHi Rob,
I have not seen this issue before.
Please attach complete logs listed in the following technote:
Also, are you installing Enterprise or Basic edition of BigInsights?
Re: Biginsights install keeps failing on Derby2012-10-07T11:19:46Z in response to SystemAdminI have the same exact problem installing BigInsights V1.4. Derby fails - then Hive and Sheets because of that.
Linux = Redhat Enterprise Linux Server 5.5
Took all defaults - assuming this means HDFS
Installing Entrprise version. I got the product off of the Extreme Leverage site.
I cannot find SecurityRealmPlan.xml anywhere.
Looks like I only have one attachment. Here is the fullinstall.xml
<?xml version="1.0" encoding="UTF-8"?>
Re: Biginsights install keeps failing on Derby2012-10-08T17:04:55Z in response to jwill20Hi,
In the attached installation log I see references to localhost.localdomain (hostname).
BigInsights can only be installed on a system configured with a static IP.
Please specify static IP/ actual hostname in /etc/hosts, re-run the installer using the actual host and see if it helps with the problem.
If problem still persists, please attach the new install.log and we can take a look.
Re: Biginsights install keeps failing on Derby2012-10-08T19:32:11Z in response to SystemAdminThanks for the help Zach. After adding an entry in /etc/hosts I get the same results. Here is the new log.
More background - I got this image from the IM download site pre-installed with 1.2. I later uninstalled 1.2 and then installed 1.3. Worked fine. Now I was in the process of going from 1.3 to 1.4. I don't recall ever having to touch /etc/hosts for the last install.
Here are two commands and results:
127.0.0.1 localhost.localdomain localhost
192.168.136.132 biginsights biginsights
Re: Biginsights install keeps failing on Derby2012-10-08T20:38:55Z in response to jwill20Hi,
Before I contact development for help, let's try one more thing.
In the new log, I have noticed the following:
INFO MgmtConfInitializer - localhost is NameNode
INFO MgmtConfInitializer - localhost is Secondary NameNode
INFO MgmtConfInitializer - localhost is JobTracker
INFO MgmtConfInitializer - localhost is DataNode
Still localhost is being used/referenced.
When you go through installer prompts, please make sure to specify 'biginsights' as your node.
See if this change helps with the issue you're having. If not, please once again, attach the new log.
Re: Biginsights install keeps failing on Derby2012-10-08T21:21:27Z in response to SystemAdminI don't get any prompts for the node/hostname. And I only see localhost on the Summary pages. Those fields are read only.
BTW - I'm doing a pseudo install. I will try again with a "normal" one node cluster install and see what happens there.
Re: Biginsights install keeps failing on Derby2012-10-08T22:04:49Z in response to jwill20Hi,
I am guessing it automatically picks up localhost, since it's the first one listed in /etc/hosts.
Please try regular install with one node option, and you will be prompted to specify your server.
Let us know the results!
Re: Biginsights install keeps failing on Derby2012-10-08T22:29:25Z in response to SystemAdminI get the same errors (derby/hive/sheets fail) when doing a 1 node install. Here I do get to specify the node names. I used bihost this time. bihost was populated in the text boxes. I didn't have to change anything. BTW - it also allows me to choose HDFS. Pseudo mode does not ask about the file system.
Re: Biginsights install keeps failing on Derby2012-10-09T16:31:59Z in response to SystemAdminHi,
Development asked me to send them the answers to the following questions.
1. the version is BI v1.4 Enterprise edition <-- I think the answer is Yes (?)
2. both a pseudo install and 1-node cluster install got this error <-- I think the answer is Yes (?)
3. Is it a upgrade from 1.3 to 1.4 or installing 1.4 on a clean env? <-- Are you using upgrade option or simply installing on top of V1.3?
You may also want to try the following approach.
1. Uninstall BigInsights v1.3 and manually remove the left over directories as described in the following technote:
2. Install cleanly. This may fix the issue. If possible save the snapshot of the VM image from the time it had the issue.
Please post your answers, and I will forward them to our dev.
Re: Biginsights install keeps failing on Derby2012-10-10T13:39:54Z in response to SystemAdmin1. Version BI v1.4 Enterprise edition <-- Yes
2. Yes - both pseudo and 1 node get same errors.
3. I ran the uninstall for 1.3. This worked fine and all directories were deleted. After the install of 1.4 failed I reverted to a snapshot that was right before I installed 1.3. This was also the point in time after a clean uninstall of 1.2. This is where I am at. System is right after a clean uninstall of 1.2 but the 1.4 install does not work.
I can save the state of the vmware image.
I see in the log the following message - "Caused by: java.io.FileNotFoundException: /data/opt/ibm/biginsights/hdm/components/derby/conf/biderby.properties "
Isn't that the problem? A missing file?
Thanks - Jim
Re: Biginsights install keeps failing on Derby2012-10-15T17:08:44Z in response to SystemAdminJim,
I'm sorry about the delay with the answer. Our dev tried the installation scenario, but they were not able to recreate the issue.
Please provide your answers to the following questions, so we can investigate further:
"1. What's the platform of the node? <-- Redhat v??
2. Before the installation, does the file /data/opt/ibm/biginsights/hdm/components/derby/conf/biderby.properties exist?
3. After the installation, (no matter pass or fail), what's the authority of of /data/opt/ibm/biginsights/hdm/components/derby/conf ?"
Re: Biginsights install keeps failing on Derby2012-10-15T19:02:48Z in response to jwill20Hit Post by mistake. Here is the rest of the answer for Q3.
a. There is no conf directory under derby - there is only a "binary" directory.
b. All files/directories are owned by biadmin
c. Most everything is 755
d. I'm installing as root. biadmin does not exist before the install. There is an hdpadmin from 1.2.
e. Sending screen shot of the permissions
Re: Biginsights install keeps failing on Derby2012-10-16T06:42:50Z in response to jwill20Hi, Jim
The reason of this failure is missing "conf" directory in BIGINSIGHTS_HOME/hdm/components/derby.
This directory should be empty and exist in INSTALL_HOME/installer/hdm/components/derby/. ( INSTALL_HOME is the parent directory of the installation build, similar like /opt/ibm/builds/biginsights-enterprise-linux64_b20120604_2018 )
Here is a workaround
1. clean up current environment.
make sure BIGINSIGHTS_HOME and BIGINSIGHTS_VAR are empty
2. check "conf" directory in INSTALL_HOME/installer/hdm/components/derby/
if it's there, please create it manually with current user ( the one to launch the start.sh )
3. install BI v1.4
Re: Biginsights install keeps failing on Derby2012-10-16T15:25:12Z in response to SystemAdminOK - this fixed the problem. I had used Archive Manager to unpack the downloads and for some reason it does not create the derby/conf directory. Have you guys had any problems with Archive Manager? Is there something better?
FYI - I had two other install issues after the conf directory one.
1. The first one died on Sheets. Seemed to have something to do with memory, so I bumped up the memory and it got past that.
2. The next install worked but the Flume verification failed. I found in the InfoCenter what to do about that and all is good now.
Bottom line - V1.4 is installed. Thanks for all the help. When does V2.0 come out :-)
Re: Biginsights install keeps failing on Derby2012-10-16T16:21:51Z in response to jwill20Jim, thanks for the good news, and Bing thanks for all your help with this issue!
I have never heard of this issue with "archive manager" from any other users. For my own installs, I use gzip/tar commands, and they seems to work fine.
Stan 120000HAGM9 PostsACCEPTED ANSWER
Re: Biginsights install keeps failing on Derby2012-10-23T18:10:16Z in response to ROBGSeems to be an Archive Manager (aka File-Roller) bug with empty directories. I guess this is why some software distributions include an empty file called: deleteme or ignorethisfile in empty directories:
.Binary package hint: file-roller
1- mkdir -p a b
2- touch a/c.txt
3- create an archive containing both directories (tried with zip and tar.gz)
only the a directory is added to the archive the empty b isn't. Also tried with
the command line utilities of zip, tar, rar and it works fine with them.
DistroRelease: Ubuntu 8.10
Package: file-roller 2.24.1-0ubuntu2
Uname: Linux 2.6.27-11-generic i686