I would like to try out SCP 1.2. I do not have access to physical machines to perform the install; but I do have access to a fairly robust existing VMWare ESX environment. I can build out the required systems as VMs, but I can't seem to get it to work. The first part of the PXE install goes fine. The 2 storage nodes and 1 compute node PXE boot and come online without any problems, but then the PXE reports "Total free memory of 2 storage nodes is 0gb, less than required memory 10gb of kernel". I found some other info that this is most likely b/c the storage nodes are vms.
This is not a production system, I just want to do a quick test and demo. Is there any way to "trick" the installer into seeing the full memory allocated to storage nodes (tried as much as 12G each node). I also tried more memory on the compute node (up to 16GB), but that did not seem to help.
This topic has been locked.
9 replies Latest Post - 2012-08-30T16:50:42Z by rossdavibm
Pinned topic Will SCP run on virtual machines
Answered question This question has been answered.
Unanswered question This question has not been answered yet.
Updated on 2012-08-30T16:50:42Z at 2012-08-30T16:50:42Z by rossdavibm
aelfner 110000DAB747 PostsACCEPTED ANSWER
Re: Will SCP run on virtual machines2012-02-07T21:28:45Z in response to WilliamSchmidtHi William - I was recently in the identical predicament. I did end up finding a couple physical storage nodes, but more importantly I learned the rule for what works:
The requirement is for a VT enabled CPU, so the KVM vms can be built, which is not possible in say, ESXi 4, but is in ESXi 5. Essentially, if virtual, you need to be able to run VMs on top of a VM.
Re: Will SCP run on virtual machines2012-02-08T14:38:59Z in response to WilliamSchmidtA possible solution to your problem is to setup and environment in the following way:
Storage nodes virtual
Compute node physical being the same ESXi hosting the other pieces
Then to avoid the dual virtualization layer, create by hand a VM in the ESXi for each of the kernel services and let them PXE boot after having recorded their MAC addresses in ISAAC.cfg on the PXE server. Then remember to cleanup the content of /var/lib/tftpboot and relaunch firstbox_run on the PXE.
You do not need to launch deploy_all.sh since the kernel service VMs will be automatically installed by the PXE
SystemAdmin 110000D4XK92 Posts
dazman 06000006SF2 PostsACCEPTED ANSWER
Re: Will SCP run on virtual machines2012-03-22T11:01:19Z in response to SystemAdminFor customers (many) who only have VMware or Hyper-V in the future, will SCP be enhanced in the future to simply run as VMs only? (without the need of a VM in a VM) or physical hardware. Customers then get the benefits of HA, DRS and even SRM etc.
Re: Will SCP run on virtual machines2012-03-22T17:08:00Z in response to dazmanHi!
The main thing to understand here is the fact that the compute node is hosting the the deployed VMs.
If you want to have a compute node running as virtual machine you then encounter the problem of dealing with dual layer virtualization... This does not work so smoothly.
A typical thing I've seen getting tried and that does not work is to have the compute node being a VM (running KVM or Xen) on top of ESX 4.1.
This simply does not work because even if the installation of the compute node is apparently successful, then you'll not manage to deploy any VM because it will be a VM running on top of a KVM that on its turn runs on top of ESX :-(
If you just have an ESX, you can have an SCP installed there as I was explaining in my previous post... well then of course your installation is not really highly available, but I think this is part of the game.
So what you can do in this case is to create in your ESX at least two virtual machines (just create the VMs, tell ESX they will be hosting linux RHEL, no need to install the OS there, the PXE will be doing it for you) for the storage nodes. Configure the storage nodes to boot from pxe.
Then you need to create a VM for each of the kernel service VM (same trick, just tell ESX to create a VM, configure them for pxe boot, the pxe server will be installing them): you need at least 3 HBASEs, 3 zookeepers, 1 ldap, 1 webconsole, 1 webadminconsole, 1 webservice.
take a note of the mac addresses of these VMs.
Then create a virtual machine for the pxe server. Install RHEL on top of the pxe server and install SCP as described in the infocenter.
Before running firstbox_run, edit ISAAC.cfg and put the MAC addresses you collected before. Then run firstbox_run. Once it completes, boot the kernel services VMs and the storage nodes.
Once they are up, define as compute node the ESX itself, that is run add_compute_vmw.sh. This command will be creating one more VM on top of your ESX. This Vm is needed to host the hyper bot.
On the other side, if your question was about the demo apckage (the one that gets installed all on a single box), so far it uses KVM as hypervisor, so you need to install it on a physical box.
Hoping it clarifies
dazman 06000006SF2 PostsACCEPTED ANSWER
Re: Will SCP run on virtual machines2012-03-22T23:45:01Z in response to rossellaThanks Rosella,
Thanks for your reply.
I'm still reading the SCP doco to understand it's architecture. Great info. It appears IBM is packaging SCP to specific hypervisor's such as KVM at the moment, which I guess explains why you need KVM etc. My suggestion was more of making SCP more portable for any hypervisor (and obviously targeting the large VMware market, but increasingly Hyper-V in the future)... so components in OVF format. Customers love virtual appliances!
That could still mean that if plenty of capacity is req for SCP. the OVF is deployed to a host (ESXi, Hyper-V, KVM) that might only run 1 or 2 VMs !
Re: Will SCP run on virtual machines2012-03-23T14:03:24Z in response to dazmanHi!
Actually what SCP does is by default using KVM as target hypervisor, but then you can also use ESX (no need for a vCenter, just ESX/ESXi) or Xen...Of course you can mix them up as you wish in the same SCP installation.
More hypervisors may come with the time... just stay tuned ;-)
akkinaavinash 2700037M0G1 PostACCEPTED ANSWER
Re: Will SCP run on virtual machines2012-08-29T16:17:13Z in response to rossellaHi All,
Tried to setup SCP on 4 servers (two x3950s and two x3550s). When tried to install storage node (with rhel6.2) on x3950 server via PXE, it throws out an error at console with the message "Disabling IRQ#18". I am just curious to know if anyone of you guys have come across the same error message while installation. I believe this is not related to SCP, but may be something that needs to be done with the server. I upgraded BIOS on x3950 to V1.5 and started the storage node installation again, but the server still gets struck at that message.
What actually happens is it stays/pause for about 20 minutes at the message on the console and then installs the Storage node successfully. Later on after the reboot it shows up "Kernel Panic" error.
Any help would be really appreciated!!
rossdavibm 060000884R25 PostsACCEPTED ANSWER
Re: Will SCP run on virtual machines2012-08-30T16:50:42Z in response to akkinaavinashAvinash, that error seems to be related to the "suspend/sleep" functionality, such as for a laptop. Have you tried disabling (if possible) the suspend/resume features in the BIOS?