Installing IBM Storage Scale Erasure Code Edition on VMware virtual machine
This topic describes the procedure for installing IBM Storage Scale Erasure Code Edition on VMware virtual machine and provisioning a new virtual machine.
Secure boot
To disable the secure boot for the ECE storage node VM, select the Secure boot Option.
, and deselectCPU and memory
For CPU and memory requirements, see VMware virtual machine requirements and limitations.
NVMe disk
IBM Storage Scale Erasure Code Edition on VMware supports use of
VMDirectPath
I/O passthrough to configure
NVMe disk drive to
IBM Storage Scale Erasure Code Edition
storage node VM.
Before enabling the passthrough feature for an NVMe storage adapter, add a hardware label for each NVMe device for IBM Storage Scale Erasure Code Edition.
Before configuring NVMe disk drive to IBM Storage Scale ECE, see Hardware checklist to prepare NVMe disk drives, such as disabling volatile cache on NVMe drives, formatting NVMe drives in proper format and so on.
Configuring an NVMe disk for IBM Storage Scale Erasure Code Edition
- Get NVMe device name.
In the Storage Adapters page, select the NVMe storage adapter, in Device property page, get the Name of the storage adapter device.
Use the esxcli command to get detailed information of this NVMe device and property.
[root@localhost:~] esxcli hardware pci list 0000:da:00.0 Address: 0000:da:00.0 Segment: 0x0000 Bus: 0xda Slot: 0x00 Function: 0x0 VMkernel Name: vmhba3 Vendor Name: Samsung Electronics Co Ltd Device Name: Thinksystem U.2 PM983 NVMe SSD Configured Owner: VMkernel Current Owner: VMkernel Vendor ID: 0x144d Device ID: 0xa808 SubVendor ID: 0x1d49 SubDevice ID: 0x403b Device Class: 0x0108 Device Class Name: Non-Volatile memory controller Programming Interface: 0x02 Revision ID: 0x00 Interrupt Line: 0x0b IRQ: 255 Interrupt Vector: 0x00 PCI Pin: 0x00 Spawned Bus: 0x00 Flags: 0x3001 Module ID: 90 Module Name: nvme_pcie Chassis: 0 Physical Slot: 73 Slot Description: Bay 9 Device Layer Bus Address: s00000049.00 Passthru Capable: true Parent Device: PCI 0:215:2:0 Dependent Device: PCI 0:218:0:0 Reset Method: Function reset FPT Sharable: true NUMA Node: 1 Extended Device ID: 0 Extended Device Name: [root@localhost:~] esxcli nvme device namespace list -A vmhba3 Namespace ID Status Device Name ------------ ------ ----------- 1 Active eui.343731304d7003670025384500000001 [root@localhost:~]
In above example, for the NVMe storage adapter vmhba3, the PCI address is 00:DA:00 and the NVMe device name of its namespace is eui.343731304d7003670025384500000001.
Use the ID in the device name 343731304d7003670025384500000001 as the hardware label for this NVMe disk.
- Toggle passthrough for the NVMe disk.Click the Configure tab, on the PCI Devices page, click ALL PCI DEVICE, and use the PCI address obtained from step 1 to identify the PCI device from the ID column. Select the PCI device and click TOGGLE PASSTHROUGH button to enable passthrough feature of this NVMe disk.Note: After the passthrough feature has been enabled for this NVMe disk, it will be listed in the PASSTHROUGH ENABLED DEVICES list.
- Set the hardware label.Use the PCI address obtained from step 1 to identify the PCI device from the ID column. Select the PCI device and click the HARDWARE LABEL button and set the hardware label defined in step 1.
Figure 1. Set hardware label for NVMe device After the hardware label is set, it will be listed in the Hardware Label column in the NVMe PCI device.Figure 2. NVMe device with a hardware label
Adding a PCI passthrough NVMe disk into VM
In VM config, select Edit Settings, and then Add New Device, select PCI Device, add NVMe PCI device into VM. For more details, see: https://docs.vmware.com/en/VMware-vSphere/7.0/com.vmware.vsphere.vm_admin.doc/GUID-5B3CAB26-5D06-4A99-92A0-3A04C69CE64B.html.
Features such as hot adding and removal of virtual device are not available for PCI device passthrough. For more details, see: https://docs.vmware.com/en/VMware-vSphere/7.0/com.vmware.vsphere.networking.doc/GUID-BF2770C3-39ED-4BC5-A8EF-77D55EFE924C.html.
IBM Storage Scale ECE needs special procedure for replacing the failed NVMe disk which is described in Replacing an NVMe disk.
HDD disk
IBM Storage Scale Erasure Code Edition on VMware supports use of Raw Device Mapping (RDM) to add an HDD or SSD disk drive to the VM.
See Add an RDM Disk to a Virtual Machine page in https://docs.vmware.com/en/VMware-vSphere/7.0/com.vmware.vsphere.vm_admin.doc/GUID-4236E44E-E11F-4EDD-8CC0-12BA664BB811.html to add HDD device to IBM Storage Scale ECE storage node VM.
Network
IBM Storage Scale Erasure Code Edition supports to use virtual function of SR-IOV enabled physical network adapter.
It is not supported to use virtual network interface connected to VMware virtual switch for Storage Scale ECE network connection.
See https://docs.vmware.com/en/VMware-vSphere/7.0/com.vmware.vsphere.networking.doc/GUID-BEA364D2-7A9D-44E6-BA2D-92A07516B6B9.html to enable SR-IOV on a host physical adapter.
See https://docs.vmware.com/en/VMware-vSphere/7.0/com.vmware.vsphere.networking.doc/GUID-EE03DC6F-32CA-42EF-98FC-12FDE06C0BE0.html to configure a virtual machine to use a virtual function of SR-IOV enabled network adapter.
Precheck on the VMware virtual machine
When the IBM Storage Scale VMs are ready, you can download and run the IBM Storage Scale ECE precheck tool from the repository: https://github.com/IBM/SpectrumScaleTools/.
Installing an ECE cluster by using the IBM installation toolkit on the VMware virtual machines
Disk slot mapping is not required in VMware Virtual Machine. Skip Step 8 in Installing IBM Storage Scale Erasure Code Edition by using the installation toolkit.
After finishing step 10, if there are multiple Declustered Array (DA) created in the recovery group, current installation toolkit will not create vdiskset and file system properly. Ignore steps 11 through 14 in Installing IBM Storage Scale Erasure Code Edition by using the installation toolkit. See IBM Storage Scale Erasure Code Edition configurations to use the mmvdisk command to create vdiskset and file system.