Installing IBM Storage Scale Erasure Code Edition on VMware virtual machine

This topic describes the procedure for installing IBM Storage Scale Erasure Code Edition on VMware virtual machine and provisioning a new virtual machine.

Secure boot

Note: IBM Storage Scale does not support secure boot.

To disable the secure boot for the ECE storage node VM, select the VM Option > Boot Option, and deselect Secure boot Option.

CPU and memory

For CPU and memory requirements, see VMware virtual machine requirements and limitations.

NVMe disk

IBM Storage Scale Erasure Code Edition on VMware supports use of VMDirectPath I/O passthrough to configure NVMe disk drive to IBM Storage Scale Erasure Code Edition storage node VM.

Note:

Before enabling the passthrough feature for an NVMe storage adapter, add a hardware label for each NVMe device for IBM Storage Scale Erasure Code Edition.

Before configuring NVMe disk drive to IBM Storage Scale ECE, see Hardware checklist to prepare NVMe disk drives, such as disabling volatile cache on NVMe drives, formatting NVMe drives in proper format and so on.

Configuring an NVMe disk for IBM Storage Scale Erasure Code Edition

Use the following steps to configure an NVMe disk for IBM Storage Scale Erasure Code Edition:
  1. Get NVMe device name.

    In the Storage Adapters page, select the NVMe storage adapter, in Device property page, get the Name of the storage adapter device.

    Use the esxcli command to get detailed information of this NVMe device and property.

    [root@localhost:~] esxcli hardware pci list
    0000:da:00.0
    Address: 0000:da:00.0
       Segment: 0x0000
       Bus: 0xda
       Slot: 0x00
       Function: 0x0
       VMkernel Name: vmhba3
       Vendor Name: Samsung Electronics Co Ltd
       Device Name: Thinksystem U.2 PM983 NVMe SSD
       Configured Owner: VMkernel
       Current Owner: VMkernel
       Vendor ID: 0x144d
       Device ID: 0xa808
       SubVendor ID: 0x1d49
       SubDevice ID: 0x403b
       Device Class: 0x0108
       Device Class Name: Non-Volatile memory controller
       Programming Interface: 0x02
       Revision ID: 0x00
       Interrupt Line: 0x0b
       IRQ: 255
       Interrupt Vector: 0x00
       PCI Pin: 0x00
       Spawned Bus: 0x00
       Flags: 0x3001
       Module ID: 90
       Module Name: nvme_pcie
       Chassis: 0
       Physical Slot: 73
       Slot Description: Bay 9
       Device Layer Bus Address: s00000049.00
       Passthru Capable: true
       Parent Device: PCI 0:215:2:0
       Dependent Device: PCI 0:218:0:0
       Reset Method: Function reset
       FPT Sharable: true
       NUMA Node: 1
       Extended Device ID: 0
       Extended Device Name:
    [root@localhost:~] esxcli nvme device namespace list -A vmhba3
    Namespace ID  Status  Device Name
    ------------  ------  -----------
               1  Active  eui.343731304d7003670025384500000001
    [root@localhost:~]
    

    In above example, for the NVMe storage adapter vmhba3, the PCI address is 00:DA:00 and the NVMe device name of its namespace is eui.343731304d7003670025384500000001.

    Use the ID in the device name 343731304d7003670025384500000001 as the hardware label for this NVMe disk.

  2. Toggle passthrough for the NVMe disk.
    Click the Configure tab, on the PCI Devices page, click ALL PCI DEVICE, and use the PCI address obtained from step 1 to identify the PCI device from the ID column. Select the PCI device and click TOGGLE PASSTHROUGH button to enable passthrough feature of this NVMe disk.
    Note: After the passthrough feature has been enabled for this NVMe disk, it will be listed in the PASSTHROUGH ENABLED DEVICES list.
  3. Set the hardware label.
    Use the PCI address obtained from step 1 to identify the PCI device from the ID column. Select the PCI device and click the HARDWARE LABEL button and set the hardware label defined in step 1.
    Figure 1. Set hardware label for NVMe device
    After the hardware label is set, it will be listed in the Hardware Label column in the NVMe PCI device.
    Figure 2. NVMe device with a hardware label

Adding a PCI passthrough NVMe disk into VM

In VM config, select Edit Settings, and then Add New Device, select PCI Device, add NVMe PCI device into VM. For more details, see: https://docs.vmware.com/en/VMware-vSphere/7.0/com.vmware.vsphere.vm_admin.doc/GUID-5B3CAB26-5D06-4A99-92A0-3A04C69CE64B.html.

Note:

Features such as hot adding and removal of virtual device are not available for PCI device passthrough. For more details, see: https://docs.vmware.com/en/VMware-vSphere/7.0/com.vmware.vsphere.networking.doc/GUID-BF2770C3-39ED-4BC5-A8EF-77D55EFE924C.html.

IBM Storage Scale ECE needs special procedure for replacing the failed NVMe disk which is described in Replacing an NVMe disk.

HDD disk

IBM Storage Scale Erasure Code Edition on VMware supports use of Raw Device Mapping (RDM) to add an HDD or SSD disk drive to the VM.

See Add an RDM Disk to a Virtual Machine page in https://docs.vmware.com/en/VMware-vSphere/7.0/com.vmware.vsphere.vm_admin.doc/GUID-4236E44E-E11F-4EDD-8CC0-12BA664BB811.html to add HDD device to IBM Storage Scale ECE storage node VM.

Use the physical compatibility mode to add an RDM HDD disk to the ECE storage node VM.
Note: Current IBM Storage Scale Erasure Code Edition does not support use of a hard drive created from the VMware datastore.

Network

IBM Storage Scale Erasure Code Edition supports to use virtual function of SR-IOV enabled physical network adapter.

Storage Scale ECE uses NIC1 for network connection as shown in Figure 1.
Note:

It is not supported to use virtual network interface connected to VMware virtual switch for Storage Scale ECE network connection.

See https://docs.vmware.com/en/VMware-vSphere/7.0/com.vmware.vsphere.networking.doc/GUID-BEA364D2-7A9D-44E6-BA2D-92A07516B6B9.html to enable SR-IOV on a host physical adapter.

See https://docs.vmware.com/en/VMware-vSphere/7.0/com.vmware.vsphere.networking.doc/GUID-EE03DC6F-32CA-42EF-98FC-12FDE06C0BE0.html to configure a virtual machine to use a virtual function of SR-IOV enabled network adapter.

Precheck on the VMware virtual machine

When the IBM Storage Scale VMs are ready, you can download and run the IBM Storage Scale ECE precheck tool from the repository: https://github.com/IBM/SpectrumScaleTools/.

Installing an ECE cluster by using the IBM installation toolkit on the VMware virtual machines

See Installing IBM Storage Scale Erasure Code Edition by using the installation toolkit to create an IBM Storage Scale ECE cluster by using the IBM Storage Scale installation toolkit.
Note:

Disk slot mapping is not required in VMware Virtual Machine. Skip Step 8 in Installing IBM Storage Scale Erasure Code Edition by using the installation toolkit.

After finishing step 10, if there are multiple Declustered Array (DA) created in the recovery group, current installation toolkit will not create vdiskset and file system properly. Ignore steps 11 through 14 in Installing IBM Storage Scale Erasure Code Edition by using the installation toolkit. See IBM Storage Scale Erasure Code Edition configurations to use the mmvdisk command to create vdiskset and file system.