Installing IBM Storage Scale Erasure Code Edition by using the installation toolkit

IBM Storage Scale Erasure Code Edition is available in a separate installation package. Install this edition by using the installation toolkit.

Use the following steps to install IBM Storage Scale Erasure Code Edition.

  1. Download IBM Storage Scale Erasure Code Edition self-extracting package from the IBM Storage Scale page on the Fix Central.
  2. Extract the installation package.
    ./Storage_Scale_Erasure_Code-<release_ver>-<os_arch>-Linux-install --textonly
    The installation toolkit gets extracted to the /usr/lpp/mmfs/<release_ver>/ansible-toolkit/ directory.
  3. Change the directory to where the installation toolkit is extracted.
    cd /usr/lpp/mmfs/<release_ver>/ansible-toolkit/
  4. Specify the installer node and the setup type in the cluster definition file.
    The setup type must be ece for IBM Storage Scale Erasure Code Edition.
    ./spectrumscale setup -s InstallerNodeIP -st ece

    You can deploy the IBM Storage Scale native REST API in the ECE environment by using the installation toolkit.

    1. Enable installation toolkit to install the administration daemon package.
      ./spectrumscale scaleadmd enable
    2. Import the node identity certificate.
      ./spectrumscale nodeid define --cert <path to certificate> --key <path to private key> --chain <path to ca chain> -N all
      For example,
      ./spectrumscale nodeid define --cert /root/tls/server.pem --key /root/tls/server.key --chain /root/tls/ca.crt -N all
      For more information, see the Installing IBM Storage Scale native REST API with the installation toolkit section in the IBM Storage Scale documentation.
  5. Add scale-out nodes for IBM Storage Scale Erasure Code Edition in the cluster definition file.
    ./spectrumscale node add NodeName -so
    Specify any other node designations in the cluster definition file. You can use the following command to change the cluster name:
    ./spectrumscale config gpfs -c ece_cluster
    Note: For environments with high-performance requirements, IBM Storage Scale Erasure Code Edition storage nodes must not be assigned file audit logging, call home, or protocol node roles.
    You can use the following command to display the list of nodes that are specified in the cluster definition file and the respective node designations.
    ./spectrumscale node list
    A sample output is as follows:
    [ INFO  ] List of nodes in current configuration:
    [ INFO  ] [Installer Node]
    [ INFO  ] 198.51.100.15
    [ INFO  ]
    [ INFO  ] [Cluster Details]
    [ INFO  ] Name: ece_cluster
    [ INFO  ] Setup Type: Erasure Code Edition
    [ INFO  ]
    [ INFO  ] [Extended Features]
    [ INFO  ] File Audit logging     : Disabled
    [ INFO  ] Watch folder           : Disabled
    [ INFO  ] Management GUI         : Enabled
    [ INFO  ] Performance Monitoring : Enabled
    [ INFO  ] Callhome               : Disabled
    [ INFO  ]
    [ INFO  ] GPFS              Admin  Quorum  Manager   NSD   Protocol   GUI    Perf Mon  Scale-out   OS   Arch
    [ INFO  ] Node               Node   Node     Node   Server   Node    Server Collector    Node
    [ INFO  ] node1.example.com           X       X                                           X     rhel7  x86_64
    [ INFO  ] node2.example.com           X       X                                           X     rhel7  x86_64
    [ INFO  ] node3.example.com   X                                        X        X               rhel7  x86_64
    [ INFO  ] node4.example.com           X       X                                           X     rhel7  x86_64
    [ INFO  ] node5.example.com           X       X                                           X     rhel7  x86_64
    [ INFO  ] node6.example.com           X       X                                           X     rhel7  x86_64
    [ INFO  ] node7.example.com                                   X                                 rhel7  x86_64
    [ INFO  ] node8.example.com                                   X                                 rhel7  x86_64
    
    [ INFO  ]
    [ INFO  ] [Export IP address]
    [ INFO  ] [Export IP address]
    [ INFO  ] 198.51.100.11 (pool)
    [ INFO  ] 198.51.100.12 (pool)
    
  6. Perform environment prechecks before you issue the installation toolkit installation command.
    ./spectrumscale install -pr
    Note: You can skip the following installation and slot location configuration steps, if:
    • IBM Storage Scale Erasure Code Edition storage server already has the correct slot location configuration files.
    When you continue with the recovery group definition step, the cluster and the recovery group are created together after defining the recovery group.
  7. Perform the installation toolkit installation procedure.
    ./spectrumscale install
    Now the GPFS cluster is created.
  8. Map the slot location configuration on IBM Storage Scale Erasure Code Edition storage servers by using the slot-mapping tool.

    For more information, see Setting up IBM Storage Scale Erasure Code Edition for disk slot location.

    Note: If you want to create file systems with the Recovery group manually or you want to work around the installation toolkit limitation, see IBM Storage Scale Erasure Code Edition configurations to use the mmvdisk command directly to finish the deployment.
  9. Define the recovery group for IBM Storage Scale Erasure Code Edition in the cluster definition file.
    ./spectrumscale recoverygroup define -N Node1,Node2,...,NodeN
  10. Do the installation toolkit installation procedure again to create recovery group.
    ./spectrumscale install
    Note:

    After this step, a Recovery Group should be created.

    Before creating vdisks, you must check or adjust the Declustered Array spare disk space following the Recommendations.

    If there is any problem in creating recovery group or you want to work around the installation toolkit limitation on vdisk and file system, see IBM Storage Scale Erasure Code Edition configurations to use the mmvdisk command directly to finish the deployment.

  11. Define vdisk sets for IBM Storage Scale Erasure Code Edition in the cluster definition file.
    1. Check declustered array information.
      ./spectrumscale recoverygroup list
      Sample output is as follows:
      [ INFO  ] Name nodeclass Server                        DA_Name:FreeCapacity:Type
      [ INFO  ] rg_1 nc_1      node1,ndoe2,node4,node5,node6 DA1:9757G:NVMe,DA2:8829G:HDD
    2. Define vdisk sets. The following example defines one vdiskset in DA1 of NVMe for file system metadata, one vdiskset in DA2 of HDD for file system data.
      ./spectrumscale vdiskset define -vs nvme_meta -rg rg_1 -code 4WayReplication -bs 2M -ss 50% -da DA1 -nsd-usage metadataOnly -storage-pool system
      
      ./spectrumscale vdiskset define -vs hdd_data -rg rg_1 -code 4+3P -bs 8M -ss 80% -da DA2 -nsd-usage dataOnly -storage-pool datapool
    3. Check vdiskset definition.
      ./spectrumscale vdiskset list
      Sample output is as follows:
      [ INFO  ] name      recoverygroup blocksize setsize  RaidCode nsdUsage     poolName daName
      [ INFO  ] hdd_data  rg_1            8M      80%      4+3P   dataOnly     datapool    DA2
      [ INFO  ] nvme_meta rg_1            2M      50%    4WayReplication metadataOnly   system    DA1
  12. Define the file system for IBM Storage Scale Erasure Code Edition in the cluster definition file.
    ./spectrumscale filesystem define -fs gpfs1 -vs hdd_data,nvme_meta --mmcrfs '-T /gpfs1'
  13. Do environment prechecks before you run the installation toolkit installation procedure.
    ./spectrumscale install -pr
  14. Do the installation toolkit installation procedure again to create the vdisk sets and file systems.
    ./spectrumscale install
    Note: If enabling native REST API, disable passwordless SSH on all nodes of a cluster.

    For troubleshooting, see Installation and configuration issues topic in the IBM Storage Scale: Problem Determination Guide.