Adding nodes or building blocks

Additional nodes or building blocks in to an existing environment increase storage capacity of a cluster during the deployment or upgrade. You can add building blocks or nodes by using the essrun command or GUI.

Before you add nodes or building blocks, ensure that the following prerequisites are met:
  • Power9 management server and one or more nodes are deployed in the cluster, which includes three or more quorum nodes.
  • A server with two canisters is added Start of change without code upgrade in the existing management serverEnd of change
  • The file system includes 4M block size, 8+2p RAID code, 80% default set-size.

Complete the following steps to add nodes to an existing cluster:

  1. Start of changeEdit the /etc/hosts file to add a building block or nodes and I/O node names to an existing management server including management and high-speed network.End of change
  2. Start of changeReinstall the deployed code image if it is not in management serverEnd of change, and run the container clean to bring the new /etc/hosts in the container.Start of change
    essrun -N ems,essio1,essio2,essio3,essio4 config load -p
    End of change
  3. Check whether nodes need any updates..Start of change
    essrun -N ems,essio1,essio2,essio3,essio4 update --precheck
    End of change
  4. Create network bonds for the added nodes.Start of change
    essrun -N essio3,essio4 network --suffix=-hs
    End of change
  5. Start of changeOutside the container, issue End of change the essnettest command against the new nodes.

    Run this command from one of the nodes in the cluster and use this command to test the health of the high-speed network connections. For more information, see the essnettest command.

  6. Add new nodes to the existing cluster by issuing the following command from the container: Start of change
    essrun -N ems cluster --add-nodes essio3,essio4 --suffix=-hs
    End of change
    Note: Add building blocks with the same node type at a time. For example:
    essrun -N ems1 cluster --suffix=-hs --add-nodes ess3k1a,ess3k1b
    Do not add building blocks with node type as follows:
    essrun -N ems1 cluster --suffix=-hs --add-nodes ess3k1a,ess3k1b,ess5k1a,ess5k1b
  7. Create node class and recovery groups by issuing the following command from the container: Start of change
    essrun -N essio3,essio4 filesystem --rg-only --suffix=-hs
    End of change
  8. Get the list of recovery groups by issuing the following command from the system host:
    mmvdisk rg list
  9. Define the VDisk set.
    Note: Start of changeFor IBM Storage Scale System 3500, you must keep 1.5 TB or more space free if future capacity MES is planned (performance to hybrid). Thus, it is recommended to not use all available space when you create a file system for the performance model. The default allocation is 80% of available space when you use the essrun filesystem command (for x86 nodes).End of change
    1. Use the ssh command to connect to one of the new nodes.
    2. Define the VDisk set. Start of change
      mmvdisk vs define --vs vs_fs1_essio3_hs_essio4_hs --rg ess3500_essio3_hs_essio4_hs 
      --code 8+2p --bs 4M --ss 80% --nsd-usage dataAndMetadata --sp system
      End of change
      Note: Assume that the existing file system has the attributes that are mentioned in the command. For VDisk set name, use a unique name similar to the existing VDisk set.

      For more information, see mmvdisk online command reference.

  10. Add the VDisk set to an existing file system.
    Start of changemmvdisk fs add --file-system fs1 --vdisk-set vs_fs1_essio3_hs_essio4_hsEnd of change
    Note: Assume that the original file system name is Start of changefs1End of change.
  11. Update the component database on the management server by issuing the following command from system host:
    mmaddcompspec default --replace
  12. Restripe the file system.
    Start of changemmrestripefs fs1 -bEnd of change
  13. Start of changeAdd new nodes to the GUI for monitoring.
    mmchnode --perfmon -N essio5-hs,essio6-hs
    To monitor new nodes from the GUI, complete following steps:End of change

Adding nodes to the GUI for monitoring

  1. From the container, issue the following command to configure and start the performance monitoring sensors. Start of change
    cd /home/deploy/ess_7.0.1.x_0604-21_dme_ppc64le.dir
    ./essmkyml
    essrun -N essio3,essio4 gui --add-to-hosts
    End of change
    Note: Start of changeEnsure that the passwordless SSH is configured from new nodes to the management server.End of change
  2. Check whether GUI web page shows new IBM Storage Scale System nodes.
  3. Add the new nodes as sensors, reconfigure call home, and rerun the GUI wizard to identify the new nodes.