Changing the size of a IBM Spectrum Scale cluster
After you deploy a IBM® Spectrum
Scale cluster,
you can increase or decrease the size of the IBM Spectrum
Scale quorum
nodes or IBM Spectrum
Scale NSD
nodes.
Before you begin
If you are increasing the IBM Spectrum
Scale cluster
size, the type of node that the system adds depends on how many quorum
nodes currently exist in the IBM Spectrum
Scale cluster:
- If the number of quorum nodes is less than the number originally requested, the template adds quorum nodes to the IBM Spectrum Scale cluster, up to the number requested.
- If the number of quorum nodes is equal to the number originally requested, the template adds NSD nodes to the IBM Spectrum Scale cluster.
If you are decreasing the IBM Spectrum
Scale cluster
size, you can remove either quorum nodes or NSD nodes. To avoid making
the IBM Spectrum
Scale cluster
or file system unavailable, when you are removing nodes, you must
ensure that both of these rules are satisfied:
- If you are removing a quorum node, you must ensure that the GPFS cluster does not lose quorum after the node is removed. A IBM Spectrum Scale cluster achieves quorum if most of quorum nodes are up. If the IBM Spectrum Scale cluster loses quorum, the entire cluster becomes unavailable. For example, if the IBM Spectrum Scale cluster has three quorum nodes, quorum is achieved when 2 are more quorum nodes are up. If you remove one node, quorum is maintained. If you remove two nodes, then quorum is lost.
- If you are removing a quorum or NSD node, the maximum number of nodes you can remove depends on the replication factor of the IBM Spectrum Scale file system. The number of nodes you remove must be less than the replication factor. If you remove more than the replication factor, the entire IBM Spectrum Scale file system becomes unavailable. For example, if the replication factor is 2, you can remove a maximum of 1 node from the cluster.
In both cases, whether increasing or decreasing the cluster
size, the following requirements must be met before you change the
cluster size:
- The IBM Spectrum Scale cluster is in Active state.
- All of the IBM Spectrum Scale nodes are in active state.
Procedure
Results
If the number of servers was increased, then the new servers are added as either quorum or NSD nodes, and their disks are added to IBM Spectrum Scale file system.
If the number of servers was decreased, then the selected nodes are removed from the GPFS cluster, and their disks are removed from the IBM Spectrum Scale file system.
What to do next
Verify that the IBM Spectrum
Scale cluster
is running correctly and that the IBM Spectrum
Scale nodes
are working correctly. To verify that the nodes are working correctly,
log in to the first IBM Spectrum
Scale quorum
node using ssh. The first IBM Spectrum
Scale quorum
node is defined by the GPFS_Primary_Quorum_Node variable.
Then, complete the following verification tasks:
- To verify that the total number of quorum nodes reflects the increased
or decreased number of servers, run the following command:
# mmgetstate -s - To verify that all servers are in active state, run the following
command:
# mmgetstate -a -L - Verify that the correct number of servers are added to the gpfsmntdata file
system, by ensuring that each disk comes from each IBM Spectrum
Scale node.
Run the following command:
# mmlsfs gpfsmntdata -d - To verify that all nodes mount the IBM Spectrum
Scale file
system, run the following command:
# mmlsmount gpfsmntdata -L