Cluster configuration data files

The GPFS administration commands are designed to keep these files synchronized between each other and with the GPFS system files on each node in the cluster. The GPFS commands constantly update the GPFS cluster configuration data files and any user modification made to this information might be lost without warning. On AIX® nodes this includes the GPFS file system stanzas in /etc/filesystems and on Linux® nodes the lists in /etc/fstab.

The GPFS cluster configuration data is stored in the /var/mmfs/gen/mmsdrfs file. The first record in the mmsdrfs file contains a generation number. Whenever a GPFS command causes something to change in the cluster or any of the file systems, this change is reflected in the mmsdrfs file and the generation number is increased by one. The latest generation number is always recorded in the mmsdrfs file on CCR.

The master copy of configuration data files is stored redundantly on all quorum nodes. This method of storing configuration data is called the cluster configuration repository (CCR) and is the default for new clusters created on IBM Storage Scale. Existing clusters can be converted to the new repository type using the --ccr-enable option of the mmchcluster command.

Using CCR has the advantage that full read/write access to the configuration data remains available as long as a majority of quorum nodes are accessible. For example, in a cluster with five quorum nodes, commands that update the mmsdrfs file continues to work normally, even if any two of the five quorum nodes have failed. In a two-node cluster with tiebreaker disks, it is still possible to run commands that change the mmsdrfs file if one of the two nodes has failed, as long as the surviving node has access to the tiebreaker disks. In general, full configuration command functionality remains available as long as enough nodes and, if specified, tiebreaker disks are accessible for GPFS to reach quorum. The CCR also has the advantage that it allows changing the tiebreaker disk configuration, including switching between node-based quorum and node quorum with tiebreaker, without first shutting down GPFS on all of the nodes. For more information about CCR, see Cluster configuration repository.

Based on the information in the GPFS cluster configuration data, the GPFS commands generate and maintain a number of system files on each of the nodes in the GPFS cluster.

Linux

/etc/fstab

On Linux nodes, contains lists for all GPFS file systems that exist in the cluster.

AIX

/etc/filesystems

On AIX nodes, contains lists for all GPFS file systems that exist in the cluster.

All GPFS nodes

/var/mmfs/gen/mmfsNodeData

Contains GPFS cluster configuration data pertaining to the node.

/var/mmfs/gen/mmsdrfs

Contains a local copy of the mmsdrfs file from CCR.

/var/mmfs/gen/mmfs.cfg

Contains GPFS daemon startup parameters.