Converting existing recovery groups to mmvdisk management

To manage existing ESS recovery group pairs using mmvdisk, you must convert them to the mmvdisk IBM Storage Scale RAID configuration structure. This task is accomplished with the mmvdisk recoverygroup convert command.

The mmvdisk recoverygroup list command displays in the remarks column which existing recovery groups are not managed by mmvdisk:

# mmvdisk recoverygroup list

                                                            needs    user
recovery group  active   current or master server          service  vdisks  remarks
--------------  -------  --------------------------------  -------  ------  -------
ESS01L          yes      ess01io1.gpfs.net                 no            5  non-mmvdisk
ESS01R          yes      ess01io2.gpfs.net                 no            5  non-mmvdisk

A recovery group pair must be converted together, and the two recovery groups must share an mmvdisk node class. An unused node class name must be specified, which will be created as an mmvdisk node class containing the two servers for the recovery group pair.

The IBM Storage Scale RAID configuration for the servers is set under the mmvdisk node class using the same settings that would be used for new mmvdisk recovery groups.

The user vdisk NSDs in the recovery group pair are matched into vdisk sets according to their file systems and attributes. The converted vdisk sets are given generated names, which can be changed later to something more meaningful using the mmvdisk vdiskset rename command.

To convert existing recovery groups ESS01L and ESS01R with a new mmvdisk node class ESS01, run the following command:

# mmvdisk recoverygroup convert --recovery-group ESS01L,ESS01R --node-class ESS01 --recycle one

mmvdisk: This command will permanently change the GNR configuration
mmvdisk: attributes and disable the legacy GNR command set for the
mmvdisk: servers and recovery groups involved, and their subsequent
mmvdisk: administration must be performed with the mmvdisk command.

mmvdisk: Do you wish to continue (yes or no)? yes

mmvdisk: Converting recovery groups 'ESS01L' and 'ESS01R'.
mmvdisk: Creating node class 'ESS01'.
mmvdisk: Adding 'ess01io1' to node class 'ESS01'.
mmvdisk: Adding 'ess01io2' to node class 'ESS01'.
mmvdisk: Associating recovery group 'ESS01L' with node class 'ESS01'.
mmvdisk: Associating recovery group 'ESS01R' with node class 'ESS01'.
mmvdisk: Recording pre-conversion cluster configuration in /var/mmfs/tmp/mmvdisk.convert.ESS01L.ESS01R.before.m24
mmvdisk: Updating server configuration attributes.
mmvdisk: Checking resources for specified nodes.
mmvdisk: Setting configuration for node class 'ESS01'.
mmvdisk: Defining vdisk set 'VS001_fs3' with recovery group 'ESS01L' (vdisk 'ESS01Lv3fs3').
mmvdisk: Defining vdisk set 'VS002_fs4' with recovery group 'ESS01L' (vdisk 'ESS01Lv4fs4').
mmvdisk: Defining vdisk set 'VS003_fs1' with recovery group 'ESS01L' (vdisk 'ESS01Lv1fs1data').
mmvdisk: Defining vdisk set 'VS004_fs2' with recovery group 'ESS01L' (vdisk 'ESS01Lv2fs2').
mmvdisk: Defining vdisk set 'VS005_fs1' with recovery group 'ESS01L' (vdisk 'ESS01Lv1fs1meta').
mmvdisk: Adding recovery group 'ESS01R' to vdisk set 'VS003_fs1' (vdisk 'ESS01Rv1fs1data').
mmvdisk: Adding recovery group 'ESS01R' to vdisk set 'VS004_fs2' (vdisk 'ESS01Rv2fs2').
mmvdisk: Adding recovery group 'ESS01R' to vdisk set 'VS001_fs3' (vdisk 'ESS01Rv3fs3').
mmvdisk: Adding recovery group 'ESS01R' to vdisk set 'VS005_fs1' (vdisk 'ESS01Rv1fs1meta').
mmvdisk: Adding recovery group 'ESS01R' to vdisk set 'VS002_fs4' (vdisk 'ESS01Rv4fs4').
mmvdisk: Committing cluster configuration changes.
mmvdisk: Recording post-conversion cluster configuration in /var/mmfs/tmp/mmvdisk.convert.ESS01L.ESS01R.after.m24

mmvdisk: Restarting GPFS on the following nodes:
mmvdisk:     ess01io1.gpfs.net
mmvdisk: Restarting GPFS on the following nodes:
mmvdisk:     ess01io2.gpfs.net

The recovery groups ESS01L and ESS01R are now under mmvdisk management. The remarks column of mmvdisk recoverygroup list is blank:

# mmvdisk recoverygroup list

                                                            needs    user
recovery group  active   current or master server          service  vdisks  remarks
--------------  -------  --------------------------------  -------  ------  -------
ESS01L          yes      ess01io1.gpfs.net                 no            5
ESS01R          yes      ess01io2.gpfs.net                 no            5

The converted vdisk sets can be listed to examine their attributes and sizing:

# mmvdisk vdiskset list --vdisk-set all

                     member vdisks
vdisk set       count   size   raw size  created  file system and attributes
--------------  ----- -------- --------  -------  --------------------------
VS001_fs3           2   59 TiB   82 TiB  yes      fs3, DA1, 8+3p, 16 MiB, dataAndMetadata, system
VS002_fs4           2  204 TiB  282 TiB  yes      fs4, DA1, 8+3p, 16 MiB, dataAndMetadata, system
VS003_fs1           2  297 TiB  410 TiB  yes      fs1, DA1, 8+3p, 16 MiB, dataOnly, data
VS004_fs2           2   51 TiB   91 TiB  yes      fs2, DA1, 4+3p, 4 MiB, dataAndMetadata, system
VS005_fs1           2   11 TiB   45 TiB  yes      fs1, DA1, 4WayReplication, 1 MiB, metadataOnly, system

                declustered           capacity            all vdisk sets defined
recovery group     array     total raw  free raw  free%  in the declustered array
--------------  -----------  ---------  --------  -----  ------------------------
ESS01L          DA1            911 TiB    64 GiB     0%  VS001_fs3, VS002_fs4, VS003_fs1, VS004_fs2,
                                                         VS005_fs1
ESS01R          DA1            911 TiB    64 GiB     0%  VS001_fs3, VS002_fs4, VS003_fs1, VS004_fs2,
                                                         VS005_fs1

                  vdisk set map memory per server
node class  available  required  required per vdisk set
----------  ---------  --------  ----------------------
ESS01          29 GiB    16 GiB  VS001_fs3 (1448 MiB), VS002_fs4 (4994 MiB), VS003_fs1 (7249 MiB),
                                 VS004_fs2 (1921 MiB), VS005_fs1 (568 MiB)

The vdisk sets can be renamed to suit the administrator's preferences, and the mmvdisk file system characteristics can be listed:

# mmvdisk vdiskset rename --vdisk-set VS005_fs1 --new-name fs1meta
mmvdisk: Vdisk set 'VS005_fs1' renamed to 'fs1meta'.
# mmvdisk vdiskset rename --vdisk-set VS003_fs1 --new-name fs1data
mmvdisk: Vdisk set 'VS003_fs1' renamed to 'fs1data'.
# mmvdisk filesystem list --file-system fs1

                                vdisk     list of       holds    holds  storage
vdisk set       recovery group  count  failure groups  metadata  data    pool
--------------  --------------  -----  --------------  --------  -----  -------
fs1data         ESS01L              1               1  no        yes    data
fs1data         ESS01R              1               2  no        yes    data
fs1meta         ESS01L              1               1  yes       no     system
fs1meta         ESS01R              1               2  yes       no     system

Multiple ESS building blocks, with multiple recovery group pairs, must be converted one pair at a time. If a pre-mmvdisk file system spans multiple recovery group pairs, it is not recognized as an mmvdisk file system until all of the recovery groups with vdisk NSDs for the file system are converted.