Installing IBM Spectrum Scale packages on SLES 12 systems
Use this information to manually install IBM Spectrum Scale™ packages on systems running on SLES 12.
- Download and extract IBM Spectrum Scale packages, and then accept the licensing agreement. For more information, see Extracting the GPFS software on Linux nodes and Accepting the electronic license agreement on Linux nodes.
The IBM Spectrum Scale RPMs for SLES 12 are extracted in the /usr/lpp/mmfs/4.2.1.0/sles12 directory.
- Install the IBM
Spectrum Scale RPMs,
including the Advanced Edition packages, using the following command.
# rpm -ivh gpfs.base*.rpm gpfs.gpl*rpm gpfs.gskit*rpm gpfs.msg*rpm gpfs.ext*rpm gpfs.adv*rpm gpfs.crypto*rpm
The system displays output similar to the following:
Preparing... ################################# [100%] Updating / installing... 1:gpfs.base-4.2.1-0 ################################# [ 14%] 2:gpfs.ext-4.2.1-0 ################################# [ 29%] 3:gpfs.adv-4.2.1-0 ################################# [ 43%] 4:gpfs.crypto-4.2.1-0 ################################# [ 57%] 5:gpfs.gpl-4.2.1-0 ################################# [ 71%] 6:gpfs.msg.en_US-4.2.1-0 ################################# [ 86%] 7:gpfs.gskit-8.0.50-57 ################################# [100%]
- Build the portability layer using the following command.
# /usr/lpp/mmfs/bin/mmbuildgpl
The system displays output similar to the following:
-------------------------------------------------------- mmbuildgpl: Building GPL module begins at Thu Mar 24 15:18:23 CST 2016. -------------------------------------------------------- Verifying Kernel Header... kernel version = 31228004 (3.12.28-4-default, 3.12.28-4) module include dir = /lib/modules/3.12.28-4-default/build/include module build dir = /lib/modules/3.12.28-4-default/build kernel source dir = /usr/src/linux-3.12.28-4/include Found valid kernel header file under /lib/modules/3.12.28-4-default/build/include Verifying Compiler... make is present at /usr/bin/make cpp is present at /usr/bin/cpp gcc is present at /usr/bin/gcc g++ is present at /usr/bin/g++ ld is present at /usr/bin/ld Verifying Additional System Headers... Verifying linux-glibc-devel is installed ... Command: /bin/rpm -q linux-glibc-devel The required package linux-glibc-devel is installed make World ... make InstallImages ... -------------------------------------------------------- mmbuildgpl: Building GPL module completed successfully at Thu Mar 24 15:18:31 CST 2016. --------------------------------------------------------
You might need to install prerequisite packages, if the portability layer cannot be built due to missing prerequisite packages. For a list of prerequisite packages, see Software requirements.
If the repository setup and the kernel configuration are correct, you can install the prerequisite packages using the following command:
# /usr/bin/zypper install -y package_name1 package_name2 ... package_nameN
For example, if kernel-default-devel, gcc, gcc-c++, and linux-glibc-devel are listed as the missing prerequisite packages, use the following command to install these packages:
# /usr/bin/zypper install -y kernel-default-devel gcc gcc-c++ linux-glibc-devel
Once IBM Spectrum Scale is built on all nodes, you can create the cluster. It is recommended to have an odd number of quorum nodes and that your NSD nodes be designated as quorum nodes
- Create the cluster using the following command.
# /usr/lpp/mmfs/bin/mmcrcluster -N nodeslist --ccr-enable -r /usr/bin/ssh -R /usr/bin/scp -C cluster1.spectrum
In this command example, nodeslist is a file that contains a list of nodes and node designations to be added to the cluster and its contents are as follows:
node1:quorum node2 node3 node4:quorum-manager node5:quorum-manager
Running the mmcrcluster command generates output similar to the following:
mmcrcluster: Performing preliminary node verification ... mmcrcluster: Processing quorum and other critical nodes ... mmcrcluster: Processing the rest of the nodes ... mmcrcluster: Finalizing the cluster data structures ... mmcrcluster: Command successfully completed mmcrcluster: Propagating the cluster configuration data to all affected nodes. This is an asynchronous process. # Thu Mar 24 15:33:06 CST 2016: mmcommon pushSdr_async: mmsdrfs propagation started Thu Mar 24 15:33:10 CST 2016: mmcommon pushSdr_async: mmsdrfs propagation completed; mmdsh rc=0
- Accept proper role licenses for the nodes using the following
commands.
- Accept the server licenses for the applicable nodes.
# /usr/lpp/mmfs/bin/mmchlicense server --accept -N node1,node4,node5
The system displays output similar to the following:
The following nodes will be designated as possessing server licenses: node1 node4 node5 mmchlicense: Command successfully completed mmchlicense: Warning: Not all nodes have proper GPFS license designations. Use the mmchlicense command to designate licenses as needed. mmchlicense: Propagating the cluster configuration data to all affected nodes. This is an asynchronous process. # Thu Mar 24 15:37:59 CST 2016: mmcommon pushSdr_async: mmsdrfs propagation started Thu Mar 24 15:38:01 CST 2016: mmcommon pushSdr_async: mmsdrfs propagation completed; mmdsh rc=0
- Accept the client licenses for the applicable nodes.
# /usr/lpp/mmfs/bin/mmchlicense client --accept -N node2,node3
The system displays output similar to the following:
The following nodes will be designated as possessing client licenses: node2 node3 mmchlicense: Command successfully completed mmchlicense: Propagating the cluster configuration data to all affected nodes. This is an asynchronous process. # Thu Mar 24 15:38:26 CST 2016: mmcommon pushSdr_async: mmsdrfs propagation started Thu Mar 24 15:38:28 CST 2016: mmcommon pushSdr_async: mmsdrfs propagation completed; mmdsh rc=0
IBM Spectrum Scale cluster is now created. You can view the configuration information of the cluster using the following command.
# /usr/lpp/mmfs/bin/mmlscluster
The system displays output similar to the following:
GPFS cluster information ======================== GPFS cluster name: cluster1.spectrum GPFS cluster id: 993377111835434248 GPFS UID domain: cluster1.spectrum Remote shell command: /usr/bin/ssh Remote file copy command: /usr/bin/scp Repository type: CCR GPFS cluster configuration servers: ----------------------------------- Primary server: node1 (not in use) Secondary server: (none) Node Daemon node name IP address Admin node name Designation -------------------------------------------------------------------- 1 node1 203.0.113.11 node1 quorum 2 node4 203.0.113.14 node4 quorum-manager 3 node5 203.0.113.15 node5 quorum-manager 4 node2 203.0.113.12 node2 5 node3 203.0.113.13 node3
- Accept the server licenses for the applicable nodes.