Cluster Export Services (CES) provides highly available file and
object services to a GPFS cluster by using Network File System (NFS), Hadoop Distributed File System
(HDFS), Object, or Server Message Block (SMB) protocols.
For more information, see Cluster Export Services overview.
CES requires a shared root directory (cesSharedRoot) to install and
configure CES protocol services on each node. This directory is used by protocols such as NFS and
Object to store CES shared configuration data and support protocol recovery and other
protocol-specific operations. This directory tree can reside anywhere on a IBM
Storage Scale file system. However, it is recommended to use a
dedicated file system to clearly separate protocol data from user data. For
more information, see Create a CES shared root directory and object fileset and Setting up Cluster Export Services shared root file system.
Important:
- If you plan to install and configure CES, all protocols available on your platform must be
installed. Installing a subset of available protocols is not supported.
Procedure
- Unmount GPFS file systems and stop
GPFS on all nodes by using the following
command:
- Configure the CES shared root file system by using the following command:
# mmchconfig cesSharedRoot=/gpfs/fs0
- Start GPFS on all nodes in the
cluster by using the following command:
- Enable CES on the required nodes by using the following command:
# mmchnode -–ces-enable –N prnode1,prnode2,prnode3
- Add to the protocol nodes that the IP addresses designated to be used for CES
connectivity by using the following command:
# mmces address add --ces-node prnode1 --ces-ip CESIPAddress
- Verify the CES configuration by using the following commands:
# mmlscluster --ces
# mmces address list
Currently, there are no services that are enabled. You can verify by using the mmces
service list -a command. A sample output is as follows:
No CES services are enabled.
- Download and extract IBM
Storage Scale
protocol packages, and then accept the licensing agreement. For more information, see Extracting the IBM Storage Scale software on Linux nodes and Accepting the electronic license agreement on Linux nodes.
- Remove conflicting Samba packages that might have been
installed on each CES node by issuing one of the following commands, depending on the operating
system.
- Install IBM
Storage Scale SMB package by
issuing one of the following commands, depending on the operating system.
- On Red Hat Enterprise Linux and SLES, issue the following
command:
# rpm -ivh gpfs.smb*.rpm
- On Ubuntu, issue the following
command:
# dpkg -i gpfs.smb*.deb
- Install IBM
Storage Scale NFS packages by
issuing one of the following commands, depending on the operating system.
- On Red Hat Enterprise Linux and SLES, issue the following
command:
# rpm -ivh NFS_Package_Name1 NFS_Package_Name2 ... NFS_Package_NameN
- On Ubuntu, issue the following
command:
# dpkg -i NFS_Package_Name1 NFS_Package_Name2 ... NFS_Package_NameN
If
you cannot install NFS package because of any error by using the dpkg -i command,
issue the following
command:# apt install ./NFS_Package_Name1 ./NFS_Package_Name2 ... ./NFS_Package_NameN
This
command installs the specified local package files.Note: Before
installing IBM
Storage Scale 5.1.x on Ubuntu operating
system, make sure that upstream NFS Ganesha package is not installed or configured in the protocol
nodes. If the NFS Ganesha package is installed or configured, then uninstall the package by using
the apt purge nfs-ganesha command.
- Install IBM
Storage Scale S3 packages by issuing the following
commands:
Install the pre-requisite on all CES
nodes.
rpm -ivh bzip2
Install the respective S3
related
RPMs.
rpm -ivh noobaa-core-* gpfs.mms3*.rpm
What to do next
If you plan to use IPv6 addresses, you must enable the CES interface mode. For more
information, see Configuring CES protocol service IP addresses.