IBM Storage Scale System Quick Deployment Guide
This guide is intended for system administrators, installers, and programmers of IBM Storage Scale clusters who are experienced with the operating systems on which each IBM Storage Scale cluster is based.
| Components | 3000 | 3200 | 3500 | 5000 | 6000 | Utility Node | BYOMS |
|---|---|---|---|---|---|---|---|
| IBM Storage Scale | 5.2.3.5 efix1 | 5.2.3.5 efix1 | 5.2.3.5 efix1 | 5.2.3.5 efix1 | 5.2.3.5 efix1 | 5.2.3.5 efix1 | 5.2.3.5 efix1 |
| Operating system |
RHEL 8.10 | RHEL 8.10 | RHEL 9.6 | RHEL 8.10 | RHEL 9.6 | RHEL 9.6 | RHEL 8.10 |
| Kernel | 4.18.0-553.79.1.el8_10 | 4.18.0-553.79.1.el8_10 | 5.14.0-570.52.1.el9_6 | 4.18.0-553.79.1.el8_10 | 5.14.0-570.52.1.el9_6 | 5.14.0-570.52.1.el9_6 | 4.18.0-553.79.1.el8_10 |
| Systemd | 239-82.el8_10.5 | 239-82.el8_10.5 | 252-51.el9_6.2 | 239-82.el8_10.5 | 252-51.el9_6.2 | 252-51.el9_6.2 | 239-82.el8_10.5 |
| Network Manager |
1.40.16-20.el8_10 | 1.40.16-20.el8_10 | 1.52.0-7.el9_6 | 1.40.16-20.el8_10 | 1.52.0-7.el9_6 | 1.52.0-7.el9_6 | 1.40.16-20.el8_10 |
| Glibc | 2.28-251.el8_10.25 | 2.28-251.el8_10.25 | 2.34-168.el9_6.23 | 2.28-251.el8_10.25 | 2.34-168.el9_6.23 | 2.34-168.el9_6.23 | 2.28-251.el8_10.25 |
| OFED | 25.07-0.9.7 | 25.07-0.9.7 | 25.07-0.9.7 | 25.07-0.9.7 | 25.07-0.9.7 | 25.07-0.9.7 | 25.07-0.9.7 |
Support matrix
| Management server type | Supports |
|---|---|
| IBM® Storage Scale System Utility Node |
|
| IBM Power9 management server |
|
Bring your own management server
(BYOMS) |
|
Network requirement
Code version
All supported IBM Storage Scale System nodes are supported within two editions: Data Management
Edition and Data Access Edition. An example of package names is as
follows:
ess_6.2.3.3_0611-23.tar.xzNote:
- The versions shown here might not be the GA version available on IBM Fix Central. It is recommended to go to IBM Fix Central and download the latest code.
- ppc64le in the package name implies that each container runs on a POWER®-based EMS. For details about functions supported by respective containers, see Support matrix.
- The x86 packages run on IBM Storage Scale System Utility Node EMS or BYOE.
You can download the latest 6.1.x.x code (6.2.3.3 is the latest) from IBM Fix Central by using the following link.
A unified container is available for both Data management and Data access editions on x86_64
and ppc64le architectures. Example package name of the container is as
follows:
Scale_System_UNIFIED-6.2.3.3-EMS.tgzNote: The container installs and runs on the EMS only. The EMS supported is Power-based only.
Running container on a x86-based node is not supported as of now.
Upgrade support matrix
To  |
6.2.3.3 | 6.2.3.2 | 6.2.3.1 | 6.2.3.0 | 6.2.2.1 | 6.2.2.0 | 6.2.1.1 | 6.2.1.0 | 6.2.0.1 | 6.2.0.0 | 6.1.9.8 | 6.1.9.7 | 6.1.9.6 | 6.1.9.5 | 6.1.9.4 | 6.1.9.3 | 6.1.9.2 | 6.1.9.1 | 6.1.9.0 | 6.1.8.3 | 6.1.8.2 | 6.1.8.1 | 6.1.8.0 | 6.1.6.1 | 6.1.6.0 | 6.1.5.1 | 6.1.5.0 | 6.1.4.1 | 6.1.4.0 | 6.1.3.1 | 6.1.3.0 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
From  |
|||||||||||||||||||||||||||||||
| 6.2.3.3 | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- |
| 6.2.3.2 |  |
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- |
| 6.2.3.1 | |
|
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- |
| 6.2.3.0 | |
|
|
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- |
| 6.2.2.1 | |
|
|
|
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- |
| 6.2.2.0 | |
|
|
|
|
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- |
| 6.2.1.1 | |
|
|
|
|
|
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- |
| 6.2.1.0 | |
|
|
|
|
|
|
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- |
| 6.2.0.1 | |
|
|
|
|
|
|
|
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- |
| 6.2.0.0 | |
|
|
|
|
|
|
|
|
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- |
| 6.1.9.8 | |
 |
|
|
|
|
|
|
|
|
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- |
| 6.1.9.7 | |
|
|
|
|
|
|
|
|
|
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- |
| 6.1.9.6 (LTS) |
|
|
|
|
|
|
|
|
|
|
|
|
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- |
| 6.1.9.5 (LTS) |
|
|
|
|
|
|
|
|
|
|
|
|
|
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- |
| 6.1.9.4 (LTS) |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- |
| 6.1.9.3 | |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- |
| 6.1.9.2 | |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- |
| 6.1.9.1 | |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- |
| 6.1.9.0 | |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- |
| 6.1.8.3 | |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- |
| 6.1.8.2 | |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- |
| 6.1.8.1 | |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- |
| 6.1.8.0 | |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
-- | -- | -- | -- | -- | -- | -- | -- | -- |
| 6.1.6.1 | |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
-- | -- | -- | -- | -- | -- | -- | -- |
| 6.1.6.0 | |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
-- | -- | -- | -- | -- | -- | -- |
| 6.1.5.1 | |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
-- | -- | -- | -- | -- | -- |
| 6.1.5.0 | |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
-- | -- | -- | -- | -- |
| 6.1.4.1 | |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
-- | -- | -- | -- |
| 6.1.4.0 | |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
-- | -- | -- |
| 6.1.3.1 | |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
-- | -- |
| 6.1.3.0 | |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
-- |
- --: Not applicable
- : Supported
- : Not supported
Note:
- For customers that are upgrading from levels older than IBM Storage Scale System 6.1.2.0, contact support for guidance.
- LTS to LTS upgrade to 6.2.3.3 is available.
- 6.2.0.0, 6.2.0.1 to 6.2.3.x upgrade is not allowed on IBM Storage Scale System 3500 nodes.
Node classes
All building blocks have node classes except the EMS node. Instead of a node list, you can use these node classes in the essrun command when the inventory file contains these nodes. (The essrun config load command adds the nodes to the inventory file.)
Where node classes are as follows:
- IBM Storage Scale System 5000: ess_ppc64le
- IBM Storage Scale System 3000: ess_x86_64
- IBM Storage Scale System 3200: ess3200_x86_64
- IBM Storage Scale System 3500: ess3500_x86_64
- Protocol Power9: ces_ppc64le
- IBM Storage Scale System 6000: s6k_x86_64
Deployment/upgrade instructions
- Log in to the EMS (over management), set root password, set campus connection.
- Campus connection interface is called ‘campus’. Use nmtui to set an address.
- Set the EMS hostname.
- Log out and log in over the campus connection.
- Set up the /etc/hosts
file.
127.0.0.1 localhost localhost.localdomain.local localhost4 localhost4.localdomain4 ## Management IPs 192.168.45.0/24 192.168.45.20 ems1.localdomain.local ems1 192.168.45.21 essio1.localdomain.local essio1 192.168.45.22 essio2.localdomain.local essio2 192.168.45.23 prt1.localdomain.local prt1 192.168.45.24 prt2.localdomain.local prt2 ## High-speed IPs 10.0.11.0/24 10.0.11.1 ems1-hs.localdomain.local ems1-hs 10.0.11.2 essio1-hs.localdomain.local essio1-hs 10.0.11.3 essio2-hs.localdomain.local essio2-hs 10.0.11.4 pr1-hs.localdomain.local prt1-hs 10.0.11.5 pr2-hs.localdomain.local prt2-hs ## Protocol CES IPs 10.0.11.100 prt_ces1.localdomain.local prt_ces1 10.0.11.101 prt_ces1.localdomain.local prt_ces1 10.0.11.102 prt_ces2.localdomain.local prt_ces2 10.0.11.103 prt_ces2.localdomain.local prt_ces2 - Copy the GA code into the /etc/deploy directory.
- Extract outer tarball.
- Decompress the inner xz
file.
xz --decompress ess_6.2.3.3_0613-04_dae_ppc64le.tar.xz - Extract tar
file.
tar xvf ess_6.2.3.3_0613-04_dae_ppc64le.tar - Run the installer.
- Start the
container.
sh ess_6.2.3.3_0613-04_dae_ppc64le - Answer any user prompts.
- Start the
container.
Configuration in the container
- Run Config load.
essrun -N ems1,essio1,essio2 config load -p - Run update
--precheck.
essrun -N ems1,essio1,essio2 update --precheck - Update EMS.When you upgrade IBM Storage Scale System 5000 nodes, you cannot upgrade the firmware because of a restriction.For example,
Add the --offline option for an offline upgrade and the --online option an online only upgrade.essrun -N ess5kio1,ess5kio2 update- Update EMS offline.
essrun -N ems1 update --offline - If you are prompted to reboot then run the command again.
- If you need to restart the container after reboot run the following command:
./essmkyml - Update the EMS again.
essrun -N ems1 update --offline
- Update EMS offline.
- Update I/O nodes.
- Update I/O nodes
online.
essrun -N <Node List/Node Name> update - Update I/O nodes
offline.
essrun -N <Node List/Node Name> update --offline
- Update I/O nodes
online.
- Update POWER firmware. For more information see, How can I upgrade the Power9 firmware? in the IBM Storage Scale System: Deployment Guide
- Create network
bonds.
essrun -N ems1,essio1,essio2 network --suffix=-hs - Run network
test.
ssh essio1ESSENV=TEST essnettest -N essio1,essio2 --suffix=-hs - Create a
cluster.
essrun -N <Node List/Node Name> cluster --suffix=-hs - Add EMS.
essrun -N essio1 cluster --add-ems ems1 --suffix=-hs - Create a file
system.
essrun -N ess3500_x86_64 filesystem --name fs1 --suffix=-hsNote: For ESS 3500, you must keep 1.5 TB or more space free if future capacity MES is planned (performance to hybrid). Thus, it is recommended to not use all available space when you create a file system for the performance model. The default allocation is 80% of available space when you use the essrun filesystem command (for x86 nodes). - Final installation check per node.
essinstallcheck -N localhost - Check whether all nodes
performance.
gnrhealthcheckmmhealth node show -a - Set up Chrony/NTP.
- Set up call home.
- Enable added security (SELinux/firewall/sudo/admin central).
- Configure the
GUI/collectors.
essrun -N ems1,essio1,essio2 gui --configure - Set up conserver.
- Set up protocol services (3500 or P9 Protocol nodes or IBM Storage Scale Utility Protocol Node).
- Set up client nodes.
Note: If you want to add a building block, see the How do I add
additional nodes or building blocks? in the IBM Storage Scale
System: Deployment
Guide