Network layout and configuration

IBM Storage Fusion HCI System has two physical networks defined within it: a high-speed network for use by the storage cluster and applications, and a management network that is used for controlling the servers and monitoring the health of the servers.

100GbE High Speed Network Switch (Model S01)

The high-speed network is built around a pair of 32-port, 100Gb Ethernet switches. The switches are configured together using MLAG to create a redundant pair. All of the compute-storage servers and the GPU servers have a 2-port, 100Gb Ethernet adapter. One port on the adapter is connected to the first high-speed switch and the second port is connected to the second high-speed switch. This 100GbE connections are reserved for use by the storage cluster. All of the compute-storage servers and the GPU servers also have a 2-port, 25Gb Ethernet adapter. Using breakout cables that split the 100GbE ports on the switch into four 25GbE ports, one port on the server’s 25 GbE network adapter is connected to the first high-speed switch and the second port is connected to the second high-speed switch. The AFM servers do not have a 2-port, 100 GbE network adapter. Instead, these servers have two of the 2-port 25GbE network adapters. Again, using breakout cables, each of the adapters has one port that is connected to the first high-speed switch and the other port that is connected to the other high-speed switch. The 25GbE network that is connected are intended for use by the Red Hat® OpenShift® cluster and the applications that are deployed within that cluster.

RU20 to RU21

1GbE Management Network Switch (Model S02)

The management network is built around a pair of 48-port, 1Gb Ethernet switches. The IMM port of every IBM Storage Fusion HCI System server is connected to the first of the management switches using CAT5e cables with RJ45 connectors. The alternate IMM port, on either the LOM or an OCP adapter, is configured for all IBM Storage Fusion HCI System servers and it is connected to the second management switch. These connections are also made using CAT5e cables with RJ45 connectors. This is all done so that there is redundancy to support management functions even if one of the management switches fail or one of the cables become disconnected. Each management port from the high speed switches (S01s) as well as each of the 6 rack PDUs are connected to the management network switches.

RU18 to RU19