Planning and configuring network

Management server network planning is essential for the deployment of IBM Storage Scale Systems. You can ensure stable communication between nodes, support high-speed data transfers, and enable redundancy for high availability. The network configuration enhances security through segmentation and firewall policies, can ensure accurate time synchronization, and supports both IPv4 and IPv6 environments.

Management servers and switches

IBM Storage Scale System needs a management server node and a management switch.
  • One management server: Power9, IBM® Storage Scale System Utility Node, or any other management server.

    For more information about Utility Node, see IBM Storage Scale Utility Node documentation.

  • Dual socket Utility Node:

    Starting with IBM Storage Scale System 6.2.3.0, you can configure a dual-socket IBM Storage Scale System Utility Node as a management server.

    The characteristics of this dual-socket management server are as follows:
    • One more socket is available.
    • Maximum memory of 1 TB.
    • Default memory of 512 GB.
    • Minimum memory of 256 GB.
    • The key difference between a single-socket and a dual-socket management server is the management NIC placement. The NIC must be installed in slot 5.
    • Slot 1 supports an NVIDIA ConnectX-6 or ConnectX-7 VPI adapter that allows the system to accommodate a third VPI card.
    Note: Support for single-socket management server continues.
    Figure 1. Slot placement rules (dual-socket management server)
    Dual-socket IBM Storage Scale System Utility Node
    •  1, 2, 4  NVIDIA Connect X-6 and ConnectX-7 (VPI)
    •  5  Management NIC

    For more information about the slot placement rules for an Utility Node, see Slot placement summary for the Utility Node (MTM 5149-23E) in the IBM Storage Scale System Utility Node Hardware Planning and Installation Guide.

  • Switch: A high-speed switch, InfiniBand or Ethernet, for cluster communication. The switch must be split into management VLAN (VLAN 102) and FSP/BMC VLAN (VLAN 101).
The following table lists the ports that are connected to the management server VLAN:
IBM Storage Scale System Management server Port/Connection VLAN Notes
3000 Power9 C11-T1 Management VLAN IPs and hostnames for all nodes
C11-T2 FSP VLAN  
C11-T3 Campus network or additional management connection Recommended to access the management server and maintain a connection when the container starts.
HMC1 FSP VLAN  
Port 1 on each canister Management VLAN IPs and hostnames for all nodes
5000 Power9 C11-T1 Management VLAN IPs and hostnames for all nodes
C11-T2 FSP VLAN  
C11-T3 Campus network Recommended for remote access and GUI
HMC1 FSP VLAN  
3200 Power9 C11-T1 Management VLAN IPs and hostnames for all nodes
  C11-T2 FSP VLAN
C11-T3 Campus network Recommended for remote access and GUI
HMC1 FSP VLAN  
Nodes (per canister) Single management connection Each connection is split into 2 MAC addresses: BMC and operating system. The BMC connection requires a VLAN tag that must be set for proper communication with the management server node.
BMC connection Shared management port VLAN 101, BMC traffic routed through VLAN 101
Management connection Shared management port VLAN 102, visible to OS
High-speed connections InfiniBand or Ethernet  

Examples of management server network

Figure 2. IBM Storage Scale Systems 3000, 3200, and 5000 management server network
3000, 5000, 3200 management server network

The highlighted green ports are trunk ports of only IBM Storage Scale System 3200. These ports needed for each IBM Storage Scale System 3200 canister that has a single interface for the BMC and the OS but unique MAC addresses. By using a VLAN tag, canister BMC MAC addresses are routed to the BMC/FSP/Service VLAN (Default is 101).
IBM racked orders have the preconfigured switch. Only the VLAN tag needs to be set. If you have an existing IBM Cumulus switch or customer-supplied switch, it needs to be modified to accommodate the IBM Storage Scale System 3200 trunk port requirement. For more information, see Configuring a switch VLAN.

Note: Start of changeConnect C11-T3 to a campus connection or run an additional management connection. Else, you lose the connection to the management server node when the container starts.End of change
Figure 3. IBM Storage Scale Systems 3200 and 5000 management server network
3200 management server network
Figure 4. IBM Storage Scale Systems 3500 and 6000 management server network
Network 3500 and 6000 connections