IBM Platform HPC provides the ability to customize the network configuration of compute nodes via Network Profiles. Network Profiles support a custom NIC script for each defined interface. This provides the ability to configure network bonding and bridging. This tip provides a detailed example of how to configure a network bridge in a cluster managed by IBM Platform HPC.
IBM Platform HPC includes xCAT technology for cluster provisioning. xCAT includes a script (/install/postscripts/xHRM) which may be used to configure network bridging. This script is used as a custom network script in the following example.
- Pre- condition:
You can also use the lsdef command to view the configuration of the provision network:
# lsdef -t network provision
You can also use the lsdef command to view the Network Profile default_network_profile configuration:
# lsdef -t group __NetworkProfile_default_network_profile
The following steps describe how to configure a network bridge br0 against eth0 for compute nodes using the Network Profile default_network_profile.
1. Add a new Network Profile with name default_network_profile_bridge in the Platform HPC Web Portal. As an Administrator user, browse to Resources > Node Provisioning > Provisioning Templates > Network Profiles and click Add.
2. Add the required devices:
- -> Type: Ethernet
- -> Network: provision
- -> Type: Customized/Other
- -> Network: provision
- -> Configuration Command: xHRM bridgeprereq eth1:br0 (creates network bridge br0 against eth1)
The new Network Profile default_network_profile_bridge is shown below.
3. Provision the nodes using the new Network Profile default_network_profile_bridge.
- To begin the process of adding nodes, go to: Resources > Devices > Nodes in the Platform HPC Web Portal and click Add.
- (Optional) In the Add Nodes dialog, select Node Group compute.
- Select Specify Properties for the provisioning template. This will allow you to select the newly created network profile default_network_profile_bridge.
- Click Next.
Nodes are added using Auto discovery by PXE boot. Nodes may also be added using a node information file.
The nodes are powered on, detected by IBM Platform HPC and provisioned.
In this example, node compute000, are detected and subsequently provisioned.
4. Once the nodes have been provisioned and complete their initial boot, they appear in the IBM Platform HPC Web console in Resources > Devices > Nodes with Status booted and Workload Agent OK.
You can see that the network bridge is configured on the nodes as expected. Go to Resources > Devices > Nodes In the Platform HPC Web Portal, select the Summary tab, and scroll down to Other Key Properties.
Finally, use the xdsh command to remotely execute ifconfig on node compute000 to check the configuration of interface br0.
# xdsh compute000 ifconfig br0
compute000: br0 Link encap:Ethernet HWaddr 00:0C:29:E6:0A:0F
compute000: inet addr:188.8.131.52 Bcast:184.108.40.206 Mask:255.255.0.0
compute000: inet6 addr: fe80::6cfe:a1ff:fe08:5d60/64 Scope:Link
compute000: UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
compute000: RX packets:1821 errors:0 dropped:0 overruns:0 frame:0
compute000: TX packets:10 errors:0 dropped:0 overruns:0 carrier:0
compute000: collisions:0 txqueuelen:0
compute000: RX bytes:84366 (82.3 KiB) TX bytes:1236 (1.2 KiB)