Changing the IP address on a RDMA-capable Ethernet port

Edit online

If you are using RDMA-capable Ethernet ports in your system, you can change the IP address on the ports that are used in these connections by using the service assistant GUI or the command-line interface.

If you need to change settings on RDMA-capable Ethernet ports, use the service assistant or the command-line interface. If communication between nodes is running, ensure that at least one redundant path is operational before you change any settings to the RDMA-capable Ethernet port. Some values cannot be changed, such as port ID or RDMA-type, which are based on the RDMA-capable adapter that is installed on the node.

If connectivity errors are present between nodes, you can change these values to fix these problems. You can view connectivity issues for RDMA-capable Ethernet ports in the management GUI or the service assistant on the Ethernet Connectivity page. The following connectivity problems can be present on RDMA-capable Ethernet ports and can require updates to port settings:
Table 1. RDMA-capable Ethernet ports connectivity issues and possible action
Connection Error Cause Possible Action
Protocol Mismatch Indicates that the protocol on the source and destination adapters is not the same. This error occurs when the RDMA-capable adapters are not using the same technology across all the nodes in the system. To fix this error, complete these steps:
  1. Install the 25-Gbps Ethernet adapters on each of the nodes. If you are using RDMA-technology for node-to-node communications, ensure that the RDMA-capable adapters use the same technology, such as RoCE or iWARP. These RDMA-capable adapters must be installed in the same slots across all the nodes of the system. These installation requirements ensure that port identifiers are the same across all nodes in the system.
  2. Redefine settings for the RDMA-capable Ethernet ports.
Unreachable Indicates that the local and remote IP addresses cannot be reached. This error can occur if one of the nodes in the system is offline. You can also use the ping command to troubleshoot connectivity issues between the nodes. Select Monitoring > Events to view errors and run any necessary fix procedures to return the node to an online status. After the errors are resolved, redefine the settings for RDMA-capable Ethernet ports.
Duplicate IP addresses Indicates that one or more IP addresses are being used in the network. Each node IP address must be unique. To fix this error, update the IP address for the port with a unique IP address.
Degraded Indicates that the negotiated speed on both the local and remote adapters is not the same. Degraded status occurs when one or both adapters are configured at lower speed rather than the maximum speed that the adapters support. To fix this issue, ensure that adapters on both nodes are configured at the maximum speed. Select Monitoring > Events to view error messages that are related to this connection status. Run any fix procedures that are associated with this status.
VLAN ID Mismatch If VLANs are being used in your network, this error indicates that the local and remote port virtual LAN identifiers are not the same. To fix this error, ensure that the local and remote nodes belong to the same VLAN. Verify that VLAN ID for both the local and target port are the same. If they are not, complete these steps to change the VLAN ID for the port:
  1. Ensure that VLAN support is configured correctly on the all the Ethernet switches in your network. On each switch, set VLAN to "Trunk" mode and specify the VLAN ID for the RDMA-capable Ethernet ports that will be in the same VLAN.
  2. If RDMA-capable Ethernet ports are already configured on the system, ensure that one redundant path remains available by updating only one port at a time.
  3. Since the VLAN ID cannot be changed independently and must be defined with other RDMA port settings, unconfigure the current IP address for the port in the service assistant or use the satask chnodeip -noip -port_id command.
  4. Redefine the port information, specifying the IP address and the correct VLAN ID. Use either the Service Assistant or command-line instructions.
  5. Wait at least 15 seconds before you complete these steps for the other ports in the system.

Using the service assistant GUI

If you are planning on changing VLAN ID settings for a node, ensure that you complete the following steps before you update settings for a RDMA-capable Ethernet port:
  1. Ensure that VLAN support is configured correctly on the all the Ethernet switches in your network. On each switch, set VLAN to "Trunk" mode and specify the VLAN ID for the RDMA-capable Ethernet ports that will be in the same VLAN.
  2. If RDMA-capable Ethernet ports are already configured on the system, ensure that one redundant path remains available by updating only one port at a time.
  3. Since the VLAN ID cannot be changed independently and must be defined with other settings on RDMA-capable Ethernet ports, clear the current IP address for the port by completing these steps:
    1. In a supported browser, enter the service IP address for one of the nodes in the system.
    2. In the service assistant GUI, select one of the nodes and select Change Node IP.
    3. On the Change Node IP panel, select the port to change and click Unconfigure.
    4. Click Save.
To change settings on the RDMA-capable Ethernet port, complete these steps:
  1. In a supported browser, enter the service IP address for one of the nodes in the system.
  2. In the service assistant GUI, select one of the nodes and select Change Node IP.
  3. On the Change Node IP panel, select the port to change and click Modify.
  4. After you make the changes, click Save.
  5. If you have other ports to change, wait at least 15 seconds before you update other ports.

Using the command-line interface

If you are planning on changing VLAN ID settings for a node, ensure that you complete the following steps before you update settings for an RDMA-capable Ethernet port:
  1. Ensure that VLAN support is configured correctly on the all the Ethernet switches in your network. On each switch, set VLAN to "Trunk" mode and specify the VLAN ID for the RDMA-capable Ethernet ports that will be in the same VLAN.
  2. If RDMA-capable Ethernet ports are already configured on the system, ensure that one redundant path remains available by updating only one port at a time.
  3. Since the VLAN ID cannot be changed independently and must be defined with other RDMA port settings, clear the current IP address for the port by entering the following command:
    satask chnodeip -noip  -port_id port_number
    where -npip clears the current IP address for the specified port (port_number).
To change settings on the RDMA-capable Ethernet ports on a node, enter the following command:
satask chnodeip  -ip ip_address -mask mask -gw gateway -port_id port_number -vlan vlanid panel_name
where ip_address is the IP address for the new RDMA port and node name (panel_name) is the name of the node to which you are adding the new port.
To verify that the new IP address is added to the node, enter the following command:
sainfo lsnodeipconnectivity
In the results that are displayed, verify that the changes to the RDMA-capable Ethernet ports are updated.