Add a network in a high availability environment

In an existing high availability environment, add a new public network, such as an InfiniBand network.

Procedure

  1. Configure the new network settings on the active management node, where eth2 is the newly added network interface.
    • For Linux, IP addresses are configured in the /etc/sysconfig/network-scripts/ifcfg-eth2 scripts.
      # cat /etc/sysconfig/network-scripts/ifcfg-eth2
      DEVICE=eth2
      BOOTPROTO=none
      ONBOOT=yes
      NM_CONTROLLED=yes
      IPADDR=10.10.10.10
      NETMASK=255.255.255.0
      TYPE=Ethernet
      GATEWAY=10.10.10.2
      IPV6INIT=no
      USERCTL=no
      #ifup eth2
    • For Ubuntu, IP addresses are configured in /etc/network/interfaces.
      # cat /etc/network/interfaces
      # This file describes the network interfaces available on your system
      # and how to activate them. For more information, see interfaces(5).
      
      # The loopback network interface
      auto lo
      iface lo inet loopback
      
      # The primary network interface
      auto eth0
      iface eth0 inet static
              address 9.21.52.162
              netmask 255.255.255.0
              network 9.21.52.0
              broadcast 9.21.52.255
              gateway 9.21.52.2
              # dns-* options are implemented by the resolvconf package, if installed
              dns-nameservers 9.21.48.113
              dns-search eng.platformlab.ibm.com
      
      auto eth1
      iface eth1 inet static
              address 10.10.10.2
              netmask 255.255.255.0
      
      auto eth2
      iface eth2 inet static
              address 11.11.11.2
              netmask 255.255.255.0
      
      # ifup eth2
    Note: Use ifconfig to check if the new IP addresses are available, and configure the virtual IP address for the new network.
  2. Configure the new network settings on the standby management node, where eth2 is the new added network interface.
    • For Linux, IP addresses are configured in the /etc/sysconfig/network-scripts/ifcfg-eth2 scripts.
      # cat /etc/sysconfig/network-scripts/ifcfg-eth2
      DEVICE=eth2
      BOOTPROTO=none
      ONBOOT=yes
      NM_CONTROLLED=yes
      IPADDR=10.10.10.11
      NETMASK=255.255.255.0
      TYPE=Ethernet
      GATEWAY=10.10.10.2
      IPV6INIT=no
      USERCTL=no
      #ifup eth2
    • For Ubuntu, IP addresses are configured in /etc/network/interfaces.
      # cat /etc/network/interfaces
      # This file describes the network interfaces available on your system
      # and how to activate them. For more information, see interfaces(5).
      
      # The loopback network interface
      auto lo
      iface lo inet loopback
      
      # The primary network interface
      auto eth0
      iface eth0 inet static
              address 9.21.52.163
              netmask 255.255.255.0
              network 9.21.52.0
              broadcast 9.21.52.255
              gateway 9.21.52.2
              # dns-* options are implemented by the resolvconf package, if installed
              dns-nameservers 9.21.48.113
              dns-search eng.platformlab.ibm.com
      
      auto eth1
      iface eth1 inet static
              address 10.10.10.3
              netmask 255.255.255.0
      
      auto eth2
      iface eth2 inet static
              address 11.11.11.3
              netmask 255.255.255.0
      
      # ifup eth2
    Note: Use ifconfig to check if the new IP addresses are available.
  3. Modify the networks table according to the new network attributes.
    # tabedit networks
    # tabdump networks
    #netname,net,mask,mgtifname,gateway,dhcpserver,tftpserver,nameservers,ntpservers,
    logservers,dynamicrange,staticrange,staticrangeincrement,nodehostname,ddnsdomain,
    vlanid,domain,comments,disable
    "provision","172.20.7.0","255.255.255.0","eth1","172.20.7.2",,,,,,"172.20.7.201-
    172.20.7.254","172.20.7.3-172.20.7.200","1",,,,"private.dns.zone",,
    "newnet","10.10.10.0","255.255.255.0","eth2","10.10.10.10",,,,,,"10.10.10.201-
    10.10.10.254","10.10.10.3-10.10.10.200","1",,,,,,
  4. Modify the node attribute to add the new network interface in NIC table for the active management node, standby management node and virtual management node.
    # chdef -t node -o primarymn nicips=’eth0!172.20.7.10,eth1!192.168.1.5,
    eth2!10.10.10.10’ 
    nichostnamesuffixes=’eth0!-eth0,eth1!-eth1,eth2!-eth2’
    # chdef -t node -o backupmn nicips=’eth0!172.20.7.11,eth1!192.168.1.6,
    eth2!10.10.10.11’ 
    nichostnamesuffixes=’eth0!-eth0,eth1!-eth1,eth2!-eth2’
    # chdef -t node -o virtualmn nicips=’eth0:0!172.20.7.12,eth1:0!192.168.1.7,
    eth2:0!10.10.10.12’ 
    nichostnamesuffixes=’eth0:0!-eth0,eth1:0!-eth1,eth2:0!-eth2
    Where primarymn is the name of your management node, and 10.10.10.10 is its new IP address.

    Where backupmn is the name of your standby management node, and 10.10.10.11 is its new IP address.

    Where virtualmn is the name of your virtual management node, and 10.10.10.12 is the new virtual IP address in this network.
  5. Regenerate the host and DNS entry for the management nodes.
    # makehosts primarymn, backupmn, virtualmn
    # makedns primarymn, backupmn,virtualmn
  6. Reconfigure the PCMHA service agent to add the new network.
    # pcm-ha-support gendata
    # pcm-ha-support start --service PCMHA
  7. Synchronize the /etc/hosts to other nodes in the IBM® Spectrum Cluster Foundation Community Edition cluster, where backupmn is the standby management node.
    #updatenode backupmn -F
    #updatenode __Managed -F