Configuration of object for isolated node and network groups

You can configure object for isolated node and network groups.

Object needs constant network access between all the configured CES IP addresses. The standard configuration uses all the available CES IP addresses.

All IP addresses are used for object.

If a cluster configuration has isolated node and network groups and CES IP addresses have been assigned to those groups, parts of the object store are not accessible.

IP addresses are unable to connect to each other and parts of the object store are not accessible.

In such a configuration, a network and node group that must be used for object can be configured in the spectrum-scale-object.conf file. Only the CES IP addresses of this group are used for object.
Note: Only one object group can be used.
Note: If the Singleton and Database attributes of the IP assignments are changed manually by using the mmces address change command, only the IP addresses that belong to the object group can be used.

Configuration example

In the following example, LAN1 is used as the object group, IP1, IP2, and IP3 are used for object, and the object store is fully available. If only LAN1 is used, the used object services will be limited to Node1, Node2, and Node3. To distribute the object load to all the nodes in the cluster, create a network that spans across all nodes. Create an object group and assign all nodes to it. Add new CES IPs, at least one CES IP per protocol node, and assign the IPs to the same Object Group.

New IP addresses can be used by the object store.

  1. To set up the object group and create the LAN4 group by adding nodes to groups, run the following command:
    mmchnode --ces-group=LAN4 -N Node1,Node2,Node3,Node4,Node5,Node6,Node7 
    If you want to add CES IP addresses to the group, run the following command:
    mmces address add --ces-ip ces_ip8,ces_ip9,ces_ip10,ces_ip11,
    ces_ip12,ces_ip13,ces_ip14 --ces-group LAN4
    If you want to move the existing CES IP addresses to the group, run the following command:
    mmces address change --ces-ip ces_ip8,ces_ip9,ces_ip10,ces_ip11,
    ces_ip12,ces_ip13,ces_ip14 --ces-group LAN4
  2. To set up the object group when object has already been configured, run the following command. The following command is on one line:
    mmobj config change --ccrfile spectrum-scale-object.conf --section node-group
    --property object-node-group --value LAN4
    To synchronize the ring files, run the following command:
    /usr/lpp/mmfs/bin/mmcesobjcrring --sync
  3. To set up the object group when object has not been configured, use the --ces-group option of the mmobj swift base command:
    mmobj swift base  -g /gpfs/ObjectFS --cluster-hostname cluster-ces-ip.ibm --local-keystone 
    --enable-s3 --admin-password Passw0rd --ces-group LAN4

    CES IPs ranging from ces_ip8 to ces_ip14 are used by the object store and the object load is distributed to all the nodes in the cluster. These IPs can be used for client connections, but more importantly, are used for traffic between the Swift proxy service and the account, container, and object services.