Configuration of object for isolated node and network groups

You can configure object for isolated node and network groups.

Object needs constant network access between all the configured Cluster Export Services (CES) IP addresses. The standard configuration uses all the available CES IP addresses.

All IP addresses are used for object.

Note: If a cluster configuration has an isolated node and network groups and CES IP addresses have been assigned to those groups, parts of the object store are not accessible.

IP addresses are unable to connect to each other and parts of the object store are not accessible.

In this configuration, a network and node group that must be used for object can be configured in the spectrum-scale-object.conf file. Only the CES IP addresses of this group are used for object.
Note: Only one object group can be used.
Note: If the Singleton and database attributes of the IP address assignments are changed manually by using the mmces address change command, only the IP addresses that belong to the object group can be used.

Configuration example

In the following example, LAN1 is used as the object group, IP1, IP2, and IP3 are used for object. And, the object store is fully available. If only LAN1 is used, the used object services will be limited to Node1, Node2, and Node3. To distribute the object load to all the nodes in the cluster, create a network that spans across all nodes. Create an object group and assign all nodes to it. Add new CES IP addresses, at least one CES IP address per protocol node. Then, assign the IP addresses to the same Object Group.

New IP addresses can be used by the object store.

  1. To set up the object group and create the LAN4 group by adding nodes to groups, run the following command:
    mmchnode --ces-group=LAN4 -N Node1,Node2,Node3,Node4,Node5,Node6,Node7 
    Run the following command to add CES IP addresses to the group:
    mmces address add --ces-ip ces_ip8,ces_ip9,ces_ip10,ces_ip11,
    ces_ip12,ces_ip13,ces_ip14 --ces-group LAN4T
    Run the following command to move the existing CES IP addresses to the group:
    mmces address change --ces-ip ces_ip8,ces_ip9,ces_ip10,ces_ip11,
    ces_ip12,ces_ip13,ces_ip14 --ces-group LAN4
  2. To set up the object group when object has already been configured, run the following command. The following command is on one line:
    mmobj config change --ccrfile spectrum-scale-object.conf --section node-group
    --property object-node-group --value LAN4
    To synchronize the ring files, run the following command:
    /usr/lpp/mmfs/bin/mmcesobjcrring --sync
  3. To set up the object group when object has not been configured, use the --ces-group option of the mmobj swift base command:
    mmobj swift base  -g /gpfs/ObjectFS --cluster-hostname cluster-ces-ip.ibm --local-keystone 
    --enable-s3 --pwd-file mmobjpwd --ces-group LAN4

    CES IP addresses ranging from ces_ip8 to ces_ip14 are used by the object store and the object load is distributed to all the nodes in the cluster. These IP addresses can be used for client connections. These IP addresses can also be used for traffic between the Swift proxy service and the account, container, and object services.