Configuration of object for isolated node and network groups
You can configure object for isolated node and network groups.
Object needs constant network access between all the configured Cluster Export Services (CES) IP addresses. The standard configuration uses all the available CES IP addresses.
Note: If a cluster configuration has an isolated node and network groups and CES IP addresses have
been assigned to those groups, parts of the object store are not accessible.
In this configuration, a network and node group that must be used for object can be configured in
the spectrum-scale-object.conf file. Only the CES IP addresses of this group
are used for object.
Note: Only one object group can be used.
Note: If the Singleton and
database attributes of the IP address assignments are changed manually by using the mmces
address change command, only the IP addresses that belong to the object group can be
used.
Configuration example
In the following example,LAN1
is used
as the object group, IP1, IP2, and IP3 are used for object. And, the object store is fully
available. If only LAN1 is used, the used object services will be limited to Node1, Node2, and
Node3. To distribute the object load to all the nodes in the cluster, create a network that spans
across all nodes. Create an object group and assign all nodes to it. Add new CES IP addresses, at
least one CES IP address per protocol node. Then, assign the IP addresses to the same Object
Group.-
To set up the object group and create the LAN4 group by adding nodes to groups, run the following command:
mmchnode --ces-group=LAN4 -N Node1,Node2,Node3,Node4,Node5,Node6,Node7
Run the following command to add CES IP addresses to the group:mmces address add --ces-ip ces_ip8,ces_ip9,ces_ip10,ces_ip11, ces_ip12,ces_ip13,ces_ip14 --ces-group LAN4T
Run the following command to move the existing CES IP addresses to the group:mmces address change --ces-ip ces_ip8,ces_ip9,ces_ip10,ces_ip11, ces_ip12,ces_ip13,ces_ip14 --ces-group LAN4
-
To set up the object group when object has already been configured, run the following command. The following command is on one line:
mmobj config change --ccrfile spectrum-scale-object.conf --section node-group --property object-node-group --value LAN4
To synchronize the ring files, run the following command:/usr/lpp/mmfs/bin/mmcesobjcrring --sync
- To set up the object group when object has not been configured, use the
--ces-group option of the mmobj swift base
command:
mmobj swift base -g /gpfs/ObjectFS --cluster-hostname cluster-ces-ip.ibm --local-keystone --enable-s3 --pwd-file mmobjpwd --ces-group LAN4
CES IP addresses ranging from
ces_ip8
toces_ip14
are used by the object store and the object load is distributed to all the nodes in the cluster. These IP addresses can be used for client connections. These IP addresses can also be used for traffic between the Swift proxy service and the account, container, and object services.