Configuring a multi-site

Configure multi-site on the IBM Storage Ceph dashboard.

Before you begin

  • An IBM Storage Ceph cluster at both the sites.
  • At least one Ceph Object Gateway service installed at both the sites.

Procedure

  1. Enable the Ceph Object Gateway module on both the sites to enable import/export feature.
    1. From the dashboard navigation of the primary site, go to Object > Multi-site.
    2. In the Information box, click Enable RGW Module.
  2. On the primary site dashboard, create a default realm, zonegroup, and zone.
    1. From the Object > Multi-site, click Create Realm.
    2. In the Create Realm dialog, provide a realm name, and select Default.
    3. Click Create Realm.
    4. Click Create Zone Group from the action drop-down.
    5. In the Create Zone Group dialog, provide a zone group name, the Ceph Object Gateway endpoints, and select Default.
    6. Click Create Zonegroup.
    7. Click Create Zone from the action drop-down.
    8. In the Create Zone dialog, provide a Zone Name, select Default, provide the Ceph Object Gateway endpoints of the primary site. For the user, provide the access and secret key of the user with system privileges.
      Note: While creating a zone, provide the access key and secret key of the dashboard default user, dashboard.
  3. After the zone is created, a warning is emitted to restart the Ceph Object Gateway Service.
    1. From the Administration > Services.
    2. Select the Ceph Object Gateway (rgw) service row and expand to see the service details.
    3. From the Daemons table, select the host and click Restart from the action drop-down.
  4. When you go to Object > Gateways, you get an error that The Object Gateway Service is not configured. This bug is a BZ#2231072.
    1. As a workaround, set the Ceph Object Gateway credentials on the command-line interface. 
      ceph dashboard set-rgw-credentials
RGW credentials configured
    2. Go to Object > Gateways, to verify that you are able to access the Ceph Object Gateway on the dashboard.
  5. Create a replication user on the primary site. You can use the following two options:
    • Create user using the CLI. 
      [ceph: root@host01 /]# radosgw-admin user create --uid="uid" --display-name="displayname" --system
    • Create user from the dashboard and modify the user from the CLI. 
      [ceph: root@host01 /]# radosgw-admin user modify --uid="uid" --system
  6. From, Object > Gateways, on the Users table, select the user row created in the previous step.
    1. Expand the user row.
    2. Copy the Access Key and Secret Key.
    3. From, Object > Multi-site, select the zone.
    4. Click the edit icon and paste the access key and secret key that was copied earlier.
    5. Click Edit Zone.
  7. Click Export.
    1. From the Export Multi-site Realm Token dialog box, copy the token.
    2. Close the dialog box.
  8. On the secondary site, go to Object > Multi-site.
  9. Click Import to import token from the primary zone.
  10. In the Import Multi-site Token dialog box, paste the token that was copied earlier, and provide a secondary zone name.
    1. Under Service details, select the placement and the port where the new Ceph Object Gateway service is going to be created.
    2. Click Import.
  11. After the token is imported, you get a warning to restart the Ceph Object Gateway Service.
    1. Go to Administration > Services.
    2. Select the Ceph Object Gateway (rgw) service row.
    3. From the Daemons table, select the host. Verify that the Ceph Object Gateway is configured on the secondary site.
    4. Click Restart from the action drop-down.
  12. You need to wait for sometime till the users are synced to the secondary site. Verify that the sync is complete with the following commands. 
    [ceph: root@host01 /]# radosgw-admin sync status
[ceph: root@host01 /]# radosgw-admin user list
  13. When you go to Object > Gateways, you get an error that The Object Gateway Service is not configured. This bug is a BZ#2231072.
    1. As a workaround, set the Ceph Object Gateway credentials on the command-line interface. 
      ceph dashboard set-rgw-credentials
RGW credentials configured
    2. Go to Object > Gateways, to verify that you are able to access the Ceph Object Gateway on the dashboard.
  14. On the primary site, under an error displays on the Multi Site Sync Status panel of the Object > Overview page. This is because on the secondary zone, you can see that the endpoints are of the hostname and not the IP address. This bug is a known issue while configuring multi-site. See BZ#2242994.
    1. As a workaround, in the secondary site, go to Object > Multi-site and select the secondary zone.
    2. Edit the endpoints to reflect the IP address.
    3. Click Edit Zone.
  15. On the primary site and secondary site dashboard, you can see the status displays on the Multi Site Sync Status panel of the Object > Overview page.

What to do next

To verify, create a user on the primary site. You see that the user syncs to the secondary site.