Reconciling files between IBM Spectrum Scale file system and cloud storage tier

This topic describes how to reconcile files between IBM Spectrum Scale™ file systems and the cloud tier.

When you remove files from the file system, no policy is currently available to automatically remove the cloud objects that are created, which might cause orphan objects on the cloud.

To clean that up, it is recommended to periodically run the following command to keep the cloud in sync with the file system.
mmcloudgateway files reconcile {Device | all}
where,
  • Device is the device name of the file system that is associated with the node class
If a migrated file is removed from the file system, reconcile removes the corresponding cloud objects and references that are contained in the cloud directory. Additionally, if multiple versions of a file are stored on the cloud, reconcile removes all older cloud versions (keeping the most recent). For example, if a file is migrated, then updated, and migrated again. In this case, two versions of the file are stored on the cloud. Reconcile removes the older version from the cloud. Reconcile also deletes cloud objects that are no longer referenced.
Note: Reconcile removes entries from the Cloud Directory that references deleted file system objects. The ability to restore accidentally deleted files is lost after reconciliation is run. Therefore, it is recommended that any files that need to be restored are restored before you run a reconcile. It is also recommended to run the reconciliation operation as a background activity during low load on the IBM Spectrum Scale cluster.