Optimizing the bucket lifecycle

Optimize the bucket lifecycle for different types of workloads.

Before you begin

  • A running IBM Storage Ceph cluster.
  • Root-level access to all nodes in the storage cluster.

About this task

Two options in the Ceph configuration file affect the efficiency of bucket lifecycle processing:
rgw_lc_max_worker
Specifies the number of lifecycle worker threads to run in parallel. This enables the simultaneous processing of both bucket and index shards. The default value for this option is 3.
rgw_lc_max_wp_worker
Specifies the number of threads in each lifecycle worker thread’s work pool. This option helps to accelerate processing for each bucket. The default value for this option is 3.
For a workload with many buckets, for example a workload with thousands of buckets, consider increasing the value of the rgw_lc_max_worker option.

For a workload with a smaller number of buckets but with a higher number of objects in each bucket, such as in the hundreds of thousands, consider increasing the value of the rgw_lc_max_wp_worker option.

Note: Before increasing the value of either of these options, validate current storage cluster performance and Ceph Object Gateway use. Do not assign a value of 10 or more for either of these options.

Procedure

  1. Increase the number of threads.
    • To increase the number of threads to run in parallel, set the value of rgw_lc_max_worker to a value between 3 and 9.
      ceph config set client.rgw rgw_lc_max_worker 7
    • To increase the number of threads in each thread’s work pool, set the value of rgw_lc_max_wp_worker to a value between 3 and 9.
      ceph config set client.rgw rgw_lc_max_wp_worker 7
  2. Restart the Ceph Object Gateway.
    Restarting allows the changed settings to take effect.
  3. Monitor the storage cluster to verify that the increased values do not adversely affect performance.