Adding a node to a user-provisioned infrastructure

Add nodes to increase storage capacity for Fusion Data Foundation to a user-provisioned infrastructure when existing worker nodes reached the maximum supported OSDs or when resources are insufficient to add new OSDs on existing nodes.

Before you begin

  • You are logged in to the Red Hat® OpenShift® Container Platform web console as an administrator.
  • Fusion Data Foundation service is installed and configured.
  • It is recommended to add nodes in multiples of three, placing each node in a different failure domain or zone. Repeat this procedure for each node. For bare metal installer-provisioned infrastructure, expand the cluster before proceeding.

    While adding nodes in multiples of three is recommended, you can still add one node at a time in a flexible scaling deployment. To verify whether flexible scaling is enabled, see Red Hat Knowledgebase article Scaling OpenShift Data Foundation cluster using YAML when flexible scaling is enabled.

    Important: Fusion Data Foundation does not support heterogeneous disk size and types. Add only nodes with disks that match the type and size that is used during the initial deployment.

Procedure

  1. Based on your infrastructure type, complete these steps:
    1. Provision a new machine that meets the required specifications.
      For more information on infrastructure requirements, see Platform requirements.
    2. Use the new machine to create a new Red Hat OpenShift Container Platform worker node.
  2. Check for certificate signing requests (CSRs) that are in Pending state.
    Command example:
    oc get csr
  3. Approve all the required CSRs for the new node.
    Command example:
    oc adm certificate approve <Certificate_Name>
  4. Click Compute > Nodes and verify that the new node is in Ready state.
  5. Apply the Fusion Data Foundation label to the new node by using any one of the following methods:
    User interface
    1. Click the Action Menu (⋮) for the new node and select Edit labels.
    2. Add the cluster.ocs.openshift.io/openshift-storage label and click Save.
    Command line interface
    Run the following oc command on the new node.
    oc label node <new_node_name> cluster.ocs.openshift.io/openshift-storage=""
  6. In the Red Hat OpenShift Container Platform web console, go to Operators > Installed Operators.
    In the Project drop-down list, ensure that you selected the required project.
  7. Click Local Storage.
  8. Select the Local Volume Discovery tab and do as follows:
    1. Click the Action menu (⋮) next to LocalVolumeDiscovery and select Edit LocalVolumeDiscovery.
    2. In the YAML tab, add the hostname of the new node in the values field under nodeSelector.
    3. Click Save.
  9. Select the Local Volume Sets tab and do as follows:
    1. Click the Action menu (⋮) next to LocalVolumeSet and select Edit LocalVolumeSet.
    2. In the YAML tab, add the hostname of the new node in the values field under nodeSelector.
    3. Click Save.
  10. Do the following verification steps:
    1. Run the following command and verify that the new node is present in the command output:
      Command example:
      oc get nodes --show-labels | grep cluster.ocs.openshift.io/openshift-storage= |cut -d' ' -f1
      Output example:
      r8-ru10-w-1.stg-odf-211.fusion.tadn.ibm.com
      r8-ru12-w-1.stg-odf-211.fusion.tadn.ibm.com
      r8-ru14-w-1.stg-odf-211.fusion.tadn.ibm.com
      r8-ru8-w-1.stg-odf-211.fusion.tadn.ibm.com
    2. Go to Workloads > Pods and check that the following Pods on the new node are in the Running state:
      • openshift-storage.cephfs.csi.ceph.com-*
      • openshift-storage.rbd.csi.ceph.com-*

Results

Additional nodes are added to the infrastructure and are available for use in the Fusion Data Foundation cluster.

What to do next

Scale up the storage capacity by following the instructions mentioned in Scaling up storage capacity.