IBM Support

How to add OpenShift Data Foundation to a ROKS cluster

How To


Summary

use this runbook to add openshift data foundation to a ROKS cluster

Environment

ROKS VPC -  IBM Cloud Kubernetes services with Red Hat OpenShift

Steps

  1. Verify there are at least three worker nodes of at least 16x64 in different worker zones. 
    1. If there are not, create a new worker pool with at least three 16x64 worker nodes in different zones. 
    2. This can be done by selecting Worker pools >> Add+
      1. Enable all Worker zones and subnets
      2. Change to 1 Worker node per zone that is 16x64
      3. Disable worker pool encryption
      4. Name it "storage" if one does not exist. Select "create"
        image-20241219104333-1
  2. uninstall openshift data foundation from the ibmcloud console if it was installed wrong.image-20240925200026-3
  3. verify there is not a ocscluster CRD in the ocs if there is, delete it.
    1. In OpenShift Cluster UI, go to Administration >> CustomResourceDefinitions
    2. Delete ocscluster custom resource definition
      image-20240925195738-1image-20240925195839-2
  4. Once everything is set up and cleaned up, make sure everything else is removed as necessary as well. If these commands aren't working, please make sure everything listed on this page is installed so that these commands work as expected: https://cloud.ibm.com/docs/openshift?topic=openshift-cli-install
    1. In Command Line a. Login to OpenShift Cluster and IBM Cloud (Please know the first 4 instructions (i-iv) will fail if everything is cleaned up correctly. Otherwise, this will assist with the final steps of cleanup)
      1. oc login --token={token} --server={server:port}
        1. ibmcloud login --sso
        2. Run these commands
          1. ocscluster_name=`oc get ocscluster | awk 'NR==2 {print $1}'`
      2. oc delete ocscluster --all --wait=false
      3. kubectl patch ocscluster/$ocscluster_name -p '{"metadata":{"finalizers":[]}}' --type=merge
      4. oc delete ns openshift-storage --wait=false
      5. ibmcloud oc vpc outbound-traffic-protection disable --cluster {cluster name from IBM Cloud UI} * Cluster Name Example: itzroks-663002um2y-0fb3ejqr
      6. oc edit operatorhub cluster -n openshift-marketplace
        * Change disableAllDefaultSources to false
      7. oc get po -n openshift-marketplace
        * Make sure all pods are running before continuing
  5. From there, in the IBM Cloud UI, do the following:
    1. Overview >> Add Ons >> Install OpenShift Data Foundation
      1. Select the "storage" worker pool created in step 1.a 
      2. taint the workers
  6. In OpenShift Cluster UI
    1. Operators >> Installed Operators
      1. Validate that the Operator is showing the "Successful" status
        1. You can also look for operator
          1. image-20240925200340-5
        2. storageclasses - go to Installed Operators > ocs-storagecluster-storagesystem > Resources > ocs-storagecluster > Resources
          1. You should be able to see 4-5 additional resources. This can also take a moment to reflect if the OCP was installed recently 
            1. image-20240925200415-6
        3. oc get pods -n openshift-storage
The official IBM Cloud documentation for this can be found here, however, the steps above should be more reliable for our purposes: https://cloud.ibm.com/docs/openshift?topic=openshift-deploy-odf-vpc&interface=ui

Related Information

Document Location

Worldwide

[{"Type":"MASTER","Line of Business":{"code":"","label":""},"Business Unit":{"code":"","label":""},"Product":{"code":"SSNR6KN","label":"IBM Technology Zone"},"ARM Category":[{"code":"a8mKe0000004CUbIAM","label":"Infrastructure-\u003EIBM Cloud"}],"ARM Case Number":"TS017264552","Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"All Versions"}]

Document Information

Modified date:
26 December 2024

UID

ibm17170685