Gather information about your foundational services installation
Get information to help with resolving IBM Cloud Pak foundational services issues in your cluster.
These commands provide information about the foundational services operators and operands that are installed in your cluster.
Identify whether the issues are related to Operand Deployment Lifecycle Manager
The commands in this section help you to identify issues with the Operand Deployment Lifecycle Manager. If these commands do not show any errors, then the issues are not related to the Operand Deployment Lifecycle Manager.
NOTE: The cert-manager service generates the cs-ca-certificates-secert secret, and the management ingress and NGINX ingress generate the ibmcloud-cluster-info configmap. The ibm-iam-operator installation completes only after the cs-ca-certificates-secert secret and the ibmcloud-cluster-info configmap are ready. Therefore, the ibm-iam-operator is ready only after the operands of the ibm-cert-manager-operator,
the ibm-management-ingress-operator, and the ibm-ingress-nginx-operator are deployed.
-
foundational services subscriptions
Provides a list of installed operators in your cluster.oc -n ibm-common-services get subscriptionFollowing is a sample output:
NAME PACKAGE SOURCE CHANNEL ibm-catalog-ui-operator ibm-catalog-ui-operator-app opencloud-operators stable-v1 ibm-cert-manager-operator ibm-cert-manager-operator opencloud-operators stable-v1 ibm-commonui-operator ibm-commonui-operator-app opencloud-operators stable-v1 ibm-helm-api-operator ibm-helm-api-operator-app opencloud-operators stable-v1 ibm-helm-repo-operator ibm-helm-repo-operator-app opencloud-operators stable-v1 ibm-iam-operator ibm-iam-operator opencloud-operators stable-v1 ibm-ingress-nginx-operator ibm-ingress-nginx-operator-app opencloud-operators stable-v1 ibm-licensing-operator ibm-licensing-operator-app opencloud-operators stable-v1 ibm-management-ingress-operator ibm-management-ingress-operator-app opencloud-operators stable-v1 ibm-mongodb-operator ibm-mongodb-operator-app opencloud-operators stable-v1 ibm-platform-api-operator ibm-platform-api-operator-app opencloud-operators stable-v1 -
foundational services ClusterServiceVersions (CSVs)
Provides a list of operators, their CSV version, and whether they are correctly installed or not.oc -n ibm-common-services get csvFollowing is a sample output:
NAME DISPLAY VERSION REPLACES PHASE ibm-catalog-ui-operator.v3.6.1 IBM Catalog UI Operator 3.6.1 ibm-catalog-ui-operator.v3.6.0 Succeeded ibm-cert-manager-operator.v3.6.2 IBM Cert Manager Operator 3.6.2 ibm-cert-manager-operator.v3.6.1 Succeeded ibm-commonui-operator.v1.2.2 Ibm Common UI Operator 1.2.2 ibm-commonui-operator.v1.2.1 Succeeded ibm-helm-api-operator.v3.6.1 IBM Helm API Operator 3.6.1 ibm-helm-api-operator.v3.6.0 Failed ibm-helm-repo-operator.v3.6.1 IBM Helm Repo Operator 3.6.1 ibm-helm-repo-operator.v3.6.0 Failed ibm-iam-operator.v3.6.2 IBM IAM Operator 3.6.2 ibm-iam-operator.v3.6.1 Succeeded ibm-ingress-nginx-operator.v1.2.2 IBM Ingress Nginx Operator 1.2.2 ibm-ingress-nginx-operator.v1.2.1 Succeeded ibm-licensing-operator.v1.1.3 IBM Licensing Operator 1.1.3 ibm-licensing-operator.v1.1.2 Succeeded ibm-management-ingress-operator.v1.2.1 Management Ingress Operator 1.2.1 ibm-management-ingress-operator.v1.2.0 Succeeded ibm-mongodb-operator.v1.1.1 IBM Mongodb Operator 1.1.1 ibm-mongodb-operator.v1.0.0 Succeeded ibm-platform-api-operator.v3.6.1 IBM Platform API Operator 3.6.1 ibm-platform-api-operator.v3.6.0 Succeeded operand-deployment-lifecycle-manager.v1.2.1 Operand Deployment Lifecycle Manager 1.2.1 operand-deployment-lifecycle-manager.v1.2.0 SucceededNOTE: If all the CSVs exist, but no operand is deployed, it might be because the Operand Deployment Lifecycle Manager is waiting for the
installPlanof the operator to be ready. After theinstallplanis ready, the Operand Deployment Lifecycle Manager deploys its operands. You can get theinstallPlanstatus by running the following command:oc -n ibm-common-services get installplanFollowing is a sample output:
NAME CSV APPROVAL APPROVED install-7jlth ibm-helm-repo-operator.v3.6.1 Automatic true install-kk5fl ibm-cert-manager-operator.v3.6.2 Automatic true install-m6b5x ibm-platform-api-operator.v3.6.1 Automatic true install-twbp8 ibm-helm-repo-operator.v3.6.1 Automatic trueTo view details about an
installPlan, use the following command:oc describe installplan -n ibm-common-services <installplan-name>
Identify other causes
These commands provide information about the foundational services pods that are created in your cluster.
-
Check the operator pod status.
oc -n ibm-common-services get pod | grep operatorFollowing is a sample output:
ibm-catalog-ui-operator-c6c59ccf9-tbsdj 1/1 Running 0 4d17h ibm-cert-manager-operator-5869ccb57-8xr2x 1/1 Running 0 4d17h ibm-commonui-operator-7f5bcbc964-s6wz9 1/1 Running 0 4d17h ibm-helm-api-operator-98d7445cb-r5cmb 0/1 Pending 0 3d22h ibm-helm-repo-operator-849fbc45d4-2lgdj 0/1 Pending 0 3d22h ibm-iam-operator-7c97568b59-2xqpp 1/1 Running 0 4d17h ibm-ingress-nginx-operator-696c78bd46-hk8t9 1/1 Running 0 4d17h ibm-licensing-operator-784c8f5988-w5bt5 1/1 Running 0 4d17h ibm-management-ingress-operator-6b6f57c9c9-t74d2 1/1 Running 0 4d17h ibm-mongodb-operator-54c46c8cd8-dt5kd 1/1 Running 0 4d17h ibm-platform-api-operator-6b6db96696-tfppl 1/1 Running 0 4d17h -
Check the logs of the IBM Common Service Operator and the Operand Deployment Lifecycle Manager
oc -n openshift-operators logs -f $(oc -n openshift-operators get pod -l app.kubernetes.io/name=odlm -o jsonpath="{.items[].metadata.name}") >> logs.yaml -
Get a list of pods that have error
oc -n ibm-common-services get pod | grep -v RunningFollowing is a sample output:
NAME READY STATUS RESTARTS AGE auth-idp-557bcb88bb-x6dmr 0/4 Pending 0 4d17h auth-pdp-67fc7599b7-2xh8t 0/2 OutOfcpu 0 4d17h helm-api-6699b67c7c-8zhjf 0/2 Pending 0 4d17h iam-onboarding-7tz44 0/1 Init:0/5 0 4d2h ibm-helm-api-operator-98d7445cb-r5cmb 0/1 Pending 0 3d23h ibm-helm-repo-operator-849fbc45d4-2lgdj 0/1 Pending 0 3d23h icp-mongodb-1 0/2 Pending 0 4d17h secret-watcher-84fb694fc7-5x9jv 0/1 CreateContainerConfigError 0 4d17h security-onboarding-skrpf 0/1 Init:0/1 0 4d17h