IBM Support

Upgrade IBM Cloud Private (ICP) 3.1.x to V3.2.1.x unable to access the API servers

Troubleshooting


Problem

After the upgrading of the Kubernetes on the "IBM Cloud Private cluster," following pods were not started 

kubectl get pods --all-namespaces | grep -v Running

Show non-Running pods
NAMESPACE           NAME                              READY  STATUS       RESTARTS  AGE
kube-system          k8s-proxy-qkmvf                        0/1   ContainerCreating  0     1h
kube-system          k8s-proxy-wvbws                        0/1   ContainerCreating  0     1h
kube-system          k8s-proxy-xws79                        0/1   ContainerCreating  0     1h

Symptom

Apiserver logs

I0429 02:03:24.307185       1 controller.go:105] OpenAPI AggregationController: Processing item v1beta1.servicecatalog.k8s.io
E0429 02:03:25.939799       1 available_controller.go:316] v1beta1.servicecatalog.k8s.io failed with: Operation cannot be fulfilled on apiservices.apiregistration.k8s.io "v1beta1.servicecatalog.k8s.io": the object has been modified; please apply your changes to the latest version and try again
E0429 02:03:30.945853       1 available_controller.go:316] v1beta1.servicecatalog.k8s.io failed with: Get https://10.0.0.33:443: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
E0429 02:03:35.952120       1 available_controller.go:316] v1beta1.servicecatalog.k8s.io failed with: Operation cannot be fulfilled on apiservices.apiregistration.k8s.io "v1beta1.servicecatalog.k8s.io": the object has been modified; please apply your changes to the latest version and try again
E0429 02:03:40.964045       1 available_controller.go:316] v1beta1.servicecatalog.k8s.io failed with: Get https://10.0.0.33:443: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

Document Location

Worldwide

[{"Type":"MASTER","Line of Business":{"code":"LOB77","label":"Automation Platform"},"Business Unit":{"code":"BU048","label":"IBM Software"},"Product":{"code":"SSBS6K","label":"IBM Cloud Private"},"ARM Category":[{"code":"a8m50000000Ck50AAC","label":"IBM Cloud Private-\u003EUpgrade"}],"ARM Case Number":"TS009195149","Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"3.2.0;3.2.1;3.2.2"}]

Log InLog in to view more of this document

This document has the abstract of a technical article that is available to authorized users once you have logged on. Please use Log in button above to access the full document. After log in, if you do not have the right authorization for this document, there will be instructions on what to do next.

Document Information

Modified date:
02 May 2022

UID

ibm16579125