Debugging GUI issues
Debugging IBM Storage Scale GUI issues that affects IBM Storage Scale Container Storage Interface driver operations.
Symptoms
- PVC and Snapshot creation and deletion operation fails.
- Attach and Detach operation of PVC to Pod fails.
- IBM Storage Scale Container Storage Interface driver pod fails repeatedly during the GUI start.
Causes
- IBM Storage Scale GUI does not function as expected.
- GUI user credentials that are needed for IBM Storage Scale Container Storage Interface driver setup are no longer valid.
- GUI SSL CA certificate is expired.
If the GUI user credentials are reset or expired, then you can see the related error messages
during various volume-specific operations. The following example shows pending status for Create PVC
operation due to issues as written in the
messages.
[root@cnss-deeghuge7-inf fileset]# kubectl describe pvc scale-fset-pvc-1
Name: scale-fset-pvc-1
Namespace: ibm-spectrum-scale-csi-driver
StorageClass: ibm-spectrum-scale-csi-fileset
Status: Pending
Volume:
Labels: <none>
Annotations: volume.beta.kubernetes.io/storage-provisioner: spectrumscale.csi.ibm.com
Finalizers: [kubernetes.io/pvc-protection]
Capacity:
Access Modes:
VolumeMode: Filesystem
Mounted By: <none>
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal ExternalProvisioning 9s (x2 over 13s) persistentvolume-controller waiting for a volume to be created, either by external provisioner "spectrumscale.csi.ibm.com" or manually created by system administrator
Normal Provisioning 5s (x4 over 13s) spectrumscale.csi.ibm.com_ibm-spectrum-scale-csi-provisioner-0_1fc0b34c-fc13-46b5-bf04-552bad562df0 External provisioner is provisioning volume for claim "ibm-spectrum-scale-csi-driver/scale-fset-pvc-1"
Warning ProvisioningFailed 5s (x4 over 13s) spectrumscale.csi.ibm.com_ibm-spectrum-scale-csi-provisioner-0_1fc0b34c-fc13-46b5-bf04-552bad562df0 failed to provision volume with StorageClass "ibm-spectrum-scale-csi-fileset": rpc error: code = Internal desc = unable to check type of filesystem [fs0]. Error: rpc error: code = Unauthenticated desc = Unauthorized GET request to https://10.11.48.228:443/scalemgmt/v2/filesystems/fs0: 401 Unauthorized
Resolving the problem
- To ensure proper functioning of IBM Storage Scale GUI,
monitoring of GUI health status helps debug and resolve the IBM Storage Scale Container Storage Interface driver GUI issues. You can check the health of the GUI node
by issuing the mmhealth command. The following output sample shows no error when
mmhealth command is issued to check the GUI
status.
[root@remote-deeghuge7-1 ~]# /usr/lpp/mmfs/bin/mmhealth node show GUI -N remote-deeghuge7-2.ibm.com Node name: remote-deeghuge7-2.ibm.com Component Status Status Change Reasons ----------------------------------------------------- GUI HEALTHY 21 days ago - To resolve the GUI access issue, reset the IBM Storage Scale GUI user credential and update the secret for IBM Storage Scale Container Storage Interface driver. For more information about updating a secret, see
Changing the configuration after deployment.Note: The PVC creation issue, as previously mentioned, can be resolved by fixing the secret as given in Step 2.
- To ensure that the GUI HA function (multiple GUIs on a storage cluster) works properly, the
non-functional GUI node must be shutdown.
If a GUI node is available but the file system is unmounted, the GUI HA function cannot be availed and a volume provisioning failure occurs. In such case, the GUI node where the file system is unmounted must be shut down manually to benefit from the GUI HA function.