Question & Answer
Question
We have a lot of files sitting on the file-api-claim PVC. This can lead to Spark pods in CreateContainerErr state.
How can we clean the files (logs & events) linked to Spark?
(Note: the message 'Context Deadline Exceeded', occurring when pods are started, can be the sign of an issue with the SELinux relabeling process that takes place when the file-api-claim PVC is mounted in a pod... to address that issue, see this note)
[{"Type":"MASTER","Line of Business":{"code":"LOB76","label":"Data Platform"},"Business Unit":{"code":"BU048","label":"IBM Software"},"Product":{"code":"SSHGYS","label":"IBM Cloud Pak for Data"},"ARM Category":[{"code":"a8m3p0000006xtgAAA","label":"Services-\u003EData Science Tools-\u003EAnalytics Engine-\u003ENotebook - Spark"}],"ARM Case Number":"TS016190219","Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"All Versions"}]
Log InLog in to view more of this document
This document has the abstract of a technical article that is available to authorized users once you have logged on. Please use Log in button above to access the full document. After log in, if you do not have the right authorization for this document, there will be instructions on what to do next.
Was this topic helpful?
Document Information
Modified date:
17 May 2024
UID
ibm17154156