Runtime storage layout

/ds-storage

/ds-storage is the persistent volume that is mounted across all runtime instances and some other services. Its primary purpose is project storage. Project data can be found under /ds-storage/PXRuntime/Projects in the directory that is labeled with the project ID.

/ds-storage/PXRuntime/Projects/projectid/flows/flowid

This directory contains directories for scripts, logs, and libraries associated with a flow. Each subfolder is labeled with a flow ID.

/ds-storage/PXRuntime/Projects/projectid/jobs/jobid

This directory contains artifacts that are copied from the associated flow during the run of a specified job, contained in the directory labeled with the job ID. Each job folder contains data for all the job runs for the job in directories that are labeled with the job run ID.

/ds-storage/PXRuntime/Projects/projectid/jobs/jobid/runs/jobrunid

This directory contains logs, metadata, parameters, and other config data for the specified job run.

/px-storage

/px-storage is the persistent volume that is mounted locally to each runtime instance. The directories in /px-storage contain configuration files, the dynamic config file resource disk, and workload manager data.

/opt

/opt is the local image storage. It contains service files, examples, client installs, config files, and dynamic config file scratch storage.