Using the spark.zos.executor.jobname.template

A system programmer can specify a template for generating job names by using the spark.zos.executor.jobname.template property in the spark-defaults.conf configuration file. The template property provides further customization when you are generating job names for executors. The template uses variables that can be substituted for several pieces of information about the work that the executor is running. These variables include cluster, application, and executor.

cluster: The number that is specified by spark.zos.cluster.instanceNumber.
Default length: 1
application: The application instance number.
Default length: 4
executor: The executor instance number.
Default length: 1

A number of digits can be specified for each, for example:

<executor:2>: The least 2 significant digits of the executor instance number are used.

For example, ODA<cluster:1><application:2><executor:2> where cluster number is 2, application number is 0312, and executor is 0000, would yield ODA21200.

Note: The spark.zos.executor.jobname.template property supersedes spark.zos.executor.jobname.prefix options.