Using the Spark configuration workflow

Using the Spark configuration workflow to configure Spark.

About this task

You can use the the Workflows task in IBM z/OS Management Facility (z/OSMF) to configure Spark (FMID HSPK120). The information and commands are similar to those described in this manual.

The z/OSMF interface simplifies the configuration steps, collects input, discovers details about your installation, helps you manage task assignments to members of your team, and runs configuration jobs. The parts of the configuration workflow are as follows:

workflow-spark-config.xml
The workflow definition file. Specify the fully-qualified path to this file on the 'Create Workflow' dialog in the z/OSMF workflow task. The workflow definition and the other supporting files in this directory will then load into z/OSMF
workflow-spark-config-*.rexx
These REXX programs support various workflow tasks. The programs are invoked by the z/OSMF workflow. Do not run them manually unless directed by IBM Support.
workflow-spark-config-attls*.template
Template files for configuration of Application Transparent Transport Layer Security (AT-TLS) and client authentication. These files are processed as input by the workflow code, but they can serve as a model for manually configuring AT-TLS and client authentication.

These workflow files are located in the Spark installation directory under the zos-workflow directory for the Spark releases supported by the workflow. The default installation directory is /usr/lpp/IBM/izoda/spark/sparknnn, where nnn is the current Spark version (for example, /usr/lpp/IBM/izoda/spark/spark24x for Spark 2.4.8). Note that for all Spark 2.4 releases, nnn is 24x. (for example, /usr/lpp/IBM/izoda/spark/spark24x for Spark 2.4.8).

Procedure

  1. Create and run the workflow using a UID 0 user.
  2. From the Workflows task on z/OSMF, locate the Workflows table.
    Workflows table
  3. Click the Actions drop down menu and select Create Workflow...
  4. From the Create Workflow dialog, enter the fully-qualified path to the workflow-spark-config.xml file in the Workflow definition file field.

    Leave the 'Workflow variable input file' field empty. In the 'System' field, select the local z/OS system name.

    Workflow System field
  5. Click Next > .
  6. Ensure the 'Owner user ID' field is the same as the current UID 0 user.

    Check the Assign all steps to owner user ID checkbox.

    Assign all steps to owner user ID
  7. Click Finish.

    Read and run the steps in the order presented in the workflow.

    Workflow steps
    Note: The workflow can be used to copy and modify an existing Spark configuration to be a new configuration or to update an existing configuration. To use the workflow for these purposes, read and follow the instructions in step 2 - How to use this workflow to copy or upgrade from a previous Spark configuration.

What to do next

You may assign certain steps to other users who have other skills or authority such as your Security Administrator or Network administrator depending on how your organization divides configuration work. IBM® Open Data Analytics for z/OS® also provides a workflow that provides step-by-step instructions for tuning and allocating resources. That workflow exists at the following location: https://github.com/IBM/IBM-Z-zOS/tree/master/zOS-Workflow/IzODA%20Workflows

Note that customization steps need to be done in sequential order.

For more information about the Workflows task in z/OSMF, see the following location: https://www.ibm.com/support/knowledgecenter/SSLTBW_2.3.0/com.ibm.zosmfworkflows.help.doc/izuWFhpWorkflowsTask.html