Using the Spark configuration workflow
Using the Spark configuration workflow to configure Spark.
About this task
You can use the the Workflows task in IBM z/OS Management Facility (z/OSMF) to configure Spark (FMID HSPK120). The information and commands are similar to those described in this manual.
The z/OSMF interface simplifies the configuration steps, collects input, discovers details about your installation, helps you manage task assignments to members of your team, and runs configuration jobs. The parts of the configuration workflow are as follows:
- workflow-spark-config.xml
- The workflow definition file. Specify the fully-qualified path to this file on the 'Create Workflow' dialog in the z/OSMF workflow task. The workflow definition and the other supporting files in this directory will then load into z/OSMF
- workflow-spark-config-*.rexx
- These REXX programs support various workflow tasks. The programs are invoked by the z/OSMF workflow. Do not run them manually unless directed by IBM Support.
- workflow-spark-config-attls*.template
- Template files for configuration of Application Transparent Transport Layer Security (AT-TLS) and client authentication. These files are processed as input by the workflow code, but they can serve as a model for manually configuring AT-TLS and client authentication.
These workflow files are located in the Spark installation directory under the zos-workflow directory for the Spark releases supported by the workflow. The default installation directory is /usr/lpp/IBM/izoda/spark/sparknnn, where nnn is the current Spark version (for example, /usr/lpp/IBM/izoda/spark/spark24x for Spark 2.4.8). Note that for all Spark 2.4 releases, nnn is 24x. (for example, /usr/lpp/IBM/izoda/spark/spark24x for Spark 2.4.8).
Procedure
What to do next
You may assign certain steps to other users who have other skills or authority such as your Security Administrator or Network administrator depending on how your organization divides configuration work. IBM® Open Data Analytics for z/OS® also provides a workflow that provides step-by-step instructions for tuning and allocating resources. That workflow exists at the following location: https://github.com/IBM/IBM-Z-zOS/tree/master/zOS-Workflow/IzODA%20Workflows
Note that customization steps need to be done in sequential order.
For more information about the Workflows task in z/OSMF, see the following location: https://www.ibm.com/support/knowledgecenter/SSLTBW_2.3.0/com.ibm.zosmfworkflows.help.doc/izuWFhpWorkflowsTask.html