Adding Spark versions

Add new Spark versions that you can use when creating Spark instance groups.

Before you begin

You must be a cluster administrator or have the Version Management Configure permission.

About this task

Follow these steps to download and import Spark version packages that are posted to IBM® Fix Central. Multiple Spark versions can coexist, with each version bundling a specific Apache Spark version with other IBM Spectrum Conductor files.

This task is typically not required for built-in Spark versions that are installed with IBM Spectrum Conductor (see Supported Spark, Anaconda, and notebook versions). If you removed a built-in version and want to add it again to the cluster, or if you want to add an updated version, download the Spark version package from IBM Fix Central and follow the instructions in the accompanying readme.

Procedure

  1. Log in to Fix Central and download the Spark version.
    Before you download an update from Fix Central:
    • Know your IBM user ID and password. You are required to log in to the IBM Fix Central web site before you can download an update.
    • To search for a Spark version, click the Find Product tab and enter IBM Spectrum Conductor.
    • To get information about the download process or help during the process, see IBM Fix Central help.
  2. Download the Spark version package (available as a .tgz file) to a local directory.
  3. Log in to the cluster management console.
  4. Click Version Management.
  5. Click Add.
  6. Click Browse and navigate to the directory where you downloaded the Spark version package.
  7. Click Add.

Results

You have added a Spark version for your Spark instance groups.

What to do next

Create a Spark instance group and select the Spark version that you added. See Creating Spark instance groups.

To enable an existing Spark instance group to use this updated Spark version, see Updating Spark instance groups to use an updated Spark version or notebook package.