Using updated or upgraded Spark versions or notebook packages
When an updated or new Apache Spark version becomes available, upon adding it to your
system to use it with IBM® Spectrum
Conductor , you can then update existing instance groups to use that new Spark version.
This eliminates the need to re-create the instance groups for upgraded packages.
Similarly, when updated notebook packages become available, you can update your existing instance groups to use the latest notebook
package.
Updating instance groups to use an updated Spark version or notebook package IBM Spectrum Conductor , you can then update existing instance groups to use the upgraded packages.Updating instance groups to use a new Spark version IBM Spectrum Conductor , you can then update existing instance groups to use the new Spark version.Updating instance groups to use a new Jupyter version IBM Spectrum Conductor and using its built-in Anaconda distribution distribution version. You then update existing instance groups to use the new Anaconda distribution , which also upgrades your Jupyter notebooks to the new Jupyter version installed with the upgraded Anaconda distribution . For example, if you upgrade to IBM Spectrum Conductor 2.4.1 , you upgrade the Anaconda distribution to version 2019.03 with Jupyter notebook version 5.7.8 built-in. Use this topic to modify your instance groups and Jupyter notebooks to use 5.7.8 . To simply update your existing Jupyter notebook package without changing the Jupyter version, follow the steps in Updating instance groups to use an updated Spark version or notebook package instead of the steps in this topic.