IBM Support

Apache Spark version 2.1.0 is here!

Technical Blog Post


Abstract

Apache Spark version 2.1.0 is here!

Body

imageHave you tried our new product offering IBM Spectrum Conductor with Spark 2.2? If you have, you might have found that Apache Spark versions 1.5.2, 1.6.1, and 2.0.1 come built-in with the product, and are available to choose when creating a Spark instance group. However, IBM Spectrum Conductor with Spark allows you to add other supported Spark versions, including the newly released Apache Spark version 2.1.0! 

Apache Spark 2.1.0 is now publicly available and is supported for IBM Spectrum Conductor with Spark 2.2.0. To learn more about the new features in this Spark version, see the Apache Spark 2.1.0 release notes.

To try out this Spark version, you can download the Apache Spark 2.1.0 package for IBM Spectrum Conductor with Spark 2.2.0 on IBM Fix Central

If you have not yet tried IBM Spectrum Conductor with Spark 2.2 yet, you can download an evaluation version here. If you have any questions about our product or about the new Apache Spark version, post in our forum!

[{"Business Unit":{"code":"BU059","label":"IBM Software w\/o TPS"},"Product":{"code":"SS4H63","label":"IBM Spectrum Conductor"},"Component":"","Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"","Edition":"","Line of Business":{"code":"LOB10","label":"Data and AI"}}]

UID

ibm16163695