End of support for Spark version 2.0 in Analytics for Apache Spark

Share this post:

We’d like to inform you about the withdrawal of support for Apache Spark v2.0 in IBM Analytics for Apache Spark which will end on April 30, 2018. However, this service will continue to support Apache Spark versions under the Spark 2.1.x branch.
As part of IBM’s effort to provide a current, secure and GDPR compliant cloud service, several security vulnerabilities are being identified and repaired. A number of them present in Spark v2.0 have been fixed in the Spark v2.1 branch. In addition, Spark 2.1 API is compatible with that of Spark 2.0 with minimal upgrade updates needed to move from version 2.0 to 2.1.x.

For a more complete list of changes added to Apache Spark, consult the release notes for the Spark release at (Spark 2.1).
The support for Apache Spark v2.0 will be withdrawn on April 30, 2018. Here’s what you need to know:

  • End of Support Announce Date: February 27, 2018
  • End of Support Withdrawal Date: April 30, 2018

For the period after the End of Support Announce Date, through April 30, 2018 all new or existing instances of Analytics for Apache Spark will have the ability to submit and execute jobs using a Spark v2.0 kernel or driver.

As of April 30, 2018, new or existing kernels or jobs cannot be submitted to execute with Spark v2.0 driver.

  • Please remember to update your applications and notebooks to use Spark v2.1.2 APIs before the End of Support Withdrawal Date, i.e. April 30, 2018.

We strongly recommend you to move your applications to Spark v2.1.2 in order to get access to the latest APIs and capabilities of Apache Spark in order to stay compliant with the GDPR requirements. Also, you may follow these migration guidelines to upgrade.

As always, we’re here to help! Reach out to us in the support forums.

More Community stories

Announcing Data Virtualization (Federation) for Db2 on Cloud

IBM is happy to announce Db2 Data Virtualization features for Db2 on Cloud. Sometimes called “federation”, this feature lets our customers access data from multiple different databases with a single query. With this latest addition, users will now be able to access data that is located on any of their Db2 or Informix data sources including both cloud and on premises system. This functionality is supported on all versions of Db2 on Cloud, except for the free Lite plan (However, users can use the Lite plan as a target that you can pull data from).

Continue reading

IBM Content Delivery Network improves user experience worldwide

This blog shows how much the IBM Content Delivery Network (CDN) can improve the performance of your cloud applications, globally. We tested some specific use cases, and we wanted to share what we learned!

Continue reading

Now available: Veeam on IBM Cloud price reductions + new licensing options + free trial

We are excited to announce that we have reduced the price of our existing Veeam Availability Suite Enterprise Plus and Veeam Physical Agent solutions, as well as launched a new Veeam License, Veeam Backup and Replication. The new prices and options are now available in our IBM Cloud Portal: Veeam Availability Suite Enterprise Plus for […]

Continue reading