June 4, 2019 By IBM Cloud Team < 1 min read

Support for Apache Spark as a Service integration with Watson Machine Learning and Watson Studio is being deprecated.

This integration will be retired on June 28, 2019. We are happy to announce that this service integration has been replaced by built-in Spark environments

Benefits of Spark environments

  • Spark kernels on-demand:  Save time and energy to focus your analysis; create a Spark environment in Watson Studio and launch directly into a notebook.
  • Configurable, elastic compute: Configure your Spark environment and choose your kernel hardware configurations from Watson Studio.
  • Easily share your environment :  Your collaborators can easily use Spark environments.
  • Multiple language support :— Choose from the most popular languages for your Spark kernels (Python 3, R, Scala).

Switching to built-in Spark environments

If you currently use the Apache Spark as a Service in any of the following ways, you must switch to using built-in Spark environments:

  • Batch Deployments
  • Model Builder
  • Modeler Flows with Spark Runtime
  • Notebooks

Here are the dates you need to know

Service Retirement Announce Date: June 4, 2019

End of Support Date: June 28, 2019

For a period of 24 days after the Service Retirement Announce Date, through June 28, 2019, all existing Spark as a Service integrations with Watson Machine Learning and with Watson Studio projects will continue to be supported. After June 28, 2019, Spark as a Service will no longer be available to Watson Machine Learning or by tools in Watson Studio like Notebooks and Model Builder. Spark-powered realtime streaming predictions will no longer be available. 

We strongly recommend you update as soon as possible to work with the newer, more flexible Spark engines in Watson Machine Learning and Watson Studio.

Learn more.

More from Artificial intelligence

A new era in BI: Overcoming low adoption to make smart decisions accessible for all

5 min read - Organizations today are both empowered and overwhelmed by data. This paradox lies at the heart of modern business strategy: while there's an unprecedented amount of data available, unlocking actionable insights requires more than access to numbers. The push to enhance productivity, use resources wisely, and boost sustainability through data-driven decision-making is stronger than ever. Yet, the low adoption rates of business intelligence (BI) tools present a significant hurdle. According to Gartner, although the number of employees that use analytics and…

The power of remote engine execution for ETL/ELT data pipelines

5 min read - Business leaders risk compromising their competitive edge if they do not proactively implement generative AI (gen AI). However, businesses scaling AI face entry barriers. Organizations require reliable data for robust AI models and accurate insights, yet the current technology landscape presents unparalleled data quality challenges. According to International Data Corporation (IDC), stored data is set to increase by 250% by 2025, with data rapidly propagating on-premises and across clouds, applications and locations with compromised quality. This situation will exacerbate data silos, increase costs…

Where to begin: 3 IBM leaders offer guidance to newly appointed chief AI officers

4 min read - The number of chief artificial intelligence officers (CAIOs) has almost tripled in the last 5 years, according to LinkedIn. Companies across industries are realizing the need to integrate artificial intelligence (AI) into their core strategies from the top to avoid falling behind. These AI leaders are responsible for developing a blueprint for AI adoption and oversight both in companies and the federal government. Following a recent executive order by the Biden administration and a meteoric rise in AI adoption across…

IBM Newsletters

Get our newsletters and topic updates that deliver the latest thought leadership and insights on emerging trends.
Subscribe now More newsletters