Support for Apache Spark as a Service integration with Watson Machine Learning and Watson Studio is being deprecated.

This integration will be retired on June 28, 2019. We are happy to announce that this service integration has been replaced by built-in Spark environments

Benefits of Spark environments

  • Spark kernels on-demand:  Save time and energy to focus your analysis; create a Spark environment in Watson Studio and launch directly into a notebook.
  • Configurable, elastic compute: Configure your Spark environment and choose your kernel hardware configurations from Watson Studio.
  • Easily share your environment :  Your collaborators can easily use Spark environments.
  • Multiple language support :— Choose from the most popular languages for your Spark kernels (Python 3, R, Scala).

Switching to built-in Spark environments

If you currently use the Apache Spark as a Service in any of the following ways, you must switch to using built-in Spark environments:

  • Batch Deployments
  • Model Builder
  • Modeler Flows with Spark Runtime
  • Notebooks

Here are the dates you need to know

Service Retirement Announce Date: June 4, 2019

End of Support Date: June 28, 2019

For a period of 24 days after the Service Retirement Announce Date, through June 28, 2019, all existing Spark as a Service integrations with Watson Machine Learning and with Watson Studio projects will continue to be supported. After June 28, 2019, Spark as a Service will no longer be available to Watson Machine Learning or by tools in Watson Studio like Notebooks and Model Builder. Spark-powered realtime streaming predictions will no longer be available. 

We strongly recommend you update as soon as possible to work with the newer, more flexible Spark engines in Watson Machine Learning and Watson Studio.

Learn more.

More from Announcements

IBM Hybrid Cloud Mesh and Red Hat Service Interconnect: A new era of app-centric connectivity 

2 min read - To meet customer demands, applications are expected to be performing at their best at all times. Simultaneously, applications need to be flexible and cost effective, and therefore supported by an underlying infrastructure that is equally reliant, performant and secure as the applications themselves.   Easier said than done. According to EMA's 2024 Network Management Megatrends report only 42% of responding IT professionals would rate their network operations as successful.   In this era of hyper-distributed infrastructure where our users, apps, and data…

IBM named a Leader in Gartner Magic Quadrant for SIEM, for the 14th consecutive time

3 min read - Security operations is getting more complex and inefficient with too many tools, too much data and simply too much to do. According to a study done by IBM, SOC team members are only able to handle half of the alerts that they should be reviewing in a typical workday. This potentially leads to missing the important alerts that are critical to an organization's security. Thus, choosing the right SIEM solution can be transformative for security teams, helping them manage alerts…

IBM and MuleSoft expand global relationship to accelerate modernization on IBM Power 

2 min read - As companies undergo digital transformation, they rely on APIs as the backbone for providing new services and customer experiences. While APIs can simplify application development and deliver integrated solutions, IT shops must have a robust solution to effectively manage and govern them to ensure that response times and costs are kept low for all applications. Many customers use Salesforce’s MuleSoft, named a leader by Gartner® in full lifecycle API management for seven consecutive times, to manage and secure APIs across…

IBM Newsletters

Get our newsletters and topic updates that deliver the latest thought leadership and insights on emerging trends.
Subscribe now More newsletters