Analytics Engine powered by Apache Spark

Version: 5.2.2

Experience: Cloud Pak for Data watsonx™

Thumbnail depiction of the interface of this service Thumbnail depiction of the interface of this service Thumbnail depiction of the interface of this service

Description

With Analytics Engine powered by Apache Spark, you can run jobs on a Spark cluster. You can:

  • Run Jupyter notebooks and jobs from other tools in Watson Studio analytics projects by selecting a Spark environment runtime. Install this service either before or after you install the Watson Studio service.
  • Run Spark SQL or jobs for data transformation, data science, or machine learning using Spark job APIs. The Spark job APIs do not require the Watson Studio service.

Licensing information

This service is included in the following licenses:

  • IBM Cloud Pak® for Data Enterprise Edition
  • IBM Cloud Pak for Data Standard Edition
  • IBM® watsonx.ai™
  • IBM watsonx.data™

For more information, see Licenses and entitlements.

Quick links

  • Install: Install the service
  • Set up: Set up the service after installation
  • Upgrade: Upgrade the service
  • Use: Work with the service
  • Administer: Manage and maintain the service

Integrated services

Table 1. Related services. The following related services are often used with this service and provide complementary features, but they are not required.
Service Capability
Watson Studio Prepare, analyze, and model data in a collaborative environment with tools for data scientists, developers, and domain experts.
Watson Machine Learning Build, train, and deploy machine learning models with a full range of tools.