Analytics Engine Powered by Apache Spark on Cloud Pak for Data

Version: 4.6.5    Included   IBM

Thumbnail depiction of the interface of this service Thumbnail depiction of the interface of this service Thumbnail depiction of the interface of this service

Description

With Analytics Engine powered by Apache Spark, you can run jobs on a Spark cluster. You can:

  • Run Jupyter notebooks and jobs from other tools in Watson Studio analytics projects by selecting a Spark environment runtime. Install this service either before or after you install the Watson Studio service.
  • Run Spark SQL or jobs for data transformation, data science, or machine learning using Spark job APIs. The Spark job APIs do not require the Watson Studio service.

Quick links

  • Install: Install the service
  • Set up: Set up the service after installation
  • Upgrade: Upgrade the service
  • Use: Work with the service
  • Administer: Manage and maintain the service
  • Develop: Write code and build applications

Integrated services

Table 1. Related services. The following related services are often used with this service and provide complementary features, but they are not required.
Service Capability
Watson™ Studio Prepare, analyze, and model data in a collaborative environment with tools for data scientists, developers, and domain experts.
Watson Machine Learning Build, train, and deploy machine learning models with a full range of tools.