Analytics Engine powered by Apache Spark

With Analytics Engine powered by Apache Spark, you can run Spark jobs or applications on the IBM Cloud Pak for Data cluster.

You need to install the Analytics Engine powered by Apache Spark service in IBM Cloud Pak for Data if you want to:

  • Run Spark applications in IBM Watson Studio by selecting a Spark environment runtime. If required, the applications can be scheduled using the Jobs user interface in Watson Studio.
  • Submit Spark applications that run Spark SQL, or data transformation, data science or machine learning jobs using the REST APIs of Analytics Engine powered by Apache Spark.

You only need to install Analytics Engine powered by Apache Spark once to run Spark applications in IBM Watson Studio and to submit jobs using the Spark jobs API. For example, if you have installed Analytics Engine powered by Apache Spark and decide to install Watson Studio at a later stage, you don't have to install Analytics Engine powered by Apache Spark again to enable running Spark applications in Watson Studio.

Next steps

Parent topic: Installing services