Configuring an Analytics Engine powered by Apache Spark instance for watsonx.data

You can integrate Analytics Engine powered by Apache Spark with watsonx.data so that you can run Apache Spark workloads for the watsonx.data service.

You can use Spark for the following watsonx.data use cases:

• Loading large volume of data into watsonx.data tables. You can also cleanse and transform data before ingestion.
• Table maintenance operation to improve performance of the watsonx.data table.
• Complex analytics workload that is difficult to represent as queries.

There are multiple methods of integrating Analytics Engine powered by Apache Spark with watsonx.data:

• Integrating with watsonx.data on Cloud Pak for Data
• Integrating with watsonx.data on IBM Cloud
• Integrating with watsonx.data stand-alone