What's new and changed in Execution Engine for Apache Hadoop

Execution Engine for Apache Hadoop updates can include new features and fixes. Releases are listed in reverse chronological order so that the latest release is at the beginning of the topic.

You can see a list of the new features for the platform and all of the services at What's new in IBM Software Hub.

IBM® watsonx™ Version 2.1.3

A new version of Execution Engine for Apache Hadoop was released in April 2025.

This release includes the following changes:

Updates: The following updates were introduced in this release:
Execution Engine for Apache Hadoop can now work with data on Cloudera Data Platform 7.1.9sp1 and 7.3.1. Execution Engine for Apache Hadoop also works with Spark 3.4 on Cloudera Data Platform version 7.3.1. You can use Spark 3.4 to run livy sessions on Runtime 24.1 on Python 3.11
Customer-reported issues fixed in this release: For a list of customer-reported issues that were fixed in this release, see the Fix List for IBM Cloud Pak® for Data on the IBM Support website.

IBM watsonx Version 2.1.2

A new version of Execution Engine for Apache Hadoop was released in March 2025.

This release includes the following changes:

IBM watsonx Version 2.1.1

A new version of Execution Engine for Apache Hadoop was released in February 2025.

This release includes the following changes:

Customer-reported issues fixed in this release: For a list of customer-reported issues that were fixed in this release, see the Fix List for IBM Cloud Pak for Data on the IBM Support website.

IBM watsonx Version 2.1.0

A new version of Execution Engine for Apache Hadoop was released in December 2024.

This release includes the following changes:

New features

This release of Execution Engine for Apache Hadoop includes the following features:

Execution Engine for Apache Hadoop now uses Java 11: The Hadoop Execution Engine RPM is now upgraded to use Java 11 instead of Java 8. All of the edge nodes must also be upgraded to Java 11 before you can install the RPM.

Updates

The following updates were introduced in this release:

- Hadoop upgraded to 3.4.0.

- Updated to meet IBM Carbon 11 standards.

Customer-reported issues fixed in this release

For a list of customer-reported issues that were fixed in this release, see the Fix List for IBM Cloud Pak for Data on the IBM Support website.