IBM Support

Technical Service Bulletin (2023-688) - Incorrect Java heap memory allocation when creating Small, Medium or Large NiFi flow deployments

Flashes (Alerts)


Abstract

When using Cloudera DataFlow, Small, Medium and Large flow deployments appear to be utilizing the appropriate amount of heap memory for their allocated cluster resources, but only 2GB of heap memory is actually allocated. This can result in a limitation of flow functionality as flow deployments may not have sufficient memory available.

Content

Products affected:  Cloudera DataFlow (DataFlow) for Public Cloud (CDF-PC)
Releases affected:  CDF-PC 2.5.0-b210
Users affected: 
Customers who have created new flow deployments with Small, Medium or Large Apache NiFi (NiFi) node sizes on 2.5.0-b210 version.
Impact: 
The flow deployments do not have the correct heap memory allocated, which may result in data processing issues.
Action required:
Upgrade:
  • Customers must upgrade any CDF service which is running 2.5.0-b210 to the CDF 2.5.0-H2-B1 version. 
  • Review the CDF Service Upgrade documentation (https://docs.cloudera.com/cdp-public-cloud-preview-features/cloud/cdf-service-upgrade/cdf-service-upgrade.pdf) before performing the following steps:
    • Navigate to DataFlow from the CDP Public Cloud home screen.
    • Click Environments in the DataFlow service.
    • Find the environment you want to upgrade, and click on it.
    • Click Manage Dataflow.
    • Click Actions > Upgrade.
    • Choose whether you want to Preserve current deployment NiFi versions. This setting is selected by default.
  • As the upgrade completes, all existing deployments will be restarted with the correctly allocated heap memory. 

Addressed in release:
CDF 2.5.0-H1-B6 (released on July 18th, 2023)
CDF 2.5.0-H2-B1 (released on August 1st, 2023)

[{"Type":"MASTER","Line of Business":{"code":"LOB10","label":"Data and AI"},"Business Unit":{"code":"BU059","label":"IBM Software w\/o TPS"},"Product":{"code":"SSGQ6Y","label":"Cloudera Data Platform Streaming with IBM"},"ARM Category":[{"code":"a8m3p0000006ws8AAA","label":"OpenSource DB-\u003ECloudera"}],"Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"All Versions"}]

Document Information

Modified date:
15 August 2023

UID

ibm17027617