IBM Support

JAVA OOM (out-of-memory) error when writing around 100GB ORC data to HDFS via File connector

Troubleshooting


Problem

JAVA OOM (out-of-memory) error when writing around 100GB ORC data to HDFS via File connector

Symptom

The FileConnector job with ORC-file-format fails with Java-OOM (out-of-memory) error

[{"Product":{"code":"SSVSEF","label":"IBM InfoSphere DataStage"},"Business Unit":{"code":"BU048","label":"IBM Software"},"Component":"Not Applicable","Platform":[{"code":"PF016","label":"Linux"}],"Version":"11.5.0.1","Edition":"All Editions","Line of Business":{"code":"LOB76","label":"Data Platform"}}]

Log InLog in to view more of this document

This document has the abstract of a technical article that is available to authorized users once you have logged on. Please use Log in button above to access the full document. After log in, if you do not have the right authorization for this document, there will be instructions on what to do next.

Document Information

More support for:
IBM InfoSphere DataStage

Software version:
11.5.0.1

Operating system(s):
Linux

Document number:
542065

Modified date:
25 April 2025

UID

swg21976887

Manage My Notification Subscriptions