IBM Support

InformationServer DataStage: 2GB Hash File Limit

Troubleshooting


Problem

Problem with use of hash file in DataStage. A job fills hash files and will be used in another job. All hash files have been filled except one. Nearly 12 million records out of 88 million were written, then the job aborted after 50 warnings.

Symptom

Hash File is too big. After the 11 million rows the DATA.30 file has 2.15GB and the OVER.30 file
0.5GB

[{"Product":{"code":"SSVSEF","label":"IBM InfoSphere DataStage"},"Business Unit":{"code":"BU048","label":"IBM Software"},"Component":"Not Applicable","Platform":[{"code":"PF002","label":"AIX"},{"code":"PF010","label":"HP-UX"},{"code":"PF016","label":"Linux"},{"code":"PF027","label":"Solaris"},{"code":"PF033","label":"Windows"}],"Version":"8.7.0.1;8.7;8.5.0.2;8.5.0.1;8.1.0.2;8.1.0.1;8.1;8.0.1.3;8.0.1.2;8.0.1.1;8.0.1;7.5.3;7.5.2","Edition":"","Line of Business":{"code":"LOB76","label":"Data Platform"}}]

Log InLog in to view more of this document

This document has the abstract of a technical article that is available to authorized users once you have logged on. Please use Log in button above to access the full document. After log in, if you do not have the right authorization for this document, there will be instructions on what to do next.

Document Information

Modified date:
25 April 2025

UID

swg21445736