JR49560: Unstructured Data stage throws OutOfMemoryError when reading a large Exel (xlsx) file

InfoSphere Information Server, Version 11.3 for Microsoft Windows
InfoSphere Information Server, Version 11.3 for AIX
InfoSphere Information Server, Version 11.3 for Linux
IBM InfoSphere Information Server Enterprise Edition V11.3 for Windows

APAR status

• Closed as fixed if next.

Error description

• When reading the small size of Excel data, the
  customer job works fine. But when reading the large
  size of Excel data (over 50MB), then Unstructured cause
  OutofMemory due to the needs of the extra space.
  

Local fix

• NO
  

Problem summary

• Unstructured Data stage internally uses an API of Apache POI
  library that loads all of uncompressed contents of an
  Excel(xlsx) file on memory. As a result, it requires more than
  10 times of Java heap memory as the file size.
  

Problem conclusion

Temporary fix

• Specify Java heap memory size about 10 to 20 times as the file
  size using CC_UNST_JAVA_HEAP environment variable.
  

Comments

APAR Information

• APAR is sysrouted FROM one or more of the following:

• APAR is sysrouted TO one or more of the following:

Fix information

Applicable component levels

• R910 PSY

     UP

• R912 PSY

     UP