Troubleshooting
Problem
When reading large amounts of data (of the order of 1GB or more) from tables, Snowflake Connector jobs configured to run with Snowflake JDBC driver 3.13.15 (till 3.13.20) might fail with a memory exception.
Also, in the job log, some unrelated warning messages can be seen.
On AIX platform, in addition to preceding issues Snowflake connector read jobs might fail with Java runtime exception.
Symptom
1. Snowflake CC read job might fail or extract only partial records from the table if the volume of data is more than 1GB. If the job fails the error that can be seen the job log is -
The reported error is:
The reported error is:
[SQLSTATE XX000] net.snowflake.client.jdbc.SnowflakeSQLLoggedException: JDBC driver internal error: Max retry reached for the download of #chunk113 (Total chunks: 212) retry=10, error=null.
(chunk number, total chunks, and retry numbers could be different than mentioned here).
2. In the job log, the following warnings can be seen. These warning messages can be seen even with 3.13.21 and 3.13.22 versions of the JDBC driver.
net.snowflake.client.jdbc.internal.apache.arrow.memory.BaseAllocator <clinit>
INFO: Debug mode disabled.
net.snowflake.client.jdbc.internal.apache.arrow.memory.DefaultAllocationManagerOption getDefaultAllocationManagerFactory
INFO: allocation manager type not specified, using netty as the default type
net.snowflake.client.jdbc.internal.apache.arrow.memory.CheckAllocator reportResult
Using DefaultAllocationManager at memory/DefaultAllocationManagerFactory.class
3. On AIX platform Snowflake connector read jobs might fail with Java runtime exception when char or varchar datatype columns are fetched from the table. The error message could be as -
Java runtime exception occurred: java.lang.IndexOutOfBoundsException: index: 0, length: nnnnnnnn (expected: range(0, n)) (net.snowflake.client.jdbc.internal.apache.arrow.memory.ArrowBuf::checkIndex, file ArrowBuf.java
The preceding three issues are from the latest Snowflake JDBC driver and are not related to any code changes in Snowflake Connector.
Document Location
Worldwide
[{"Type":"MASTER","Line of Business":{"code":"LOB76","label":"Data Platform"},"Business Unit":{"code":"BU048","label":"IBM Software"},"Product":{"code":"SSZJPZ","label":"IBM InfoSphere Information Server"},"ARM Category":[{"code":"a8m0z000000ble2AAA","label":"DataStage-\u003EJob Stages-\u003EDatabase Stages-\u003ESnowflake Connector"}],"ARM Case Number":"","Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"11.7.0;11.7.1"}]
Log InLog in to view more of this document
This document has the abstract of a technical article that is available to authorized users once you have logged on. Please use Log in button above to access the full document. After log in, if you do not have the right authorization for this document, there will be instructions on what to do next.
Was this topic helpful?
Document Information
Modified date:
25 April 2025
UID
ibm16617945