I am using the dbms::jdbc module in Jaql for BigInsights 3.0. I am trying to pull a large table from a DBMS connection with code that works for smaller tables (I also have a requirement that I cannot use the partitioned query functionality). However, I get the following error:
JVMDUMP039I Processing dump event "systhrow", detail "java/lang/OutOfMemoryError" at 2014/08/07 15:54:23 - please wait.
JVMDUMP032I JVM requested Heap dump using '/opt/ibm/biginsights/jaql/bin/heapdump.20140807.155423.3658788.0001.phd' in response to an event
JVMDUMP010I Heap dump written to /opt/ibm/biginsights/jaql/bin/heapdump.20140807.155423.3658788.0001.phd
JVMDUMP032I JVM requested Java dump using '/opt/ibm/biginsights/jaql/bin/javacore.20140807.155423.3658788.0002.txt' in response to an event
JVMDUMP010I Java dump written to /opt/ibm/biginsights/jaql/bin/javacore.20140807.155423.3658788.0002.txt
JVMDUMP032I JVM requested Snap dump using '/opt/ibm/biginsights/jaql/bin/Snap.20140807.155423.3658788.0003.trc' in response to an event
JVMDUMP010I Snap dump written to /opt/ibm/biginsights/jaql/bin/Snap.20140807.155423.3658788.0003.trc
JVMDUMP013I Processed dump event "systhrow", detail "java/lang/OutOfMemoryError".
encountered an exception during the evaluation of a statement
java.lang.OutOfMemoryError: Java heap space
I have increased the heap size of map and reduce jobs and experienced no change, so I presume this Java heap space issue has to do with the Jaql client itself. Does anyone know if there is a way that I can increase the heap space that the Jaql client has access to when acting in a standalone capacity?
Thank you in advance for the help!