Troubleshooting
Problem
DataStage job with java Connector throws error
java.lang.OutOfMemoryError: Java heap space
Symptom
Following error is seen the the DataStage Job log
Kafka_Connector_0,0: Fatal Error: The Kafka Producer Send method failed with exception :
org.apache.kafka.common.errors.TimeoutException: Batch containing 10 record(s) expired due to timeout while requesting metadata from brokers for kc_trades-0
Possible reasons could be
1. Invalid hostname or port number.
2. Creating an invalid topic name.
Consumer:
Kafka_Connector_0,0: java.lang.OutOfMemoryError: Java heap space
at java.nio.HeapByteBuffer.<init> (HeapByteBuffer.java: 57)
at java.nio.ByteBuffer.allocate (ByteBuffer.java: 331)
at org.apache.kafka.common.network.NetworkReceive.readFromReadableChannel (NetworkReceive.java: 93)
at org.apache.kafka.common.network.NetworkReceive.readFrom (NetworkReceive.java: 71)
at org.apache.kafka.common.network.KafkaChannel.receive (KafkaChannel.java: 154)
at org.apache.kafka.common.network.KafkaChannel.read (KafkaChannel.java: 135)
at org.apache.kafka.common.network.Selector.pollSelectionKeys (Selector.java: 323)
at org.apache.kafka.common.network.Selector.poll (Selector.java: 283)
at org.apache.kafka.clients.NetworkClient.poll (NetworkClient.java: 260)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.clientPoll (ConsumerNetworkClient.java: 360)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll (ConsumerNetworkClient.java: 224)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll (ConsumerNetworkClient.java: 192)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll (ConsumerNetworkClient.java: 163)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureCoordinatorReady (AbstractCoordinator.java: 179)
at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce (KafkaConsumer.java: 973)
at org.apache.kafka.clients.consumer.KafkaConsumer.poll (KafkaConsumer.java: 937)
at com.ibm.is.cc.kafka.runtime.KafkaConsumerProcessor.process (KafkaConsumerProcessor.java: 201)
at com.ibm.is.cc.kafka.runtime.KafkaProcessor.process (KafkaProcessor.java: 165)
at com.ibm.is.cc.javastage.connector.CC_JavaAdapter.run (CC_JavaAdapter.java: 443)
org.apache.kafka.common.errors.TimeoutException: Batch containing 10 record(s) expired due to timeout while requesting metadata from brokers for kc_trades-0
Possible reasons could be
1. Invalid hostname or port number.
2. Creating an invalid topic name.
Consumer:
Kafka_Connector_0,0: java.lang.OutOfMemoryError: Java heap space
at java.nio.HeapByteBuffer.<init> (HeapByteBuffer.java: 57)
at java.nio.ByteBuffer.allocate (ByteBuffer.java: 331)
at org.apache.kafka.common.network.NetworkReceive.readFromReadableChannel (NetworkReceive.java: 93)
at org.apache.kafka.common.network.NetworkReceive.readFrom (NetworkReceive.java: 71)
at org.apache.kafka.common.network.KafkaChannel.receive (KafkaChannel.java: 154)
at org.apache.kafka.common.network.KafkaChannel.read (KafkaChannel.java: 135)
at org.apache.kafka.common.network.Selector.pollSelectionKeys (Selector.java: 323)
at org.apache.kafka.common.network.Selector.poll (Selector.java: 283)
at org.apache.kafka.clients.NetworkClient.poll (NetworkClient.java: 260)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.clientPoll (ConsumerNetworkClient.java: 360)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll (ConsumerNetworkClient.java: 224)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll (ConsumerNetworkClient.java: 192)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll (ConsumerNetworkClient.java: 163)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureCoordinatorReady (AbstractCoordinator.java: 179)
at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce (KafkaConsumer.java: 973)
at org.apache.kafka.clients.consumer.KafkaConsumer.poll (KafkaConsumer.java: 937)
at com.ibm.is.cc.kafka.runtime.KafkaConsumerProcessor.process (KafkaConsumerProcessor.java: 201)
at com.ibm.is.cc.kafka.runtime.KafkaProcessor.process (KafkaProcessor.java: 165)
at com.ibm.is.cc.javastage.connector.CC_JavaAdapter.run (CC_JavaAdapter.java: 443)
Document Location
Worldwide
[{"Business Unit":{"code":"BU048","label":"IBM Software"},"Product":{"code":"SSVSEF","label":"IBM InfoSphere DataStage"},"Component":"","Platform":[{"code":"PF002","label":"AIX"},{"code":"PF016","label":"Linux"},{"code":"PF033","label":"Windows"}],"Version":"11.5;11.7","Edition":"","Line of Business":{"code":"LOB76","label":"Data Platform"}}]
Log InLog in to view more of this document
This document has the abstract of a technical article that is available to authorized users once you have logged on. Please use Log in button above to access the full document. After log in, if you do not have the right authorization for this document, there will be instructions on what to do next.
Was this topic helpful?
Document Information
Modified date:
25 April 2025
UID
ibm10875396