JR60903: KAFKA CONNECTOR IS NOT CLOSING PRODUCER THREAD IN TARGET MODE.

IBM InfoSphere Information Server, Version 11.7.1.1 (Fix Pack 1)
IBM InfoSphere Information Server, Version 11.7.1.1 for AIX
IBM InfoSphere Information Server, Version 11.7.1.1 for Windows
IBM InfoSphere Information Server, Version 11.7.1.1 for Linux

APAR status

• Closed as program error.

Error description

• When Datastage job contains Kafka Connector as a target, kafka
  producer thread writing to kafka topic is not closed. That can
  lead into thread leak in case of many EndOfWave markers coming
  into producer, e.g. OutOfMemory error:
  "java/lang/OutOfMemoryError" "Failed to create a thread: retVal
  -1073741830, errno 11" received
  

Local fix

• N/A
  

Problem summary

• ****************************************************************
  USERS AFFECTED:
  Users using Kafka connector in target mode
  ****************************************************************
  PROBLEM DESCRIPTION:
   When Datastage job contains Kafka Connector as a target, kafka
  producer thread writing to kafka topic is not closed. That can
  lead into thread leak in case of many EndOfWave markers coming
  into producer, e.g. OutOfMemory error:
  
   "java/lang/OutOfMemoryError" "Failed to create a thread: retVal
  -1073741830, errno 11" received
      <DB2_Connector_14,3> Number of records loaded = 0
  
  ****************************************************************
  RECOMMENDATION:
  Install APAR JR60903
  ****************************************************************
  

Problem conclusion

• Remove redundant kafka producer thread being opened without
  closure.
  

Temporary fix

Comments

APAR Information

• APAR is sysrouted FROM one or more of the following:

• APAR is sysrouted TO one or more of the following:

Fix information

• Fixed component name

  WIS DATASTAGE

• Fixed component ID

  5724Q36DS

Applicable component levels

• RB70 PSY

     UP

• RB71 PSY

     UP