IBM Support

Release Notes for IDR 11.4 for Kafka

Fix Readme


Abstract

Release Notes for IBM Data Replication 11.4 Replication Engine for Kafka

Content

Release notes for other IDR 11.4 LUW Replication Engines can be found here: Release Notes for IIDR 11.4 Replication Engines for Linux, Unix and Windows

Binaries are available on Fix Central 

December 19, 2025

IDR 11.4.0.5-5789

Enhancements in IDR 11.4.0.5-5789 for CDC Replication Engine for Kafka

  • Updated JVM to 17.0.17.0, java version "17.0.17" 2025-10-21 IBM Semeru Runtime Certified Edition 17.0.17.0 (build 17.0.17+10). For details, see IBM Semeru Runtimes fixes for version 17 enhancement luw-base
  • Updated various open source libraries. Installer size increased.

Bugs fixed in IDR 11.4.0.5-5789 for CDC Replication Engine for Kafka

  • External Secret Store fields are missing from the Windows configuration tool dmconfigurets

November 28, 2025

IDR 11.4.0.5-5788

Enhancements in IDR 11.4.0.5-5788 for CDC Replication Engine for Kafka

  • Dmshowversion command output now includes Java version

Known Issues fixed in IDR 11.4.0.5-5788 for CDC Replication Engine for Kafka

  • DT456860 CDC Replication Engine targets - refresh performance can be lower when using multiple image builder threads
 

October 30, 2025

IDR 11.4.0.5-5785

Enhancements in IDR 11.4.0.5-5785 for CDC Replication Engine for Kafka

  • Kafka REST server is now deprecated and will no longer be supported In the future.
  • The property deserializer.class can now be set and used in the KCOP Test Harness

Known Issues fixed in IDR 11.4.0.5-5785 for CDC Replication Engine for Kafka

  • DT448348 CDC Replication Engines do not set JVM parameter -Xms after saving configuration
  • DT452373 CDC Replication Engine for Kafka - upgrade fails with 'Invalid Installation Folder - Cannot invoke "java.util.jar.Attributes.getValue(java.lang.String)" because "attributes" is null'

Bugs fixed in IDR 11.4.0.5-5785 for CDC Replication Engine for Kafka

  • com.datamirror.ts.assertion.NecessityException with encoding not supported error reported after upgrading CDC.
  • MsgReaddTableshandler.readdPublishedTable() can block metadata access when getting the latest column definitions
  • External table load while mirror call to dmmarkexternalunloadend fails with "Attempt to mark end of external unload without marking start of external unload for table"
  • Message to get the DB columns for a table holds metadata lock too long so it locks out other threads

September 30, 2025

IDR 11.4.0.5-5783

Enhancements in IDR 11.4.0.5-5783 for CDC Replication Engine for Kafka

  • CDC is now supported in OpenShift Virtualization clusters, with configuration guidance available in the Knowledge Center.
  • Updated JVM to 17.0.16.0, java version "17.0.16" 2025-07-15 IBM Semeru Runtime Certified Edition 17.0.16.0 (build 17.0.16+8). For details, see IBM Semeru Runtimes fixes for version 17
  • Implement a global %REPLACE functionality that would replace all matching characters in all columns of all tables.
  • IDR now supports External Parallel Table Load (Refresh) while mirroring.

Known Issues fixed in IDR 11.4.0.5-5783 for CDC Replication Engine for Kafka

  • DT450444 Differential Refresh deletes all remaining rows in the target table if the subscription is stopped immediate or abort

Bugs fixed in IDR 11.4.0.5-5783 for CDC Replication Engine for Kafka

  • Fixed NumberFormatException caused by having leading or trailing spaces in the value for KCOP property PARTITION_DEFAULT.

September 1, 2025

IDR 11.4.0.5-5776

Enhancements in IDR 11.4.0.5-5776 for CDC Replication Engine for Kafka

  • System property target_allow_parallel_jdbc_refresh has been added to enable JDBC refresh of a table to be performed by multiple apply threads.

APARs fixed in IDR 11.4.0.5-5776 for CDC Replication Engine for Kafka

  • DT447888 INVALID TABLE NAME EXCEPTION WHEN RUNNING DMREMOVECLOSEDTXN UTILITY IF PERSISTED PRIVATE PARSER TXN QUEUES EXIST AND THE CORRESPONDING SUBSCRIPTION NAME IS NOT EXACTLY 12 CHARACTERS IN LENGTH.

Known Issues fixed in IDR 11.4.0.5-5776 for CDC Replication Engine for Kafka

  • DT447888 INVALID TABLE NAME EXCEPTION WHEN RUNNING DMREMOVECLOSEDTXN UTILITY IF PERSISTED PRIVATE PARSER TXN QUEUES EXIST AND THE CORRESPONDING SUBSCRIPTION NAME IS NOT EXACTLY 12 CHARACTERS IN LENGTH.

August 1, 2025

IDR 11.4.0.5-5770

Enhancements in IDR 11.4.0.5-5770 for CDC Replication Engine for Kafka

  • Upgraded kafka-client to 3.9.1
  • IDR now supports cipher suites TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384 and TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256 with TLS 1.2.
  • IDR now supports Ubuntu 22.04 LTS and 24.04 LTS
  • The system properties queue_blocking_call_before_flushing_timeout and target_optimizer_wait_timeout_millis can now be changed without requiring the subscription to be stopped before the changes take effect
  • The system properties queue_blocking_call_before_flushing_timeout and target_optimizer_wait_timeout_millis can now be set on a per-subscription basis

Known Issues fixed in IDR 11.4.0.5-5770 for CDC Replication Engine for Kafka

  • DT446769 - Upgrading CDC for Kafka engine from Java 8 to Java 17 (build 5752 or higher) caused bad_certificate error during subscription startup.

Bugs fixed in IDR 11.4.0.5-5770 for CDC Replication Engine for Kafka

  • Fixed the issue that caused %TOCHAR expression to fail with "newValue is out of valid range" error while using decimal parameters after upgrade

June 27, 2025

IDR 11.4.0.5-5768

Enhancements in IDR 11.4.0.5-5768 for CDC Replication Engine for Kafka

  • Batching is now allowed when using a NetEffectConvertUpdates fast apply algorithm for Adaptive Apply mappings or during the Refresh While Active (RWA) period. This substantially improves performance in these situations.
  • Insert batching via a single multi-row insert statement is now supported when JDBC insert batching does not deliver signficant performance gains.
  • Adaptive Apply (AA) is now only performed during refresh if table truncate is disabled or the user has explicitly specified they want AA during refresh by setting a system property. This substantially improves refresh performance for AA mappings by allowing Fastload refresh and JDBC batching during JDBC refresh

Known Issues fixed in IDR 11.4.0.5-5768 for CDC Replication Engine for Kafka

  • DT440186 CDC Replication Engine for Kafka - setting a bookmark can configure an incorrect starting position due to a synchronization issue
  • DT438282 CDC Replication Engine for Kafka - Starting subscription can show state "Mirror Continuous" but data does not replicate and subscription cannot end if engine encounters an exception during startup
  • DT442954 CDC Replication Engines - subscriptions intermittently fail to start with "startup timeout has occurred. Replication will end" event

Bugs fixed in IDR 11.4.0.5-5768 for CDC Replication Engine for Kafka

  • KCOP properties file parameter "header.jcfs" does not alter headers for journal control fields properly

June 4, 2025

IDR 11.4.0.5-5765

Enhancements in IDR 11.4.0.5-5765 for CDC Replication Engine for Kafka

  • Kafka transactionally consistent consumer: Performance improvement for reading large transaction from multi-partition topics. Recompile your TCC application with the latest libraries from txnconsumer-applications-samples-*-repository.zip to improve performance when reading large transactions from multi-partition topics.
  • Updated JVM to 17.0.15.0, java version "17.0.15" 2025-04-15 IBM Semeru Runtime Certified Edition 17.0.15.0 (build 17.0.15+6). For details, see IBM Semeru Runtimes fixes for version 17

Known Issues fixed in IDR 11.4.0.5-5765 for CDC Replication Engine for Kafka

  • DT438085 CDC Replication Engines - Event notification with SMTP fails with javax.mail.AuthenticationFailedException after secret store changes. The fix is available in 11.4.0.5-5752 and newer.

Bugs fixed in IDR 11.4.0.5-5765 for CDC Replication Engine for Kafka

  • Non inline LOBs in a JDBC batch are not closed

May 1, 2025

IDR 11.4.0.5-5761

Enhancements in IDR 11.4.0.5-5761 for CDC Replication Engine for Kafka

  • Upgraded kafka-client to 3.8.1

Bugs fixed in IDR 11.4.0.5-5761 for CDC Replication Engine for Kafka

  • CDC Replication Engine for Kafka - subscriptions stop on a NullPointerException in error handling when progress stream consumer cannot connect to the Kafka Cluster to retrieve topic list
  • CDC Replication Engine for Kafka - following engine upgrade, subscriptions fail to start. Instance trace log contains error "java.lang.UnsatisfiedLinkError Failed to load library ("/tmp2/libzstd-jni-1.5.6-310298630295226204242.so") .. Unsupported OS/arch, cannot find /linux/amd64/libzstd-jni-1.5.6-3.so or load zstd-jni-1.5.6-3 from system libraries"

April 4, 2025

IDR 11.4.0.5-5757

Enhancements in IDR 11.4.0.5-5757 for CDC Replication Engine for Kafka

Known Issues fixed in IDR 11.4.0.5-5757 for CDC Replication Engine for Kafka

  • DT433610 CDC Replication Engine for Kafka - engine shuts down on NullPointerException writing metadata
 
 

February 28, 2025

IDR 11.4.0.5-5752

Enhancements in IDR 11.4.0.5-5752 for CDC Replication Engine for Kafka

  • Updated JVM to 17.0.13.0, java version "17.0.13" 2024-10-15 IBM Semeru Runtime Certified Edition 17.0.13.0 (build 17.0.13+11). How to take a backup, recompile Java user exits, KCOPs and external secret store classes are described in CDC Replication Engines migrate from Java 8 to Java 17, along with troubleshooting tips.
  • Effective July 2025, IDR CDC will no longer provide support for following operating system versions: RedHat Enterprise Linux (RHEL) 7; CentOS 7.x. This extends support from January 2025 through July 2025
 

December 20, 2024

IDR 11.4.0.5-5742

Enhancements in IDR 11.4.0.5-5742 for CDC Replication Engine for Kafka

  • Updated JVM to 8.0.8.35, java version "1.8.0_431" Java(TM) SE Runtime Environment (build 8.0.8.35 - pap6480sr8fp35-20241105_01(SR8 FP35)). For details, see Java SDK fixes, version 8.0. Recompile Java user exits, KCOPs and external secret store classes.

Known Issues fixed in IDR 11.4.0.5-5742 for CDC Replication Engine for Kafka

  • DT419526 CDC Replication Engine for Kafka - NullPointerException thrown when stopping subscription
  • DT419421 CDC Replication Engines - command line utilities might not properly negotiate TLS settings with the local engine

December 9, 2024

IDR 11.4.0.5-5740

Enhancements in IDR 11.4.0.5-5740 for CDC Replication Engine for Kafka

  • You can now specify a custom classpath for Kafka client libraries by creating and populating the CDC_Kafka_instance_directory/conf/kafka-client-classloader.cp configuration file
  • Kcop Test Harness java application and its dependencies packaged separately in a zip file under CDC-KAFKA-INSTALL/samples
  • KcopSingleRowAvroAuditHeadersIntegrated is now deprecated. Functionality is not affected.
  • Provide ability to trim trailing whitespace characters from source character-type columns when being applied to varchar columns

Known Issues fixed in IDR 11.4.0.5-5740 for CDC Replication Engine for Kafka

  • DT398056 CDC target Replication Engines - differential refresh log table name was generated incorrectly
  • DT416679 CDC Replication Engines - Subscription does not stop if data channel and/or control channel connection is implicitly closed due to error
  • DT418775 CDC Replication Engines - Following upgrade, engines using an External Secret Store User Exit may fail to start, reporting invalid user/password to customer database. Affects upgrades to 11.4.0.5-5735 or older.
 
 

October 2, 2024

IDR 11.4.0.5-5733

Enhancements in IDR 11.4.0.5-5733 for CDC Replication Engine for Kafka

  • Updated JVM to 8.0.8.30, java version "1.8.0_421" Java(TM) SE Runtime Environment (build 8.0.8.30 - pwa6480sr8fp30-20240801_01(SR8 FP30))
  • %REPLACE derived expression can now replace codepoints above 127

Known Issues fixed in IDR 11.4.0.5-5733 for CDC Replication Engine for Kafka

  • DT395890 CDC Replication Engines - an instance being used as a source datastore can stop due to NullPointerException in singlescrape
  • DT396565 CDC Replication Engines - Target engine Fast Apply does not retry if it encounters a SQL exception such as a commit failing

Bugs fixed in IDR 11.4.0.5-5733 for CDC Replication Engine for Kafka

  • dmshowversion, dmconfigurets unable to run if you select "IBM Data Replication IMS for z/OS Remote Source" offering during installation

September 10, 2024

IDR 11.4.0.5-5731

Enhancements in IDR 11.4.0.5-5731 for CDC Replication Engine for Kafka

  • Introducing a Standalone KCOP Test Harness that runs sample KCOPS independently from CDC Kafka
  • Users can now specify subscriptions that are not allowed to use the shared scrape staging store by setting system property mirror_subs_allowed_to_use_staging_store to false at the subscription level

Known Issues fixed in IDR 11.4.0.5-5731 for CDC Replication Engine for Kafka

  • DT394553 CDC Replication Engines - subscription ends on error NullPointerException when a commit fails on the target engine
  • DT393813 CDC Replication Engines - Differential Refresh includes CDR columns in update and delete where clauses leading to rows not being found

September 10, 2024

IDR 11.4.0.5-5730

Enhancements in IDR 11.4.0.5-5730 for CDC Replication Engine for Kafka

  • CDC Replication Engines now issue a warning if source and target columns have incompatible datatypes during table assignment for non-explicitly mapped columns
  • System property mirror_timezone_support_enabled added to force CDC Replication Engines to use the source timezone when converting JCF and commit timestamps

Known Issues fixed in IDR 11.4.0.5-5730 for CDC Replication Engine for Kafka

  • DT391116 CDC Replication Engine for Kafka - Index Out Of Bounds in Kafka statistics collector thread

June 27, 2024

IDR 11.4.0.5-5726

Enhancements in IDR 11.4.0.5-5726 for CDC Replication Engine for Kafka

  • Effective January 2025, IDR CDC will no longer provide support for following operating system versions: RedHat Enterprise Linux (RHEL) 7; CentOS 7.x

June 4, 2024

IDR 11.4.0.5-5725

Enhancements in IDR 11.4.0.5-5725 for CDC Replication Engine for Kafka

  • IIDR now provides the option of retrying the fast apply failed Unit of Work
  • Updated JVM to 8.0.8.25, java version "1.8.0_411" Java(TM) SE Runtime Environment (build 8.0.8.25 - pwa6480sr8fp25-20240328_01(SR8 FP25))

Known Issues fixed in IDR 11.4.0.5-5725 for CDC Replication Engine for Kafka

  • DT382379 CDC Replication Engines - dmsupportinfo command does not collect complete details expected.

May 23, 2024

IDR 11.4.0.5-5722

Known Issues fixed in IDR 11.4.0.5-5722 for CDC Replication Engine for Kafka

  • DT258648 CDC Replication Engines - Replication ends on error "ClassNotFoundException" for Timestamp12Format class when executing a user exit that uses Timestamp12 class

May 1, 2024

IDR 11.4.0.5-5721

Enhancements in IDR 11.4.0.5-5721 for CDC Replication Engine for Kafka

  • Upgraded kafka-client to 3.6.0 and schema-registry client to 7.6.0
  • During lenient-tail functionality execution, added TCC retries and error handling when a Kafka cluster returns no records to a poll request to the commitstream topic with records
  • CDC now supports custom character sets that map multiple byte sequences to the same Unicode character.
 

March 28, 2024

IDR 11.4.0.5-5715

Enhancements in IDR 11.4.0.5-5715 for CDC Replication Engine for Kafka

  • TCC consumer now has individual default names for collecting JMX statistics. Preserve the original consumer name using the "client.id" consumer property.
  • Document userexit interfaces such as UserExitIF, DataRecordIF and ReplicationEventIF in docs folder

Known Issues fixed in IDR 11.4.0.5-5715 for CDC Replication Engine for Kafka

  • DT255108 IDR CDC Kafka - KcopSingleRowAvroAuditIntegrated throws Invalid Schema Modification error when the column is a not-nullable CLOB with default value
 

March 1, 2024

IDR 11.4.0.5-5706

Enhancements in IDR 11.4.0.5-5706 for CDC Replication Engine for Kafka

  • Updated JVM to 8.0.8.20, java version "1.8.0_401" (build 8.0.8.20 - pwa6480sr8fp20-20240112_01(SR8 FP20))
  • Increased the requested maximum number of pending connections on the TCP accept queue

January 25, 2024

IDR 11.4.0.5-5703

Enhancements in IDR 11.4.0.5-5703 for CDC Replication Engine for Kafka

  • Effective February 2024, IDR CDC will no longer provide support for following operating system versions: SuSE 11.0; Ubuntu 16.04; Oracle Linux 6.x; CentOS 6.x; AIX 7.1; Microsoft Windows 7, 8, 8.1, Server 2008, Server 2008R2

Bugs fixed in IDR 11.4.0.5-5703 for CDC Replication Engine for Kafka

  • When a key column update is converted to a delete/insert, we unnecessarily use Adaptive Apply as the RWA conflict resolution method for the delete and insert

December 22, 2023

IDR 11.4.0.5-5702

Enhancements in IDR 11.4.0.5-5702 for CDC Replication Engine for Kafka

  • Set PARTITION_AUTO to dynamically detect the number of partitions of the topic currently writing to
  • Added ParallelizeByHash, ParallelizeByHashNetEffect, and ParallelizeByHashNetEffectConvertUpdates fast apply algorithms

Bugs fixed in IDR 11.4.0.5-5702 for CDC Replication Engine for Kafka

  • Specifying the number of image builder threads via the NullMirrorOptimizer fast apply user exit causes subscription to stop

December 5, 2023

IDR 11.4.0.5-5700

Enhancements in IDR 11.4.0.5-5700 for CDC Replication Engine for Kafka

  • Upgraded kafka-client to 3.5.1 and schema-registry client to 7.5.1
  • Updated various open source libraries
 
 

September 28, 2023

IDR 11.4.0.5-5696

Enhancements in IDR 11.4.0.5-5696 for Kafka

  • Updated JVM to 8.0.8.11, java version "1.8.0_381"

August 30, 2023

IDR 11.4.0.4-5694

Enhancements in IDR 11.4.0.4-5694 for Kafka

  • Enabling JSON Records in a format excluding Data Types on Nullable columns
  • Updated JVM to 8.0.8.6, java version "1.8.0_371" (build 8.0.8.6 - pxz6480sr8fp6ifix-20230817_01(SR8 FP6+IJ47696))

APARs in IDR 11.4.0.4-5694 for Kafka

  • JR65317 CDC NOT REPORTING ERROR WHEN COMMITSTREAM TOPIC NOT ACCESSIBLE
 

July 31, 2023

IDR 11.4.0.4-5686

Enhancements in IDR 11.4.0.4-5686 for Kafka

  • Updated JVM to 8.0.8.6, java version "1.8.0_371"

July 14, 2023

IDR 11.4.0.4-5684

Enhancements in IDR 11.4.0.4-5684 for Kafka

  • Added KcopSingleRowFlatAvroAuditIntegrated supporting flat avro format.
  • Temporarily disabled auto partitioning. Setting PARTITION_AUTO or PARTITION_TOPIC_topic_name in kcop.properties returns an error.

Bug fixes in IDR 11.4.0.4-5684 for Kafka

  • Improved communication between stages of the Kafka Target Engine to reduce latency in low-volume topics amongst high-volume workloads when providing records to the underlying Kafka producers
  • Following an upgrade to 11.4.0.4-5672 through 5680, mirroring for a subscription using a custom KCOP ends on error "An error is thrown by the Kafka user exit KCOP. Please check the KCOP. Error: java.lang.Error: Unresolved compilation problem: | The method createThreadSpecificContext(T, String) in the type AbstractKcop is not applicable for the arguments (AvroAuditKcopSpecificContext)"

May 30, 2023

IDR 11.4.0.4-5676

Enhancements in IDR 11.4.0.4-5676 for Kafka

  • Improved the commit frequency in certain higher and lower volume workload scenarios

Bug fixes in IDR 11.4.0.4-5676 for Kafka

  • Ensured mirror_commit_after_max_seconds is being honoured in all scenarios for the CDC for Kafka target

April 27, 2023

IDR 11.4.0.4-5674

Enhancements in IDR 11.4.0.4-5674 for Kafka

  • Updated JVMs to 8.0.8.0

APARs in IDR 11.4.0.4-5674 for Kafka

  • JR65266 ARRAY INDEX OUT OF BOUNDS EXCEPTION IF MAPPING HAS MULTIPLE DERIVED COLUMNS AND A SELECTED DERIVED COLUMN FOLLOWS AN OMITTED DERIVED COLUMN

March 31, 2023

IDR 11.4.0.4-5672

Enhancements in IDR 11.4.0.4-5672 for Kafka

  • Updated JVMs to 8.0.7.20

Bug fixes in IDR 11.4.0.4-5672 for Kafka

  • In some low volume workloads latency can be 1-5 seconds more than it should be

March 3, 2023

IDR 11.4.0.4-5670

APARs in IDR 11.4.0.4-5670 for Kafka

  • JR65110 REFRESH NUMBER OF ROWS SUCCESSFULLY APPLIED CAN BE NEGATIVE
  • JR65235 ROW FILTER &ENTTYP='UB' NEVER MATCHES, AND &ENTTYP='UP' MATCHES BOTH UB AND UP ROWS

February 3, 2023

IDR 11.4.0.4-5666

Enhancements in IDR 11.4.0.4-5666 for Kafka

  • Distributed workload to producers move evenly and removed a possibility for not advancing bookmark when the topics mapped to a producer have infrequent changes and the source engine is CDC for z/OS native engine.
  • IDR now supports TLS 1.3 in addition to TLS 1.2 for communication between Management Console, Access Server, source datastores and target datastores. For improved security, only the most secure protocols are supported for TLS 1.3 (TLS_AES_256_GCM_SHA384, TLS_AES_128_GCM_SHA256) and TLS 1.2 (TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384, TLS_DHE_RSA_WITH_AES_256_GCM_SHA384, TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256, TLS_DHE_RSA_WITH_AES_128_GCM_SHA256).

Bug fixes in IDR 11.4.0.4-5666 for Kafka

  • TCP/IP connections are closed prematurely when encrypted with TLS.
  • "PKIX path building failed" error while retrieving schemas from the database over TLS, even though the database's root CA certificate was configured in the encryption profile's trust store.

December 22, 2022

IDR 11.4.0.4-5661

Enhancements in IDR 11.4.0.4-5661 for Kafka

  • Kafka client libraries are now upgraded to version 3.1.0.

November 25, 2022

IDR 11.4.0.4-5660

Enhancements in IDR 11.4.0.4-5660 for Kafka

  • Enhanced commit stream consistency and removed a possibility for missing commit stream entries when encountering cluster errors on commit stream
  • CDC for kafka target now supports property tcc_send_progress_stream_messages_synchronously which takes effect when kafka_bookmark_storage_type=COMMITSTREAMTOPIC and bypass_commitstream_apply_operation=false

October 31, 2022

IDR 11.4.0.4-5659

Enhancements in IDR 11.4.0.4-5659 for Kafka

  • Added property target_apply_assume_db_enforces_unique_key_violations that indicates whether CDC should assume the target database enforces unique key violations
  • Do not send DML operation if column participating in row filtering condition is updated

September 28, 2022

IDR 11.4.0.4-5656

Enhancements in IDR 11.4.0.4-5656 for Kafka

  • Added additional internal validation of commitstream consistency when kafka_bookmark_storage_type=COMMITSTREAMTOPIC
  • MODIFY FIELD SCHEMA HAS BEEN ADDED AS A NEW FEATURE FOR THE SCHEMA MODIFICATION LANGUAGE
  • Performance optimization added for applying all deletes in a batch as a single delete statement. Dramatically improves performance of applying deletes against column organized tables. Enabled by setting system property target_apply_delete_batch_via_single_statement = true

APARs in IDR 11.4.0.4-5656 for Kafka

  • JR65145 CDC COMMAND DMFLAGFORREFRESH SHOULD NOT ALLOW TO USE DIFFERENTIAL REFRESH (-DR) OPTION IF TARGET ENGINE DOESN'T SUPPORT IT

August 31, 2022

IDR 11.4.0.4-5652

Enhancements in IDR 11.4.0.4-5652 for Kafka

  • dmclearstagingstore no longer implicitly clears the shared scrape parser transaction queues as this is not necessary in most cases

APARs in IDR 11.4.0.4-5652 for Kafka

  • JR65094 KAFKA SUBSCRIPTION USING KCOP FAILS WITH NPE AFTER UPGRADING TO RELEASE 11.4.0.4-5644
  • JR65123 TRUNCATION WARNING ISSUED EVEN THOUGH THERE IS NO NON-SPACE DATA TO BE TRUNCATED

July 29, 2022

IDR 11.4.0.4-5644

Enhancements in IDR 11.4.0.4-5644 for Kafka

  • Modify the value schema of producer record through MODIFY_SCHEMA_*, MODIFY_FIELD_*, "before.image.prefix", and "after.image.prefix" in the KCOP properties for all KCOPs.
  • Added support for modifying Avro schemas and fields in Kafka custom operation processors (KCOPs) by adding Schema Modification Language (SML) to the parameter file

Bug fixes in IDR 11.4.0.4-5644 for Kafka

  • Fixed incorrect "doc" field in the NON-NULLABLE LOB columns in the "afterImage" field when KcopSingleRowAvroAuditIntegrated is used

June 27, 2022

IDR 11.4.0.4-5643

Enhancements in IDR 11.4.0.4-5643 for Kafka

  • Support storing replication engine database credentials in an external secret store
  • Updated JVMs to 8.0.7.10

May 5, 2022

IDR 11.4.0.4-5629

APARs in IDR 11.4.0.4-5629 for Kafka

  • JR64572 NO WARNING EVENT WHEN CHARACTER DATA IS TRUNCATED

March 30, 2022

IDR 11.4.0.4-5627

Enhancements in IDR 11.4.0.4-5627 for Kafka

  • Parallel Apply is now allowed with Adaptive Apply

APARs in IDR 11.4.0.4-5627 for Kafka

  • JR64736 WARNING 9700 CAN OCCUR AND DUPLICATE OPERATIONS APPLIED IF A SUBSCRIPTION IS USING SHARED SCRAPE AND STAGING STORE IS CLEARED

March 3, 2022

IDR 11.4.0.4-5625

Enhancements in IDR 11.4.0.4-5625 for Kafka

  • InstallAnywhere VM pack for CDC engine installer updated to Java 8.0.7.0
  • IDR added a new command line utility "dmimportuserconfiguration" to help automate creation of multiple product instances with user configured values

APARs in IDR 11.4.0.4-5625 for Kafka

  • JR64599 TCC APPLICATION FAILS : INVALID WRITER SCHEMA VERSION 2
  • JR64618 DMTS64 PROCESS IS TAKING A LONGER TIME TO START

January 28, 2022

IDR 11.4.0.4-5622

Enhancements in IDR 11.4.0.4-5622 for Kafka

  • Java Runtime Environment updated from IBM Java 8.0.6.30 to 8.0.7.0. Fix notes can be found at https://developer.ibm.com/javasdk/support/fixes/sdk8/ . This resolves IJ35231 - Missing byte when retrieving LOB data from database.

Bug fixes in IDR 11.4.0.4-5622 for Kafka

  • Addressed an issue causing a subscription with z/OS source and Kafka target to restart from an earlier position after a table mapping is refreshed when the kafka_bookmark_storage_type datastore parameter is set to COMMITSTREAMTOPIC

January 4, 2022

IDR 11.4.0.4-5618

APARs in IDR 11.4.0.4-5618 for Kafka

  • JR64485 ADDRESSED ILLEGALARGUMENTEXCEPTION EMPTY KEY ERROR ISSUED DURING UPGRADE FOR SUBSCRIPTION ALERT HANDLERS CONFIGURED WITHOUT A SENDER EMAIL AND PASSWORD

December 28, 2021

IDR 11.4.0.4-5617

Enhancements in IDR 11.4.0.4-5617 for Kafka

  • Added SourceId as Kafka header. To include it in a kcop configuration use "headers.include.sourceid=true".
  • You can add a KCOP option to change the audit JCF field name from its default name "A_ " to any other Avro compliant name.

December 17, 2021

IDR 11.4.0.4-5616

Enhancements in IDR 11.4.0.4-5616 for Kafka

  • Third party Kafka dependencies that rely on SLF4J for logging are now binding to Java Util Logging (JUL) provider instead of Log4J logging provider
  • Added slf4j-api-2.0.0-alpha5.jar, slf4j-jdk14-2.0.0-alpha5.jar
  • No longer bundle log4j-1.2.17.jar, slf4j-api-1.7.26.jar, slf4j-log4j12-1.7.26.jar dependencies

November 30, 2021

IDR 11.4.0.4-5611

Enhancements in IDR 11.4.0.4-5611 for Kafka

  • Lessen the impact of high Kafka cluster response time on replication performance when there are fewer writers than source tables

APARs in IDR 11.4.0.4-5611 for Kafka

  • JR64335 OUTOFMEMORY OCCURS WHEN TLS ENCRYPTION IS ENABLED AND MANY AGENT CONNECTIONS ARE MADE TO THE INSTANCE

Bug fixes in IDR 11.4.0.4-5611 for Kafka

  • Addressed the java.lang.ClassNotFoundException: com.github.luben.zstd.ZstdInputStream thrown after the compression.type=zstd property is set in the kafkaproducer.properties file

October 29, 2021

IDR 11.4.0.4-5609

Enhancements in IDR 11.4.0.4-5609 for Kafka

  • You can now specify a custom classpath for KCOPs by creating and populating the CDC_Kafka_instance_directory/conf/user-classloader.cp configuration file
  • You can now specify a custom Avro serializer for all Avro-compatible integrated KCOPs using the serializer.class property

APARs in IDR 11.4.0.4-5609 for Kafka

  • JR63828 LOCK TIMEOUT ON TS_BOOKMARK TABLE WHEN TARGET IS KAFKA AND METADATA IS BEING UPDATED AND SYSTEM IS BUSY

September 27, 2021

IDR 11.4.0.4-5607

APARs in IDR 11.4.0.4-5607 for Kafka

  • JR64176 USER-SET JOURNAL CONTROL FIELDS IN AUDIT KCOPS COME OUT NON-NULLABLE, BUT SHOULD BE NULLABLE

Bug fixes in IDR 11.4.0.4-5607 for Kafka

  • Addressed an issue causing bootstrap- .jar, user-exit- .jar and kafka-engine-kcop- .jar to keep accumulating in lib folder after product upgrades

September 3, 2021

IDR 11.4.0.4-5603

Enhancements in IDR 11.4.0.4-5603 for Kafka

  • KcopJsonFormatIntegrated users can now override the default topic suffix "-json".
  • Audit KCOPs no longer require auditing journal control fields

APARs in IDR 11.4.0.4-5603 for Kafka

  • JR63569 REFRESHING SUBSCRIPTION WITH SINGLE ROW AVRO KCOP WRITES INVALID VALUES FOR AUDIT FIELDS
  • JR64072 NULL ENTTYP ON UPDATE IN JSON SINGLE ROW AUDIT KCOP
  • JR64071 IDR CDC FAILS WITH STATEMENT CLOSED ERROR WHILE RUNNING ADDITIONAL SQL STATEMENTS DURING REFRESH.

Bug fixes in IDR 11.4.0.4-5603 for Kafka

  • Addressed an issue causing an OOM error if there are large number of trace files

July 29, 2021

IDR 11.4.0.4-5602

Enhancements in IDR 11.4.0.4-5602 for Kafka

  • The CommitStreamConsole output now includes a Transactionally Consistent Consumer (TCC) bookmark
  • IDR for Kafka now uses exactly-once semantics when writing to a commit stream in order to prevent the "Progress Stream Fragments are not in sequentially ascending order" error in the Transactionally Consistent Consumer (TCC)
  • The HEADER_COLUMNS_*, headers.include.schema, headers.include.table.name, headers.include.table.schema, header.prefix and header.jcfs properties can now be used to add headers to a Kafka producer record with all integrated KCOPs
  • Replicating data to Kafka for consumption by the Transactionally Consistent Consumer (TCC) now requires the Kafka version 0.11 or higher
  • An upgrade of the Transactionally Consistent Consumer (TCC) library is required due to a commit stream record structure change

APARs in IDR 11.4.0.4-5602 for Kafka

  • JR63770 LESSEN THE IMPACT OF HIGH LATENCY CLUSTERS WHEN THERE ARE FEWER PRODUCERS THAN SOURCE TABLES

Bug fixes in IDR 11.4.0.4-5602 for Kafka

  • Subscriptions no longer fail with the "Error deserializing key/value for partition *-commitstream" error after an upgrade from the version prior to 11.4.0.2-5503
  • The getLibrary() method of the JournalHeaderIF interface now correctly returns a table schema when called from a KCOP or a user exit

July 6, 2021

IDR 11.4.0.4-5599

Enhancements in IDR 11.4.0.4-5599 for Kafka

  • The default Non-KCOP behaviour and all KCOPs leveraging the Kafka-Avro-Serializer are now using a Kafka-Avro-Serializer at version 5.3.1
  • Updated the Java Virtual Machine to IBM 8.0.6.30

APARs in IDR 11.4.0.4-5599 for Kafka

  • JR63800 UNABLE TO CREATE INSTANCE IN COMMAND LINE
  • JR63805 UTILITY TRACE FILES ARE ALWAYS GENERATED EVEN IF GLOBAL_TRACE_UTILITY_CREATE_ON_DEMAND = TRUE IF GLOBAL TRACING WAS EVER ENABLED
  • JR63847 NECCESSITYEXCEPTION "CHANGE LOG BLOCK WE ARE TRYING TO READ IS EMPTY!" IF TIMING CIRCUMSTANCES ARE UNFORTUNATE
  • JR63844 NPE OR ASSUMPTION EXCEPTION IF SUBSCRIPTION IS USING SHARED SCRAPE AND STAGING STORE IS CLEARED OR DISK QUOTA EXCEEDED
  • JR63848 MEMORY LEAK IF SHARED SCRAPE STAGING STORE IS CLEARED WHEN MEMORY WAS TIGHT

Bug fixes in IDR 11.4.0.4-5599 for Kafka

  • Addressed an issue causing some persistent subscriptions to restart unexpectedly after the user stopped multiple subscriptions at the same time

May 26, 2021

IDR 11.4.0.3-5596

APARs in IDR 11.4.0.3-5596 for Kafka

  • JR63445 HEADERS OF BINARY AVRO COLUMNS IN THE SINGLE ROW AVRO AUDIT KCOP DO NOT CONTAIN BYTE CONTENT

Bug fixes in IDR 11.4.0.3-5596 for Kafka

  • Fixed NecessityException in ChangeLogBlock on instance start up

April 28, 2021

IDR 11.4.0.3-5594

APARs in IDR 11.4.0.3-5594 for Kafka

  • JR63511 AUDIT WRONGLY DETECTS THAT REPLICATION ENGINE HAS MULTIPLE OFFERINGS INSTALLED
  • JR63191 DMTS64 CPU USAGE GOES TO NEAR 100% WHEN LAST SUB USING SHARED SCRAPE STOPS AND BEFORE ITS LOG PARSER AND READER STOP

March 31, 2021

IDR 11.4.0.3-5593

APARs in IDR 11.4.0.3-5593 for Kafka

  • JR63374 SUBSCRIPTION DOES NOT SHUT DOWN WHEN THE NUMBER OF KAFKA WRITER THREADS ASSIGNED TO IT IS LESS THAN THE NUMBER OF TABLE MAPPINGS

Bug fixes in IDR 11.4.0.3-5593 for Kafka

  • Fixed NPE in KcopSingleRowAvroAuditHeadersIntegrated when "header.columns" is not present within the KCOP properties file.
  • Addressed an issue that prevented the events 3170, 3171, 3172, 3173 from being logged when latency thresholds defined for a subscription were crossed
  • Addressed an issue that caused Management Console to display latency status as Normal even when latency thresholds defined for a subscriptions were exceeded

February 26, 2021

IDR 11.4.0.3-5590

Enhancements in IDR 11.4.0.3-5590 for Kafka

  • Kafka producer statistics are now collected and persisted during replication

Bug fixes in IDR 11.4.0.3-5590 for Kafka

  • Addressed an issue that prevented a subscription from shutting down if a target topic did not exist and could not be created
  • Addressed an issue that prevented a subscription from stopping when a normal shutdown was followed by a shutdown immediate or abort

January 31, 2021

IDR 11.4.0.3-5587

Enhancements in IDR 11.4.0.3-5587 for Kafka

  • The new PARTITION_TOPIC_* and PARTITION_DEFAULT properties can now be used with all KCOPs that are shipped with the product
  • The mirror_write_format and the mirror_[timestamp|time|date|decimal]_write_format datastore parameters can now be set per subscription
  • Added the lenientTail() method to the TxConsistentConsumerBookmarkBuilder interface, which returns the bookmark of the first usable record in a commit stream
  • You can now use the "-bk" option to specify a bookmark when running CommitStreamConsole
  • You can now use the parameter tx_consistent_consumer_lenient_read to prevent TCC from failing when a record is missing from a data topic

Bug fixes in IDR 11.4.0.3-5587 for Kafka

  • Addressed an issue that caused a subscription to fail with a NecessityException and the "Failed to update KafkaTopicOperationSequenceRecordList" error meesage
  • The TxConsistentConsumerException.tail() method now correctly returns the bookmark of the very first record replicated to Kafka

December 31, 2020

IDR 11.4.0.3-5582

Enhancements in IDR 11.4.0.3-5582 for Kafka

  • The MAP_TABLE_*, MAP_DEFAULT and MAP_ALL properties can now be used with all KCOPs that are shipped with the product

Bug fixes in IDR 11.4.0.3-5582 for Kafka

  • Addressed an issue preventing a subscription from shutting down when a commit stream did not not exist, could not be auto-created and retries were enabled in the kafkaproducer.properties file
  • Addressed an issue that caused a subscription to fail with the OutOfMemoryError or stall when refreshing a large table with a Kafka partitioner or a KCOP partitioner
  • Addressed an issue that caused TCC to throw the NecessityException with the error "An incorrect record read from the input queue" when using the tx_consistent_consumer_max_number_of_kafka_consumers property to limit the number of Kafka consumers

December 3, 2020

IDR 11.4.0.3-5576

Enhancements in IDR 11.4.0.3-5576 for Kafka

  • Management Console now displays the "Target Database" bottleneck instead of the "Target Engine" when replication is slowed down by Kafka producer send
  • A log compacted topic can now be used as a Commit Stream
  • JR63074 COLUMN SIZE TRUNCATED ON CDC KAFKA TARGET
  • The dmsupportinfo command line utility now dumps and collects configuration metadata in a text format

APARs in IDR 11.4.0.3-5576 for Kafka

  • JR63074 COLUMN SIZE TRUNCATED ON CDC KAFKA TARGET
  • JR62920 EXCESSIVE DIAGNOSTIC PROBES FOR TRUNCATE OF CLOB EVENTS

Bug fixes in IDR 11.4.0.3-5576 for Kafka

  • IDR now truncates LOB data precisely based on the value of the userexit_max_lob_size_kb parameter instead of exceeding the maximum size for some values
 

November 5, 2020

IDR 11.4.0.3-5572

Enhancements in IDR 11.4.0.3-5572 for Kafka

  • EVENT THAT ALERTS USER THAT IDR HAS DETECTED A DDL NOW INCLUDES THE DDL TEXT IF LOGGING OF DDL STATEMENTS IS ENABLED

APARs in IDR 11.4.0.3-5572 for Kafka

  • JR62909 INCORRECT SAMPLE CONTENT WHEN ISSUING "DMEXPORTCONFIGURATION -?"
  • JR62934 DMTS64 NOT RELEASING IX (EXCLUSIVE) LOCK ON SYSTABLES AFTER MAKING DATABASEMETADATA CALLS

Bug fixes in IDR 11.4.0.3-5572 for Kafka

  • Removed possible hang and operation mis-ordering condition when multiple image builders employed. This may occur with default behaviour of the Kafka engine or a KCOP producing multiple Kafka messages per single source operation.
  • &LIBRARY, &MEMBER and &OBJECT Journal Control Fields now evaluate to the correct values instead of an empty string when used in a derived column
  • JR62973 IDR IS NOT POPULATING JCF FIELDS FOR START AND END REFRESH EVENTS WHEN USEREXIT USED

November 5, 2020

IDR 11.4.0.3-5570

Enhancements in IDR 11.4.0.3-5570 for Kafka

  • Transactionally Consistent Consumer (TCC) now throws an exception after a commit stream topic is truncated during processing
  • Transactionally Consistent Consumer (TCC) is now able to recreate the correct sequence of operations when idempotence is disabled and records are produced to a data topic out-of-order
  • TCC API topic level include and exclude filtering now supports partition level granularity, which allows the TCC to return specific topic/partition pairs written by a given subscription.
  • The dmsupportinfo command line utility now collects trace files significantly faster
  • The dmsupportinfo command line utility now collects all available trace files, performance statistics and events when you do not use the "-t" property to specify a time range

APARs in IDR 11.4.0.3-5570 for Kafka

  • JR62799 MIRRORING DOES NOT ENTER FAILED STATE WHEN IT DETECTS A DDL OCCURRED ON A STATIC TABLE
  • JR62787 USER GETS A DUPLICATE KEY EXCEPTION IF THEY HAVE A TABLE MAPPING WITH TWO OR MORE COLUMNS WITH A COMMENT THAT IS THE SAME FOR THE FIRST 260 CHARACTERS

Bug fixes in IDR 11.4.0.3-5570 for Kafka

  • Refresh now completes successfully instead of stalling when the number of binary writers is lower than the number of topic partitions and a KCOP is used to partition records
  • Addressed a defect in the dmsupportinfo command line utility that caused trace files to be omitted during collection
 

August 28, 2020

IDR 11.4.0.3-5567

Enhancements in IDR 11.4.0.3-5567 for Kafka

  • Kafka libraries are now upgraded to version 2.3.1
  • Event 9809 now includes the name of the affected Kafka topic

APARs in IDR 11.4.0.3-5567 for Kafka

  • JR62293 IDR CANNOT FIND THE CORRECT SCHEMA AFTER UPGRADING AND STARTING THE INSTANCE
  • JR62737 CDC ERROR 9506 OCCURS AFTER A DDL EVEN WHEN ALL DDL PROCEDURES ARE FOLLOWED

Bug fixes in IDR 11.4.0.3-5567 for Kafka

  • Fixed Array Index Out of Bounds Exception or Null Pointer Exception occurring when operation from shared scrape staging store needs a table definition that is older than the current table definition

July 30, 2020

IDR 11.4.0.3-5566

Enhancements in IDR 11.4.0.3-5566 for Kafka

  • Java Runtime Environment updated from IBM Java 8.0.6.0 to 8.0.6.10. Fix notes can be found at https://developer.ibm.com/javasdk/support/fixes/sdk8/

APARs in IDR 11.4.0.3-5566 for Kafka

  • JR61151 JAVA.LANG.NULLPOINTEREXCEPTIONERROR WITH LOB DATA USING KAFKA.KCOPMULTIROWAVROLIVEAUDITINTEGRATED
  • JR62628 INDEX OUT OF BOUNDS EXCEPTION CAN OCCUR AT DBCONNECTIONMANAGER.RELEASEMETADATASESSION()

Bug fixes in IDR 11.4.0.3-5566 for Kafka

  • KCOP filter might lead to target pipeline hang when using multiple formatter threads
 

June 30, 2020

IDR 11.4.0.2-5563

Enhancements in IDR 11.4.0.2-5563 for Kafka

  • Added a new KCOP that allows for replication of audit journal fields and before image with messages delivered in JSON format
  • Transactionally Consistent Consumer (TCC) now allows a renamed version of ts.jar to be included in CLASSPATH
  • Transactionally Consistent Consumer (TCC) now provides an alternate overloaded constructor that permits passing in Kafka consumer properties as an instance of java.util.Properties
  • Transactionally Consistent Consumer (TCC) now correctly sets the cause of TxConsistentConsumerException

APARs in IDR 11.4.0.2-5563 for Kafka

  • JR62451 IDR REPLICATES SOURCE DERIVED COLUMN DATA TO INCORRECT TARGET COLUMN

Bug fixes in IDR 11.4.0.2-5563 for Kafka

  • Addressed a resource leak in Transactionally Consistent Consumer (TCC) caused by Kafka consumers not being closed after they are no longer needed

May 28, 2020

IDR 11.4.0.2-5560

Enhancements in IDR 11.4.0.2-5560 for Kafka

  • Instance-specific command line utilities now trace their parameters and an execution return code.

APARs in IDR 11.4.0.2-5560 for Kafka

  • JR62289 UPDATE OPERATION MAY BE LOST OR APPLIED OUT-OF-ORDER WITH MULTIPLE FORMATTER THREADS

Bug fixes in IDR 11.4.0.2-5560 for Kafka

  • IDR will no longer log excessive tracing of NonTransientConnectionException by avoiding rolling back a transaction on a database connection that has auto-commit enabled.
  • dmconfigurets no longer creates two trace files when run in the command line mode.

April 23, 2020

IDR 11.4.0.2-5548

Bug fixes in IDR 11.4.0.2-5548 for Kafka

  • Improved TCC Buffered Queue Writer Timeout Handling

April 7, 2020

IDR 11.4.0.2-5544

Enhancements in IDR 11.4.0.2-5544 for Kafka

  • IDR supports configuring kafkaproducer.properties and kafkaconsumer.properties files per CDC instance
  • dmsupportinfo no longer collects duplicate information in the "dir.txt" support assistant file when an instance folder is inside the product installation directory.

APARs in IDR 11.4.0.2-5544 for Kafka

  • JR62030 UPGRADING CDC KAFKA RESETS KAFKAPRODUCER.PROPERTIES SETTINGS
  • JR62126 IMPROVED IDR COMMAND LINE UTILITIES PERFORMANCE BY OPTIMIZING ACCESS TO CDC SECRET STORE WHEN ENGINE-TO-ENGINE ENCRYPTION IS DISABLED, ENABLED OR REQUIRED.
  • JR62158 SCHEDULED END BY TIME SOMETIMES DOESN'T WORK WHEN DB IS 100% IDLE, SHARED SCRAPE IS USED AND SUBSCRIPTION FINDS NEW OPERATIONS IN STAGING STORE AT STARTUP.

Bug fixes in IDR 11.4.0.2-5544 for Kafka

  • Addressed "com.datamirror.ts.assertion.NecessityException The error value is "10,000"" when replicating the timestamp value of "9999-12-31 24:00:00.0000000000000".
  • Adapted intermittent "io.confluent.kafka.schemaregistry.client.rest.exceptions.RestClientException: Register operation timed out; error code: 50002" that could be issued due schema registry connection timeout to be logged as an CDC engine event and have replication stop normally due to the error.
  • Addressed the error "row already exist in index TABLE_NAMES_IDENTITY_NAME_IDX" when accessing the metadata
  • Addressed intermittent "java.lang.AssertionError thread interruption is not supported" in TraceFormatter.
  • Instance commands no longer create trace files in "installation_directory/log".
 

February 20, 2020

IDR 11.4.0.2-5528

Enhancements in IDR 11.4.0.2-5528 for Kafka

  • IDR now closes some idle database connections and re-opens them as needed. The global_database_connection_idle_timeout_seconds system parameter controls how long to keep idle database connections open. Closing idle database connections before firewalls close them prevents subscriptions from stopping due to broken database connections.

APARs in IDR 11.4.0.2-5528 for Kafka

  • JR61841 ERROR REFRESHING A TABLE WITH A LONG COLUMN COMMENT: "AN UNCAUGHT EXCEPTION HAS OCCURRED"

Bug fixes in IDR 11.4.0.2-5528 for Kafka

  • IDR automatically recovers an erroneous metadata state that could cause lead to "An error has occurred. Possible recovery steps: Please try again. If the error persists, if possible restart the IBM Data Replication instance and try again. Internal error information: Agent Message 'Message3036' Exception text 'null'"
  • Improved reliability when global_subscription_level_connection_keep_alive_seconds is set to a non-zero value.
  • IDR now uses a different method to manipulate metadata table TABLE_NAMES_IDENTITY that is expected to prevent metadata corruption involving this table. This corruption could lead to the inability to use a table mapping or even delete it.
  • Addressed intermittent EOFException and SocketException when running command line utilities under stress.
  • Addressed intermittent EOFException reported by Agent Reader thread when using command line utilities.

January 21, 2020

IDR 11.4.0.2-5522

Enhancements in IDR 11.4.0.2-5522 for Kafka

  • The engine no longer errs with SerializationException when replicating DMSETBOOKMARK from the source
  • IDR issues an improved error message when dmconfigurets is run with non-Administrator privileges in Windows Server 2016

APARs in IDR 11.4.0.2-5522 for Kafka

  • JR61803 IIDR FAILS WITH ERROR TOO MANY OPEN FILE DESCRIPTOR WHEN MULTIPLE INSTANCES ARE RUNNING FROM SAME INSTALLATION BECAUSE OF FILE DESCRIPTOR LEAK.

December 19, 2019

IDR 11.4.0.2-5521

Bug fixes in IDR 11.4.0.2-5521 for Kafka

  • Addressed UnresolvedUnionException when replicating a FLOAT derived column with length <= 4
  • The replication engine now has enhanced support for Kafka retry properties and improved resiliency when replicating metadata to Kafka

November 27, 2019

IDR 11.4.0.2-5512

Enhancements in IDR 11.4.0.2-5512 for Kafka

  • IDR no longer requires a custom KCOP to connect to IBM Event Streams.
  • Datastore parameters mirror_timestamp_write_format, mirror_time_write_format and mirror_date_write_format can now be set to SIMPLE to enable high-performance formatter.
  • IIDR now supports always encrypting communication with TLS, without negotiation. This feature may be enabled by setting Engine-to-Engine Communication Encryption to Always in the encryption profile. When this feature is enabled, IIDR will not be able to communicate with source datastores, target datastores, or Access Servers that negotiate encryption through STARTTLS.
  • IDR no longer raises an error event if it cannot extract primary index information for a table from the database

APARs in IDR 11.4.0.2-5512 for Kafka

  • JR61641 REPLICATION TO KAFKA TARGET FAILS FOR BINARY COLUMN AND DYNAMIC FORMATTER
  • JR61637 CDC STILL TAKES VALUES IN BYTES AFTER CHANGING SYSTEM PARAMETER USEREXIT_MAX_LOB_SIZE_KB UNLESS THE INSTANCE IS RESTARTED

Bug fixes in IDR 11.4.0.2-5512 for Kafka

  • Decimal floating point numbers are now written to a topic with an exponent when dynamic formatter is used
  • Trace can now be collected reliably using support assistant in concurrent invocations.
  • Addressed differential refresh failing when order of columns in primary key differs from order returned by JDBC

October 31, 2019

IDR 11.4.0.2-5507

Enhancements in IDR 11.4.0.2-5507 for Kafka

  • dmsupportinfo command line utility collects replication product traces using an optimized algorithm to speed up data collection

Bug fixes in IDR 11.4.0.2-5507 for Kafka

  • Allow Configurable Client and Group ID Kafka Client Properties in IDR Kafka's kafkaproducer.properties and in Transactionally Consistent Consumer's properties file.

September 27, 2019

IDR 11.4.0.2-5506

Enhancements in IDR 11.4.0.2-5506 for Kafka

  • IDR CDC product binaries are signed with a new signing service and with an updated certificate with expiry date "Wed Jun 30 08:00:00 2021"
  • IIDR now supports dmcreateencryptionprofile for creating encryption profiles.

APARs in IDR 11.4.0.2-5506 for Kafka

  • JR61492 SUBSCRIPTION HITS NPE WHEN ENABLE GLOBAL TRACE

September 10, 2019

IDR 11.4.0.2-5503

Enhancements in IDR 11.4.0.2-5503 for Kafka

  • IIDR for Kafka now migrates Kafka SSL/TLS configuration from dmts64.vmargs to an encryption profile.
  • Subscription now stops properly after Kafka producer throws an exception
  • Prior product libraries found in /lib are deleted when upgrading product binaries before new libraries are dropped on disk. All jar files with names similar to those installed with the product will be deleted.
  • IIDR now supports the option of requiring TLS encryption for all connections from Access Server and other datastores.

APARs in IDR 11.4.0.2-5503 for Kafka

  • JR61380 "ARITHMETICEXCEPTION DIVIDE BY 0" IS THROWN WHEN ONLY DERIVED COLUMN ARE SET FOR REPLICATION

[{"Type":"MASTER","Line of Business":{"code":"LOB76","label":"Data Platform"},"Business Unit":{"code":"BU048","label":"IBM Software"},"Product":{"code":"SSTRGZ","label":"InfoSphere Data Replication"},"Version":"All Versions"}]

Document Information

Modified date:
22 December 2025

UID

ibm16217948

Page Feedback