Structure of the data and metadata objects in Apache Kafka

Edit online

This topic outlines the structure of the data and metadata objects Data Gate for Confluent stores in Apache Kafka.

Structure of the data and metadata objects

By default, events are streamed to topics whose names start with the configured prefix, that is, the value that topic.prefix is set to. Replication events are streamed to one topic per table. That topic follows the naming pattern topicPrefix.schemaName.tableName. A table MYSCHEMA.MYTABLE with topic.prefix=db2z will end up in the topic db2z.MYSCHEMA.MYTABLE.

Data types and mappings

The supported Db2®data types are mapped to equivalent Kafka Connect row content data types. The mappings are described in Data type mappings.

Supported data types

Data Gate for Confluent does not support all Db2 for z/OS® types. The supported types are:

  • INT
  • BINARY
  • CHAR
  • TIME
  • TIMESTAMP
  • DATE
  • BIGINT
  • SMALLINT
  • DOUBLE
  • REAL
  • DECIMAL
  • DECFLOAT
  • VARCHAR
  • VARBINARY
  • ROWID
  • GRAPHIC
  • VARGRAPHIC

Unsupported data types

The following Db2 for z/OS data types are not supported by Data Gate for Confluent. If they do occur in a source table, you must define an exclude list to exclude them:

  • XML
  • BLOB
  • CLOB
  • DBCLOB
  • TIMESTAMP WITH TIME ZONE