Configuring Apache Kafka consumer properties files

This topic introduces how to configure the Apache Kafka consumer properties for the System Data Engine.

Procedure

There are two ways to configure Apache Kafka properties. If you configure the properties in both ways, the configurations in the second way take effect, and override the configurations in the first way.

Copy the sample gatherer.consumer.properties file from the CDP_SMP_HOME/SDE/samples directory to the CDP_HOME directory, and then configure the properties according to your needs.
Specify the file path of the customized Kafka consumer properties file KAFKA_PROPER in the JCL SET statement.

Kafka uses key-value pairs in the property file format for configuration. For more information, see the configuration topic in Apache Kafka document.