You can use the Kafka Connector stage in your jobs to read messages from the topic(s) or
write messages to the topic(s) in Kafka.
Procedure
-
Design a job that contains the Kafka Connector
stage.
-
Define a connection to Kafka data source.
-
To set up the Kafka Connector stage as a source stage to read messages from the topics residing
in Kafka, complete the following steps
-
Configure the Kafka Connector stage as a
source.
-
Set up column definitions on the output
link.
Note: The Kafka Connector stage does not support reject link.
-
To set up the Kafka Connector stage as a target stage to write data from the topics in Kafka,
complete the following steps
-
Configure the Kafka connector stage as a
target.
-
Set up column definitions.
-
Compile and run the job.