Using Kafka with IBM App Connect Enterprise

You can use the IBM® App Connect Enterprise Kafka nodes to produce and consume messages on Kafka topics.

Before you begin

About this task

You can use the KafkaProducer node to publish messages that are generated from within your message flow to a topic that is hosted on a Kafka server. The published messages are then delivered by the Kafka server to all topic consumers (subscribers). You can use a KafkaConsumer node in a message flow to subscribe to a specified topic on a Kafka server. The KafkaConsumer node then receives messages that are published on the Kafka topic, as input to the message flow. You can also read an individual message published on a Kafka topic, by using a KafkaRead node in a message flow to specify the offset position of the message in the topic partition.

For information about the supported versions of Kafka, see IBM App Connect Enterprise system requirements. For more information about Kafka version compatibility, see the Apache Kafka documentation.

Procedure

Use the KafkaProducer, KafkaConsumer, and KafkaRead nodes to complete the following tasks:

For more information about configuring and using Kafka nodes, see the following topics: