Kafka properties

When you configure a Kafka cluster, you can define advanced connection properties.

The following table lists common connection properties for the Kafka cluster that are supported and do not cause a configuration failure. The listed properties are not the complete list of available and supported properties. Some of the unlisted properties are unsupported and cause a configuration failure when defined.

Property Description
auto.commit.interval.ms The frequency in milliseconds that the consumer offsets are committed to offset storage.
Type
Integer
Range
0 - 86400000
Default
5000
client.id Client identifier.
Type
String
Default
rdkafka
compression.codec The compression algorithm to compress message sets. The value applies to all topics.
Type
Enum
Values
gzip, lz4, none, snappy, zstd
Default
none
fetch.max.bytes Maximum amount of data the broker can return for a Fetch request. The consumer fetches messages in batches. When the first message batch in the first nonempty partition of the Fetch request is larger than this value, the message batch is returned to make sure that the consumer can progress. The maximum message batch size that the broker accepts is defined with message.max.bytes. The value of fetch.max.bytes is adjusted automatically to be at least message.max.bytes.
Type
Integer
Range
0 - 2147483135
Default
52428800
isolation.level Controls how to read transaction messages.
Values
read_committed
Return only committed transactional messages. This setting is the default value.
read_uncommitted
Return all messages, even transactional messages that were aborted.
Type
Enum
message.max.bytes Maximum request message size. Due to differing framing between protocol versions, the producer cannot reliably enforce a strict maximum message limit at produce time and can exceed the maximum size by one message in protocol ProduceRequests. The broker enforces the topic max.message.bytes limit. See the Apache Kafka documentation.
Type
Integer
Range
1000 - 1000000000
Default
1000000
receive.message.max.bytes Maximum response message size as a precaution to avoid memory exhaustion. This value must be at least fetch.max.bytes + 512 to allow for protocol processing. The value is adjusted automatically unless the configuration property is explicitly set.
Type
Integer
Range
1000 - 2147483647
Default
100000000