Performance considerations for events data collection

Learn more about the performance considerations for Generic Webhook and Kafka integrations in IBM Cloud Pak® for AIOps.

Generic Webhook integration

When you configure the Generic Webhook integration, it is important to consider the maximum event rate (per second) when you create an integration.

The Generic Webhook integration provides the option to configure a maximum event rate, which can have a minimum of 10 and a maximum of 1000 events per second with a default value of 100. To avoid the rejection of events, scale the maximum event rate if you anticipate exceeding the maximum events rate limit for the integration.

Kafka integration

When you are configuring the Kafka integration, it is important to consider the following performance factors:

  • The Kafka replication factor is set to one replica by default. If you are implementing a production deployment of Cloud Pak for AIOps, you might lose data if your Kafka pods fail or restart. If the data collection is enabled in your Kafka integration when the Kafka pods go down, you might experience a gap in the data that your integration generated during the downtime.
  • The maximum Kafka message size limit in Cloud Pak for AIOps is 1048588 bytes. If you frequently send in messages that are close to the maximum size, it can adversely impact the performance of the integration. If the maximum message size limit is exceeded, the message is rejected.