Increasing job parallelism for event processing

Use the <job>.parallelism parameter to increase the parallelism of an event processing job.

About this task

When you first install IBM Business Automation Insights, you need to specify only what processing jobs you want to install. Business Automation Insights automatically creates the task managers that are necessary for the execution of the selected jobs. Likewise, when you scale a specific job, Business Automation Insights automatically creates the necessary task managers.

For more information about Flink clusters, see Cluster components.

Procedure

  1. Make sure that the bai_configuration.<job>.install parameter for this job is set to true.
    The supported values for the <job> placeholder are those indicated in the Event type table column in the Flink jobs for event types section of the Fixed-format event emission page.
    Note: For fixed-format events that are emitted by Business Automation Workflow, job enablement is automatic. For events from custom sources, you need to enable jobs manually by using the Processing Application, as instructed in Events from custom sources.
  2. Increase the parallelism of the job by updating the value of the corresponding bai_configuration.<job>.parallelism parameter.
    The default value is 2.

    For more information, see Updating your Business Automation Insights custom resource.

What to do next

Higher parallelism requires more overall memory and CPU. For each job, calculate on the following basis.
Number of necessary CPUs = <job>.parallelism
Memory = 1.7 Gb X <job>.parallelism