How replication workers process actions

Replication workers process actions as a batched database transaction or as single database transactions. The lower the number of database transactions that are required to complete the batch, the higher the throughput. Optimal throughput is achieved when the replication worker can process all the actions that are required for the entire batch with a single database transaction.

The following primary actions are associated with the inbound replication workers:

  • Insert
  • Export Only
  • Update
  • Export and Delete
  • Delete

If an entire batch consists of insert and export actions, Content Platform Engine processes the batch as a single insert transaction to the database. Update and delete actions are processed as single database transactions. A batch of action requests that consists of update and delete actions generally requires many more transactions and more time to complete.

For example, an inbound batch has the following action codes: Insert document1, Insert document2, Insert document3, Update document2, Update document2, Insert document4, Insert document5, Insert document6, Insert document7. Assuming that no errors are encountered, the batch requires six transactions:
  • Transaction 1: Insert document1, document2, document3
  • Transaction 2: Retrieve document2 from the database
  • Transaction 3: Update document2
  • Transaction 4: Retrieve document2 from the database
  • Transaction 5: Update document2
  • Transaction 6: Insert document4, document5, document6, document7
The following primary actions are associated with the outbound replication workers:
  • Initiate®
  • Update (includes update and delete pending actions)
  • Dereplicate
The outbound journal selection on Content Cortex assigns one journal for the same document in each batch. Multiple actions for the same document are in different batches. Within the same batch, different operations are sent in separate remote procedure calls (RPCs) to FileNet® Image Services.
For example, assume that document1 was replicated. The following journals are in the replication queue: Initiate document2, Initiate document3, Update document2, Update document2, Update document1, Initiate document4, Initiate document5, Initiate document6, Initiate document7. Assuming that the batch size is 50, this batch requires three RPCs.
  • Batch 1 RPC 1: Create document2, document3, document4, document5, document6, document7
  • Batch 1 RPC 2: Update document1
  • Batch 2 RPC 1: Update document2
  • Batch 3 RPC 1: Update document2