shm_max_size - Maximum size of shared memory configuration parameter

Specifies the maximum size of Inter Process Communication (IPC) shared memory in bytes. Because the ingest utility runs on the client, this memory is allocated on the client machine.

Configuration type
Ingest command
Applies to
Ingest utility
Parameter type
Configurable
Default [range]
512 MB (4,294,967,296) [n to available memory]
n is calculated as follows:
11000 +
(numTransporters x 500) +
(NUM_FORMATTERS x 500) +
(numUsedPartitions x 50) +
(totalNumFlushers x 4000) +
(MSG_BUF_COUNT x (100 + MSG_BUF_SIZE)) +
(numFields x 66300) +
(1.5 x NUM_FORMATTERS x sumOfAllFieldLengths)
where
  • numTransporters is the number of input sources (if operation is INSERT or REPLACE), or 1 otherwise.
  • numUsedPartitions is number of database partitions that the target table uses.
  • totalNumFlushers is num_flushers_per_partition x numUsedPartitions.
  • sumOfAllFieldLengths is the total number of bytes in all the field definitions.
  • numFields is the number of field definitions.
Unit of measure
bytes