CC_DB2_EXTERNAL_TABLES_ROW_COMMIT_THRESHOLD

Use this variable to control when to commit the data inserted into a table using external tables.

When loading big amount of data into Db2 it is possible to exceed Db2 transaction limits and job fails. When external tables are used there are not periodical commits issued to avoid the failure of write process as external table command is executed as single SQL INSERT statement.

With use of CC_DB2_EXTERNAL_TABLES_ROW_COMMIT_THRESHOLD it is possible to split the execution of write using external tables into smaller chunks - there are multiple insert from external table statements executed in sequence, each reading a subset of the data from the source external table file (pipe) to avoid reaching the database transaction log limit.

The environment variable CC_DB2_EXTERNAL_TABLES_ROW_COMMIT_THRESHOLD defines number of rows that each intermediate insert statement must write before it is committed. The value must be a multiple of Array size property value. If not, the actual commit threshold will be rounded down to nearest multiple of the Array size value.