Information icon IBM InfoSphere Information Server, Version 8.5
space Feedback

Setting the array size

To control the number of records to fetch from a database or write to a database at one time, increase or decrease the array size.

About this task

You set the Array size and Record count properties together. The array size specifies the number of records to include in each batch that the read and write operations on the database process. The record count specifies the number of records to process in each transaction.

If you configure row prefetching, when a SELECT statement runs, the connector fetches the number of rows specified by the Array size property plus the number of rows specified by the Prefetch row count property.

To set the array size:

Procedure

  1. Set Array size to a number between 1 and 999,999,999. The default is 2,000.
  2. Set Record count to the number of records to process before the connector commits the current transaction. The default is 2,000. The value that you specify must be a number between 0 and 999,999,999 and be a multiple of the value that you specify for the Array size property. Enter 0, and the connector processes all records before it commits the transaction.
    Note: If the value that you specify for the Record count property is not 0 and is not a multiple of the value that you specify for the Array size property, the connector automatically chooses an array size so that the record count is a multiple of it. When choosing the array size, the connector attempts to find a value that is close to the value that you specified. If the connector cannot find that value, it chooses the value 1 or the value that matches record count value, whichever is closer to the value that you specified. Then connector logs an informational message to inform you that it modified the value of the Array size property.
  3. Optional: Use the Mark end of wave property to specify whether or not to insert an end-of-wave marker after the number of records that are specified in the Record count property are processed. By default, end-of-wave markers are not inserted.
    Note: When the end-of-wave marker is inserted, any records that the Oracle connector buffered are released from the buffer and pushed into the job flow so that downstream stages can process them.

PDFThis topic is also in the IBM InfoSphere DataStage and QualityStage Connectivity Guide for Oracle Databases.

Update timestamp Last updated: 2014-7-18