Load interval

You can separate your load tasks into intervals for better performance. Specifying a load interval reduces the amount of data being read and processed by your ETL tool's load engine at one time by dividing the data into a number of smaller batches. This ensures that the server does not run out of memory and that the load operation completes successfully.

For example, for the initial load of your data warehouse, will probably have historical data from many years that you want to load. Calculate the number of batches for the filter by dividing the difference between the From and To dates by the number of load intervals. Based on the volume of the data, you must find a balance between the batch limit and the memory capacity of your machine.

If you are using InfoSphere® DataStage®, refer to refer to IBM InfoSphere Information Server documentation for more information about load management and optimizing performance. If you are using any other ETL tool, refer to the corresponding product documentation for information.