Configure Sterling™ Business Intelligence for loading large dimensions
While loading, large dimensions and their dependant facts in Business Intelligence memory-related errors occur as system memory can be a limiting resource. Large dimensions are dimensions that are typically in excess of 1,000,000 rows and greater than 2 KB wide. These large dimensions exhaust available memory that is used to cache records during the Dimension Build and Look Up ETL steps during load management.
Symptomatic is memory allocation failure errors reported in load management job logs. Under, normal operating conditions memory constraints prevent successful delivery of large dimensions and their dependant facts.
The following techniques can be applied to successfully load large
dimensions:
- Loading a large dimension with load partitioning
- Loading a fact with a related large dimension