Troubleshooting
Problem
With a relatively small about of data the READ DATA SOURCE step takes very long to complete. This occurs regardless of whether the data source is a Cognos Package, an IQD or a a flat file.
Symptom
Compared to other Transformer models with equivalent volumes of data it can take 10 times longer to read same volume of data. The same model may even have large difference in read time between two different sets of data (prod, uat, dev etc). The problem is also demonstrated by only Generating Categories. It could be limited to specific data sources or specific Dimensions. An example of poor data read performance, 100,000 rows take 4 hours to read.
Log InLog in to view more of this document
Was this topic helpful?
Document Information
Modified date:
08 May 2025
UID
swg21616176