Tivoli Data Warehouse improvements in ITM 6.3.0
fmoraes 060000Y2YB Visits (1916)
Table Range Partitioning
Range partitioning is a database feature that allows for quick rollout of data from a table. Instead of deleting a set of rows at a time and having to commit frequently to avoid filling the transaction log, a whole day partition can be quickly detached and removed. This partition detach/removal takes seconds instead of hours that it could take when the table is not range partitioned.
The Warehouse Proxy Agent (WPA) and Summarization and Pruning Agent (SPA) both support this new feature and will create range partitioned tables when configured.
The maintenance of partitions is done by the SPA, according to the retention settings specified for each attribute group. The SPA is responsible to adding new partitions to existing tables, so it should run periodically to avoid insertion failures.
Queries also can benefit from the table range partitioning when the partitioning column (typically WRITETIME) is part of the WHERE clause.
Existing customers that upgrade to ITM 6.3.0 can migrate their existing TDW database by using the Schema Publication Tool (part of the SPA) and selecting the migrate mode option. This generates a set of scripts that will migrate existing tables to the new range partitioned tables. You can select which tables to migrate first, based on product, attribute group, summarization. The entire database doesn’t need to be migrated at once; it can be done in increments as maintenance windows are available and the performance gains are justified.
This feature is available for DB2 Enterprise Edition 9.7 or later, DB2 for z/OS 9 or later and Oracle databases.
Self monitoring improvements
The existing TDW self monitoring was enhanced to detect capacity problems and alert when such conditions arrive. List of enhancements:
In addition to the TDW agents self monitoring improvements, a new attribute group was added to all agents that allows for monitoring the historical exports from a given agent or monitoring server. This attribute group provides metrics such as the attribute group name, product, collection interval, upload interval, type, row size, data uploaded, status, last upload status and last successful upload. Situations can be created against this attribute group and distributed, allowing for alerts to be generated when there is some problem exporting the historical data for a given agent.
This data can be accessed from TEP via the Managed System Status workspace. Right-clicking on a given managed system link on the table, allows you to navigate to the Historical Exports workspace which will present the metrics above for the historical exports from that agent or monitoring server.
NOTE: this feature requires that the agent uses at least the ITM 6.3.0 agent framework. For a monitoring server, this requires the server to be least at version 6.3.0.
A few other minor improvements were done: