High-performance solution to feeding a data warehouse with real-time data, Part 2, Explore the integration options with staging tables and WebSphere MQ messages
Integrating InfoSphere Replication Server and InfoSphere DataStage to trickle feed the data warehouse
From the developerWorks archives
Date archived: January 12, 2017 | First published: September 02, 2010
Feeding a data warehouse with changes from the source database can be very expensive. If the extraction is only done with SQL, there is no way to easily identify the rows that have been changed. IBM InfoSphere™ Replication Server can detect changed data by reading only the database log. This series shows how to use InfoSphere Replication Server to efficiently extract only the changed data and how to pass the changes to IBM InfoSphere DataStage® to feed the data warehouse. Part 1 of the 2-part series provided an overview of these products and how they can work together. In this Part 2, explore two integration options: using WebSphere® MQ messages with InfoSphere Event Publisher and using staging tables.
This content is no longer being updated or maintained. The full article is provided "as is" in a PDF file. Given the rapid evolution of technology, some steps and illustrations may have changed.