WebSphere DataStage

Data transformation and movement is the process by which source data is selected, converted, and mapped to the format required by targeted systems. The process manipulates data to bring it into compliance with business, domain, and integrity rules and with other data in the target environment.

Transformation can take some of the following forms:

Aggregation: Consolidating or summarizing data values into a single value. Collecting daily sales data to be aggregated to the weekly level is a common example of aggregation.
Basic conversion: Ensuring that data types are correctly converted and mapped from source to target columns.
Cleansing: Resolving inconsistencies and fixing the anomalies in source data.
Derivation: Transforming data from multiple sources by using an algorithm.
Enrichment: Combining data from internal or external sources to provide additional meaning to the data.
Normalizing: Reducing the amount of redundant and potentially duplicated data.
Pivoting: Converting records in an input stream to many records in the appropriate table in the data warehouse or data mart.
Sorting: Sequencing data based on data or string values.

WebSphere^® DataStage™ supports the collection, transformation and distribution of large volumes of data, with data structures that range from simple to highly complex. WebSphere DataStage manages data that arrives and data that is received on a periodic or scheduled basis. WebSphere DataStage enables companies to solve large-scale business problems with high-performance processing of massive data volumes.

By leveraging the parallel processing capabilities of multiprocessor hardware platforms, WebSphere DataStage can scale to satisfy the demands of ever-growing data volumes, stringent real-time requirements, and ever-shrinking batch windows.

Introduction to WebSphere DataStage
WebSphere DataStage has the functionality, flexibility, and scalability that are required to meet the most demanding data integration requirements.
A closer look at WebSphere DataStage
In its simplest form, WebSphere DataStage performs data transformation and movement from source systems to target systems in batch and in real time.
WebSphere DataStage tasks
The key elements of WebSphere DataStage are jobs, which define the sequence of transformation steps, and stages, the individual steps that make up jobs. Using WebSphere DataStage involves designing, executing, managing and deploying, and administering WebSphere DataStage jobs.
Data transformation for zSeries
To integrate data throughout the enterprise, companies must access and respond to all the information that affects them. A significant amount of corporate data continues to reside in mainframes.

Parent topic: Introduction to IBM Information Server