Skip to main content


developerWorks  >  Information Management  >

Custom combinable operators for IBM WebSphere DataStage, Part 1: Creating custom combinable operators that use input datasets

developerWorks

Level: Advanced

Martin Klumpp (maklumpp@us.ibm.com), Software Engineer, IBM 

19 Jun 2008

Register now or sign in using your IBM ID and password.

Learn how to create a custom combinable operator in a IBM® WebSphere® DataStage environment that can read input records from input datasets, process the data, and output the records. This tutorial gives you an overview of the combinable operator concept. You will learn how to develop a custom combinable operator API implementation, and then compile, deploy, and test the operator.

Objectives

  • Get an overview of the combinable operator concept.

  • Develop a custom combinable operator API implementation.

  • Compile a custom combinable operator.

  • Deploy the custom combinable operator.

  • Test the custom combinable operator.

Prerequisites

This tutorial is written for C++ DataStage operator programmers whose skills and experience are at an intermediate to advanced level. You should have a general familiarity with implementing custom operators, a working knowledge of the C++ language and the WebSphere DataStage product.


System requirements

To run the examples in this tutorial, you need a Windows® system, an IBM Information Server Installation, user access for a DataStage project, the ability to reboot the machine several times a day, and an installed C++ compiler environment. You will also need to install Maven on your workstation (instructions on how to do so are in the tutorial).

I recommend the following compiler and SDK:

  • C++ Compiler: Microsoft Visual Studio .NET 2003
  • SDKs: Microsoft 2003 Platform SDK and Microsoft .NET SDK
  • MKS Toolkit (comes with the IBM WebSphere DataStage and QualityStage Designer installation)


Formats

html, pdf


Tutorial overview

This tutorial shows you how to develop a custom, combinable operator for IBM WebSphere DataStage. You will compile and build the operator within a Maven environment. The binary of the operator will then be deployed into the DataStage environment. In the final step, a sample job is provided to test the execution of the operator within DataStage.

Share this....

digg Digg this story del.icio.us del.icio.us Slashdot Slashdot it!


Back to top


Document options

Document options requiring JavaScript are not displayed


My developerWorks needs you!

Connect to your technical community


More in this series:
Custom combinable operators for IBM WebSphere DataStage