Skip to main content

By clicking Submit, you agree to the developerWorks terms of use.

The first time you sign into developerWorks, a profile is created for you. Select information in your developerWorks profile is displayed to the public, but you may edit the information at any time. Your first name, last name (unless you choose to hide them), and display name will accompany the content that you post.

All information submitted is secure.

  • Close [x]

The first time you sign in to developerWorks, a profile is created for you, so you need to choose a display name. Your display name accompanies the content you post on developerworks.

Please choose a display name between 3-31 characters. Your display name must be unique in the developerWorks community and should not be your email address for privacy reasons.

By clicking Submit, you agree to the developerWorks terms of use.

All information submitted is secure.

  • Close [x]

Select a language:

  • Close [x]
  • Close [x]

Custom combinable operators for IBM WebSphere DataStage, Part 1: Creating custom combinable operators that use input datasets

Martin Klumpp (maklumpp@us.ibm.com), Software Engineer, IBM
Martin Klumpp has worked for IBM since 2003 and has fulfilled various roles in software development, including software testing, development, and design in the Information Integration Solutions Organization. He now works in the Information Server Integration Team and provides rapid solutions for integrating cross-product functionality into the Information Integration Server suite.

Summary:  Learn how to create a custom combinable operator in a IBM® WebSphere® DataStage environment that can read input records from input datasets, process the data, and output the records. This tutorial gives you an overview of the combinable operator concept. You will learn how to develop a custom combinable operator API implementation, and then compile, deploy, and test the operator.

View more content in this series

Date:  19 Jun 2008
Level:  Advanced
PDF:  A4 and Letter (489 KB | 32 pages)Get Adobe® Reader®

Activity:  6816 views
Comments:  

Before you start

This tutorial shows you how to develop a custom, combinable operator for IBM® WebSphere® DataStage. You will compile and build the operator within a Maven environment. The binary of the operator will then be deployed into the IBM Information Server DataStage environment. In the final step, a sample job is provided to test the execution of the operator within IBM Information Server DataStage.

About this series

This tutorial is the first part of the series "Create custom combinable operator for IBM Information Server DataStage". While Part 1 shows you how to create custom combinable operators that use datasets, Part 2 shows you how to create custom combinable operators without the input datasets.

Back to top

About this tutorial

This tutorial is a detailed description of how to develop custom operators for the WebSphere DataStage product. This tutorial gives you an in-depth look at the combinable operator concept, the combinable application programming interface and the record processing concepts. See how to compile, deply and test your custom compiler. (See the "Create custom operators for WebSphere DataStage" tutorial for a basic understanding of custom operator development).

Back to top

Objectives

In this tutorial, you will:

  • Get an overview of the combinable operator concept.
  • Develop a custom combinable operator API implementation.
  • Compile a custom combinable operator.
  • Deploy the custom combinable operator.
  • Test the custom combinable operator.

Back to top

Prerequisites

This tutorial is written for C++ DataStage operator programmers whose skills and experience are at an intermediate to advanced level. You should have a general familiarity with implementing custom operators, a working knowledge of the C++ language and the WebSphere DataStage product.

Back to top

System requirements

To run the examples in this tutorial, you need a Windows® system, an IBM Information Server Installation, user access for a DataStage project, the ability to reboot the machine several times a day, and an installed C++ compiler environment. You will also need to install Maven on your workstation (instructions on how to do so are in the tutorial).

I recommend the following compiler and SDK:

  • C++ Compiler: Microsoft Visual Studio .NET 2003
  • SDKs: Microsoft 2003 Platform SDK and Microsoft .NET SDK
  • MKS Toolkit (comes with the IBM WebSphere DataStage and QualityStage Designer installation)

1 of 10 | Next

Comments

Back to top

Close [x]

Help: Update or add to My dW interests

What's this?

This little timesaver lets you update your My developerWorks profile with just one click! The general subject of this content (AIX and UNIX, Information Management, Lotus, Rational, Tivoli, WebSphere, Java, Linux, Open source, SOA and Web services, Web development, or XML) will be added to the interests section of your profile, if it's not there already. You only need to be logged in to My developerWorks.

And what's the point of adding your interests to your profile? That's how you find other users with the same interests as yours, and see what they're reading and contributing to the community. Your interests also help us recommend relevant developerWorks content to you.

View your My developerWorks profile

Return from help

Close [x]

Help: Remove from My dW interests

What's this?

Removing this interest does not alter your profile, but rather removes this piece of content from a list of all content for which you've indicated interest. In a future enhancement to My developerWorks, you'll be able to see a record of that content.

View your My developerWorks profile

Return from help

static.content.url=http://www.ibm.com/developerworks/js/artrating/
SITE_ID=1
Zone=Information Management
ArticleID=315126
TutorialTitle=Custom combinable operators for IBM WebSphere DataStage, Part 1: Creating custom combinable operators that use input datasets
publish-date=06192008
author1-email=maklumpp@us.ibm.com
author1-email-cc=

Table of contents

1 of 10 | Next

Local resources

Tags

Help
Use the search field to find all types of content in My developerWorks with that tag.

Use the slider bar to see more or fewer tags.

Popular tags shows the top tags for this particular content zone (for example, Java technology, Linux, WebSphere).

My tags shows your tags for this particular content zone (for example, Java technology, Linux, WebSphere).

Use the search field to find all types of content in My developerWorks with that tag. Popular tags shows the top tags for this particular content zone (for example, Java technology, Linux, WebSphere). My tags shows your tags for this particular content zone (for example, Java technology, Linux, WebSphere).

 

Dig deeper into Information Management on developerWorks

Try IBM PureSystems. No charge.

IBM PureSystems on a kaleideoscope background

Experience today!

Get started with the cloud-based trial and pattern development kit.

Share this page:

  • Close [x]

Follow developerWorks:

  • Close [x]