Optimizing BDFS jobs using InfoSphere DataStage Balanced Optimization

From the developerWorks archives

Rao Lella

Date archived: January 13, 2017 | First published: February 20, 2014

This article explains how to use InfoSphere® DataStage® Balanced Optimization to rewrite Big Data File Stage jobs into Jaql. BDFS stage operates on InfoSphere BigInsights. BDFS stage is a new stage introduced in InfoSphere Information Server 9.1. To optimize performance of BDFS jobs, InfoSphere DataStage Balanced Optimization is required. It redesigns a job to maximize performance by minimizing the amount of input and output performed and by balancing the processing against source, intermediate, and target environments. Readers will learn how to use InfoSphere DataStage Balanced Optimization in association with BDFS stage and configuration parameters required for Jaql Connector when a job is optimized.

This content is no longer being updated or maintained. The full article is provided "as is" in a PDF file. Given the rapid evolution of technology, some steps and illustrations may have changed.



static.content.url=http://www.ibm.com/developerworks/js/artrating/
SITE_ID=1
Zone=Information Management
ArticleID=963110
ArticleTitle=Optimizing BDFS jobs using InfoSphere DataStage Balanced Optimization
publish-date=02202014