JR46342: DATASTAGE BALANCED OPTIMIZATION PERFORMANCE ENHANCEMENT REQUEST REGARDING JAQL QUERIES

IBM InfoSphere Information Server, Version 9.1.2

APAR status

• Closed as program error.

Error description

• Balanced Optimization JAQL queries are 7 times slower compared
  to the original DataStage job
  
  This Patch is to include changes to DataStage Balanced
  Optimization in order to provide performance improvement for
  GM's reconcile job scenarios. The following changes will be
  included in the patch:
   (1) convert JAQL record schema to array schema in order to gain
  better performance.
    (2) remove intermediate sort statements in the generated JAQL
  query and only optionally add a sort statement right before the
  write statement.
    (3) convert localWrite statement to write statement.
    (4) provide an advanced option and job parameter in the
  Balanced Optimization parameter set that sets MapReduce
  properties. Details of these changes and sample jobs will be
  provided as attachment.
  

Local fix

• There is no workaround in the JAQL generated by Balanced
  Optimization. The fix is to improve performance of the
  generated JAQL by implementing the four area of changes
  described in the CRM earlier.
  

Problem summary

• ERROR DESCRIPTION:
  Balanced Optimization JAQL queries are 7 times slower compared
  to the original DataStage job
  
  This Patch is to include changes to DataStage Balanced
  Optimization in order to provide performance improvement for
  GM's reconcile job scenarios. The following changes will be
  included in the patch:
   (1) convert JAQL record schema to array schema in order to gain
  better performance.
    (2) remove intermediate sort statements in the generated JAQL
  query and only optionally add a sort statement right before the
  write statement.
    (3) convert localWrite statement to write statement.
    (4) provide an advanced option and job parameter in the
  Balanced Optimization parameter set that sets MapReduce
  properties. Details of these changes and sample jobs will be
  provided as attachment.
  
  LOCAL FIX:
  There is no workaround in the JAQL generated by Balanced
  Optimization. The fix is to improve performance of the
  generated JAQL by implementing the four area of changes
  described in the CRM earlier.
  

Problem conclusion

• A patch has been made for these improbements and they will go
  into the next fixpack.
  

Temporary fix

Comments

APAR Information

• APAR is sysrouted FROM one or more of the following:

• APAR is sysrouted TO one or more of the following:

Fix information

• Fixed component name

  INFO SRVR PLATF

• Fixed component ID

  5724Q3612

Applicable component levels

• R910 PSY

     UP