JR32622: TRANSFORMER BINARIES ARE OVERWRITTEN IN MULTI-INSTANCE JOBS ON MPP ENVIRONMENTS

APAR status

• Closed as program error.

Error description

• When multiple multi-instance jobs are kicked off at the same
  time, they sometimes overwrite the binary distribution on
  MPP system.  Need fix for this.
  

Local fix

• Set  APT_COPY_TRANSFORM_OPERATOR to false and manually copy the
  binaries to the processing nodes.
  

Problem summary

•  When multiple multi-instance jobs are kicked off at the same
  time, they sometimes overwrite the binary distribution on
  MPP system
  

Problem conclusion

• RESOLUTION:
    Added a new feature which will allow PXEngine to push newly
  compiled
    transform libraries out to remote compute nodes at
  compile-time instead
    of at runtime.  This new feature is controlled through the use
  of a new
    environment variable APT_DIST_TRANSFORM_OPERATOR.  When
  present in the
    environment, pushing to the remote nodes will be enabled at
  compile-time.
  
    This environment variable should contain a whitespace
  separated list of
    all server names in the cluster which will be merged with the
  list of
    fastnames contained in the configuration file used when the
  job is compiled.
    If no configuration file is specified in the job, the default
  configuration
    file is used.  Setting the environment variable this way
  ensures that the
    compiled transform libraries are distributed to all nodes
  regardless of the
    configuration file used at compile time.
  
    Note: If you use compile-time distribution, you don't need to
  use runtime
          distribution.  If this feature is going to be used on
  prodution
          servers, a compiler is required.
  

Temporary fix

•  Set APT_COPY_TRANSFORM_OPERATOR to false and manually copy the
  binaries to the processing nodes.
  

Comments

APAR Information

• APAR is sysrouted FROM one or more of the following:

• APAR is sysrouted TO one or more of the following:

Fix information

• Fixed component name

  WIS DATASTAGE

• Fixed component ID

  5724Q36DS

Applicable component levels

• R801 PSY

     UP

• R802 PSY

     UP

• R810 PSY

     UP

• R870 PSY

     UP

• R910 PSY

     UP