JR32251: PX TRANSFORMER STAGE SOUNDEX FUNCTION NOT HANDLING UNICODE CHARACTERS PROPERLY.

APAR status

• Closed as program error.

Error description

• The SOUNDEX function in the Linux 8.0.1, PX Transformer stage
  did not handle Unicode
  characters properly.
  
  Upon review of the code 2 issues were discovered.
  1) function accepts a string and returns a string - not ustring
  - so it doesn't work correctly on Unicode converted to UTF-8.
  2) The code intended to verify that the first character is
  alphabetic and return an empty string if it is not. In fact,
  the
  check is incorrectly coded and does nothing, which is why
  
  squirrely UTF-8 characters are slipping through the routine.
  

Local fix

Problem summary

• ****************************************************************
  USERS AFFECTED:
  All  programs using 8.x DataStage Parallel framework Soundex
  functions in transformer stages will be affected
  ****************************************************************
  PROBLEM DESCRIPTION:
  If the SOUNDEX function is used with Unicode input,
  uppredictable results will occur. Soundex is frequently used in
  QulaityStage jobs and this error will lead to spurious warnings
  in the job logs
  ****************************************************************
  RECOMMENDATION:
  Install the patch.
  This change is included in 8.1 Fix Pack 1.
  ****************************************************************
  

Problem conclusion

• Tranformer stages including SOUNDEX functions will run without
  error messages and emptu string inputs will now be propery
  detected
  

Temporary fix

Comments

APAR Information

• APAR is sysrouted FROM one or more of the following:

• APAR is sysrouted TO one or more of the following:

Modules/Macros

• SERVER
  

Fix information

• Fixed component name

  WIS DATASTAGE

• Fixed component ID

  5724Q36DS

Applicable component levels

• R801 PSN

     UP