JR42605: INVESTIGATE STAGE IS NOT HANDLING UTF16 SURROGATE-PAIR CHARACTERS PROPERLY

IBM InfoSphere Information Server, Version 8.5 Fix Pack 3

APAR status

• Closed as program error.

Error description

• Investigate stage is not handling UTF16 surrogate-pair
  characters properly.
  

Local fix

Problem summary

• ****************************************************************
  USERS AFFECTED:
  Users of QS Investigate stage with UTF16 surrogate-pair
  characters
  in the input data (usually Japanese characters).
  ****************************************************************
  PROBLEM DESCRIPTION:
  The Investigate stage is accidentally breaking up UTF16
  surrogate
  pair characters which leads to bogus data being passed out of
  the
  stage and errors in the following stage(s) of the type:
  Invalid character(s) ([xD843]) found converting Unicode string
  (code point(s): [xD843][xD843][xD843][xD843]b[xD844][xD844
  [xD844][xD844]) to codepage UTF-8
  ****************************************************************
  RECOMMENDATION:
  Use a version of the software which includes this fix
  ****************************************************************
  

Problem conclusion

• Fix ensures that no UTF16 surrogate pair characters are
  accidentally handled as multiple characters
  

Temporary fix

Comments

APAR Information

• APAR is sysrouted FROM one or more of the following:

• APAR is sysrouted TO one or more of the following:

Fix information

• Fixed component name

  WIS DATASTAGE

• Fixed component ID

  5724Q36DS

Applicable component levels

• R850 PSY

     UP

• R870 PSN

     UP