JR57153: INCORRECT COLUMN LENGTH AND CHARACTERS WHEN READING FROM MYSQL WITH NON-GENERIC UTF-8.

APAR status

• Closed as program error.

Error description

• When reading from a MySQL table with a non-generic utf8
  collation (i.e. utf8_spanish_ci), DataStage is detecting three
  times the actual length of the column and it is issuing the
  following warning:
  
  When binding output interface field "col" to field "col":
  Implicit conversion from source type "ustring[max=30]" to
  result type "ustring [max=10]": Possible truncation of variable
  length string.
  
  Also, the accented characters or letters with diacritic are
  wrongly decoded, so an "a with diatritic acute" is interpreted
  like an "upper case A with tilde followed by an inverted
  exclamation mark".
  

Local fix

• This does not happen if you switch the column collation to
  "utf8_general_ci", but you might not be able to use this
  workaround if you need to distinguish between letter "N" and
  Upper case 'n' with tilde  which are two completely different
  letters in Spanish.
  

Problem summary

• Incorrect column length and characters when reading from MYSQL
  with non-generic utf-8.
  

Problem conclusion

• Install latest MYSQL DD driver, which fixed the non-generic
  utf-8 chars, when reading from mysql database.
  

Temporary fix

Comments

APAR Information

• APAR is sysrouted FROM one or more of the following:

• APAR is sysrouted TO one or more of the following:

Modules/Macros

•    DD-Drive
  

Fix information

• Fixed component name

  WIS DATASTAGE

• Fixed component ID

  5724Q36DS

Applicable component levels

• R810 PSY

     UP