JR31284: PXCFF STAGE, IS 8.1, AIX. UNABLE TO READ/DISPLAY CHAR COLUMN WITH CHINESE IN EBCDIC STATEFUL ENCODING.

APAR status

• Closed as program error.

Error description

• Customer has fixed width sequntial file exported from mainframe
  that has char columns as defined in copy book as CHAR(15).
  However the data in the columns is Chinese in EBCIDC stateful
  encoding ibm-1388_P103-2001. Modified the the column as extended
  Unicode and providing map for column as ibm-1388_P103-2001.
  Error when run
  
  APT_CombinedOperatorController,0: External ustring too long.
  Imported only 15 out of 467 external characters into a ustring
  of fixed length 15.  Ignoring last 452 characters of external
  ustring up to delimiter.
  
  Job aborts.
  
  Iif using a sequential file I would read this as
  
  CM_SHORT_NAME:ustring[max=15] {width=15,
  charset="ibm-1388_P103-2001"};
  
  However cannot use CFF options to generate this osh.
  

Local fix

• Set extended = Unicode and define map in column meta data. In
  extended attributes define field width as fixed width length of
  field in bytes in external file. However this leaves output
  field as fixed width when in fact it is variable.
  

Problem summary

• ****************************************************************
  USERS AFFECTED:
  Users using datastage PxCFF stage
  ****************************************************************
  PROBLEM DESCRIPTION:
  Unicode VARCHAR with shift in and shift out is not handled
  correctly.
  ****************************************************************
  RECOMMENDATION:
  Install the patch for this fix.
  ****************************************************************
  

Problem conclusion

• In the original design.  OSH scipt for VARCHAR column is assumed
  to have prefix of 2 byte.
  However the user has a type of varchar column with no prefix but
  need to have WIDTH set to the char length
  and max set to max charlength. In the fix the user can remove
  the prefix for this type of varchar by set the prefix to
  0 and set the WIDTH=char length.  In this way the OSH script is
  generated like:
  
  CM_SHORT_NAME:ustring[max=15] {width=15,
  charset="ibm-1388_P103-2001"};
  

Temporary fix

Comments

APAR Information

• APAR is sysrouted FROM one or more of the following:

• APAR is sysrouted TO one or more of the following:

Modules/Macros

• 2
  

Fix information

• Fixed component name

  WIS DATASTAGE

• Fixed component ID

  5724Q36DS

Applicable component levels

• R810 PSN

     UP