OA50506: EDIT INCORRECTLY PUTS UP A CAUTION STATING, "DATA CONTAINS INVALID (NON-DISPLAY) CHARACTERS." ON A UTF-8 USS FILE.

Obtain the fix for this APAR.

APAR status

• Closed as program error.

Error description

• A customer edits a UTF-8 file that has a matrix of 1047 code
  points.  They specify to use UTF-8 encoding and the file is
  displayed correctly.  However Edit shows the following caution:
  -CAUTION- Data contains invalid (non-display) characters. Use
  command
            ===> FIND P'.' to position cursor to these
  If Find P'.' is then done,  it does not find any non-display
  characters.
  

Local fix

Problem summary

• ****************************************************************
  * USERS AFFECTED:                                              *
  * All ISPF Users                                               *
  ****************************************************************
  * PROBLEM DESCRIPTION:                                         *
  * A UTF-8 file, containing only displayable UTF-8 characters,  *
  * is edited.                                                   *
  * The file is displayed correctly, but Edit shows the          *
  * following caution:                                           *
  * -CAUTION- Data contains invalid (non-display) characters.    *
  * Use                                                          *
  * command  ===> FIND P'.' to position cursor to these          *
  * If the Find P'.' command is entered as suggested by the      *
  * caution message,                                             *
  * no non-display characters are found.                         *
  ****************************************************************
  * RECOMMENDATION:                                              *
  * Apply the provided PTF.                                      *
  ****************************************************************
  The logic in ISREDI that looks for non-displayable characters in
  UTF-8 data is treating each byte as an ASCII character.
  This works for 1-byte UTF-8 characters, but not for 2-byte UTF-8
  characters.  A 2-byte UTF-8 character that is actually
  displayable is found to be non-displayable when the value in
  either byte is not a displayable ASCII character.
  

Problem conclusion

• ISREDI is modified to preprocess the data looking for
  displayable 2-byte UTF-8 characters.
  When found, the 2 bytes are replaced with displayable 1-byte
  ASCII characters so that the
  subsequent test finds the character to be displayable.
  

Temporary fix

Comments

APAR Information

• APAR is sysrouted FROM one or more of the following:

• APAR is sysrouted TO one or more of the following:

  UA81901

Modules/Macros

• ISREDI
  

Fix information

• Fixed component name

  ISPF Z/OS PDF&S

• Fixed component ID

  565504202

Applicable component levels

• RP02 PSY UA81901

     UP16/06/16 P F606

Fix is available

• Select the PTF appropriate for your component level. You will be required to sign in. Distribution on physical media is not available in all countries.