IBM Support

AIX Globalization: Why do I see garbage characters when displaying globalized text?

Question & Answer


Question

When I list file names, or messages in a graphical client, why do I see garbage, even though the output is correct on the host, or in the application?

Answer

The characters rendered are dependent on the client encoding.

If the data from the server is UTF-8, but the client displaying the data is ISO8859-1, you see the characters represented by the code points in the client's encoding.

For example, consider a UTF-8 character:

  • LATIN_CAPITAL_LETTER_Z_WITH_ACUTE [Ź] [Hex xc5 xb9]

This character does not exist in ISO8859-1, however these code points do represent other characters:

  • LATIN_CAPITAL_LETTER_A_WITH_RING_ABOVE [Å] [Hex xc5]
  • SUPERSCRIPT_ONE [¹] [Hex b9]

A demonstration of the rendering differences:

1) First, generate this code point:

# perl -e 'print "\xc5\xb9"'

  • In a UTF-8 client (xterm, or PuTTY, for example) we see Ź
  • In an ISO8859-1 client, we see Ź

2) Now, convert to ISO8859-1 encoding, and display in the ISO8859-1 client:

# perl -e 'print "\xc5\xb9"' | iconv -f UTF-8 -t ISO8859-1

  • There is no character displayed, because there is no LATIN_CAPITAL_LETTER_Z_WITH_ACUTE in the ISO8859-1 encoding.

Summary:  The client environment encoding must the data encoding that is rendered to your screen.

SUPPORT

If you require more assistance, use the following step-by-step instructions to contact IBM to open a case for software with an active and valid support contract.  

1. Document (or collect screen captures of) all symptoms, errors, and messages related to your issue.

2. Capture any logs or data relevant to the situation.

3. Contact IBM to open a case:

   -For electronic support, see the IBM Support Community:
     https://www.ibm.com/mysupport
   -If you require telephone support, see the web page:
      https://www.ibm.com/planetwide/

4. Provide a clear, concise description of the issue.

 - For guidance, see: Working with IBM AIX Support: Describing the problem.

5. If the system is accessible, collect a system snap, and upload all of the details and data for your case.

 - For guidance, see: Working with IBM AIX Support: Collecting snap data

[{"Business Unit":{"code":"BU058","label":"IBM Infrastructure w\/TPS"},"Product":{"code":"SWG10","label":"AIX"},"ARM Category":[{"code":"a8m0z000000cw2lAAA","label":"Desktop->Globalization"}],"ARM Case Number":"TS003979943","Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"All Version(s)","Line of Business":{"code":"LOB08","label":"Cognitive Systems"}}]

Document Information

Modified date:
26 July 2021

UID

ibm16253207