Troubleshooting
Problem
It may be observed that a NULL (0x00) character is injected into the output data when using an IBM Transformation Extender (ITX) 9.0.0.x map with the codepagefallback = substitute option and specifying a substitute character.
Symptom
It may be noted that if a substitute character is specified, that character is used where appropriate, but a NULL character (0x00) is also injected into the output data stream.
For example:
The character 'ń' (0x84 in UTF-8) has no equivalent in Latin-9.
If the codepagefallback option was set to 'substitute' and the substitute character was defined as '?', then the output data would then contains a NULL after the substituted character:
?<NULL>
or
0x3F 0x00
Cause
The substitute character length was being stored in the compiled map in bytes when it should have been in characters
Environment
IBM Transformation Extender 9.0.0.x on any supported execution platform
Diagnosing The Problem
Using a hex editor, the NULL can be seen after the substitute character. (It cannot be seen with a simple text editor, such as Notepad, which renders it as a space).
Resolving The Problem
Obtain and apply the fix for APAR PI98900
Was this topic helpful?
Document Information
More support for:
IBM Transformation Extender
Software version:
9.0.0.3, 9.0.0.2, 9.0.0.1, 9.0.0.0
Operating system(s):
AIX, HP-UX, Linux, Solaris, Windows, z/OS
Document number:
712115
Modified date:
29 September 2018
UID
swg22017098