IBM Support

PI92342: CREATING A HADOOP TABLE WITH A LINE TERMINATOR OTHER THAN THE DEFAULT NEWLINE CHARACTER MAY RESULT IN UNEXPECTED BEHAVIOUR

Subscribe

You can track all active APARs for this component.

 

APAR status

  • Closed as fixed if next.

Error description

  • Although the CREATE HADOOP TABLE syntax allows for the
    specification of a line terminator other than the default, the
    newline character \n is the only supported option as documented
    ("The only valid delimiter is the newline character (\n)").
    This limitation exists due to the same limitation in Hive.
    The code to restrict line terminators other than the \n is
    currently missing from Big SQL.
    .
    Data which contains a different line terminator cannot be read
    by the Big SQL Java reader, nor can it be properly processed by
    Analyze.  As a result, querying a table with a different line
    terminator may result in errors or wrong results or may cause
    performance issues due to incorrect statistics.
    .
    To prevent this, the specification of line terminators other
    than the default will now be blocked.  Any tables created with
    invalid line terminators will have to be recreated and the
    data corrected.
    

Local fix

  • N/A
    

Problem summary

  • Problem is fixed in IBM Db2 Big SQL version
    6.0.0.0
    

Problem conclusion

Temporary fix

  • N/A
    Use the supported line termination character (\n)
    

Comments

APAR Information

  • APAR number

    PI92342

  • Reported component name

    INFO BIGINSIGHT

  • Reported component ID

    5725C0900

  • Reported release

    420

  • Status

    CLOSED FIN

  • PE

    NoPE

  • HIPER

    NoHIPER

  • Special Attention

    NoSpecatt / Xsystem

  • Submitted date

    2018-01-11

  • Closed date

    2018-12-12

  • Last modified date

    2018-12-12

  • APAR is sysrouted FROM one or more of the following:

  • APAR is sysrouted TO one or more of the following:

Fix information

Applicable component levels

  • R420 PSN

       UP

[{"Business Unit":{"code":"BU059","label":"IBM Software w\/o TPS"},"Product":{"code":"SSCRJT","label":"IBM Db2 Big SQL"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"420","Line of Business":{"code":"LOB10","label":"Data and AI"}}]

Document Information

Modified date:
25 August 2020