IBM Support

JR55180: DataLoad might fail on large CSV files that contain double quotation mark characters (") in some fields

Subscribe

You can track all active APARs for this component.

 

APAR status

  • Closed as program error.

Error description

  • The CSVReader class reads the CSV file one buffer at a time and
    the buffer size is hardcoded at 10000 characters. You might
    encounter any of the following issues if you are trying to load
    a CSV file with a large data set:
    
    1. You might notice that the Data Load utility parses the tokens
    incorrectly if the string in the buffer ends with the token
    separator (comma), the next token starts with the token
    value delimiter (double quotation mark), and commas exist
    in between the double quotation marks.
    
    2. Data Load utility parses the tokens incorrectly if the string
    in the buffer ends in a token that is surrounded by double
    quotation marks.
    
    3.  A DataLoadApplicationException is thrown if the last token
    in the CSV line is in double quotation marks and the buffer
    reader ends in between teh carriage return '\r' and the line
    feed '\n'.
    

Local fix

Problem summary

  • USERS AFFECTED:
    WebSphere Commerce v8 admininstrators or business users who run
    data load or catalog upload.
    
    PROBLEM ABSTRACT:
    DataLoad might fail on large CSV files that contain double
    quotation mark characters (") in some fields
    
    
    BUSINESS IMPACT:
    Cannot successfully run Data Load utility. Administrators might
    encounter exception errors, or tokens are parsed incorrectly.
    
    
    RECOMMENDATION:
    

Problem conclusion

  • Updated the logic in CSV reader that prevented correct
    parsing of the input file.
    

Temporary fix

Comments

APAR Information

  • APAR number

    JR55180

  • Reported component name

    WC BUS DEV ED W

  • Reported component ID

    5724I3900

  • Reported release

    800

  • Status

    CLOSED PER

  • PE

    NoPE

  • HIPER

    NoHIPER

  • Special Attention

    NoSpecatt / Xsystem

  • Submitted date

    2016-01-27

  • Closed date

    2016-02-10

  • Last modified date

    2016-05-09

  • APAR is sysrouted FROM one or more of the following:

  • APAR is sysrouted TO one or more of the following:

Fix information

  • Fixed component name

    WC BUS DEV ED W

  • Fixed component ID

    5724I3900

Applicable component levels

  • R800 PSY

       UP

[{"Business Unit":{"code":"BU055","label":"Cognitive Applications"},"Product":{"code":"SSYT2H","label":"WebSphere Commerce Developer Enterprise"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"8.0","Line of Business":{"code":"LOB31","label":"WCE Watson Marketing and Commerce"}}]

Document Information

Modified date:
11 December 2021