IBM Support

IJ28818: ARIEL DATA FILE CORRUPTION CAN OCCUR CAUSING "I/O ERROR" DURING SEARCHES WHEN EMAIL RESPONSE TO A SPECIFIC RULE IS CONFIGURED

Subscribe to this APAR

By subscribing, you receive periodic emails alerting you to the status of the APAR, along with a link to the fix after it becomes available. You can track this item individually or track all items by product.

Notify me when this APAR changes.

Notify me when an APAR for this component changes.

 

APAR status

  • Closed as program error.

Error description

  • Ariel data corruption can occur when using the rule "log
    source stopped sending events" with a large number of Custom
    Event Properties (CEP) and/or log sources in a log source group
    with an email response configured.
    When this data corruption is experienced, ariel searches can
    generate an "I/O error" in the QRadar User Interface if these
    corrupted files are acccessed.
    Messages similar to the following might be visible in
    /var/log/qradar.log when this issue occurs:
    java.lang.IndexOutOfBoundsException
            at java.nio.Buffer.checkBounds(Buffer.java:578)
            at java.nio.ByteBuffer.get(ByteBuffer.java:686)
            at
    java.nio.DirectByteBuffer.get(DirectByteBuffer.java:285)
            at
    com.q1labs.core.types.BitMask.getBitMask(BitMask.java:107)
            at
    com.q1labs.core.types.event.mapping.NormalizedEventMappingV2.get
    (NormalizedEventMappingV2.java:61)
            at
    com.q1labs.core.types.event.mapping.NormalizedEventMappingV2.get
    (NormalizedEventMappingV2.java:31)
            at
    com.q1labs.ariel.FileReader.doRead(FileReader.java:192)
            at com.q1labs.ariel.FileReader.read(FileReader.java:184)
            at
    com.q1labs.ariel.RecordDumper.dumpRecords(RecordDumper.java:66)
            at
    com.q1labs.cve.utils.CommandLineClient.doDump(CommandLineClient.
    java:153)
            at
    com.q1labs.cve.utils.CommandLineClient.run(CommandLineClient.jav
    a:188)
            at
    com.q1labs.cve.utils.CommandLineClient.main(CommandLineClient.ja
    va:173)
    ------- or --------
    java.lang.IllegalStateException: Potential mapping error. Array
    size: -1792 Max is 32767
     at
    com.q1labs.frameworks.nio.MappingBase.getSizeShort(MappingBase.j
    ava:86)
     at
    com.q1labs.frameworks.nio.MappingBase.getSizeShort(MappingBase.j
    ava:80)
     at
    com.q1labs.core.types.networkevent.mapping.NetworkEventMappingUt
    ils.readCustomRuleResultMap(NetworkEventMappingUtils.java:238)
     at
    com.q1labs.core.types.event.mapping.NormalizedEventMappingV2.rea
    dCustomRules(NormalizedEventMappingV2.java:715)
     at
    com.q1labs.core.types.event.mapping.NormalizedEventMappingV2.get
    (NormalizedEventMappingV2.java:147)
     at
    com.q1labs.core.types.event.mapping.NormalizedEventMappingV2.get
    (NormalizedEventMappingV2.java:35)
     at com.q1labs.ariel.FileReader.doRead(FileReader.java:192)
     at com.q1labs.ariel.FileReader.read(FileReader.java:184)
     at
    com.q1labs.ariel.searches.service.ids.ArielFile$Crawler.nextReco
    rd(ArielFile.java:31)
     at
    com.q1labs.ariel.searches.service.ids.ArielFile.next(ArielFile.j
    ava:206)
     at
    com.q1labs.ariel.searches.service.ids.FilteredSource.next(Filter
    edSource.java:39)
     at
    com.q1labs.ariel.searches.tasks.QueryWorker.execute(QueryWorker.
    java:53)
     at
    com.q1labs.ariel.searches.tasks.ServiceTaskBase.runTask(ServiceT
    askBase.java:89)
     at
    com.q1labs.ariel.searches.tasks.ServiceTask.runTask(ServiceTask.
    java:69)
     at
    com.q1labs.ariel.searches.tasks.ServiceTaskBase$Runner.run(Servi
    ceTaskBase.java:32)
     at
    java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExec
    utor.java:1160)
     at
    java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExe
    cutor.java:635)
     at java.lang.Thread.run(Thread.java:818)
    -------or-------
    [ecs-ep.ecs-ep] Ariel Writer#events
    com.q1labs.frameworks.core.ThreadExceptionHandler: [ERROR]
    [NOT:0000003000][ IP_ADDRESS/- -] [-/- -]Exception was uncaught
    in thread: Ariel Writer#events
    [ecs-ep.ecs-ep] Ariel Writer#events
    java.lang.NullPointerException
    [ecs-ep.ecs-ep] Ariel Writer#events at
    com.q1labs.core.types.networkevent.CustomPropertyRecord.toByteBu
    ffer(CustomPropertyRecord.java:188)
    [ecs-ep.ecs-ep] Ariel Writer#events at
    com.q1labs.core.types.networkevent.mapping.NetworkEventMappingUt
    ils.writeCustomProperties(NetworkEventMappingUtils.java:326)
    [ecs-ep.ecs-ep] Ariel Writer#events at
    com.q1labs.core.types.event.mapping.NormalizedEventMappingV2.put
    CustomProperties(NormalizedEventMappingV2.java:701)
    [ecs-ep.ecs-ep] Ariel Writer#events at
    com.q1labs.core.types.event.mapping.NormalizedEventMappingV2.put
    Event(NormalizedEventMappingV2.java:541)
    [ecs-ep.ecs-ep] Ariel Writer#events at
    com.q1labs.core.types.event.mapping.NormalizedEventMappings$Exlu
    deCachedResults.putData(NormalizedEventMappings.java:68)
    [ecs-ep.ecs-ep] Ariel Writer#events at
    com.q1labs.core.types.event.mapping.NormalizedEventMappingV2.put
    (NormalizedEventMappingV2.java:281)
    [ecs-ep.ecs-ep] Ariel Writer#events at
    com.q1labs.core.types.event.mapping.NormalizedEventMappingV2.put
    (NormalizedEventMappingV2.java:35)
    [ecs-ep.ecs-ep] Ariel Writer#events at
    com.q1labs.ariel.io.NIOFileWriter.write(NIOFileWriter.java:110)
    [ecs-ep.ecs-ep] Ariel Writer#events at
    com.q1labs.ariel.io.SimpleWriter.writeRecord(SimpleWriter.java:4
    7)
    [ecs-ep.ecs-ep] Ariel Writer#events at
    com.q1labs.ariel.io.BucketWriter.writeRecord(BucketWriter.java:6
    2)
    [ecs-ep.ecs-ep] Ariel Writer#events at
    com.q1labs.ariel.io.AbstractDatabaseWriter.put(AbstractDatabaseW
    riter.java:114)
    [ecs-ep.ecs-ep] Ariel Writer#events at
    com.q1labs.ariel.DatabaseWriterAsync.processRecord(DatabaseWrite
    rAsync.java:131)
    [ecs-ep.ecs-ep] Ariel Writer#events at
    com.q1labs.ariel.ScatteringDatabaseWriter.access$401(ScatteringD
    atabaseWriter.java:30
    

Local fix

  • Where possible, do not use the email response option when using
    the rule "log source stopped sending events".
    

Problem summary

  • This issue was fixed in QRadar QRM QVM release of 7.4.2 FixPack
    2.
    

Problem conclusion

  • This issue was fixed in QRadar QRM QVM release of 7.4.2 FixPack
    2.
    

Temporary fix

Comments

APAR Information

  • APAR number

    IJ28818

  • Reported component name

    QRADAR SOFTWARE

  • Reported component ID

    5725QRDSW

  • Reported release

    732

  • Status

    CLOSED PER

  • PE

    NoPE

  • HIPER

    NoHIPER

  • Special Attention

    NoSpecatt / Xsystem

  • Submitted date

    2020-10-20

  • Closed date

    2021-01-26

  • Last modified date

    2021-01-26

  • APAR is sysrouted FROM one or more of the following:

  • APAR is sysrouted TO one or more of the following:

Fix information

  • Fixed component name

    QRADAR SOFTWARE

  • Fixed component ID

    5725QRDSW

Applicable component levels

[{"Line of Business":{"code":"LOB10","label":"Data and AI"},"Business Unit":{"code":"BU029","label":"Software"},"Product":{"code":"SSBQAC","label":"IBM QRadar SIEM"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"732"}]

Document Information

Modified date:
27 January 2021