IBM Support

IJ26117: PERFORMING A FREE TEXT SEARCH IN THE LAST FEW SECONDS OF AN HOUR CAN RETURN PARTIAL RESULTS AND CAUSE INDEX CORRUPTION

Subscribe to this APAR

By subscribing, you receive periodic emails alerting you to the status of the APAR, along with a link to the fix after it becomes available. You can track this item individually or track all items by product.

Notify me when this APAR changes.

Notify me when an APAR for this component changes.

 

APAR status

  • Closed as program error.

Error description

  • Due to a timing issue (race condition), performing a free text
    Quick Filter search can sometimes only return partial results
    and cause corrupted indexes when the free text search is
    performed in the in last 5-10 seconds of an hour.
    A message generated in the QRadar User Interface can be similar
    to:
    "Partial results may be returned due to incomplete payload
    indexes for the specified time range".
    Messages similar to the following might be visible in
    /var/log/qradar.log when this issue is occurring:
    /events/records/aux/1/2020/5/4/13/lucene
    lockFactory=org.apache.lucene.store.NativeFSLockFactory@87bbef33
    ): org.apache.lucene.store.LockObtainFailedException: Lock held
    by this virtual machine:
    /store/ariel/events/records/aux/1/2020/5/4/13/lucene/write.lock
    [ariel.ariel_query_server] [odi_31]    at
    org.apache.lucene.store.SleepingLockWrapper.obtainLock(SleepingL
    ockWrapper.java:102)
    [ariel.ariel_query_server] [odi_31]    at
    org.apache.lucene.index.IndexWriter.<init>(IndexWriter.java:800)
    [ariel.ariel_query_server] [odi_31]    at
    com.q1labs.ariel.liquery.FTSIndexWriter.<init>(FTSIndexWriter.ja
    va:34)
    [ariel.ariel_query_server] [odi_31]    at
    com.q1labs.ariel.liquery.FTSIndexWriter_MT.<init>(FTSIndexWriter
    _MT.java:106)
    [ariel.ariel_query_server] [odi_31]    at
    com.q1labs.ariel.liquery.LuManager.createIndexWriter(LuManager.j
    ava:308)
    [ariel.ariel_query_server] [odi_31]    at
    com.q1labs.ariel.liquery.LuIndexer.getODIWriter(LuIndexer.java:4
    12)
    [ariel.ariel_query_server] [odi_31]    at
    com.q1labs.ariel.liquery.LuIndexer.indexDirectory(LuIndexer.java
    :466)
    [ariel.ariel_query_server] [odi_31]    at
    com.q1labs.ariel.liquery.LuIndexer.indexDirectory(LuIndexer.java
    :429)
    [ariel.ariel_query_server] [odi_31]    at
    com.q1labs.ariel.liquery.ReaderCache$IndexReaderInfo.reIndexDire
    ctory(ReaderCache.java:156)
    [ariel.ariel_query_server] [odi_31]    at
    com.q1labs.ariel.liquery.ReaderCache$IndexReaderInfo.openDirecto
    ryReader(ReaderCache.java:139)
    [ariel.ariel_query_server] [odi_31]    at
    com.q1labs.ariel.liquery.ReaderCache$IndexReaderInfo.call(Reader
    Cache.java:187)
    [ariel.ariel_query_server] [odi_31]    at
    com.q1labs.ariel.liquery.ReaderCache$IndexReaderInfo.call(Reader
    Cache.java:59)
    [ariel.ariel_query_server] [odi_31]    at
    java.util.concurrent.FutureTask.run(FutureTask.java:277)
    [ariel.ariel_query_server] [odi_31]    at
    java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExec
    utor.java:1160)
    [ariel.ariel_query_server] [odi_31]    at
    java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExe
    cutor.java:635)
    [ariel.ariel_query_server] [odi_31]    at
    java.lang.Thread.run(Thread.java:818)
    [ariel.ariel_query_server] [odi_31] Caused by:
    [ariel.ariel_query_server] [odi_31]
    org.apache.lucene.store.LockObtainFailedException: Lock held by
    this virtual machine:
    /store/ariel/events/records/aux/1/2020/5/4/13/lucene/write.lock
    [ariel.ariel_query_server] [odi_31]    at
    org.apache.lucene.store.NativeFSLockFactory.obtainFSLock(NativeF
    SLockFactory.java:127)
    [ariel.ariel_query_server] [odi_31]    at
    org.apache.lucene.store.FSLockFactory.obtainLock(FSLockFactory.j
    ava:41)
    [ariel.ariel_query_server] [odi_31]    at
    org.apache.lucene.store.BaseDirectory.obtainLock(BaseDirectory.j
    ava:45)
    [ariel.ariel_query_server] [odi_31]    at
    org.apache.lucene.store.SleepingLockWrapper.obtainLock(SleepingL
    ockWrapper.java:84)
    [ariel.ariel_query_server] [odi_31]    ... 15 more
    

Local fix

  • Where possible, do not perform a free text Quick Filter search
    in the last 5-10 seconds of the hour.
    

Problem summary

  • This issue was fixed in QRadar QRM QVM release of 7.4.2 FixPack
    3 and 7.3.3 FixPack 8.
    

Problem conclusion

  • This issue was fixed in QRadar QRM QVM release of 7.4.2 FixPack
    3 and 7.3.3 FixPack 8.
    

Temporary fix

Comments

APAR Information

  • APAR number

    IJ26117

  • Reported component name

    QRADAR SOFTWARE

  • Reported component ID

    5725QRDSW

  • Reported release

    732

  • Status

    CLOSED PER

  • PE

    NoPE

  • HIPER

    NoHIPER

  • Special Attention

    NoSpecatt / Xsystem

  • Submitted date

    2020-07-08

  • Closed date

    2021-04-12

  • Last modified date

    2021-05-03

  • APAR is sysrouted FROM one or more of the following:

  • APAR is sysrouted TO one or more of the following:

Fix information

  • Fixed component name

    QRADAR SOFTWARE

  • Fixed component ID

    5725QRDSW

Applicable component levels

[{"Line of Business":{"code":"LOB10","label":"Data and AI"},"Business Unit":{"code":"BU029","label":"Software"},"Product":{"code":"SSBQAC","label":"IBM QRadar SIEM"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"732"}]

Document Information

Modified date:
04 May 2021