IBM Support

IJ12883: SIM RESET CAUSING OFFENSES TO BECOME INACTIVE CAN SOMETIMES OCCUR WHEN MULTIPLE DEPLOY FUNCTIONS ARE PERFORMED

Subscribe to this APAR

By subscribing, you receive periodic emails alerting you to the status of the APAR, along with a link to the fix after it becomes available. You can track this item individually or track all items by product.

Notify me when this APAR changes.

Notify me when an APAR for this component changes.

 

APAR status

  • Closed as program error.

Error description

  • It has been observed that when a "Deploy" function is initiated
    while a previous Deploy is still in progress, the ecs-ep
    process can sometimes shutdown incorrectly.
    When this occurs, the magistrate can become corrupt and cause a
    SIM reset that sets all the offenses to "inactive" state.
    Messages similar to the following might be visible in
    /var/log/qadar.log when this issue is occurring:
    [hostcontext.hostcontext]
    [cdec3d92-2a0c-413e-a2c2-76c5bbb033b3/SequentialEventDispatcher]
    com.q1labs.hostcontext.processmonitor.ProcessManager: [INFO]
    [NOT:0000006000][127.0.0.1/- -] [-/- -]Starting process ecs-ep
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]
    com.q1labs.frameworks.cache.ResizableBufferPool: [WARN]
    [NOT:0000004000][127.0.0.1/- -] [-/- -]null
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]
    java.lang.InterruptedException
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]    at
    java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireInt
    erruptibly(AbstractQueuedSynchronizer.java:1231)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]    at
    java.util.concurrent.locks.ReentrantLock.lockInterruptibly(Reent
    rantLock.java:346)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]    at
    java.util.concurrent.LinkedBlockingQueue.put(LinkedBlockingQueue
    .java:350)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]    at
    com.q1labs.frameworks.cache.ResizableBufferPool.dispose(Resizabl
    eBufferPool.java:101)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]    at
    com.q1labs.frameworks.cache.ChainAppendCache.readChainEntry(Chai
    nAppendCache.java:1320)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]    at
    com.q1labs.frameworks.cache.ChainAppendCache.findOnDisk(ChainApp
    endCache.java:1162)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]    at
    com.q1labs.frameworks.cache.ChainAppendCache.findOnDisk(ChainApp
    endCache.java:1148)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]    at
    com.q1labs.frameworks.cache.ChainAppendCache.get(ChainAppendCach
    e.java:1000)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]    at
    com.q1labs.core.dao.sem.light.Target.findByNetworkAddress(Target
    .java:423)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]    at
    com.q1labs.sem.magi.contrib.PersistenceContext.findTargetByNetwo
    rk(PersistenceContext.java:3739)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]    at
    com.q1labs.sem.magi.contrib.commands.netid.OffenseUpdateNetidCom
    mand.updateTargetNetworkDetails(OffenseUpdateNetidCommand.java:3
    91)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]    at
    com.q1labs.sem.magi.contrib.commands.netid.OffenseUpdateNetidCom
    mand.execute(OffenseUpdateNetidCommand.java:63)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]    at
    com.q1labs.sem.magi.contrib.ModelPersister.processCommands(Model
    Persister.java:2464)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]    at
    com.q1labs.sem.magi.contrib.ModelPersister.processCommands(Model
    Persister.java:2428)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]    at
    com.q1labs.sem.magi.contrib.ModelPersister.executeOffenseUpdateN
    etidCommands(ModelPersister.java:2399)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]    at
    com.q1labs.sem.magi.contrib.ModelPersister.process(ModelPersiste
    r.java:1207)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]    at
    com.q1labs.sem.magi.contrib.ModelPersister.processCurrentTransac
    tion(ModelPersister.java:543)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]    at
    com.q1labs.sem.magi.contrib.ModelPersister.processCommands(Model
    Persister.java:417)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]    at
    com.q1labs.sem.magi.contrib.ModelPersister.process(ModelPersiste
    r.java:257)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]    at
    com.q1labs.sem.magi.contrib.TxStateManager.playCurrent(TxStateMa
    nager.java:259)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]    at
    com.q1labs.sem.magi.contrib.ModelPersister$Persister.playCurrent
    (ModelPersister.java:2854)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]    at
    com.q1labs.sem.magi.contrib.ModelPersister$Persister.run(ModelPe
    rsister.java:2810)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]
    com.q1labs.sem.magi.contrib.ModelPersister: [WARN]
    [NOT:0180002100][127.0.0.1/- -] [-/- -]Exception encounted when
    executing transaction 24069.
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]
    com.q1labs.frameworks.cache.SpilloverCacheException: Error
    reading chain entry for offset:2972118239436 in File:
    /store/transient/ecs-ep.ecs-ep/TargetIPtoID/692
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]    at
    com.q1labs.frameworks.cache.ChainAppendCache.readChainEntry(Chai
    nAppendCache.java:1350)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]    at
    com.q1labs.frameworks.cache.ChainAppendCache.findOnDisk(ChainApp
    endCache.java:1162)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]    at
    com.q1labs.frameworks.cache.ChainAppendCache.findOnDisk(ChainApp
    endCache.java:1148)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]    at
    com.q1labs.frameworks.cache.ChainAppendCache.get(ChainAppendCach
    e.java:1000)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]    at
    com.q1labs.core.dao.sem.light.Target.findByNetworkAddress(Target
    .java:423)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]    at
    com.q1labs.sem.magi.contrib.PersistenceContext.findTargetByNetwo
    rk(PersistenceContext.java:3739)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]    at
    com.q1labs.sem.magi.contrib.commands.netid.OffenseUpdateNetidCom
    mand.updateTargetNetworkDetails(OffenseUpdateNetidCommand.java:3
    91)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]    at
    com.q1labs.sem.magi.contrib.commands.netid.OffenseUpdateNetidCom
    mand.execute(OffenseUpdateNetidCommand.java:63)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]    at
    com.q1labs.sem.magi.contrib.ModelPersister.processCommands(Model
    Persister.java:2464)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]    at
    com.q1labs.sem.magi.contrib.ModelPersister.processCommands(Model
    Persister.java:2428)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]    at
    com.q1labs.sem.magi.contrib.ModelPersister.executeOffenseUpdateN
    etidCommands(ModelPersister.java:2399)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]    at
    com.q1labs.sem.magi.contrib.ModelPersister.process(ModelPersiste
    r.java:1207)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]    at
    com.q1labs.sem.magi.contrib.ModelPersister.processCurrentTransac
    tion(ModelPersister.java:543)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]    at
    com.q1labs.sem.magi.contrib.ModelPersister.processCommands(Model
    Persister.java:417)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]    at
    com.q1labs.sem.magi.contrib.ModelPersister.process(ModelPersiste
    r.java:257)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]    at
    com.q1labs.sem.magi.contrib.TxStateManager.playCurrent(TxStateMa
    nager.java:259)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]    at
    com.q1labs.sem.magi.contrib.ModelPersister$Persister.playCurrent
    (ModelPersister.java:2854)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]    at
    com.q1labs.sem.magi.contrib.ModelPersister$Persister.run(ModelPe
    rsister.java:2810)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]
    com.q1labs.sem.magi.OffenseManagerDelegate: [INFO]
    [NOT:0000006000][127.0.0.1/- -] [-/- -]Collecting sim model to
    file /store/LOGS/sim_model_20180919_144618.tar.gz
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000024069]
    com.q1labs.sem.magi.OffenseManagerDelegate: [INFO]
    [NOT:0000006000][127.0.0.1/- -] [-/- -]running command
    /usr/bin/pg_dump -U qradar -Fc -t offense* -t attacker* -t
    target* -t category* -t network_details*  -f
    /store/LOGS/SIM_DUMP/sim_tables.Fc.sql
    [ecs-ep.ecs-ep] [FrameworksShutdownHook/ecs-ep.ecs-ep]
    com.q1labs.semsources.filters.OffenseManagerFilter: [ERROR]
    [NOT:0000003000][127.0.0.1/- -] [-/- -]Error occurred stopping
    Offense manager
    [ecs-ep.ecs-ep] [FrameworksShutdownHook/ecs-ep.ecs-ep]
    java.lang.NullPointerException
    [ecs-ep.ecs-ep] [FrameworksShutdownHook/ecs-ep.ecs-ep]    at
    com.q1labs.sem.magi.OffenseManagerDelegate.stop(OffenseManagerDe
    legate.java:2004)
    [ecs-ep.ecs-ep] [FrameworksShutdownHook/ecs-ep.ecs-ep]    at
    com.q1labs.semsources.filters.OffenseManagerFilter.shutdown(Offe
    nseManagerFilter.java:295)
    [ecs-ep.ecs-ep] [FrameworksShutdownHook/ecs-ep.ecs-ep]    at
    com.q1labs.semsources.filters.OffenseManagerFilter.onShutdown(Of
    fenseManagerFilter.java:281)
    [ecs-ep.ecs-ep] [FrameworksShutdownHook/ecs-ep.ecs-ep]    at
    com.q1labs.frameworks.core.FrameworksContext.invokeShutdownHooks
    (FrameworksContext.java:869)
    [ecs-ep.ecs-ep] [FrameworksShutdownHook/ecs-ep.ecs-ep]    at
    com.q1labs.frameworks.core.FrameworksContext.access$000(Framewor
    ksContext.java:84)
    [ecs-ep.ecs-ep] [FrameworksShutdownHook/ecs-ep.ecs-ep]    at
    com.q1labs.frameworks.core.FrameworksContext$1.run(FrameworksCon
    text.java:839)
    [hostcontext.hostcontext] [reset_sim]
    com.q1labs.hostcontext.core.executor.BaseHostExecutor: [INFO]
    [NOT:0000006000][127.0.0.1/- -] [-/- -]Invoking ResetSim request
    [hostcontext.hostcontext] [reset_sim]
    com.q1labs.hostcontext.capabilities.ResetSim: [INFO]
    [NOT:0000006000][127.0.0.1/- -] [-/- -]SIM reset will begin in
    10 seconds
    

Local fix

  • No workaround available.
    

Problem summary

  • This issue was fixed in QRadar QRM QVM release of 7.3.1 patch 8
    and 7.3.2 patch 1.
    

Problem conclusion

  • This issue was fixed in QRadar QRM QVM release of 7.3.1 patch 8
    and 7.3.2 patch 1.
    

Temporary fix

Comments

APAR Information

  • APAR number

    IJ12883

  • Reported component name

    QRADAR SOFTWARE

  • Reported component ID

    5725QRDSW

  • Reported release

    728

  • Status

    CLOSED PER

  • PE

    NoPE

  • HIPER

    NoHIPER

  • Special Attention

    NoSpecatt / Xsystem

  • Submitted date

    2019-01-18

  • Closed date

    2019-07-03

  • Last modified date

    2019-07-03

  • APAR is sysrouted FROM one or more of the following:

  • APAR is sysrouted TO one or more of the following:

Fix information

  • Fixed component name

    QRADAR SOFTWARE

  • Fixed component ID

    5725QRDSW

Applicable component levels

[{"Business Unit":{"code":"BU048","label":"IBM Software"}, "Product":{"code":"SSBQAC","label":"IBM Security QRadar SIEM"},"Component":"","ARM Category":[],"Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"728","Edition":""}]

Document Information

Modified date:
03 July 2019