IBM Support

IJ13367: LONG RUNNING TRANSACTION CAN CAUSE THE MAGISTRATE TO NOT SHUTDOWN PROPERLY AND OFFENSES CAN STOP GENERATING

Subscribe to this APAR

By subscribing, you receive periodic emails alerting you to the status of the APAR, along with a link to the fix after it becomes available. You can track this item individually or track all items by product.

Notify me when this APAR changes.

Notify me when an APAR for this component changes.

 

APAR status

  • Closed as program error.

Error description

  • It has been identified that a long running transaction can
    cause the Magistrate to not shutdown cleanly (during a Deploy
    function for example).  When this occurs, Offenses can stop
    being generated if the Magistrate is unable to start up as
    expected after the unclean shutdown.
    This has sometimes been observed when subsequent Deploy
    functions are attempted prior to the current Deploy being
    completed successfully.
    Messages similar to the following might be visible in
    /var/log/qradar.log when this issue is occurring:
    ecs-ep.ecs-ep] [MPC/CleanupAndPersistence[1]]
    com.q1labs.sem.magi.contrib.ModelPersister: [INFO]
    [NOT:0000006000][127.0.0.1/- -] [-/- -]Saving TX 0000002592
    0.66MB
    [ecs-ep.ecs-ep] [MPC/CleanupAndPersistence[1]]
    com.q1labs.sem.magi.contrib.ModelPersister: [INFO]
    [NOT:0000006000][127.0.0.1/- -] [-/- -]Harvested 10318 commands
    in 0:00:02.074
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000002592]
    com.q1labs.sem.magi.contrib.ModelPersister: [INFO]
    [NOT:0000006000][127.0.0.1/- -] [-/- -]Processing TX 0000002592
    (1/1) 0.66MB
    [hostcontext.hostcontext] [Thread-190754]
    com.q1labs.hostcontext.processmonitor.ProcessManager: [INFO]
    [NOT:0000006000][127.0.0.1/- -] [-/- -]Restarting necessary
    components for deploy.
    [hostcontext.hostcontext] [Thread-190754]
    com.q1labs.hostcontext.processmonitor.ProcessManager: [INFO]
    [NOT:0000006000][127.0.0.1/- -] [-/- -]Stopping process ecs-ep
    [ecs-ep.ecs-ep] [FrameworksShutdownHook/ecs-ep.ecs-ep]
    com.q1labs.sem.magi.OffenseManagerDelegate: [INFO]
    [NOT:0000006000][127.0.0.1/- -] [-/- -]Stopping chain manager
    [ecs-ep.ecs-ep] [FrameworksShutdownHook/ecs-ep.ecs-ep]
    com.q1labs.sem.magi.chain.DispatchChainManager: [INFO]
    [NOT:0000006000][127.0.0.1/- -] [-/- -]Requesting executor
    stop: Aggregator
    [ecs-ep.ecs-ep] [FrameworksShutdownHook/ecs-ep.ecs-ep]
    com.q1labs.sem.magi.chain.DispatchChainManager: [INFO]
    [NOT:0000006000][127.0.0.1/- -] [-/- -]Executor stopped:
    Aggregator
    [ecs-ep.ecs-ep] [FrameworksShutdownHook/ecs-ep.ecs-ep]
    com.q1labs.sem.magi.chain.DispatchChainManager: [INFO]
    [NOT:0000006000][127.0.0.1/- -] [-/- -]Requesting executor
    stop: ContextAndDefense
    [ecs-ep.ecs-ep] [FrameworksShutdownHook/ecs-ep.ecs-ep]
    com.q1labs.sem.magi.chain.DispatchChainManager: [INFO]
    [NOT:0000006000][127.0.0.1/- -] [-/- -]Executor stopped:
    ContextAndDefense
    [ecs-ep.ecs-ep] [FrameworksShutdownHook/ecs-ep.ecs-ep]
    com.q1labs.sem.magi.chain.DispatchChainManager: [INFO]
    [NOT:0000006000][127.0.0.1/- -] [-/- -]Requesting executor
    stop: DescriberAndAnnotator
    [ecs-ep.ecs-ep] [FrameworksShutdownHook/ecs-ep.ecs-ep]
    com.q1labs.sem.magi.chain.DispatchChainManager: [INFO]
    [NOT:0000006000][127.0.0.1/- -] [-/- -]Executor stopped:
    DescriberAndAnnotator
    [ecs-ep.ecs-ep] [FrameworksShutdownHook/ecs-ep.ecs-ep]
    com.q1labs.sem.magi.chain.DispatchChainManager: [INFO]
    [NOT:0000006000][127.0.0.1/- -] [-/- -]Requesting executor
    stop: SecurityAnalysis
    [ecs-ep.ecs-ep] [FrameworksShutdownHook/ecs-ep.ecs-ep]
    com.q1labs.sem.magi.chain.DispatchChainManager: [INFO]
    [NOT:0000006000][127.0.0.1/- -] [-/- -]Executor stopped:
    SecurityAnalysis
    [ecs-ep.ecs-ep] [FrameworksShutdownHook/ecs-ep.ecs-ep]
    com.q1labs.sem.magi.chain.DispatchChainManager: [INFO]
    [NOT:0000006000][127.0.0.1/- -] [-/- -]Requesting executor
    stop: CleanupAndPersistence
    [ecs-ep.ecs-ep] [FrameworksShutdownHook/ecs-ep.ecs-ep]
    com.q1labs.sem.magi.chain.DispatchChainManager: [INFO]
    [NOT:0000006000][127.0.0.1/- -] [-/- -]Executor needs more time
    to stop: CleanupAndPersistence with 1 tasks in the queue
    [ecs-ep.ecs-ep] [FrameworksShutdownHook/ecs-ep.ecs-ep]
    com.q1labs.sem.magi.chain.DispatchChainManager: [INFO]
    [NOT:0000006000][127.0.0.1/- -] [-/- -]executor name is:
    CleanupAndPersistence
    [ecs-ep.ecs-ep] [FrameworksShutdownHook/ecs-ep.ecs-ep]
    com.q1labs.sem.magi.chain.DispatchChainManager: [INFO]
    [NOT:0000006000][127.0.0.1/- -] [-/- -]the thread:
    MPC/CleanupAndPersistence[1] TIMED_WAITING
    [ecs-ep.ecs-ep] [FrameworksShutdownHook/ecs-ep.ecs-ep]
    com.q1labs.sem.magi.chain.DispatchChainManager: [INFO]
    [NOT:0000006000][127.0.0.1/- -] [-/- -]the stack trace:
    java.lang.Thread.sleep(Native Method)
    [ecs-ep.ecs-ep] [FrameworksShutdownHook/ecs-ep.ecs-ep]
    com.q1labs.sem.magi.chain.DispatchChainManager: [INFO]
    [NOT:0000006000][127.0.0.1/- -] [-/- -]the stack trace:
    java.lang.Thread.sleep(Thread.java:941)
    [ecs-ep.ecs-ep] [FrameworksShutdownHook/ecs-ep.ecs-ep]
    com.q1labs.sem.magi.chain.DispatchChainManager: [INFO]
    [NOT:0000006000][127.0.0.1/- -] [-/- -]the stack trace:
    com.q1labs.sem.magi.contrib.ModelPersister.waitforPersistence(Mo
    delPersister.java:720)
    [ecs-ep.ecs-ep] [FrameworksShutdownHook/ecs-ep.ecs-ep]
    com.q1labs.sem.magi.chain.DispatchChainManager: [INFO]
    [NOT:0000006000][127.0.0.1/- -] [-/- -]the stack trace:
    com.q1labs.sem.magi.contrib.ModelPersister.chainComplete(ModelPe
    rsister.java:346)
    [ecs-ep.ecs-ep] [FrameworksShutdownHook/ecs-ep.ecs-ep]
    com.q1labs.sem.magi.chain.DispatchChainManager: [INFO]
    [NOT:0000006000][127.0.0.1/- -] [-/- -]the stack trace:
    com.q1labs.sem.magi.chain.BaseChain.fireChainCompleteEvent(BaseC
    hain.java:203)
    [ecs-ep.ecs-ep] [FrameworksShutdownHook/ecs-ep.ecs-ep]
    com.q1labs.sem.magi.chain.DispatchChainManager: [INFO]
    [NOT:0000006000][127.0.0.1/- -] [-/- -]the stack trace:
    com.q1labs.sem.magi.chain.BaseChain.next(BaseChain.java:118)
    [ecs-ep.ecs-ep] [FrameworksShutdownHook/ecs-ep.ecs-ep]
    com.q1labs.sem.magi.chain.DispatchChainManager: [INFO]
    [NOT:0000006000][127.0.0.1/- -] [-/- -]the stack trace:
    com.q1labs.sem.magi.chain.BaseChain.run(BaseChain.java:150)
    [ecs-ep.ecs-ep] [FrameworksShutdownHook/ecs-ep.ecs-ep]
    com.q1labs.sem.magi.chain.DispatchChainManager: [INFO]
    [NOT:0000006000][127.0.0.1/- -] [-/- -]the stack trace:
    java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExec
    utor.java:1160)
    [ecs-ep.ecs-ep] [FrameworksShutdownHook/ecs-ep.ecs-ep]
    com.q1labs.sem.magi.chain.DispatchChainManager: [INFO]
    [NOT:0000006000][127.0.0.1/- -] [-/- -]the stack trace:
    java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExe
    cutor.java:635)
    [ecs-ep.ecs-ep] [FrameworksShutdownHook/ecs-ep.ecs-ep]
    com.q1labs.sem.magi.chain.DispatchChainManager: [INFO]
    [NOT:0000006000][127.0.0.1/- -] [-/- -]the stack trace:
    java.lang.Thread.run(Thread.java:811)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000002592]
    com.q1labs.sem.magi.contrib.commands.netid.OffenseUpdateNetidCom
    mand: [INFO] [NOT:0000006000][127.0.0.1/- -] [-/- -]Network
    update: Updating the offense, source and destination networks...
    [ecs-ep.ecs-ep] [FrameworksShutdownHook/ecs-ep.ecs-ep]
    com.q1labs.sem.magi.chain.DispatchChainManager: [INFO]
    [NOT:0000006000][127.0.0.1/- -] [-/- -]Executor needs more time
    to stop: CleanupAndPersistence with 1 tasks in the queue
    [ecs-ep.ecs-ep] [FrameworksShutdownHook/ecs-ep.ecs-ep]
    com.q1labs.sem.magi.chain.DispatchChainManager: [INFO]
    [NOT:0000006000][127.0.0.1/- -] [-/- -]executor name is:
    CleanupAndPersistence
    [ecs-ep.ecs-ep] [FrameworksShutdownHook/ecs-ep.ecs-ep]
    com.q1labs.sem.magi.chain.DispatchChainManager: [INFO]
    [NOT:0000006000][127.0.0.1/- -] [-/- -]the thread:
    MPC/CleanupAndPersistence[1] TIMED_WAITING
    

Local fix

  • No workaround available.
    

Problem summary

  • This issue was fixed in QRadar QRM QVM release of 7.3.2 Patch 3.
    

Problem conclusion

  • This issue was fixed in QRadar QRM QVM release of 7.3.2 Patch 3.
    

Temporary fix

Comments

APAR Information

  • APAR number

    IJ13367

  • Reported component name

    QRADAR SOFTWARE

  • Reported component ID

    5725QRDSW

  • Reported release

    728

  • Status

    CLOSED PER

  • PE

    NoPE

  • HIPER

    NoHIPER

  • Special Attention

    NoSpecatt / Xsystem

  • Submitted date

    2019-02-07

  • Closed date

    2019-07-25

  • Last modified date

    2019-07-25

  • APAR is sysrouted FROM one or more of the following:

  • APAR is sysrouted TO one or more of the following:

Fix information

  • Fixed component name

    QRADAR SOFTWARE

  • Fixed component ID

    5725QRDSW

Applicable component levels

[{"Business Unit":{"code":"BU048","label":"IBM Software"}, "Product":{"code":"SSBQAC","label":"IBM Security QRadar SIEM"},"Component":"","ARM Category":[],"Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"728","Edition":""}]

Document Information

Modified date:
25 July 2019