IBM Support

IV94508: POSTGRES DEADLOCKS CAN SOMETIMES LEAD TO SEARCH DATA RESULT INCONSISTENCY

Subscribe to this APAR

By subscribing, you receive periodic emails alerting you to the status of the APAR, along with a link to the fix after it becomes available. You can track this item individually or track all items by product.

Notify me when this APAR changes.

Notify me when an APAR for this component changes.

 

APAR status

  • Closed as program error.

Error description

  • Postgres deadlock messages related to TrafficAnalysis and
    SourceServices have been observed in some customer environments
    where search data results are seen to be inconsistent.
    Messages similar to the following might be visible in
    /var/log/qradar.error when this issue is occuring:
    [tomcat] [TrafficAnalysisServices_PersisterTimer]
    com.q1labs.rpcservices.TrafficAnalysisServices: [ERROR] SQL
    Exception: Batch entry 274 UPDATE sensordevice SET eps60s = 1,
    timestamp_eps60s = '2017-02-14 21:10:10.673000 +01:00:00' WHERE
    id = 10460 was aborted.  Call getNextException to see the
    cause. {prepstmnt -115318166 UPDATE sensordevice SET eps60s =
    ?, timestamp_eps60s = ? WHERE id = ?} [code=0, state=40P01]
    [tomcat] [TrafficAnalysisServices_PersisterTimer]
    org.apache.openjpa.lib.jdbc.ReportingSQLException: Batch entry
    274 UPDATE sensordevice SET eps60s = 1, timestamp_eps60s =
    '2017-02-14 21:10:10.673000 +01:00:00' WHERE id = 10460 was
    aborted. Call getNextException to see the cause. {prepstmnt
    -115318166 UPDATE sensordevice SET eps60s = ?, timestamp_eps60s
    = ? WHERE id = ?} [code=0, state=40P01]
    [tomcat] [TrafficAnalysisServices_PersisterTimer]    at
    org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(Logg
    ingConnectionDecorator.java:219)
    [tomcat] [TrafficAnalysisServices_PersisterTimer]    at
    org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(Logg
    ingConnectionDecorator.java:207)
    [tomcat] [TrafficAnalysisServices_PersisterTimer]    at
    org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$12
    00(LoggingConnectionDecorator.java:59)
    [tomcat] [TrafficAnalysisServices_PersisterTimer]    at
    org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingCo
    nnection$LoggingPreparedStatement.executeBatch(LoggingConnection
    Decorator.java:1215)
    [tomcat] [TrafficAnalysisServices_PersisterTimer]    at
    org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeB
    atch(DelegatingPreparedStatement.java:247)
    [tomcat] [TrafficAnalysisServices_PersisterTimer]    at
    org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeB
    atch(DelegatingPreparedStatement.java:247)
    [tomcat] [TrafficAnalysisServices_PersisterTimer]    at
    org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedSt
    atement.executeBatch(JDBCStoreManager.java:1783)
    [tomcat] [TrafficAnalysisServices_PersisterTimer]    at
    org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeB
    atch(DelegatingPreparedStatement.java:247)
    [tomcat] [TrafficAnalysisServices_PersisterTimer]    at
    com.q1labs.frameworks.session.PreparedStatementWrapper.executeBa
    tch(PreparedStatementWrapper.java:265)
    [tomcat] [TrafficAnalysisServices_PersisterTimer]    at
    com.q1labs.rpcservices.TrafficAnalysisServices$PersistTrafficAna
    lysisServicesUpdateTask.persistECLogSourceStats(TrafficAnalysisS
    ervices.java:367)
    [tomcat] [TrafficAnalysisServices_PersisterTimer]    at
    com.q1labs.rpcservices.TrafficAnalysisServices$PersistTrafficAna
    lysisServicesUpdateTask.run(TrafficAnalysisServices.java:185)
    [tomcat] [TrafficAnalysisServices_PersisterTimer]    at
    java.util.TimerThread.mainLoop(Timer.java:567)
    [tomcat] [TrafficAnalysisServices_PersisterTimer]    at
    java.util.TimerThread.run(Timer.java:517)
    [tomcat] [SourceServices_PersisterTimer]
    com.q1labs.rpcservices.TrafficAnalysisServices: [ERROR]
    [NOT:0000003000][127.0.0.1/- -] [-/- -]Exception occurred
    attempting to persist protocol status updates.
    [tomcat] [SourceServices_PersisterTimer]
    org.apache.openjpa.lib.jdbc.ReportingSQLException: ERROR:
    deadlock detected Detail: Process 12501 waits for ShareLock on
    transaction 2089146179; blocked by process 12479.Process 12479
    waits for ShareLock on transaction 2089145478; blocked by
    process 12501.   Hint: See server log for query details.
    {prepstmnt 1742558542 UPDATE sensordevice SET status_record=?
    WHERE id=?;} [code=0, state=40P01]
    [tomcat] [SourceServices_PersisterTimer]    at
    org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(Logg
    ingConnectionDecorator.java:219)
    [tomcat] [SourceServices_PersisterTimer]    at
    org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(Logg
    ingConnectionDecorator.java:195)
    [tomcat] [SourceServices_PersisterTimer]    at
    org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$10
    00(LoggingConnectionDecorator.java:59)
    [tomcat] [SourceServices_PersisterTimer]    at
    org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingCo
    nnection$LoggingPreparedStatement.executeUpdate(LoggingConnectio
    nDecorator.java:1134)
    [tomcat] [SourceServices_PersisterTimer]    at
    org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeU
    pdate(DelegatingPreparedStatement.java:272)
    [tomcat] [SourceServices_PersisterTimer]    at
    org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeU
    pdate(DelegatingPreparedStatement.java:272)
    [tomcat] [SourceServices_PersisterTimer]    at
    org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedSt
    atement.executeUpdate(JDBCStoreManager.java:1765)
    [tomcat] [SourceServices_PersisterTimer]    at
    org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeU
    pdate(DelegatingPreparedStatement.java:272)
    [tomcat] [SourceServices_PersisterTimer]    at
    com.q1labs.frameworks.session.PreparedStatementWrapper.executeUp
    date(PreparedStatementWrapper.java:280)
    [tomcat] [SourceServices_PersisterTimer]    at
    com.q1labs.rpcservices.SourceServices$PersistSourceServicesUpdat
    eTask.persistUpdate(SourceServices.java:205)
    [tomcat] [SourceServices_PersisterTimer]    at
    com.q1labs.rpcservices.SourceServices$PersistSourceServicesUpdat
    eTask.run(SourceServices.java:151)
    [tomcat] [SourceServices_PersisterTimer]    at
    java.util.TimerThread.mainLoop(Timer.java:567)
    [tomcat] [SourceServices_PersisterTimer]    at
    java.util.TimerThread.run(Timer.java:517)
    [tomcat] [SourceServices_PersisterTimer]
    com.q1labs.rpcservices.TrafficAnalysisServices: [ERROR] SQL
    Exception: ERROR: deadlock detected
    

Local fix

  • No workaround available.
    

Problem summary

  • This issue was fixed in QRadar QRM QVM release of 7.3.1 patch 8
    and 7.3.2 GA.
    

Problem conclusion

  • This issue was fixed in QRadar QRM QVM release of 7.3.1 patch 8
    and 7.3.2 GA
    

Temporary fix

Comments

APAR Information

  • APAR number

    IV94508

  • Reported component name

    QRADAR SOFTWARE

  • Reported component ID

    5725QRDSW

  • Reported release

    727

  • Status

    CLOSED PER

  • PE

    NoPE

  • HIPER

    NoHIPER

  • Special Attention

    NoSpecatt / Xsystem

  • Submitted date

    2017-03-23

  • Closed date

    2019-05-14

  • Last modified date

    2019-05-14

  • APAR is sysrouted FROM one or more of the following:

  • APAR is sysrouted TO one or more of the following:

Fix information

  • Fixed component name

    QRADAR SOFTWARE

  • Fixed component ID

    5725QRDSW

Applicable component levels

[{"Business Unit":{"code":"BU048","label":"IBM Software"}, "Product":{"code":"SSBQAC","label":"IBM Security QRadar SIEM"},"Component":"","ARM Category":[],"Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"727","Edition":""}]

Document Information

Modified date:
14 May 2019