IBM Support

IJ09472: OFFENSES CAN FAIL TO GENERATE AFTER CHANGES ARE MADE TO THE NETWORK HIERARCHY

Subscribe to this APAR

By subscribing, you receive periodic emails alerting you to the status of the APAR, along with a link to the fix after it becomes available. You can track this item individually or track all items by product.

Notify me when this APAR changes.

Notify me when an APAR for this component changes.

 

APAR status

  • Closed as program error.

Error description

  • It has been identified that after a Network Hierarchy change
    has been saved, Offenses can sometimes stop being generated
    within QRadar.
    
    Messages similar to the following might be visible when this
    issue is occurring:
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000001531]
    com.q1labs.sem.magi.contrib.ModelPersister: [WARN]
    [NOT:0180002100][127.0.0.1/- -] [-/- -]Exception encounted when
    executing transaction 15
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000001531]
    com.q1labs.sem.magi.contrib.PersistenceException: Failed to
    persist sem model
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000001531]    at
    com.q1labs.sem.magi.contrib.ModelPersister.processCurrentTransac
    tion(ModelPersister.java:640)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000001531]    at
    com.q1labs.sem.magi.contrib.ModelPersister.processCommands(Model
    Persister.java:417)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000001531]    at
    com.q1labs.sem.magi.contrib.ModelPersister.process(ModelPersiste
    r.java:257)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000001531]    at
    com.q1labs.sem.magi.contrib.TxStateManager.playCurrent(TxStateMa
    nager.java:259)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000001531]    at
    com.q1labs.sem.magi.contrib.ModelPersister$Persister.playCurrent
    (ModelPersister.java:2854)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000001531]    at
    com.q1labs.sem.magi.contrib.ModelPersister$Persister.run(ModelPe
    rsister.java:2810)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000001531] Caused by:
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000001531]
    java.sql.BatchUpdateException: Batch entry 0 UPDATE offense SET
    end_time=1512568735207, credibility=3, relevance=4, severity=8,
    tokens='1|3318|3536', event_count=325,
    naming_contributions='Multiple Exploit/Malware Types Targeting
    a Single Source', direction_code=3, active_code=1,
    start_time=1512566578233, target_count=2, first_target_ip=0,
    attacker_id=13330, category_count=4, security_category_count=4,
    policy_category_count=0, target_offenses_network_details_id=88,
    attacker_offenses_network_details_id=14,
    naming_override='FALSE', target_network_details_count=2,
    remote_target_count=1,
    category_naming_contributions='PROTOCOL-POP USER format string
    attempt,Buffer Overflow', attacker_count=83, username_count=0,
    mpc_query_event_count=89, device_count=170,
    source='1111261851', rule_id=100113, offense_mapper=1,
    crs_update_count=1, flow_count=0, raw_domain_info=0,
    first_target_domain_id=0, historical='FALSE',
    first_target_ipv6=NULL WHERE id = 32 was aborted: ERROR: insert
    or update on table "offense" violates foreign key constraint
    "fka3aef2aac5255a31"
    Detail: Key (target_offenses_network_details_id)=(88) is not
    present in table "network_details".  Call getNextException to
    see other errors in the batch.
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000001531]    at
    org.postgresql.jdbc.BatchResultHandler.handleError(BatchResultHa
    ndler.java:148)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000001531]    at
    org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExe
    cutorImpl.java:2126)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000001531]    at
    org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorIm
    pl.java:469)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000001531]    at
    org.postgresql.jdbc.PgStatement.executeBatch(PgStatement.java:79
    1)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000001531]    at
    org.postgresql.jdbc.PgPreparedStatement.executeBatch(PgPreparedS
    tatement.java:1547)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000001531]    at
    com.q1labs.sem.magi.contrib.ModelPersister.flushDirtyOffenses(Mo
    delPersister.java:1912)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000001531]    at
    com.q1labs.sem.magi.contrib.ModelPersister.persistDirtyModel(Mod
    elPersister.java:1309)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000001531]    at
    com.q1labs.sem.magi.contrib.ModelPersister.process(ModelPersiste
    r.java:1154)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000001531]    at
    com.q1labs.sem.magi.contrib.ModelPersister.processCurrentTransac
    tion(ModelPersister.java:543)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000001531]    ... 5 more
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000001531] Caused by:
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000001531]
    org.postgresql.util.PSQLException: ERROR: insert or update on
    table "offense" violates foreign key constraint
    "fka3aef2aac5255a31"
    Detail: Key (target_offenses_network_details_id)=(88) is not
    present in table "network_details".
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000001531]    at
    org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(Qu
    eryExecutorImpl.java:2412)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000001531]    at
    org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExe
    cutorImpl.java:2125)
    [ecs-ep.ecs-ep] [MPC/PersisterThread@0000001531]    ... 12 more
    

Local fix

  • Performing a restart of the Console's ecs-ep process from an
    SSH session or doing a Deploy Full Configuration (User
    Interface) should correct this issue:
    
    # systemctl restart ecs-ep
    
    or
    
    QRadar User Interface -> Admin -> Advanced drop down -> Deploy
    Full Configuration
    
    *Note - Proper QRadar funcitionality requires all neccessary
    QRadar services to be in running state.  Restarting services or
    Performing a Deploy Full Configuration can cause an interuption
    of collection, processing and/or storage of events/flows until
    all required services are functioning as required.
    

Problem summary

  • This issue was fixed in QRadar QRM QVM release of 7.3.1 Patch 5
    and 7.3.2 GA.
    

Problem conclusion

  • This issue was fixed in QRadar QRM QVM release of 7.3.1 Patch 5
    and 7.3.2 GA.
    

Temporary fix

Comments

APAR Information

  • APAR number

    IJ09472

  • Reported component name

    QRADAR SOFTWARE

  • Reported component ID

    5725QRDSW

  • Reported release

    731

  • Status

    CLOSED PER

  • PE

    NoPE

  • HIPER

    NoHIPER

  • Special Attention

    NoSpecatt / Xsystem

  • Submitted date

    2018-09-19

  • Closed date

    2019-02-26

  • Last modified date

    2019-02-26

  • APAR is sysrouted FROM one or more of the following:

  • APAR is sysrouted TO one or more of the following:

Fix information

  • Fixed component name

    QRADAR SOFTWARE

  • Fixed component ID

    5725QRDSW

Applicable component levels

[{"Business Unit":{"code":"BU048","label":"IBM Software"}, "Product":{"code":"SSBQAC","label":"IBM Security QRadar SIEM"},"Component":"","ARM Category":[],"Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"731","Edition":""}]

Document Information

Modified date:
26 February 2019