IBM Support

Hearbeat Error "should_drop_message: attempted replay attack"

Troubleshooting


Problem

Hearbeat shutdown due to attempted replay attack errror.

Symptom

The heartbeat can't start up with following error message in /var/log/message.

Feb 2 16:00:15 NZ12345-H1 heartbeat: [15951]: ERROR: should_drop_message: attempted replay attack [NZ12345-h2]? [gen = 1421181723, curgen = 1421181724]
Feb 2 16:00:17 NZ12345-H1 heartbeat: [15951]: ERROR: should_drop_message: attempted replay attack [NZ12345-h2]? [gen = 1421181723, curgen = 1421181724]
Feb 2 16:00:19 NZ12345-H1 heartbeat: [15951]: ERROR: should_drop_message: attempted replay attack [NZ12345-h2]? [gen = 1421181723, curgen = 1421181724]
Feb 2 16:00:21 NZ12345-H1 heartbeat: [15951]: ERROR: should_drop_message: attempted replay attack [NZ12345-h2]? [gen = 1421181723, curgen = 1421181724]
Feb 2 16:00:23 NZ12345-H1 heartbeat: [15951]: ERROR: should_drop_message: attempted replay attack [NZ12345-h2]? [gen = 1421181723, curgen = 1421181724]

Feb 2 16:34:58 NZ12345-H1 heartbeat: [3205]: info: killing HBFIFO process 3214 with signal 15
Feb 2 16:34:58 NZ12345-H1 heartbeat: [3205]: info: killing HBWRITE process 3215 with signal 15
Feb 2 16:34:58 NZ12345-H1 heartbeat: [3205]: info: killing HBREAD process 3216 with signal 15
Feb 2 16:34:58 NZ12345-H1 heartbeat: [3205]: info: killing HBWRITE process 3217 with signal 15
Feb 2 16:34:58 NZ12345-H1 heartbeat: [3205]: info: killing HBREAD process 3218 with signal 15
Feb 2 16:34:58 NZ12345-H1 heartbeat: [3205]: info: Core process 3214 exited. 5 remaining
Feb 2 16:34:58 NZ12345-H1 heartbeat: [3205]: info: Core process 3215 exited. 4 remaining
Feb 2 16:34:58 NZ12345-H1 heartbeat: [3205]: info: Core process 3216 exited. 3 remaining
Feb 2 16:34:58 NZ12345-H1 heartbeat: [3205]: info: Core process 3217 exited. 2 remaining
Feb 2 16:34:58 NZ12345-H1 heartbeat: [3205]: info: Core process 3218 exited. 1 remaining
Feb 2 16:34:58 NZ12345-H1 heartbeat: [3205]: info: NZ12345-h1 Heartbeat shutdown complete.

Resolving The Problem

1.login HA1 as root user, stop heartbeat service if it is still running

#ssh ha2 service heartbeat stop; service heartbeat stop

2. delete the hb_generation on HA1 and HA2


#rm /var/lib/heartbeat/hb_generation
#ssh ha2 rm /var/lib/heartbeat/hb_generation

3. Restart the heartbeat service on HA1 and HA2

#ssh ha2 service heartbeat start; service heartbeat start

[{"Product":{"code":"SSULQD","label":"IBM PureData System"},"Business Unit":{"code":"BU053","label":"Cloud & Data Platform"},"Component":"Cluster","Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"1.0.0","Edition":"","Line of Business":{"code":"LOB10","label":"Data and AI"}}]

Document Information

Modified date:
17 October 2019

UID

swg21696434