Newsletters
Abstract
If replication failover is configured for a client node, the version 8.1.15.0 backup-archive client and applications that use the 8.1.15.0 API crash with a "double free" error message during startup.
Content
The problem
If IBM Spectrum Protect Backup-Archive Client version 8.1.15 is install on a Linux node that is configured for automatic failover to a replication server, the client crashes during startup.
One of the following sets of messages might accompany the crash:
free(): double free detected in tcache 2
Aborted (core dumped)
Aborted (core dumped)
*** Error in `xxxx': double free or corruption (!prev): nxnnnnnnnnnnnnnnnn ***
======= Backtrace: =========
...
======= Memory map: ========
...
======= Backtrace: =========
...
======= Memory map: ========
...
In the second message, 'xxxx' is the module that crashed, such as dsmc, and nxnnnnnnnnnnnnnnnn is a hexadecimal number.
The dsmerror.log file might include this message:
<date> <time> ANS0361I DIAG: main thread, fatal error, signal 6
The following stack trace is representative of the problem.
#0 0x00007f04e2c06387 in raise () from /lib64/libc.so.6
#1 0x00007f04e2c07a78 in abort () from /lib64/libc.so.6
#2 0x0000000000712a74 in psTrapHandler(int) ()
#3 <signal handler called>
#4 0x00007f04e2c06387 in raise () from /lib64/libc.so.6
#5 0x00007f04e2c07a78 in abort () from /lib64/libc.so.6
#6 0x00007f04e2c48ed7 in __libc_message () from /lib64/libc.so.6
#7 0x00007f04e2c51299 in _int_free () from /lib64/libc.so.6
#8 0x00007f04e2c3e1b7 in fclose@@GLIBC_2.2.5 () from /lib64/libc.so.6
#9 0x00000000006efe2f in clientOptions::optSaveReplConnInfo() ()
#10 0x000000000068103f in cuSignOnEResp(Sess_o*) ()
#11 0x0000000000652b75 in scSignOnTheSession(Sess_o*) ()
#12 0x0000000000658ce3 in NegotiateSession(Sess_o*) ()
#13 0x0000000000653648 in OpenSess(Sess_o*, bool) ()
#14 0x0000000000654ad0 in Logon(Sess_o*) ()
#15 0x0000000000656c36 in CheckSession(Sess_o*, sessLoadPolicy_t) ()
#16 0x000000000043e5fe in dscInit(int, char**, cliType_t) ()
#17 0x000000000043eb5b in dscmain(int, char**) ()
#18 0x000000000043b3fa in main ()
The signature elements are clientOptions::optSaveReplConnInfo() and fclose, as shown in frames 9 and 8 of the example stack trace.
The crash can occur in the command-line client, the remote agent, or the API. Thus IBM Spectrum Protect Data Protection products and other API applications are also affected by this problem.
The problem is documented by APAR IT41452.
Note: The APAR is not publicly visible until it is closed.
Levels affected
- IBM Spectrum Protect Backup-Archive Client for Linux, version 8.1.15.0
- IBM Spectrum Protect for Virtual Environments: Data Protection for VMware on Linux, version 8.1.15.0
Immediate action
If your client nodes are configured for replication, do not install 8.1.15 until a fix for IT41452 is available.
If 8.1.15 is already installed and the crash occurs, follow the instructions at the following document to collect diagnostic data:
Note: Skip the step to collect the dsminfo.txt file. The step does not work because of the crash.
One of the diagnostic files, getcoreinfo.txt, includes a stack trace. Compare the stack trace in getcoreinfo.txt to the stack trace in the "Problem" section of this flash to verify it is a match for APAR IT41452.
An immediate workaround is to disable automatic failover by adding the following line to the appropriate servername stanzas in /opt/tivoli/tsm/client/ba/bin/dsm.sys:
usereplicationfailover no
However, if the client needs to fail over to the replication target server, you must manually configure the client settings to connect to the target server.
Important: After you install the fix for APAR IT41452, remove the usereplicationfailover no option.
For further assistance with diagnosing the crash or circumventing the problem, contact IBM Support.
Fix
A fix is targeted for mid-August, subject to change at IBM's discretion.
[{"Type":"MASTER","Line of Business":{"code":"LOB26","label":"Storage"},"Business Unit":{"code":"BU058","label":"IBM Infrastructure w\/TPS"},"Product":{"code":"SSEQVQ","label":"IBM Spectrum Protect"},"ARM Category":[{"code":"a8m3p000000hAZtAAM","label":"API"},{"code":"a8m3p000000hAZoAAM","label":"B\/A Client"}],"ARM Case Number":"","Platform":[{"code":"PF016","label":"Linux"}],"Version":"8.1.15"},{"Type":"MASTER","Line of Business":{"code":"LOB26","label":"Storage"},"Business Unit":{"code":"BU058","label":"IBM Infrastructure w\/TPS"},"Product":{"code":"SSERB6","label":"IBM Spectrum Protect for Virtual Environments"},"ARM Category":[{"code":"a8m3p000000hAZoAAM","label":"B\/A Client"}],"Platform":[{"code":"PF016","label":"Linux"}],"Version":"8.1.15"}]
Was this topic helpful?
Document Information
Modified date:
19 July 2022
UID
ibm16605073