IBM Support

IBM Spectrum Protect server fails to start on Linux after the OS upgrade

Troubleshooting


Problem

Spectrum Protect server may fail to start after upgrading the Linux operating system or updating the Kernel parameters.

Symptom

The following errors will be seen when starting the server in the foreground:

ANR0152I Database manager successfully started.
ANR0172I rdbdb.c(2519): Error encountered performing action ActivateDatabase.
ANR0162W Supplemental database diagnostic information:  -930:SQLSTATE 57011: Virtual storage or database resource is not available.
:--930 (SQL0930N  There is not enough storage available to process the statement.  SQLSTATE=57011).
ANR0163E dbiconn.c(1942): Database insufficient memory detected on 0:1.
ANR0162W Supplemental database diagnostic information:  -1:57011:-930 ([IBM][CLI Driver] SQL0930N  There is not enough storage available to process the statement.  SQLSTATE=57011).

Cause

Kernel parameters become incompatible with the server database requirements.

Environment

Operating System: Linux
Spectrum Protect: V8.1 and higher

Diagnosing The Problem

The following messages will be logged to the db2diag.log:
2020-06-19-06.20.30.517814-300 I55939006E564         LEVEL: Severe
PID     : 46704                TID : 139680351774464 PROC : db2sysc 0
INSTANCE: tsminst1             NODE : 000            DB   : TSMDB1
APPHDL  : 0-12                 APPID: *LOCAL.tsminst1.200619111851
AUTHID  : TSMINST1             HOSTNAME: XXXXXXX.XXXXXXX.com
EDUID   : 30                   EDUNAME: db2agent (TSMDB1) 0
FUNCTION: DB2 UDB, global services, sqzEDUObj::StartEDU, probe:10
RETCODE : ZRC=0x870F00F2=-2029059854=SQLO_NORES  
         "no resources to create process or thread"
2020-06-19-06.20.30.518726-300 I55941318E608         LEVEL: Error
PID     : 46704                TID : 139680351774464 PROC : db2sysc 0
INSTANCE: tsminst1             NODE : 000            DB   : TSMDB1
APPHDL  : 0-12                 APPID: *LOCAL.tsminst1.200619111851
AUTHID  : TSMINST1             HOSTNAME: XXXXXXX.XXXXXXX.com
EDUID   : 30                   EDUNAME: db2agent (TSMDB1) 0
FUNCTION: DB2 UDB, buffer pool services, sqlbinit, probe:604
MESSAGE : ZRC=0x850F0005=-2062614523=SQLO_NOSEG 
          "No Storage Available for allocation"
 DIA8305C Memory allocation failure occurred.

Resolving The Problem

To resolve the issue, complete the following steps:
  • Run the 'ipcs -l' command to list the current kernel parameter settings.
  • Check the output and determine what changes are required so that kernel parameters become sufficient for the server database . For more details, please click here
  • Edit the /etc/sysctl.conf with the new values ( Note:  maximum allowed number of kernel semaphore arrays (kernel.sem SEMMNI) is 32768, which is generally sufficient).
  • Make sure to run the "sysctl -p" command  as root to commit the changes immediately.
  • Start the the Spectrum Protect server instance.

Document Location

Worldwide

[{"Business Unit":{"code":"BU058","label":"IBM Infrastructure w\/TPS"},"Product":{"code":"SSEQVQ","label":"IBM Spectrum Protect"},"ARM Category":[{"code":"a8m50000000Ci5XAAS","label":"Server"}],"ARM Case Number":"TS003841436","Platform":[{"code":"PF016","label":"Linux"}],"Version":"All Version(s)","Line of Business":{"code":"LOB26","label":"Storage"}}]

Historical Number

TS003841436 ; TS003770230

Document Information

Modified date:
29 July 2020

UID

ibm16253899