IBM Support

Spectrum Protect Server fails to start with ANR0169E SQL12225N

Troubleshooting


Problem

Startup of the Spectrum Protect server may fail with the following error:
SQL1225N  The request failed because an operating system process, thread, or swap space limit was reached.  SQLSTATE=57049

Symptom

The following output may be seen when the server fails to start:
ANR0172I rdbdb.c(2516): Error encountered performing action ActivateDatabase.
ANR0162W Supplemental database diagnostic information:  -1225:SQLSTATE 57049:
The operating system process limit has been reached.:-1225 (SQL1225N  The request
failed because an operating system process, thread, or swap space limit was reached.  SQLSTATE=57049).
ANR0171I dbiconn.c(1936): Error detected on 0:1, database in evaluation mode.
ANR0169E An unexpected error has occurred and the IBM Spectrum Protect server is stopping.
ANR0162W Supplemental database diagnostic information:  -1:57049:-1225 ([IBM][CLI Driver] SQL1225N 
The request failed because an operating system process, thread, or swap space limit was reached.  SQLSTATE=57049
In the db2diag.log you may see the following errors when the server fails to start:
 2019-11-14-15.40.12.347963+660 E33174E486            LEVEL: Severe
PID     : 119306               TID : 139867115742976 PROC : db2sysc 0
INSTANCE: tsminst1             NODE : 000
HOSTNAME: tsmserver.local
FUNCTION: DB2 UDB, oper system services, sqloEDUEntry, probe:10
CALLED  : DB2 UDB, oper system services, sqloGetShrEDUWaitElem
RETCODE : ZRC=0x850F0081=-2062614399=SQLO_SSEM_EXCEED_MAX
          "Requesting too many semaphores"
          DIA8336C Requested too many semaphores.
2019-11-14-15.40.12.348786+660 I34782E599            LEVEL: Error
PID     : 119306               TID : 139898816292608 PROC : db2sysc 0
INSTANCE: tsminst1             NODE : 000            DB   : TSMDB1
APPHDL  : 0-7                  APPID: *LOCAL.tsminst1.191114043955
AUTHID  : TSMINST1             HOSTNAME: tsmserver.local
EDUID   : 18                   EDUNAME: db2agent (TSMDB1) 0
FUNCTION: DB2 UDB, base sys utilities, sqeAgent::startAgent, probe:2846
RETCODE : ZRC=0x870F00F2=-2029059854=SQLO_NORES
          "no resources to create process or thread"
DATA #1 : signed integer, 4 bytes
1
2019-11-14-15.40.12.349020+660 I35382E640            LEVEL: Severe
PID     : 119306               TID : 139898816292608 PROC : db2sysc 0
INSTANCE: tsminst1             NODE : 000            DB   : TSMDB1
APPHDL  : 0-7                  APPID: *LOCAL.tsminst1.191114043955
AUTHID  : TSMINST1             HOSTNAME: tsmserver.local
EDUID   : 18                   EDUNAME: db2agent (TSMDB1) 0
FUNCTION: DB2 UDB, base sys utilities, sqeAgentServices::RequestAgentForAppl, probe:2163
RETCODE : ZRC=0xFFFFFB37=-1225
                     SQL1225N  The request failed because an operating system process,
                     thread, or swap space limit was reached.

Cause

The linux kernel  SEMIPHORE settings  are not correctly configured

Environment

Spectrum Protect Server on Linux

Diagnosing The Problem

Run the following command to check linux kernel settings:
ipcs -l
The output will look similar to the following:
   ------ Shared Memory Limits --------
   max number of segments = 4096                            // SHMMNI    
   max seg size (kbytes) = 32768                                // SHMMAX
   max total shared memory (kbytes) = 8388608  // SHMALL
   min seg size (bytes) = 1
   ------ Semaphore Limits --------
   max number of arrays = 1024                                // SEMMNI
   max semaphores per array = 250                        // SEMMSL
   max semaphores system wide = 256000         // SEMMNS
   max ops per semop call = 32                               // SEMOPM
   semaphore max value = 32767
   ------ Messages: Limits --------
   max queues system wide = 1024                      // MSGMNI
   max size of message (bytes) = 65536             // MSGMAX
   default max size of queue (bytes) = 65536   // MSGMNB

Resolving The Problem

Here are the suggested volues for the linux kernel SEMIPHORE settings:
kernel.sem (SEMMNI) 16384
kernel.sem (SEMMSL) 250
kernel.sem (SEMMNS) 256 000
kernel.sem (SEMOPM) 32
Compare the settings and make any needed changes. Once the settings are changed, stop/restart DB2. The Spectrum Protect server should no longer fail to start with the errors discussed in this article.

Document Location

Worldwide

[{"Business Unit":{"code":"BU058","label":"IBM Infrastructure w\/TPS"},"Product":{"code":"SSEQVQ","label":"IBM Spectrum Protect"},"Component":"Server","Platform":[{"code":"PF016","label":"Linux"}],"Version":"All Versions","Edition":"","Line of Business":{"code":"LOB26","label":"Storage"}}]

Product Synonym

Tsm Tivoli Storage Manager

Document Information

Modified date:
09 December 2020

UID

ibm11107405