PM42345: VOB shared memory mutex never recovers and database processes loop in db_VISTA -926 timed out waiting for lock

Rational ClearCase Fix Pack (7.1.2.5) for version 7.1.2
Rational ClearCase Fix Pack (8.0.0.1) for version 8.0
Rational ClearCase Fix Pack 14 (7.1.2.14) for 7.1.2
Rational ClearCase Fix Pack 11 (8.0.0.11) for 8.0
Rational ClearCase Fix Pack 12 (8.0.0.12) for 8.0
Rational ClearCase Fix Pack 15 (7.1.2.15) for 7.1.2
Rational ClearCase Fix Pack 13 (8.0.0.13) for 8.0
Rational ClearCase Fix Pack 16 (7.1.2.16) for 7.1.2
Rational ClearCase Fix Pack 17 (7.1.2.17) for 7.1.2
Rational ClearCase Fix Pack 14 (8.0.0.14) for 8.0
Rational ClearCase Fix Pack 18 (7.1.2.18) for 7.1.2
Rational ClearCase Fix Pack 15 (8.0.0.15) for 8.0
Rational ClearCase Fix Pack 19 (7.1.2.19) for 7.1.2
Rational ClearCase Fix Pack 16 (8.0.0.16) for 8.0
Rational ClearCase Fix Pack 17 (8.0.0.17) for 8.0
Rational ClearCase Fix Pack 18 (8.0.0.18) for 8.0
Rational ClearCase Fix Pack 19 (8.0.0.19) for 8.0
Rational ClearCase Fix Pack 20 (8.0.0.20) for 8.0
Rational ClearCase Fix Pack 21 (8.0.0.21) for 8.0

APAR status

• Closed as program error.

Error description

• VOB shared memory mutex never recovers and database processes
  loop in db_VISTA -926 timed out waiting for lock
  
  
  ClearCase 7.1.2.x
     VOB Storage stored on a NAS Device
  
  
  RedHat 5 Update 5 and Update 6
  
  
  
  Symptoms:
  
  
  When using a VOB server on RedHat with NAS storage, the
  following may be seen within the db_server or vobrpc_server logs
  if a specific VOB becomes unresponsive:
  
  db_server(*****): Ok: CRRDM0532I Rollforward recovery using
  ?/ccstg/vobs/test.vbs/db/vista.tjf? started Mon Jun 13 12:31:12
  2011
  db_server(*****): Ok:
  db_server(*****): Ok: CRRDM0605I Rollforward recovery using
  ?/ccstg/vobs/test.vbs/db/vista.tjf? finished Mon Jun 13 12:31:12
  2011
  db_server(*****): Ok:
  .
  .
  2011-06-14T00:36:09+05:30 db_server(*****): Ok: CRRDM0656E ***
  db_VISTA database error -926 - problem in shared memory lock
  manager: Process 2291 timed out waiting for lock.
  2011-06-14T00:36:09+05:30 db_server(*****): Ok: Timeout getting
  lock in VOB ?/ccstg/vobs/test.vbs/db?.
  .
  .
  2011-06-14T00:41:09+05:30 db_server(*****): Ok: CRRDM0656E ***
  db_VISTA database error -926 - problem in shared memory lock
  manager: Process 2291 timed out waiting for lock.
  2011-06-14T00:41:09+05:30 db_server(*****): Ok: Timeout getting
  lock in VOB ?/ccstg/vobs/test.vbs/db?.
  
  
  The error message above repeats every 5 minutes for the same
  server process, and never recovers.  The VOB indicated within
  the message will not respond to any cleartool commands during
  this period of time.
  
  
  Workaround:  None
  

Local fix

Problem summary

• ****************************************************************
  * USERS AFFECTED:                                              *
  ****************************************************************
  * PROBLEM DESCRIPTION:                                         *
  ****************************************************************
  * RECOMMENDATION:                                              *
  ****************************************************************
  VOB shared memory mutex never recovers and database
  processes loop in db_VISTA -926 timed out waiting for lock
  
  
  ClearCase 7.1.2.x
     VOB Storage stored on a NAS Device
  
  
  RedHat 5 Update 5 and Update 6
  
  
  
  Symptoms:
  
  
  When using a VOB server on RedHat with NAS storage, the
  following may be seen within the db_server or vobrpc_server
  logs if a specific VOB becomes unresponsive:
  
  db_server(*****): Ok: CRRDM0532I Rollforward recovery using
  ?/ccstg/vobs/test.vbs/db/vista.tjf? started Mon Jun 13
  12:31:12 2011
  db_server(*****): Ok:
  db_server(*****): Ok: CRRDM0605I Rollforward recovery using
  ?/ccstg/vobs/test.vbs/db/vista.tjf? finished Mon Jun 13
  12:31:12 2011
  db_server(*****): Ok:
  .
  .
  2011-06-14T00:36:09+05:30 db_server(*****): Ok: CRRDM0656E
  *** db_VISTA database error -926 - problem in shared memory
  lock manager: Process 2291 timed out waiting for lock.
  2011-06-14T00:36:09+05:30 db_server(*****): Ok: Timeout
  getting lock in VOB ?/ccstg/vobs/test.vbs/db?.
  .
  .
  2011-06-14T00:41:09+05:30 db_server(*****): Ok: CRRDM0656E
  *** db_VISTA database error -926 - problem in shared memory
  lock manager: Process 2291 timed out waiting for lock.
  2011-06-14T00:41:09+05:30 db_server(*****): Ok: Timeout
  getting lock in VOB ?/ccstg/vobs/test.vbs/db?.
  
  
  The error message above repeats every 5 minutes for the same
  server process, and never recovers.  The VOB indicated
  within the message will not respond to any cleartool
  commands during this period of time.
  
  
  Workaround:  None
  

Problem conclusion

• A fix is available in ClearCase versions 7.1.1.8, 7.1.2.5
  and 8.0.0.1
  

Temporary fix

Comments

APAR Information

• APAR is sysrouted FROM one or more of the following:

• APAR is sysrouted TO one or more of the following:

Fix information

• Fixed component name

  CLEARCASE UNIX

• Fixed component ID

  5724G2901

Applicable component levels

• R712 PSN

     UP