IC81119: DEDUP DELETION THREADS DISABLED. RECLAMATION ON DEDUP POOL NOT RUNNING. DEDUP STORAGE POOL FILLING.

APAR status

• Closed as program error.

Error description

• The Tivoli Storage Manager 6.x server has deduplication deletion
  threads that remove chunks that have been dereferenced either by
  expiration or data movement processes. If these threads stop
  running the dedup chunks will not be removed. This will lead to
  reclamation not being able to complete and dedup storage pools
  to fill unexpectedly. The dedup deletion thread processing is
  very resilient except for one point at the beginning of their
  processing. If a problem should occur that causes this initial
  processing to fail the threads will terminate and not attempt to
  start again until the server is restarted. Running out of log
  space or DB2 locklist failures are two failures that have been
  reported as leading to this thread failure. The server needs to
  be more resilient at this thread beginning point to avoid
  terminating these critical threads on a server using
  deduplication. Message indicating the termination of these
  threads should also be externalized.
  Tivoli Storage Manager Versions Affected: TSM server 6.x using
  deduplication
  Customer/L2 Diagnostics (If Applicable)
  Before using the SHOW DEDUPDELETEINFO commend referenced below
  please ensure you have the fix for IC79957 in place to avoid the
  potential crash addressed by this APAR.
  When problem has occurred SHOW DEDUPDELETEINFO returns:
  The dedup deletions have been disabled.
  Normal show SHOW DEDUPDELETEINFO returns something like:
   ****Dedup Deletion General Status****
   Number of worker threads             : 4
   Number of active worker threads    : 0
   Number of chunks waiting in queue : 0
      ****Dedup Deletion Worker Info****
      Worker thread 1 is not active
      Worker thread 2 is not active
      Worker thread 3 is not active
      Worker thread 4 is not active
      ------------------------------------------
      Total worker chunks queued    : 0
      Total worker chunks deleted    : 0
  Server Actlog for reported case where exhausted log space is the
  catalyst shows:
  ANR0171I tbrsql.c(1430): Error detected on 2:2, database in
  evaluation mode.
  ANR0103E bfdedup.c(9183): Error 2157 updating row in table
  "BF.Queued.Chunks".
  ANR0171I dbitxn.c(695): Error detected on 0:2,  database in
  evaluation mode.
  ANR0130E dbitxn.c(1710): Server LOG space exhausted.
  ANR0162W Supplemental database diagnostic information:
  -1:40003:-99999 ([IBM][CLI Driver]
                      CLI0108E Communication link failure.
  SQLSTATE=40003).
  01/18/2012 13:06:44 ANR0171I dbiconn.c(1784): Error detected on
  0:2, database in evaluation mode.
  Initial Impact: Medium
  Additional Keywords:
  TSM deduplicated
  

Local fix

Problem summary

• ****************************************************************
  * USERS AFFECTED: All Tivoli Storage Manager server users.     *
  ****************************************************************
  * PROBLEM DESCRIPTION: See ERROR DESCRIPTION.                  *
  ****************************************************************
  * RECOMMENDATION: Apply fixing level when available.           *
  *                 This problem is currently projected to be    *
  *                 fixed in levels 6.2.4 and 6.3.1.             *
  *                 Note that this is subject to change at       *
  *                 the discretion of IBM.                       *
  ****************************************************************
  *
  

Problem conclusion

• The described problem has been resolved.
  
  AFFECTED PLATFORMS:
  AIX, HP-UX, Solaris, Linux, and Windows.
  

Temporary fix

Comments

APAR Information

• APAR is sysrouted FROM one or more of the following:

• APAR is sysrouted TO one or more of the following:

Fix information

• Fixed component name

  TSM SERVER

• Fixed component ID

  5698ISMSV

Applicable component levels

• R61A PSY

     UP

• R61H PSY

     UP

• R61L PSY

     UP

• R61S PSY

     UP

• R61W PSY

     UP

• R62A PSY

     UP

• R62H PSY

     UP

• R62L PSY

     UP

• R62S PSY

     UP

• R62W PSY

     UP

• R63A PSY

     UP

• R63H PSY

     UP

• R63L PSY

     UP

• R63S PSY

     UP

• R63W PSY

     UP