IC88411: "AUDIT VOLUME" ON A DEDUPLICATED STGPOOL VOLUME MAY RESULT IN ANR9999D MESSAGE AND CAN MARK FILES INVALIDLY AS DAMAGED

APAR status

• Closed as program error.

Error description

• Prior to Tivoli Storage Manager version 6.3.3, the AUDIT VOLUME
  command does not sufficiently audit volumes of deduplicated
  storage pools.
  
  Prior to this level of the server, the audit process does not
  follow and validate the linked chunks that exist on the
  deduplicated volume. In addition, and in rare cases, the audit
  process might also result in an invalid ANR9999D message being
  issued. In this case, files are invalidly being marked as
  damaged on the volume.
  
  
  Customer/L2 Diagnostics
  Example actlog output of an AUDIT VOLUME from a 6.2.4.0 server:
  
   ANR9999D_0377813007 smAuditBitfile(smtrans.c:5685) Thread<41>:
     Invalid residual header detected. (SESSION: 2, PROCESS: 2)
   ANR9999D Thread<41> issued message 9999 from:
     (SESSION: 2, PROCESS: 2)
   ANR9999D Thread<41>  00000001807E9566 OutDiagToCons()+1a6
   ANR9999D Thread<41>  00000001807E3372 outDiagfExt()+f2
   ANR9999D Thread<41>  0000000180671FBF smAuditBitfile()+28f
   ANR9999D Thread<41>  00000001801D87EA bfAbsorbFunc()+11a
   ANR9999D Thread<41>  0000000180778213 SsIsValidFrame()+cb3
   ANR9999D Thread<41>  0000000180780BCB ssRtrv()+d1b
   ANR9999D Thread<41>  000000018022FDB3 AfAuditBitfile()+f3
   ANR9999D Thread<41>  00000001801DBE5C bfAuditBitfile()+66c
   ANR9999D Thread<41>  00000001800B0B0B AdmVolDelThread()+1e2b
   ANR9999D Thread<41>  00000001800B32A7 AdmAuditVolThread()+7f7
   ANR9999D Thread<41>  0000000180006865 startThread()+125
   ANR9999D Thread<41>  0000000074D32FDF endthreadex()+47
   ANR9999D Thread<41>  0000000074D33080 endthreadex()+e8
   ANR9999D Thread<41>  00000000777CF56D BaseThreadInitThunk()+d
   ANR9999D Thread<41>  0000000077A02CC1 RtlUserThreadStart()+21
  
   ANR2317W Audit Volume found damaged file on volume <<volname>>
     Node <<nodename>>, Type Backup (Active),
     File space <<filespace>>, fsId <<number>>,
     File name <<dirname>> <<filename>> is number 1 of 2 versions.
     (SESSION: XX, PROCESS: XX)
  
  
  Tivoli Storage Manager Versions Affected:
  Tivoli Storage Manager  server 6,1, 6.2 and 6.3 on all platforms
  
  Initial Impact:
  medium
  
  Additional Keywords:
  zz61 zz62 zz63 TSM audit dedup deduplicate dedupe corrupt
  corrupted corruption integrity
  

Local fix

• If a volume has been affected by this APAR condition, the
  damaged bitfiles on the volume can be reset with the
  following DB2 commands:
  
  db2 connect to tsmdb1
  db2 set schema tsmdb1
  
  db2 "delete from af_damaged where bfid in (select bfid
   from af_segments where srvid=0 and volid in (select volid
   from as_volume_status where
   volname='<fully qualified volume name>'))"
  

Problem summary

• ****************************************************************
  * USERS AFFECTED: All Tivoli Storage Manager server users.     *
  ****************************************************************
  * PROBLEM DESCRIPTION: See ERROR DESCRIPTION.                  *
  ****************************************************************
  * RECOMMENDATION: Apply fixing level when available.           *
  *                 This problem is currently projected to be    *
  *                 fixed in level 6.3.3.                        *
  *                 Note that this is subject to change at       *
  *                 the discretion of IBM.                       *
  ****************************************************************
  *
  
  AFFECTED PLATFORMS:
  AIX, HP-UX, Solaris, Linux, and Windows.
  

Problem conclusion

• The described problem has been resolved.
  

Temporary fix

Comments

APAR Information

• APAR is sysrouted FROM one or more of the following:

• APAR is sysrouted TO one or more of the following:

Fix information

• Fixed component name

  TSM SERVER

• Fixed component ID

  5698ISMSV

Applicable component levels

• R61A PSY

     UP

• R61H PSY

     UP

• R61L PSY

     UP

• R61S PSY

     UP

• R61W PSY

     UP

• R62A PSY

     UP

• R62H PSY

     UP

• R62L PSY

     UP

• R62S PSY

     UP

• R62W PSY

     UP

• R63A PSY

     UP

• R63H PSY

     UP

• R63L PSY

     UP

• R63S PSY

     UP

• R63W PSY

     UP