IT29907: REPLICATION FAILS WHEN VSNAP SNAPSHOT IS ALREADY DELETED

APAR status

• Closed as program error.

Error description

• Backup or catalog replication fails when the snapshot to be
  replicated is already deleted from the vSnap.
  
  This can happen in the following scenario:
  1. Retention is 2 days and the snapshot is being removed after 2
  days.
  
    Snapshot creation time : [2019-07-27 00:00:36,419]
    Snapshot deletion time: [2019-07-29 00:00:51,483] ==>>
  difference more than 2 days. This happens during maintenance
  
  2. Replication is scheduled after the snapshot has been deleted:
  
  [2019-07-29T03:00:07.671Z] INFO pool-9540-thread-1
   c.c.e.s.common.storage.vsnap.VsnapStorageConnection
   1564369200036 reason :
   org.springframework.web.client.HttpClientErrorException: 404
   NOT FOUND
  [2019-07-29T03:00:07.671Z] INFO pool-9540-thread-1
   c.c.e.s.common.storage.vsnap.VsnapStorageConnection
   1564369200036 Status: 404
  [2019-07-29T03:00:07.671Z] INFO pool-9540-thread-1
   c.c.e.s.common.storage.vsnap.VsnapStorageConnection
   1564369200036 Vsnap object not found exception
  [2019-07-29T03:00:07.671Z] INFO pool-9540-thread-1
   c.c.e.s.common.storage.vsnap.VsnapStorageConnection
   1564369200036 vsnap storage object get exception :
  com.catalogic.ecx.serviceprovider.vsnap.exception.VsnapObjectNot
   FoundException: Object not found on Vsnap : 404 NOT FOUND
  [2019-07-29T03:00:07.671Z] INFO pool-9540-thread-1
   c.c.ecx.serviceprovider.common.storage.vsnap.VsnapStorageServer
   1564369200036 Storage snapshot with id : 110 not found
  [2019-07-29T03:00:07.671Z] INFO pool-9540-thread-1
   c.c.e.s.protection.storage.lifecycle.copy.StorageCopyWorker
   1564369200036 replication failed reason
  com.catalogic.ecx.serviceprovider.common.storage.exception.Stora
   geSnapshotNotFoundException: 110
  [2019-07-29T03:00:07.672Z] ERROR pool-9540-thread-1
   c.c.e.s.protection.storage.lifecycle.copy.StorageCopyWorker
   1564369200036 null
  e=...serviceprovider.common.storage.exception.StorageSnapshotNot
   FoundException: 110
  
  IBM Spectrum Protect Plus Versions Affected:
  IBM Spectrum Protect Plus 10.1.x
  
  Initial Impact: Medium
  
  Additional Keywords: SPP, SPPlus, TS002539774
  

Local fix

• Increase the retention or lower the replication/offload policy
  trigger time.
  

Problem summary

• ****************************************************************
  * USERS AFFECTED:                                              *
  * IBM Spectrum Protect Plus level 10.1.4                       *
  ****************************************************************
  * PROBLEM DESCRIPTION:                                         *
  * See ERROR DESCRIPTION                                        *
  ****************************************************************
  * RECOMMENDATION:                                              *
  * This problem is currently projected to be fixed IBM Spectrum *
  * Protect Plus level 10.1.4 222 and 10.1.5. Note that this is  *
  * subject to change at the discretion of IBM.                  *
  ****************************************************************
  

Problem conclusion

• This problem has been fixed by detecting the the absence of the
  snapshot and handling this error condition.
  

Temporary fix

Comments

APAR Information

• APAR is sysrouted FROM one or more of the following:

• APAR is sysrouted TO one or more of the following:

Fix information

• Fixed component name

  SP PLUS

• Fixed component ID

  5737SPLUS

Applicable component levels