IT36842: UNEXPECTED GUEST BACKUP ERROR CTGGA2649 "FAILED TO RECEIVE STATUS UPDATES FROM THE BACKUP PROCESS ON PROXY"

APAR status

• Closed as program error.

Error description

• The IBM Spectrum Protect Plus backup job can stop with the
  following message seen in the job log when protecting VM
  guests :
  
  SUMMARY,<timestamp>,CTGGA2399,Starting job for policy BACKUP
                                with job name <SLAName>
                                (ID:<SLAId>). id -> <JobId>.
                                IBM Spectrum Protect Plus version
                                10.1.7-3102.
  ...
   DETAIL,<timestamp>,CTGGA0576,Initializing backup of vm:
                                <GuestName> (host:
                                <ESXiHostAddress) data center:
                                <DatacenterName>
   DETAIL,<timestamp>,CTGGA0671,Backing up VM (<GuestName>) from
                                remote proxy (IP: <vADPIP> Host
                                name: <vADPName>)
     INFO,<timestamp>,CTGGA2110,Will do incremental backup for VM
                                <GuestName>
     WARN,<timestamp>,,SPP failed to receive status updates from
                       the backup process on proxy (<vADPName>)
                       will stop the backup of VM (<GuestName>).
     WARN,<timestamp>,CTGGA2410,VM <GuestName> is in need for
                                consolidation
    ERROR,<timestamp>,CTGGA2649,Backup of VM <GuestName> failed
                                due to an unexpected error.
                                Contact support for further
                                assistance.
                                Error: SPP failed to receive
                                       status updates from the
                                       backup process on proxy
                                       (<vADPName>) stopped the
                                       backup of VM (<GuestName>)
  
  Typically, the warning reporting the unresponsive vADP will be
  seen 60 minutes after having started the backup of the
  affected guest.
  The IBM Spectrum Protect Plus host will retry during a period of
  60 minutes before finally failing the backup.
  
  
  This APAR applies if the following error is seen in the vADP
  log (location: /opt/IBM/SPP/logs/vadp.log) of the affected
  proxy host during the backup attempt timeframe :
  
  <timestamp> ERROR xxxx --- [pool-y-thread-z] c.c.v.domain.
                    VmdkBackupConfigManager     :
                    Error updating vmbackupstatus
                    org.springframework.web.client.
                    HttpClientErrorException: 429
                    at ...
  
  where HTTP error 429 means : "Too Many Requests".
  
  | MDVREGR 10.1.6 5737SPLUS |
  
  IBM Spectrum Protect Plus Versions Affected:
  IBM Spectrum Protect Plus 10.1.7 and later.
  
  Initial Impact: Medium
  
  Additional Keywords: SPP, SPPLUS, TS005555269, timeout
  

Local fix

• Run again the affected backup job manually.
  This will process the remaining guest backups that failed on
  the first run.
  

Problem summary

• ****************************************************************
  * USERS AFFECTED:                                              *
  * IBM Spectrum Protect Plus level 10.1.7 and 10.1.8            *
  ****************************************************************
  * PROBLEM DESCRIPTION:                                         *
  * see ERROR Description                                        *
  ****************************************************************
  * RECOMMENDATION:                                              *
  * Apply the fixing level when available. This problem is       *
  * currently projected to be fixed in IBM Spectrum Protect Plus *
  * level 10.1.8 patch1 and 10.1.9                               *
  * Note that this is subject to change at the discretion of     *
  * IBM.                                                         *
  ****************************************************************
  

Problem conclusion

• After the fix, the status updates from the VADP proxy to IBM
  Spectrum Protect Plus are throttled to prevent overloading the
  server.
  

Temporary fix

Comments

APAR Information

• APAR is sysrouted FROM one or more of the following:

• APAR is sysrouted TO one or more of the following:

Fix information

• Fixed component name

  SP PLUS

• Fixed component ID

  5737SPLUS

Applicable component levels