IBM Support

IT09194: IFINCR BACKUP FAILS WITH ANS4174E RC=-1 DURING RETRY IF GUEST VM HAS MULTIPLE VMDKS

Subscribe

You can track all active APARs for this component.

 

APAR status

  • Closed as program error.

Error description

  • If an IFINCR VM backup of a guest VM with multiple VMDKs is
    retried, the VM backup will fail with ANS5250E, ANS4174 RC=-1
    errors.
    
    Case example:
    dsmc.exe console output:
    C:\Program Files\Tivoli\TSM\baclient>dsmc backup vm
    -vmfulltype=vstor -vmbackuptype=fullvm -asnodename=VMWARE_NODE
    -domain.vmfull=GUEST_VM -MODE=IFIncremental
    -optfile=dsm.VMWARE_NODE_DM.opt
    
    Backup VM command started.  Total number of virtual machines to
    process: 1
    Accessing as node: VMWARE_NODE
    Starting Full VM backup of VMware Virtual Machine 'GUEST_VM'
            mode:                        'Incremental Forever -
    Incremental'
            target node name:            'VMWARE_NODE'
            data mover node name:        'VMWARE_NODE_DM'
            application protection type: 'VMware'
            application(s) protected:    'n/a'
    
    Creating snapshot for virtual machine 'GUEST_VM'
    Backing up Full VM configuration information for 'GUEST_VM'
             23,477 VM Configuration [Sent]
    Processing snapshot
            disk:         [VMFS2] GUEST_VM/GUEST_VM-000002.vmdk
    (Hard Disk 1)
            Capacity:     64,424,509,440
            Data to Send: 9,669,050,368
            Transport:     (san)[sending]
    Volume --> 64,424,509,440 [VMFS2] GUEST_VM/GUEST_VM-000002.vmdk
    (Hard Disk 1) [Sent]
    Processing snapshot
            disk:         [VMFS2] GUEST_VM/GUEST_VM_1-000003.vmdk
    (Hard Disk 2)
            Capacity:     858,993,459,200
            Data to Send: 179,876,921,344
            Transport:     (san)[sending]
    ANS9389W The DEDUP backup attempt was unsuccessful for virtual
    machine 'GUEST_VM
    '. Retry #1 with DEDUP disabled.
    Backing up Full VM configuration information for 'GUEST_VM'
             23,477 VM Configuration [Sent]
    <   35.28 GB> [ - ]
    ANS4174E Full VM backup of VMware Virtual Machine 'GUEST_VM'
    failed with RC=-1 m
    ode=Incremental Forever - Incremental, target node
    name='VMWARE_NODE', data m
    over node name='VMWARE_NODE_DM'
    ANS1228E Sending of object 'GUEST_VM' failed.
    ANS5283E The operation was unsuccessful.
    
    Statistics for Virtual Machine 'GUEST_VM'.
    
    Total number of objects inspected:            1
    Total number of objects backed up:            0
    Total number of objects updated:              0
    Total number of objects rebound:              0
    Total number of objects deleted:              0
    Total number of objects expired:              0
    Total number of objects failed:               1
    Total number of objects encrypted:            0
    Total objects deduplicated:                   0
    Total number of objects grew:                 0
    Total number of retries:                      0
    Total number of bytes inspected:         860.00 GB
    Total number of bytes processed:          35.28 GB
    Total bytes before deduplication:             0  B
    Total bytes after deduplication:              0  B
    Total number of bytes transferred:            0  B
    Data transfer time:                    1,830.13 sec
    Network data transfer rate:           20,218.99 KB/sec
    Aggregate data transfer rate:         12,633.20 KB/sec
    Objects compressed by:                        0%
    Deduplication reduction:                   0.00%
    Total data reduction ratio:               95.90%
    Elapsed processing time:               00:48:49
    Removing snapshot for virtual machine 'GUEST_VM'
    Session established with server TSM_SERVER: Windows
      Server Version 7, Release 1, Level 0.0
      Server date/time: 05/13/2015 11:12:49  Last access: 05/13/2015
    11:12:44
    
    Accessing as node: VMWARE_NODE
    
    Backup VM command complete
    Total number of virtual machines backed up successfully: 0
    Total number of virtual machines failed: 1
    
    As shown in the case above, the first backup attempt with DEDUP
    is initially unsuccessful which then results in a retry with
    DEDUP disabled, leading to IFINCR backup failure.
    
    Tivoli Storage Manager Versions Affected:
    TSM for Virtual Environments V7.1.x; Windows Platform
    
    Customer/L2 Diagnostics:
    In order to confirm this APAR applies the following must be
    true:
    1. The guest VM being backed up should have multiple VMDKs
    2. The IFINCR backup is being retried after an unsuccessful
    initial backup attempt
    3. A service trace of the problem should show messages similar
    to the following:
    
    05/13/2015 11:12:55.527 [004696] [3964] :
    ..\..\common\vm\vmbackvcm.cpp( 217): ANS5250E An unexpected
    error was encountered.
       TSM function name : vcmLogger::trace
       TSM function      : VolumeControlManager::copy_volume: The
    Destination volume 'Path:
    'C:\mnt\tsmvmbackup\fullvm\CDF_Local\GUEST_VM\Hard Disk 1' Job:
    66001' already exists
       TSM return code   : 115
       TSM file          : ..\..\common\vm\vmbackvcm.cpp (218)
    05/13/2015 11:12:55.527 [004696] [3964] :
    ..\..\common\vm\vmbackvcm.cpp( 222): <========= Exiting
    vcmLogger::trace()
    05/13/2015 11:12:55.527 [004696] [3964] :
    ..\..\common\vm\vmbackvcm.cpp( 206): =========> Entering
    vcmLogger::trace()
    05/13/2015 11:12:55.527 [004696] [3964] :
    ..\..\common\vm\vmbackvcm.cpp( 217): ANS5250E An unexpected
    error was encountered.
       TSM function name : vcmLogger::trace
       TSM function      : VolumeControlManager::copy_volume: Failed
    to create destination volume 'Path:
    'C:\mnt\tsmvmbackup\fullvm\CDF_Local\GUEST_VM\Hard Disk 1' Job:
    66001'
       TSM return code   : 115
       TSM file          : ..\..\common\vm\vmbackvcm.cpp (218)
    05/13/2015 11:12:55.527 [004696] [3964] :
    ..\..\common\vm\vmbackvcm.cpp( 222): <========= Exiting
    vcmLogger::trace()
    05/13/2015 11:12:55.527 [004696] [3964] :
    ..\..\common\vm\vmbackvcm.cpp( 324): vcmCopyVolumeControlData:
    VCMLIB_S_CopyVolumeControlData failed.
    05/13/2015 11:12:55.527 [004696] [3964] :
    ..\..\common\vm\vmbackcommon.cpp( 441): VmSendData(): Error
    1069838920 copy CTL data.
    05/13/2015 11:12:55.527 [004696] [3964] :
    ..\..\common\vm\vmbackcommon.cpp( 309): EXIT  <=====
    VmRetrieveCTLFiles(), rc = -1
    05/13/2015 11:12:55.527 [004696] [3964] :
    ..\..\common\vm\vmbackvddk.cpp(5480): VmSendData():
    VmRetrieveCTLFiles returned rc=-1
    05/13/2015 11:12:55.527 [004696] [3964] :
    ..\..\common\vm\vmbackvddk.cpp(5481): =========> VmSendData():
    Exiting, rc = -1
    
    Initial Impact:
    Low
    
    Additional Keywords:
    VolumeControlManager, IFINCR, Incremental-Forever, Failed to
    create destination volume, VM backup,
    C:\mnt\tsmvmbackup\fullvm\CDF_Local\, VmRetrieveCTLFiles,
    ANS5250E, ANS4174, ANS9389W
    

Local fix

  • Perform the backup using the IFFULL backup mode instead
    

Problem summary

  • ****************************************************************
    * USERS AFFECTED:                                              *
    * Tivoli Storage Manager for Virtual Environments versions 6.4 *
    * and 7.1 running on all Microsoft Windows x64 and Linux       *
    * x86_64 platforms.                                            *
    ****************************************************************
    * PROBLEM DESCRIPTION:                                         *
    * See ERROR DESCRIPTION                                        *
    ****************************************************************
    * RECOMMENDATION:                                              *
    * This issue is projected to be fixed in the Tivoli Storage    *
    * Manager Client on Windows x64 and Linux x86_64  in level     *
    * 7.1.4                                                        *
    * Note 1: The Tivoli Storage Manager (TSM) Client is a         *
    * prerequisite to using the Data Protection for VMware. In     *
    * Data Protection for VMware environments, the TSM Client is   *
    * also known as the data mover.                                *
    * Note 2: This is subject to change at the discretion of IBM.  *
    ****************************************************************
    

Problem conclusion

  • IFINCR backup is now correctly retried for VMs with multiple
    VMDKs.
    

Temporary fix

Comments

APAR Information

  • APAR number

    IT09194

  • Reported component name

    TSM CLIENT

  • Reported component ID

    5698ISMCL

  • Reported release

    71W

  • Status

    CLOSED PER

  • PE

    NoPE

  • HIPER

    NoHIPER

  • Special Attention

    NoSpecatt

  • Submitted date

    2015-06-02

  • Closed date

    2015-08-03

  • Last modified date

    2015-08-03

  • APAR is sysrouted FROM one or more of the following:

  • APAR is sysrouted TO one or more of the following:

Modules/Macros

  • dsmagent dsm
    

Fix information

  • Fixed component name

    TSM CLIENT

  • Fixed component ID

    5698ISMCL

Applicable component levels

  • R71W PSY

       UP

  • R71L PSY

       UP

[{"Business Unit":{"code":"BU058","label":"IBM Infrastructure w\/TPS"},"Product":{"code":"SSGSG7","label":"Tivoli Storage Manager"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"71W","Line of Business":{"code":"LOB26","label":"Storage"}}]

Document Information

Modified date:
08 January 2022