Backup of VMware virtual machine with large VMDK files to dedpulication storage folder fails with 0xe0009579
Problem
The backup of a VMware virtual machine with large VMDK files using the Agent for VMware Virtual Infrastructure (AVVI) to dedpulication storage folder fails with the error below when Granular Recovery Technology (GRT) is enabled.
Error Message
0xe0009579 - Unable to copy the virtual machine disk using the VMware VixDiskLib.
Remote Agent debug log will show the following errors:
-----------------------------------------------------------------------------
[5628] 01/29/14 05:17:53 [fsys\shared] - VDDK-Log: DISKLIB-SPARSE: "\\.pdvfs\BESERVER\2\BEData\STHVMDK\IMG002672\VMDK_1-000001.vmdk" : failed to grow disk: The request could not be performed because of an I/O device error (45d00000002).
[5628] 01/29/14 05:17:53 [fsys\shared] - VDDK-Log: DISKLIB-SPARSE: "\\.pdvfs\BESERVER\2\BEData\STHVMDK\IMG002672\VMDK_1-000001.vmdk" : failed to grow disk: The request could not be performed because of an I/O device error (45d00000002).
[5628] 01/29/14 05:17:53 [fsys\shared] - VDDK-Log: DISKLIB-LIB : RWv failed ioId: #109110552 (73203721) (9) .
[5628] 01/29/14 05:17:53 [fsys\shared] - VDDK-Log: Foundry operation failed with system error: The request could not be performed because of an I/O device error.
(1117), translated to 1
[5628] 01/29/14 05:17:53 [fsys\shared] - vddkWrapper::WriteDiskExtents() Could not write to the disk. start Sector: '2147291136', Num of sectors: '2048' Error Text: 'Unknown error' Error: '314407587640508417'
[6492] 01/29/14 05:17:53 [fsys\vmvcb\pdi] - VM_VCBPROXY_PDI_FS::WriteDataToDisk() Could not write to the disk. VixDiskLib_Write() reported the error: Unknown error
[6492] 01/29/14 05:17:53 [ndmp\loops] - LP_ENV::MsgError: error 0xe0009579 processing object VMDK\VMDK_1-000001.vmdk
[5628] 01/29/14 05:17:55 [fsys\shared] - Write thread: Write Error or Cancel request received. Bailing out...
[6492] 01/29/14 05:17:58 [fsys\shared] - AVVI Buffered Writes Performance Tuning Analysis. Total no of Writes: '1048554'
[6492] 01/29/14 05:17:58 [fsys\shared] - Write Buffer Depth: '0' Occurences: '1048554'
[6492] 01/29/14 05:17:58 [fsys\shared] - Write Buffer Depth: '1' Occurences: '0'
[6492] 01/29/14 05:17:58 [fsys\shared] - Write Buffer Depth: '2' Occurences: '0'
[6492] 01/29/14 05:17:58 [fsys\shared] - Write Buffer Depth: '3' Occurences: '0'
[6492] 01/29/14 05:17:58 [fsys\shared] - Write Buffer Depth: '4' Occurences: '0'
[3844] 01/29/14 05:17:58 [fsys\shared] - VDDK-Warn: DISKLIB-SPARSE: Failed to write out header: The request could not be performed because of an I/O device error (73203721).
[3844] 01/29/14 05:17:58 [fsys\shared] - VDDK-Warn: DISKLIB-SPARSECHK: [\\.pdvfs\BESERVER\2\BEData\STHVMDK\IMG002672\VMDK_1-000001.vmdk] Couldn't read GD
[3844] 01/29/14 05:17:58 [fsys\shared] - VDDK-Log: Failed trying to check disk for errors on close.
[3844] 01/29/14 05:18:01 [fsys\shared] - VDDK-Log: DISKLIB-LIB : Failed to close handle "00000000C2B7AFB0".
[3844] 01/29/14 05:18:01 [fsys\shared] - VDDK-Log: Foundry operation failed with system error: The request could not be performed because of an I/O device error.
(1117), translated to 1
[6492] 01/29/14 05:18:01 [fsys\vmvcb\pdi] - VM_VCBPROXY_FS::CloseObj() Could not close the disk Error Text: 'Unknown error' Error: '314407587640508417'
-----------------------------------------------------------------------------
Also, PDVFS debug log will show the following errors:
-----------------------------------------------------------------------------
2014/01/29 05:17:53 (5636:6236) PDVFS - <ERR> bcache_lru: lru failed
2014/01/29 05:17:53 (5636:6236) PDVFS - <ERR> bcache_update: failed
2014/01/29 05:17:53 (5636:6236) PDVFS - <ERR> pdvfs_pwrite: failed, bcache_write wrote -1, expected 131072 bytes
-----------------------------------------------------------------------------
Solution
This issue is resolved in Backup Exec 2014 or later versions.
A hotfix is now available for this issue in the current version(s) of the product(s) mentioned in this article. Refer to the Hotfix link under Related Documents at the end of this article to obtain the hotfix needed to resolve the issue.
Backup Exec 2014 Rev 1786 Service Pack 1 ( 000021275 ).
To resolve this issue and receive the new Backup Exec improvements please upgrade to the current version of Backup Exec.
Note: Veritas continues to focus on the current release and future releases; there are no plans to address this issue by way of a patch or hotfix in earlier versions of the software at the present time. Please contact your Veritas Sales representative or the Veritas Partner for upgrade information including upgrade eligibility to the release containing the resolution for this issue. For information on how to contact Veritas Sales, please see https://www.veritas.com .