Nutanix AOS 5.18, 5.19 and 5.20 support for NetBackup 8.2 Hypervisor policy

Problem

NetBackup 8.2 Hypervisor backup policy is successful for AOS 5.18, 5.19 and 5.20 Nutanix AHV Virtual machines, however errors are encountered when attempting a recovery.

Error

Detailed Status:

12 Mar, 2022 4:31:30 PM - Info bpVMutil (pid=007) FTL - Failed to create the VM in the Nutanix AHV cluster. Error: []
12 Mar, 2022 4:31:30 PM - Info bpVMutil (pid=007) FTL - Virtual machine creation failed, can not proceed with restore.
12 Mar, 2022 4:31:30 PM - restored from image TEST****VM_1640079731; restore time: 0:00:55
12 Mar, 2022 4:31:31 PM - end Restore; elapsed time 0:00:57
Hypervisor policy restore error.  (2822)

bpVMutil Log:

16:31:29.134 [3068.3068] <4> : readConfigFile: Error while parsing Nutanix Configuration File. nfs_mount_rsize should have been present in configuration file. Default Values will be considered
16:31:29.134 [3068.3068] <2> : readConfigFile: Error while parsing Nutanix Configuration File. nfs_read_block_size should have been present in configuration file. Default Values will be considered
16:31:29.134 [3068.3068] <2> : readConfigFile: Error while parsing Nutanix Configuration File. Invalid value for enable_cbt in configuration file. Setting Default Value

...

16:31:30.207 [3068.3068] <16> : parseTaskPoll: TaskPoll Error (header: HTTP/1.1 201 CREATED Set-Cookie: NTNX_SESSION_META="{"uuid":"49fa9da6-xxxx-0324ae4d642b"}";Path=/;Secure;Version=0;SameSite=Lax Set-Cookie: JSESSIONID=eyxxxmI-VBCMg;Max-Age=900;Path=/;Secure;Version=0;SameSite=Lax Expires: 0 Content-Type: application/json Server: envoy Pragma: no-cache Cache-Control: no-store, no-cache, must-revalidate Date: Sat, 12 Mar 2022 11:01:04 GMT X-Envoy-Upstream-Service-Time: 304 X-Webkit-Csp: default-src 'self' *.nutanix.com nutanix.com; script-src 'self' 'unsafe-inline' 'unsafe-eval';  style-src 'self' 'unsafe-inline' 'unsafe-eval'; connect-src 'self' wss: https://downloads.frame.nutanix.com https://downloads.frame.nutanix.us; img-src 'self' blob: data:; frame-src 'self' https://*.nutanix.com blob: data: Content-Security-Policy: default-src 'self' *.nutanix.com nutanix.com; script-src 'self' 'unsafe-inline' 'unsafe-eval'; style-src 'self' 'unsafe-inline' 'unsafe-eval'; connect-src 'self' wss: https://downloads.frame.nutanix.com https://downloads.frame.nutanix.us; img-src 'self' blob: data:; frame-src 'self' https://*.nutanix.com blob: data: X-Content-Type-Options: nosniff X-Dns-Prefetch-Control: off X-Ntnx-Env: pe X-Permitted-Cross-Domain-Policies: master-only Strict-Transport-Security: max-age=8640000:includeSubdomains X-Frame-Options: SAMEORIGIN X-Xss-Protection: 1; mode=block Transfer-Encoding: chunked ), (content:{"completed_tasks_info":[{"uuid":"be2exxx52c2","meta_request":{"method_name":"VmCreate"},"meta_response":{"error_code":0},"create_time_usecs":1647082864681623,"start_time_usecs":1647082864699075,"complete_time_usecs":1647082864996575,"last_updated_time_usecs":1647082864996575,"entity_list":[{"entity_id":"e33axxx721c","entity_type":"VM","entity_name":null}],"operation_type":"VmCreate","message":"","percentage_complete":100,"progress_status":"Succeeded","subtask_uuid_list":["0d30xxx3e3b"],"cluster_uuid":"0005xxx00a8"}]})
16:31:30.207 [3068.3068] <16> : ntxpgnIsTaskCompleteAndSucceeded: Failed to get task status, return : 6622
16:31:30.207 [3068.3068] <16> : ntxpgnCreateVM: Create VM operation with prism taskID: be2e86d5-xxxx-42e8864c52c2 Failed
16:31:30.207 [3068.3068] <16> : recoverVm: Failed to create the VM in the Nutanix AHV cluster. Error - 0:

...

16:31:30.233 [3068.3068] <16> : recoverVm: returing rc: 4703.
16:31:30.233 [3068.3068] <16> postRestoreVM: recoverVm failed with error 4703

...

16:31:30.686 [3068.3068] <2> bpVMutil main: error code: 4703: Virtual machine creation failed, can not proceed with restore.
16:31:30.686 [3068.3068] <2> bpVMutil main: EXIT STATUS 5: the restore failed to recover the requested files

Solution

Veritas engineering is aware of the issue, and a formal resolution is made available with an Emergency Engineering Binary (EEB): ET 4018576.

If you experience this problem, contact Veritas Technical Support to obtain the EEB for NetBackup release 8.2. This EEB is a consolidated EEB and includes all previously added fixes for ET 3992152.

NetBackup plug-in for Nutanix-AHV is required to enable "Hypervisor” policy on NetBackup 8.2, the plugin can be downloaded from SORT/Download Center. 

Install the binary on all backup hosts (Linux OS) in the Hypervisor policies that are configured for protecting Nutanix AHV VMs. For example, identify the value of backup_host entry specified at Backup Selection configurations.

Note:  

If the VM boot mode is UEFI, you need to manually start the VM post restore. You can do this by using Prism console, the Nutanix command line, or Nutanix AHV APIs. On specific AOS versions, the Prism console does not support modifying UEFI boot order after the VM is created (e.g. 5.10, 5.18, 5.19, 5.20). In such case, you need to run the command line or AHV API to update the UEFI boot configuration.

Example: 

Run the following command from the controller VM.

<acli> vm.update <restored_vm_name> uefi_boot=True