Veritas NetBackup™ Cloud Administrator's Guide

Last Published:
Product(s): NetBackup (8.1.2)
  1. About NetBackup cloud storage
    1.  
      About cloud storage features and functionality
    2.  
      About the catalog backup of cloud configuration files
    3.  
      About support limitations for NetBackup cloud storage
  2. About the cloud storage
    1.  
      About the cloud storage vendors for NetBackup
    2. About the Amazon S3 cloud storage API type
      1.  
        Amazon S3 cloud storage vendors certified for NetBackup
      2.  
        Amazon S3 storage type requirements
      3.  
        Amazon S3 cloud storage provider options
      4.  
        Amazon S3 cloud storage options
      5.  
        Amazon S3 advanced server configuration options
      6.  
        Amazon S3 credentials broker details
      7.  
        About private clouds from Amazon S3-compatible cloud providers
      8.  
        About Amazon S3 storage classes
      9.  
        Amazon virtual private cloud support with NetBackup
      10. About protecting data in Amazon for long-term retention
        1. About protecting data in Amazon Glacier
          1.  
            About backing up data to Amazon Glacier
          2.  
            About restoring data from Amazon Glacier
        2. About protecting data in Amazon Glacier vault
          1.  
            About backing up data to Amazon Glacier vault
          2.  
            About restoring data from Amazon Glacier vault
      11. Protecting data using Amazon's cloud tiering
        1.  
          About backing up data using LIFECYCLE storage class
        2.  
          About restoring data from LIFECYCLE storage class
      12.  
        About NetBackup character restrictions for Amazon S3 cloud connector
    3. About Microsoft Azure cloud storage API type
      1.  
        Microsoft Azure cloud storage vendors certified for NetBackup
      2.  
        Microsoft Azure storage type requirements
      3.  
        Microsoft Azure cloud storage provider options
      4.  
        Microsoft Azure advanced server configuration options
    4. About OpenStack Swift cloud storage API type
      1.  
        OpenStack Swift cloud storage vendors certified for NetBackup
      2.  
        OpenStack Swift storage type requirements
      3.  
        OpenStack Swift cloud storage provider options
      4.  
        OpenStack Swift storage region options
      5.  
        OpenStack Swift add cloud storage configuration options
      6.  
        OpenStack Swift proxy settings
  3. Configuring cloud storage in NetBackup
    1.  
      Before you begin to configure cloud storage in NetBackup
    2.  
      Configuring cloud storage in NetBackup
    3.  
      Cloud installation requirements
    4. Scalable Storage properties
      1.  
        Configuring advanced bandwidth throttling settings
      2.  
        Advanced bandwidth throttling settings
    5. Cloud Storage properties
      1.  
        Adding a cloud storage instance
      2.  
        Changing cloud storage host properties
      3.  
        Deleting a cloud storage host instance
    6. About the NetBackup CloudStore Service Container
      1.  
        NetBackup CloudStore Service Container security certificates
      2.  
        NetBackup CloudStore Service Container security modes
      3.  
        NetBackup cloudstore.conf configuration file
    7.  
      Deploying host name-based certificates
    8.  
      Deploying host ID-based certificates
    9.  
      About data compression for cloud backups
    10.  
      About data encryption for cloud storage
    11.  
      About key management for encryption of NetBackup cloud storage
    12.  
      About cloud storage servers
    13.  
      About object size for cloud storage
    14. About the NetBackup media servers for cloud storage
      1.  
        Using media server as NetBackup Cloud master host
    15. Configuring a storage server for cloud storage
      1.  
        KMS database encryption settings
      2.  
        Assigning a storage class to Amazon cloud storage
    16.  
      Changing cloud storage server properties
    17. NetBackup cloud storage server properties
      1.  
        NetBackup cloud storage server bandwidth throttling properties
      2.  
        NetBackup cloud storage server connection properties
      3.  
        NetBackup CloudCatalyst storage server properties
      4.  
        NetBackup cloud storage server encryption properties
    18.  
      About cloud storage disk pools
    19.  
      Configuring a disk pool for cloud storage
    20.  
      Saving a record of the KMS key names for NetBackup cloud storage encryption
    21.  
      Adding backup media servers to your cloud environment
    22. Configuring a storage unit for cloud storage
      1.  
        Cloud storage unit properties
      2.  
        Configure a favorable client-to-server ratio
      3.  
        Control backup traffic to the media servers
    23.  
      About NetBackup Accelerator and NetBackup Optimized Synthetic backups
    24.  
      Enabling NetBackup Accelerator with cloud storage
    25.  
      Enabling optimized synthetic backups with cloud storage
    26.  
      Creating a backup policy
    27. Changing cloud storage disk pool properties
      1.  
        Cloud storage disk pool properties
    28.  
      Managing Certification Authorities (CA) for NetBackup Cloud
  4. Monitoring and Reporting
    1.  
      About monitoring and reporting for cloud backups
    2.  
      Viewing cloud storage job details
    3.  
      Viewing the compression ratio
    4.  
      Viewing NetBackup cloud storage disk reports
    5.  
      Displaying KMS key information for cloud storage encryption
  5. Operational notes
    1.  
      NetBackup bpstsinfo command operational notes
    2.  
      Unable to configure additional media servers
    3.  
      Cloud configuration may fail if NetBackup Access Control is enabled
    4.  
      Deleting cloud storage server artifacts
  6. Troubleshooting
    1. About unified logging
      1.  
        About using the vxlogview command to view unified logs
      2.  
        Examples of using vxlogview to view unified logs
    2. About legacy logging
      1.  
        Creating NetBackup log file directories for cloud storage
    3.  
      NetBackup cloud storage log files
    4.  
      Enable libcurl logging
    5.  
      NetBackup Administration Console fails to open
    6. Troubleshooting cloud storage configuration issues
      1.  
        NetBackup Scalable Storage host properties unavailable
      2.  
        Connection to the NetBackup CloudStore Service Container fails
      3.  
        Cannot create a cloud storage disk pool
      4.  
        Cannot create a cloud storage
      5.  
        Data transfer to cloud storage server fails in the SSL mode
      6.  
        Amazon GovCloud cloud storage configuration fails in non-SSL mode
      7.  
        Data restore from the Google Nearline storage class may fail
      8.  
        Backups may fail for cloud storage configurations with Frankfurt region
      9.  
        Backups may fail for cloud storage configurations with the cloud compression option
      10.  
        Fetching storage regions fails with authentication version V2
    7. Troubleshooting cloud storage operational issues
      1.  
        Cloud storage backups fail
      2.  
        Stopping and starting the NetBackup CloudStore Service Container
      3.  
        A restart of the nbcssc (on legacy media servers), nbwmc, and nbsl processes reverts all cloudstore.conf settings
      4.  
        NetBackup CloudStore Service Container startup and shutdown troubleshooting
      5.  
        bptm process takes time to terminate after cancelling GLACIER restore job
      6.  
        Handling image cleanup failures for Amazon Glacier vault
      7.  
        Cleaning up orphaned archives manually
      8.  
        Restoring from Amazon Glacier vault spans more than 24 hours for single fragment
      9.  
        Restoring from GLACIER_VAULT takes more than 24 hours for Oracle databases
      10.  
        Troubleshooting failures due to missing Amazon IAM permissions
      11.  
        Restore job fails if the restore job start time overlaps with the backup job end time

Cloud storage backups fail

Accelerator backups fail

A message similar to the following is in the job details:

Critical bptm(pid=28291) accelerator verification failed: backupid=
  host_name_1373526632, offset=3584, length=141976576, error=
  2060022, error message: software error  
Critical bptm(pid=28291) image write failed: error 2060022: software 
  error      
Error bptm(pid=28291) cannot write image to disk, Invalid argument end 
  writing; write time: 0:02:31
Info bptm(pid=28291) EXITING with status 84        
Info bpbkar(pid=6044) done. status: 84: media write error media write 
  error(84)

This error may occur in the environments that have more than one cloud storage server. It indicates that NetBackup Accelerator backups of a client to one cloud storage server were later directed to a different cloud storage server.

For Accelerator backups to cloud storage, ensure the following:

  • Always back up each client to the same storage server. Do so even if the other storage server represents storage from the same cloud storage vendor.

  • Always use the same backup policy to back up a client, and do not change the storage destination of that policy.

Backups fail after the WRITE_BUFFER_SIZE is increased

If the cloud storage server WRITE_BUFFER_SIZE property exceeds the total swap space of the computer, backups can fail with a status 84.

Adjust the WRITE_BUFFER_SIZE size to a value lower than the computer's total swap space to resolve this issue.

The storage volume was created by the cloud vendor interface

A message similar to the following is in the job details:

Info bptm(pid=xxx) start backup           
Critical bptm(pid=xxxx) image open failed: error 2060029: authorization 
  failure      
Error bpbrm(pid=xxxx) from client gabby: ERR - Cannot write to STDOUT. E
  rrno  = 32: Broken pipe
Info bptm(pid=xxxx) EXITING with status 84

A message similar to the following appears in the bptm log file:

Container container_name is not Veritas container or tag data error, fail to create image. Please make sure that the LSU is created by means of NBU.

This error indicates that the volume was created by using the cloud storage vendor's interface.

You must use the NetBackup Disk Pool Configuration Wizard to create the volume on the cloud storage. The wizard applies a required partner ID to the volume. If you use the vendor interface to create the container, the partner ID is not applied.

To resolve the problem, use the cloud storage vendor's interface to delete the container. In NetBackup, delete the disk pool and then recreate it by using the Disk Pool Configuration Wizard.

See Viewing cloud storage job details.

See NetBackup cloud storage log files.

The NetBackup CloudStore Service Container is not active

This is applicable to media server versions 7.7.x to 8.1.2 only.

If the NetBackup CloudStore Service Container is not active, backups cannot be sent to the cloud storage.

NetBackup does not validate that the CloudStore Service Container is active when you use NetBackup commands to configure NetBackup cloud storage. Therefore, any backups that initiate in such a scenario fail.

See NetBackup CloudStore Service Container startup and shutdown troubleshooting.

Backups may fail if the Use any available media server option is selected

While you configure a cloud storage server, you must ensure that the media server and the master server are of the same version.

Note:

This limitation does not apply to the existing cloud storage servers.

Cloud backups may fail in the following scenario:

You selected Use any available media server while you configured the storage unit and NetBackup uses a media server with version different than the master server version during cloud storage configuration.

To resolve this issue, do the following:

Select Only use the following media servers while you configure the storage unit and select the media server with a version same as master server from the Media Servers pane.

Cloud backup and restore operations fail with error code 83 or error code 2106

The cloud backups and restore operations failing with error code 83 or error code 2106 may occur due to any one of the following reasons:

  • The media server's date and time settings are skewed (not in sync with the GMT/UTC time).

  • The storage server credentials that are provided are incorrect.

Perform the following:

Change the media server's date and time settings so that it is in sync with the GMT/UTC time.

Update the storage server credentials. Use the tpconfig command to update the credentials. For more information, see the NetBackup Commands Reference Guide.

Cloud storage backup fails for certificate issues

If the cloud storage backups fails because of certificate issues, verify the following:

  • The cacert.pem file is present on both NetBackup master and media server in following locations:

    • UNIX/Linux - /usr/openv/var/webtruststore

    • Windows - <install_path>/var/webtruststore

    For media server versions 7.7.x to 8.1.2, if the cacert.pem file is not present, run the nbcertcmd -getCACertificate on the master server. After running this command, restart the NetBackup CloudStore Service Container.

    See the NetBackup Commands Reference Guide for a complete description of the command.

    Note:

    This cacert.pem file is a NetBackup-specific file. This file includes the CA certificates generated by the NetBackup authorization service.

  • The cacert.pem file is same on the NetBackup master and media server.

  • For media server versions 7.7.x to 8.1.2, the machine certificate is present in following locations:

    • UNIX/Linux - /usr/openv/var/vxss/credentials

    • Windows - <install_path>/var/vxss/credentials

    If the security certificate is not present, run the bpnbaz -ProvisionCert on the master server. After running this command, restart the NetBackup CloudStore Service Container on the master and media server.

    See Deploying host name-based certificates.

  • For media server versions 7.7.x to 8.1.2, the NetBackup CloudStore Service Container is active.

    See Stopping and starting the NetBackup CloudStore Service Container.

  • The Enable insecure communication with 8.0 and earlier hosts option on the NetBackup master server is selected if the media server is of the version 8.0 or earlier. The option is available in the NetBackup Administration Console on the Security Management > Global Security Settings > Secure Communication tab.

  • On the media server, if the certificate deployment security level if set to Very High, automatic certificate deployment is disabled. An authorization token must accompany every new certificate request. Therefore, you must create an authorization token before deploying the certificates.

    See the 'Creating authorization tokens' topic in the NetBackup™ Security and Encryption Guide for detailed steps.

Backup jobs to Amazon S3 complaint cloud storage fail with status 41

NetBackup consumes the available bandwidth to it's maximum potential and pushes the requests accordingly, however the Amazon S3 complaint cloud is not able to process the number requests.

The cloud vendor returns error 503 to slow down the requests and the backup job fails with the following errors:

  • In the media server bptm logs:

    bptm:4940:<media_server_name>: AmzResiliency: AmzResiliency::getRetryType cURL error: 0, multi cURL error: 0, HTTP status: 503, XML response: SlowDown, RetryType: RETRY_EXHAUSTED

  • In the media server bpbrm logs:

    bpbrm Exit: client backup EXIT STATUS 41: network connection timed out

This issue arises only if higher bandwidth is available between NetBackup and the cloud storage.

To troubleshoot you can perform one of the following: