Veritas NetBackup™ Cloud Administrator's Guide

Last Published:
Product(s): NetBackup (8.2)
Platform: Windows,UNIX,Linux
  1. About NetBackup cloud storage
    1.  
      About cloud storage features and functionality
    2.  
      About the catalog backup of cloud configuration files
    3.  
      About support limitations for NetBackup cloud storage
  2. About the cloud storage
    1.  
      About the cloud storage vendors for NetBackup
    2. About the Amazon S3 cloud storage API type
      1.  
        Amazon S3 cloud storage vendors certified for NetBackup
      2.  
        Amazon S3 storage type requirements
      3.  
        Permissions required for Amazon S3 cloud provider user
      4.  
        Amazon S3 cloud storage provider options
      5.  
        Amazon S3 cloud storage options
      6.  
        Amazon S3 advanced server configuration options
      7.  
        Amazon S3 credentials broker details
      8.  
        About private clouds from Amazon S3-compatible cloud providers
      9.  
        About Amazon S3 storage classes
      10.  
        Amazon virtual private cloud support with NetBackup
      11. About protecting data in Amazon for long-term retention
        1. About protecting data in Amazon Glacier
          1.  
            About restoring data from Amazon Glacier
        2. About protecting data in Amazon Glacier vault
          1.  
            About backing up data to Amazon Glacier vault
          2.  
            About restoring data from Amazon Glacier vault
      12. Protecting data using Amazon's cloud tiering
        1.  
          About backing up data using LIFECYCLE storage class
        2.  
          About restoring data from LIFECYCLE storage class
      13. About using Amazon IAM roles with NetBackup
        1.  
          Configuring AWS IAM Role with NetBackup
      14.  
        About NetBackup character restrictions for Amazon S3 cloud connector
      15. Protecting data with Amazon Snowball and Amazon Snowball Edge
        1.  
          Configuring NetBackup for Amazon Snowball with Amazon Snowball client
        2.  
          Configuring NetBackup for Amazon Snowball with Amazon S3 API interface
        3.  
          Using multiple Amazon S3 adapters
        4.  
          Configuring NetBackup with Amazon Snowball Edge with file interface
        5.  
          Configuring NetBackup for Amazon Snowball Edge with S3 API interface
        6.  
          Configuring NetBackup for Amazon Snowball and Amazon Snowball Edge for NetBackup CloudCatalyst Appliance
        7.  
          Configuring SSL for Amazon Snowball and Amazon Snowball Edge
        8.  
          Post backup procedures if you have used S3 API interface
    3. About Microsoft Azure cloud storage API type
      1.  
        Microsoft Azure cloud storage vendors certified for NetBackup
      2.  
        Microsoft Azure storage type requirements
      3.  
        Microsoft Azure cloud storage provider options
      4.  
        Microsoft Azure advanced server configuration options
      5.  
        Protecting data in Microsoft Azure Archive for long-term retention
    4. About OpenStack Swift cloud storage API type
      1.  
        OpenStack Swift cloud storage vendors certified for NetBackup
      2.  
        OpenStack Swift storage type requirements
      3.  
        OpenStack Swift cloud storage provider options
      4.  
        OpenStack Swift storage region options
      5.  
        OpenStack Swift add cloud storage configuration options
      6.  
        OpenStack Swift proxy settings
  3. Configuring cloud storage in NetBackup
    1.  
      Before you begin to configure cloud storage in NetBackup
    2.  
      Configuring cloud storage in NetBackup
    3.  
      Cloud installation requirements
    4. Scalable Storage properties
      1.  
        Configuring advanced bandwidth throttling settings
      2.  
        Advanced bandwidth throttling settings
    5. Cloud Storage properties
      1.  
        Adding a cloud storage instance
      2.  
        Changing cloud storage host properties
      3.  
        Deleting a cloud storage host instance
    6. About the NetBackup CloudStore Service Container
      1.  
        NetBackup CloudStore Service Container security certificates
      2.  
        NetBackup CloudStore Service Container security modes
      3.  
        NetBackup cloudstore.conf configuration file
    7.  
      Deploying host name-based certificates
    8.  
      Deploying host ID-based certificates
    9.  
      About data compression for cloud backups
    10.  
      About data encryption for cloud storage
    11.  
      About key management for encryption of NetBackup cloud storage
    12.  
      About cloud storage servers
    13.  
      About object size for cloud storage
    14. About the NetBackup media servers for cloud storage
      1.  
        Using media server as NetBackup Cloud master host
    15. Configuring a storage server for cloud storage
      1.  
        KMS database encryption settings
      2.  
        Assigning a storage class to Amazon cloud storage
    16.  
      Changing cloud storage server properties
    17. NetBackup cloud storage server properties
      1.  
        NetBackup cloud storage server bandwidth throttling properties
      2.  
        NetBackup cloud storage server connection properties
      3.  
        NetBackup CloudCatalyst storage server properties
      4.  
        NetBackup cloud storage server encryption properties
    18.  
      About cloud storage disk pools
    19.  
      Configuring a disk pool for cloud storage
    20.  
      Saving a record of the KMS key names for NetBackup cloud storage encryption
    21.  
      Adding backup media servers to your cloud environment
    22. Configuring a storage unit for cloud storage
      1.  
        Cloud storage unit properties
      2.  
        Configure a favorable client-to-server ratio
      3.  
        Control backup traffic to the media servers
    23.  
      About NetBackup Accelerator and NetBackup Optimized Synthetic backups
    24.  
      Enabling NetBackup Accelerator with cloud storage
    25.  
      Enabling optimized synthetic backups with cloud storage
    26.  
      Creating a backup policy
    27. Changing cloud storage disk pool properties
      1.  
        Cloud storage disk pool properties
    28.  
      Certificate validation against Certificate Revocation List (CRL)
    29.  
      Managing Certification Authorities (CA) for NetBackup Cloud
  4. Monitoring and Reporting
    1.  
      About monitoring and reporting for cloud backups
    2.  
      Viewing cloud storage job details
    3.  
      Viewing the compression ratio
    4.  
      Viewing NetBackup cloud storage disk reports
    5.  
      Displaying KMS key information for cloud storage encryption
  5. Operational notes
    1.  
      NetBackup bpstsinfo command operational notes
    2.  
      Unable to configure additional media servers
    3.  
      Cloud configuration may fail if NetBackup Access Control is enabled
    4.  
      Deleting cloud storage server artifacts
    5.  
      Using csconfig reinitialize to load updated cloud configuration settings
  6. Troubleshooting
    1. About unified logging
      1.  
        About using the vxlogview command to view unified logs
      2.  
        Examples of using vxlogview to view unified logs
    2. About legacy logging
      1.  
        Creating NetBackup log file directories for cloud storage
    3.  
      NetBackup cloud storage log files
    4.  
      Enable libcurl logging
    5.  
      NetBackup Administration Console fails to open
    6. Troubleshooting cloud storage configuration issues
      1.  
        NetBackup Scalable Storage host properties unavailable
      2.  
        Connection to the NetBackup CloudStore Service Container fails
      3.  
        Cannot create a cloud storage disk pool
      4.  
        Cannot create a cloud storage
      5.  
        Data transfer to cloud storage server fails in the SSL mode
      6.  
        Amazon GovCloud cloud storage configuration fails in non-SSL mode
      7.  
        Data restore from the Google Nearline storage class may fail
      8.  
        Backups may fail for cloud storage configurations with Frankfurt region
      9.  
        Backups may fail for cloud storage configurations with the cloud compression option
      10.  
        Fetching storage regions fails with authentication version V2
    7. Troubleshooting cloud storage operational issues
      1.  
        Cloud storage backups fail
      2.  
        Stopping and starting the NetBackup CloudStore Service Container
      3.  
        A restart of the nbcssc (on legacy media servers), nbwmc, and nbsl processes reverts all cloudstore.conf settings
      4.  
        NetBackup CloudStore Service Container startup and shutdown troubleshooting
      5.  
        bptm process takes time to terminate after cancelling GLACIER restore job
      6.  
        Handling image cleanup failures for Amazon Glacier vault
      7.  
        Cleaning up orphaned archives manually
      8.  
        Restoring from Amazon Glacier vault spans more than 24 hours for single fragment
      9.  
        Restoring from GLACIER_VAULT takes more than 24 hours for Oracle databases
      10.  
        Troubleshooting failures due to missing Amazon IAM permissions
      11.  
        Restore job fails if the restore job start time overlaps with the backup job end time
      12.  
        Post processing fails for restore from Azure archive
    8.  
      Troubleshooting Amazon Snowball and Amazon Snowball Edge issues

NetBackup cloud storage server connection properties

All or most of the cloud storage servers use the storage server properties in Table: Storage server cloud connection properties. The following are the prefixes for the currently supported cloud vendors:

  • Amazon: AMZ

  • Amazon GovCloud: AMZGOV

  • Cloudian: CLD

  • Google Nearline: GOOG

  • Hitachi: HT

  • Microsoft Azure: AZR

  • Verizon: VER

Table: Storage server cloud connection properties

Property

Description

METER:DIRECTORY

This read-only field displays the directory in which to store data stream metering information.

Default value: UNIX: /usr/openv/var/global/wmc/cloud or /usr/openv/netbackup/db/cloud (on media server versions 7.7.x to 8.1.2 only)

Windows: install_path\Veritas\NetBackup\var\global\wmc\cloud or install_path\Veritas\NetBackup\db\cloud\ (on media server versions 7.7.x to 8.1.2 only)

METER:INTERVAL

The interval at which NetBackup gathers connection information for reporting purposes.

NetBackup OpsCenter uses the information that is collected to create reports. The value is set in seconds. The default setting is 300 seconds (5 minutes). If you set this value to zero, metering is disabled

To change this property, use the Cloud Settings tab of the Scalable Storage host properties.

See Scalable Storage properties.

Default value: 300

Possible values: 1 to 10000

PREFIX:CURL_CONNECT_TIMEOUT

The amount of time that is allocated for the media server to connect to the cloud storage server. This value is specified in seconds. The default is 300 seconds or five minutes.

This only limits the connection time, not the session time. If the media server cannot connect to the cloud storage server in the specified time, the job fails.

This value cannot be disabled. If an invalid number is entered, the CURL_CONNECT_TIMEOUT returns to the default value of 300.

Default value: 300

Possible values: 1 to 10000

PREFIX:CURL_TIMEOUT

The maximum time in seconds to allow for the completion of a data operation. This value is specified in seconds. If the operation does not complete in the specified time, the operation fails. The default is 900 seconds (15 minutes). To disable this timeout, set the value to 0 (zero).

Default value: 900

Possible values: 1 to 10000

PREFIX:ESFS_HOST

Identifies the host that contains the ESFS cache. The ESFS cache is used by a CloudCatalyst storage server for deduplication to the cloud.

This property is set internally and cannot be changed by the user.

PREFIX:LOG_CURL

Determines if cURL activity is logged. The default is NO which means log activity is disabled.

Default value: NO

Possible values: NO (disabled) and YES (enabled)

PREFIX:READ_BUFFER_SIZE

The size of the buffer to use for read operations. READ_BUFFER_SIZE is specified in bytes.

To enable the use of the buffer, set this value to a non-zero number.

The READ_BUFFER_SIZE determines the size of the data packets that the storage server transmits during each restore job. An increase in the value may increase performance when a large amount of contiguous data is accessed. If insufficient bandwidth exists to transmit the specified amount of data within a few minutes, restore failures may occur due to timeouts. When you calculate the required bandwidth, consider the total load of simultaneous backup jobs and restore jobs on multiple media servers.

See About object size for cloud storage.

PREFIX:USE_SSL

Determines if Secure Sockets Layer encryption is used for the control APIs. The default value is YES, meaning SSL is enabled.

Default value: YES

Possible values: YES or NO

PREFIX:USE_SSL_RW

Determines if Secure Sockets Layer encryption is used for read and write operations. The default value is YES, meaning SSL is enabled.

Default value: YES

Possible values: YES or NO

Provider Suffix: USE_CRL

If SSL is enabled and the CRL option is enabled, each non-self-signed SSL certificate is verified against the CRL.

PREFIX: OBJECT_SIZE

The size of the data object that NetBackup sends to the cloud storage server with an HTTP PUT and GET requests.

Object Size is specified in bytes. You cannot edit the Object Size once you set the value.

PREFIX: WRITE_BUFFER_NUM

This parameter is not applicable for Amazon S3-compatible cloud providers.

This read-only field displays the total number of write buffers that are used by the plug-in. The WRITE_BUFFER_SIZE value defines the size of the buffer. The value is set to 1 and cannot be changed.

Default value: 1

Possible values: 1

PREFIX:WRITE_BUFFER_SIZE

The size of the buffer to use for write operations. WRITE_BUFFER_SIZE is specified in bytes.

To disable the use of the buffer, set this value to 0 (zero).

The WRITE_BUFFER_SIZE value determines the size of the data packs transmitted from the data mover to the storage server during a backup. An increase in the value may increase performance when a large amount of contiguous data is accessed. If insufficient bandwidth exists to transmit the specified amount of data within a few minutes, backup failures may occur due to timeouts. When you calculate the required bandwidth, consider the total load of simultaneous backup jobs and restore jobs on multiple media servers.

See About object size for cloud storage.

HTTP:User-Agent

This is applicable only for Amazon S3-compatible cloud providers.

This property is set internally and cannot be changed by the user.

HTTP:x-amz-server-side-encryption

This is applicable only for the following cloud providers: Amazon S3 and Amazon GovCloud

Use this property to enable the server-side encryption of the data that you need to transfer to the cloud storage.

AES-256 is a server-side encryption standard.

Set this property to NONE to disable the server-side encryption for the cloud provider.

Note:

You should not enable this property, if you have already enabled the media server-side encryption option while configuring cloud storage server using the NetBackup Administration Console.

AMZ:REGION_NAME

This is applicable only for Amazon GLACIER_VAULT storage class.

Displays the region set during configuration of the storage server.

This property is set during configuration of the storage server and cannot be changed by the user.

AMZ:UPLOAD_CLASS

This is applicable only for the LIFECYCLE storage class.

Use this property to specify the storage class to back up the data.

Default value: STANDARD

Possible values: STANDARD or STANDARD_IA

AMZ:RETRIEVAL RETENTION PERIOD

This is applicable only for Amazon Glacier.

Use this property to specify the retrieval retention period in days.

AMZ:TRANSITION_TO_STANDARD_IA_AFTER

This is applicable only for the LIFECYCLE storage class.

If you have set the UPLOAD_CLASS as STANDARD, the TRANSITION_TO_STANDARD_IA_AFTER must be set to either NONE or in the range 30 to 2147483617.

If you have set the UPLOAD_CLASS as STANDARD_IA, the TRANSITION_TO_STANDARD_IA_AFTER must be set to NONE.

AMZ:TRANSITION_TO_GLACIER_AFTER

This is applicable only for the LIFECYCLE storage class.

If you have set UPLOAD_CLASS as STANDARD, and if TRANSITION_TO_STANDARD_IA_AFTER is set in the range 30 to 2147483617, you must set TRANSITION_TO_GLACIER_AFTER as NONE or in the range 60 to 2147483647. This value includes a minimum stay of 30 days for the data in the STANDARD_IA storage class.

If you have set UPLOAD_CLASS as STANDARD, and if TRANSITION_TO_STANDARD_IA_AFTER is set to NONE, you must set TRANSITION_TO_GLACIER_AFTER in the range 1 to 2147483647.

If you have set UPLOAD_CLASS as STANDARD_IA and if TRANSITION_TO_STANDARD_IA_AFTER is set to NONE, you must set TRANSITION_TO_GLACIER_AFTER in the range 30 to 2147483647.

AMZ:STORAGE_CLASS

This is applicable only for the Amazon S3 cloud providers.

Displays the storage class used by the cloud storage server.

This property is set internally and cannot be changed by the user.

AZR:STORAGE_TIER

This is applicable only for Microsoft Azure Archive.

Displays the storage tier used by the cloud storage server.

AMZ:OFFLINE_TRANSFER_MODE

This is applicable only for the Amazon S3 cloud providers.

Use this property to set the storage destination for Amazon Snowball.

Default value: NONE

Note:

Set the property to NONE after you are done with using the Snowball mode. In this mode, the end point must point to Amazon public end point.

Possible values:

FILESYSTEM: Set this property if you want the data to be transferred to Amazon Snowball using the file interface.

The storage server end point must point to the Amazon public end point.

PROVIDER_API: Set this property if you want to transfer the data to Amazon Snowball using the S3 interface provided by Amazon.

The storage server end point must point to Snowball end point.

AMZ:TRANSFER_DRIVE_PATH

This is applicable only for the Amazon S3 cloud providers and if the AMZ:OFFLINE_TRANSFER_MODE property is set to FILESYSTEM

Use this property to set the absolute mount point where the data must backed up for Amazon Snowball.

Default value: NONE

See Changing cloud storage server properties.

See NetBackup cloud storage server properties.