NetBackup™ for Cloud Object Store Administrator's Guide
- Introduction
- Managing Cloud object store assets
- Planning NetBackup protection for Cloud object store assets
- Enhanced backup performance in 11.0 or later
- Prerequisites for adding Cloud object store accounts
- Configuring buffer size for backups
- Configure a temporary staging location
- Configuring advanced dynamic multi-streaming parameters
- Permissions required for Amazon S3 cloud provider user
- Permissions required for Azure blob storage
- Permission required for Azure Data Lake Storage
- Permissions required for GCP
- Limitations and considerations
- Adding Cloud object store accounts
- Manage Cloud object store accounts
- Scan for malware
- Protecting Cloud object store assets
- About accelerator support
- About incremental backup
- About dynamic multi-streaming
- About object change tracking
- Configuring object change tracking
- Configuring access permissions for the buckets
- Configuring access policy on the log bucket
- Configuration guidelines for IBM Storage Ceph
- Enable bucket logging for source buckets
- Creating policy for the log bucket
- Additional storage requirements at the staging location
- Configuring bucket logging in IBM Storage Ceph
- Maintaining the log bucket
- Configuring NetBackup for object change tracking
- Configuring NetBackup policy for object change tracking
- Verifying object change tracking in the Activity monitor
- Scenarios when NetBackup overrides object change tracking
- About storage lifecycle policies
- About policies for Cloud object store assets
- Planning for policies
- Prerequisites for Cloud object store policies
- Creating a backup policy
- Policy attributes
- Creating schedule attributes for policies
- Configuring the Start window
- Configuring the exclude dates
- Configuring the include dates
- Configuring the Cloud objects tab
- Adding conditions
- Adding tag conditions
- Examples of conditions and tag conditions
- Managing Cloud object store policies
- Recovering Cloud object store assets
- Troubleshooting
- Error 5549: Cannot validate bucket logging information
- Error 5576: The maximum number of concurrent jobs specified for a storage unit, must be greater than or equal to the number of streams specified in the policy.
- Error 5579: Falling back to object listing for change detection, not considering object change tracking for this bucket, specified in the policy.
- Error 5580: The specified failover strategy for the storage unit group is incompatible with the Cloud object store policy, with dynamic multi-streaming.
- Error 5545: Backup failed as NetBackup cannot parse records from the log object
- Error 5541: Cannot take backup, the specified staging location does not have enough space
- Error 5537: Backup failed: Incorrect read/write permissions are specified for the download staging path.
- Error 5538: Cannot perform backup. Incorrect ownership is specified for the download staging path.
- Reduced acceleration during the first full backup, after upgrade to versions 10.5 and 11.
- After backup, some files in the shm folder and shared memory are not cleaned up.
- After an upgrade to NetBackup version 10.5, copying, activating, and deactivating policies may fail for older policies
- Backup fails with default number of streams with the error: Failed to start NetBackup COSP process.
- Backup fails, after you select a scale out server or Snapshot Manager as a backup host
- Backup fails or becomes partially successful on GCP storage for objects with content encoded as GZIP.
- Recovery for the original bucket recovery option starts, but the job fails with error 3601
- Recovery Job does not start
- Restore fails: "Error bpbrm (PID=3899) client restore EXIT STATUS 40: network connection broken"
- Access tier property not restored after overwriting the existing object in the original location
- Reduced accelerator optimization in Azure for OR query with multiple tags
- Backup failed and shows a certificate error with Amazon S3 bucket names containing dots (.)
- Azure backup jobs fail when space is provided in a tag query for either tag key name or value.
- The Cloud object store account has encountered an error
- The bucket is list empty during policy selection
- Creating a second account on Cloudian fails by selecting an existing region
- Restore failed with 2825 incomplete restore operation
- Bucket listing of a cloud provider fails when adding a bucket in the Cloud objects tab
- AIR import image restore fails on the target domain if the Cloud store account is not added to the target domain
- Backup for Azure Data Lake fails when a back-level media server is used with backup host or storage server version 10.3
- Backup fails partially in Azure Data Lake: "Error nbpem (pid=16018) backup of client
- Recovery for Azure Data Lake fails: "This operation is not permitted as the path is too deep"
- Empty directories are not backed up in Azure Data Lake
- Recovery error: "Invalid alternate directory location. You must specify a string with length less than 1025 valid characters"
- Recovery error: "Invalid parameter specified"
- Restore fails: "Cannot perform the COSP operation, skipping the object: [/testdata/FxtZMidEdTK]"
- Cloud store account creation fails with incorrect credentials
- Discovery failures due to improper permissions
- Restore failures due to object lock
Examples of conditions and tag conditions
Here is an example to illustrate the use of conditions and tag conditions.
Consider the container/bucket has the following files/directories:
The following blobs are tagged with "Project": "HR" tag
OrganizationData/Hr/resumes/resume1_selected.pdf
OrganizationData/Hr/resumes/resume2_rejected.pdf
OrganizationData/Hr/resumes/resume3_noupdate.pdf
The following blobs are tagged with "Project": "Finance" tag value
OrganizationData/Fin/accounts/account1/records1.txt
OrganizationData/Fin/accounts/account2/records2.txt
OrganizationData/Fin/accounts/account3/records3.txt
OrganizationData/Fin/accounts/monthly_expenses/Jul2022.rec
OrganizationData/Fin/accounts/monthly_expenses/Aug2022.rec
The following blobs are tagged with "Project": "Security"
The blob Getepass.pdf: Has one more tag with "TypeOfData":"ID_Cards" so this is tagged with two tags (that is: Security and ID_Cards)
OrganizationData/newJoinees/tempPassesList.xls
The following blobs are tagged with "Project": "Environment"
EnvironmentContribution.xls
NewPlantedTrees.xls
Example prefix conditions:
Case 1: To backup all resumes irrespective of their status (like, selected or rejected) from
OrganizationDataadd the query:prefix Equal to OrganizationData/Hr/resumes/resume
Result: All records that start with
OrganizationData/Hr/resumes/resumeare backed up.Case 2: To backup all resumes and records from Fin and HR, add any of the following queries:
prefix Equal to OrganizationData/Hr/resumes/resume
Or
prefix Equal to OrganizationData/Fin/accounts/account1/rec
Note:
You can add multiple prefixes with OR conditions.
Result: All records starting with OrganizationData/Hr/resumes/resume or OrganizationData/Fin/accounts/account1/rec are backed up.
Example object conditions:
To backup a specific object/blob add the following query:
object Equal to OrganizationData/Fin/accounts/monthly_expenses/Jul2022.rec
Result: Only the blob with the name Jul2022.rec is selected.
Example tag conditions:
Case 1: To back up all blobs tagged with "Project": "Finance", add the following query:
tagKey Equal to 'Project' and tagVal Equal to 'Finance'
Result: All objects/blobs tagged with "Project" = "Finance" are selected.
Case 2: To back up data that matches with project Finance or Security, add the query:
tagKey Equal to 'Project' and tagValue eq 'Finance' tagKey Equal to 'Project' and tagValue eq 'Security'
Result: All object/blobs tagged with "Project": "Finance" or "Project":"Security" are selected.
Case 3: To back up data from "Project":"Security" and "TypeOfData":"ID_Cards" add the queries:
(tagKey Equal to 'Project' and tagValue Equal to 'Security') (tagKey Equal to 'TypeOfData' and tagValue Equal to 'ID_Cards')
Result: Data with tag "Project":" Security" and "TypeOfData": "ID_Cards" are selected.