NetBackup™ for Hadoop Administrator's Guide
- Introduction
- Prerequisites and best practices for the Hadoop plug-in for NetBackup
- Configuring NetBackup for Hadoop
- About configuring NetBackup for Hadoop
- Managing backup hosts
- Adding Hadoop credentials in NetBackup
- Configuring the Hadoop plug-in using the Hadoop configuration file
- Configuring NetBackup for a highly-available Hadoop cluster
- Configuring a custom port for the Hadoop cluster
- Configuring number of threads for backup hosts
- Configuring number of streams for backup hosts
- Configuring distribution algorithm and golden ratio for backup hosts
- Configuring communication between NetBackup and Hadoop clusters that are SSL-enabled (HTTPS)
- Configuration for a Hadoop cluster that uses Kerberos
- Hadoop.conf configuration for parallel restore
- Create a BigData policy for Hadoop clusters
- Disaster recovery of a Hadoop cluster
- Performing backups and restores of Hadoop
- Troubleshooting
- About troubleshooting NetBackup for Hadoop issues
- About NetBackup for Hadoop debug logging
- Troubleshooting backup issues for Hadoop data
- Backup operation fails with error 6609
- Backup operation failed with error 6618
- Backup operation fails with error 6647
- Extended attributes (xattrs) and Access Control Lists (ACLs) are not backed up or restored for Hadoop
- Backup operation fails with error 6654
- Backup operation fails with bpbrm error 8857
- Backup operation fails with error 6617
- Backup operation fails with error 6616
- Backup operation fails with error 84
- NetBackup configuration and certificate files do not persist after the container-based NetBackup appliance restarts
- Unable to see incremental backup images during restore even though the images are seen in the backup image selection
- One of the child backup jobs goes in a queued state
- Troubleshooting restore issues for Hadoop data
- Restore fails with error code 2850
- NetBackup restore job for Hadoop completes partially
- Extended attributes (xattrs) and Access Control Lists (ACLs) are not backed up or restored for Hadoop
- Restore operation fails when Hadoop plug-in files are missing on the backup host
- Restore fails with bpbrm error 54932
- Restore operation fails with bpbrm error 21296
- Hadoop with Kerberos restore job fails with error 2850
- Configuration file is not recovered after a disaster recovery
- Index
Managing backup hosts
A backup host acts as a proxy client which hosts all the backup and restore operations for Hadoop clusters. For the Hadoop plug-in for , the backup host performs all the backup and restore operations and does that require that a separate agent be installed on the Hadoop cluster.
The backup host must be a Linux computer. 10.3 release supports only RHEL and SUSE platforms as a backup host.
The backup host can be a client or a media server or a primary server. recommends that you have a media server as a backup host.
Consider the following before adding a backup host:
For backup operations, you can add one or more backup hosts.
For restore operations, you can add only one backup host.
A primary, media, or client can perform the role of a backup host.
Hadoop plug-in for is installed on all the backup hosts.
To add a backup host
- Open the web UI.
- Create a BigData policy.
- In the Backup selections tab, click Add and add the backup host in the following format:
Backup_Host=IP_address or hostname
Alternatively, you can also add a backup host using the following command:
For Windows:
<install_path>\NetBackup\bin\admincmd\bpplinclude PolicyName -add Backup_Host=IP_address or hostname
For UNIX:
/usr/openv/var/global/bin/admincmd/bpplinclude PolicyName -add Backup_Host=IP_address or hostname
- As a best practice, add the entries of all the NameNodes and DataNodes to the
/etc/hostsfile on all the backup hosts. You must add the host name in FQDN format.OR
Add the appropriate DNS entries in the
/etc/resolv.conffile.
To remove a backup host
- In the Backup Selections tab, select the backup host that you want to remove.
- Right click the selected backup host and click Delete.
Alternatively, you can also remove a backup host using the following command:
For Windows:
Install_Path\NetBackup\bin\admincmd\bpplinclude PolicyName -delete Backup_Host=IP_address or hostname
For UNIX:
/usr/openv/var/global/bin/admincmd/bpplinclude PolicyName -delete 'Backup_Host=IP_address or hostname'