Veritas NetBackup for Hadoop Administrator's Guide
- Introduction
- Deploying the Hadoop plug-in
- Configuring NetBackup for Hadoop
- About configuring NetBackup for Hadoop
- Managing backup hosts
- Adding Hadoop credentials in NetBackup
- Configuring the Hadoop plug-in using the Hadoop configuration file
- Configuration for a Hadoop cluster that uses Kerberos
- Configuring NetBackup policies for Hadoop plug-in
- Disaster recovery of a Hadoop cluster
- Performing backups and restores of Hadoop
- Troubleshooting
- About troubleshooting NetBackup for Hadoop issues
- About NetBackup for Hadoop debug logging
- Troubleshooting backup issues for Hadoop data
- Backup operation for Hadoop fails with error code 6599
- Backup operation fails with error 6609
- Backup operation failed with error 6618
- Backup operation fails with error 6647
- Extended attributes (xattrs) and Access Control Lists (ACLs) are not backed up or restored for Hadoop
- Backup operation fails with error 6654
- Backup operation fails with bpbrm error 8857
- Backup operation fails with error 6617
- Backup operation fails with error 6616
- Troubleshooting restore issues for Hadoop data
- Restore fails with error code 2850
- NetBackup restore job for Hadoop completes partially
- Extended attributes (xattrs) and Access Control Lists (ACLs) are not backed up or restored for Hadoop
- Restore operation fails when Hadoop plug-in files are missing on the backup host
- Restore fails with bpbrm error 54932
- Restore operation fails with bpbrm error 21296
Using NetBackup Command Line Interface (CLI) to create a BigData policy for Hadoop clusters
You can also use the CLI method to create a BigData policy for Hadoop.
To create a BigData policy using NetBackup CLI method
- Log on as an Administrator.
- Navigate to
/usr/openv/netbackup/bin/admincmd. - Create a new BigData policy using the default settings.
bppolicynew policyname
- View the details about the new policy using the
-Loption.bpplinfo policyname -L
- Modify and update the policy type as BigData.
bpplinfo PolicyName -modify -v -M MasterServerName -pt BigData
- Specify the Application_Type as Hadoop.
For Windows:
bpplinclude PolicyName -add "Application_Type=hadoop"
For UNIX:
bpplinclude PolicyName -add 'Application_Type=hadoop'
Note:
The parameter values for Application_Type=hadoop are case-sensitive.
- Specify the backup host on which you want the backup operations to be performed for Hadoop.
For Windows:
bpplinclude PolicyName -add "Backup_Host=IP_address or hostname"
For UNIX:
bpplinclude PolicyName -add 'Backup_Host=IP_address or hostname'
Note:
The backup host must be a Linux computer. The backup host can be a NetBackup client or a media server or a master server.
- Specify the Hadoop directory or folder name that you want to backup.
For Windows:
bpplinclude PolicyName -add "/hdfsfoldername"
For UNIX:
bpplinclude PolicyName -add '/hdfsfoldername'
Note:
Directory or folder used for backup selection while defining BigData Policy with Application_Type=hadoop must not contain space or comma in their names.
- Modify and update the policy storage type for BigData policy.
bpplinfo PolicyName -residence STUName -modify
- Specify the IP address or the host name of the NameNode for adding the client details.
For Windows:
bpplclients PolicyName -M "MasterServerName" -add "HadoopServerNameNode" "Linux" "RedHat"
For UNIX:
bpplclients PolicyName -M 'MasterServerName' -add 'HadoopServerNameNode' 'Linux' 'RedHat'
- Assign a schedule for the created BigData policy as per your requirements.
bpplsched PolicyName -add Schedule_Name -cal 0 -rl 0 -st sched_type -window 0 0
Here,
sched_typevalue can be specified as follows:Schedule Type
Description
FULL
Full backup
INCR
Differential Incremental backup
CINC
Cumulative Incremental backup
TLOG
Transaction Log
UBAK
User Backup
UARC
User Archive
The default value for
sched_typeis FULL.Once you set the schedule, Hadoop data is backed up automatically as per the set schedule without any further user intervention.
- Alternatively, you can also perform a manual backup for Hadoop data.
For performing a manual backup operation, execute all the steps from Step 1 to Step 11.
- For a manual backup operation, navigate to
/usr/openv/netbackup/binInitiate a manual backup operation for an existing BigData policy using the following command:
bpbackup -i -p PolicyName -s Schedule_Name -S MasterServerName -t 44
Here,
-prefers to policy,-srefers to schedule,-Srefers to master server, and-t 44refers to BigData policy type.