NetBackup™ NAS Administrator's Guide
- Section I. About NAS backups
- Section II. Using NAS-Data-Protection (D-NAS)
- D-NAS overview
- D-NAS Planning and Tuning
- Pre-requisites for D-NAS configuration
- Volume multi-host backup
- Configure D-NAS policy for NAS volumes
- Using accelerator
- Using Vendor Change Tracking
- Replication using D-NAS policy
- Restoring from D-NAS backups
- Troubleshooting
- Troubleshooting
- Setting the log level
- Logging directories for Linux platforms
- Logging folders for Windows platforms
- Logging folders for multi-stream restore
- Restore from a snapshot fails with status 133
- Backup from snapshot fails with error 50
- Backup from snapshot parent job fails with error 4213: Snapshot import failed
- Backup host pool creation fails with the error "Failed to fetch host list"
- Snapshot job fails and the snapshot command does not recognize the volume name
- Accelerator enabled incremental backup of NetApp NAS volume
- Snapshot method: Auto
- Backup from snapshot jobs for NAS-Data-Protection policy fail with error 4213
- A full VCT-enabled indexing job runs, when followed by a non-VCT indexing job with a backup host prior to version to 10.3
- Backup from snapshot jobs for NAS data protection policy fail with error 927
- Error code: 930: No supported media server is available in the All_Media_Server_Pool to use to backup the NAS shares.
- Multi-stream restore from NAS array volume fails with the status: 174 Media manager - system error occurred.
- NAS job fails with the error: Crawler process timed out after 600 seconds waiting for streams to attach with shared memory.
- Section III. Using NDMP
- Introduction to NetBackup for NDMP
- About NetBackup for NDMP
- About Network Data Management Protocol (NDMP)
- Types of NDMP backup
- About NDMP policies in NetBackup
- About NetBackup storage units
- About assigning tape drives to different hosts
- About the NDMP backup process
- About the NDMP restore process
- About Direct Access Recovery (DAR)
- Snapshot Client assistance
- About NDMP multiplexing
- About NDMP support for Replication Director
- Limitations of Replication Director with NDMP
- About NDMP support for NetApp clustered Data ONTAP (cDOT)
- Installation Notes for NetBackup for NDMP
- Configuring NDMP backup to NDMP-attached devices
- About configuring NDMP-attached devices
- Authorizing NetBackup access to a NAS (NDMP) host
- About access for three-way backups and remote NDMP
- About Media and Device Management configuration
- Using the Device Configuration Wizard to configure an NDMP filer
- About adding volumes
- About verifying NDMP password and robot connection
- Adding NDMP storage units
- About creating an NDMP policy
- About environment variables in the backup selections list
- About appropriate host selection for NetApp cDOT backup policies
- About backup types in a schedule for an NDMP policy
- About enabling or disabling DAR
- Configuring NetBackup for NDMP in a clustered environment
- Configuring NDMP backup to NetBackup media servers (remote NDMP)
- Configuring NDMP DirectCopy
- Accelerator for NDMP
- Remote NDMP and disk devices
- Using the Shared Storage Option (SSO) with NetBackup for NDMP
- NAS appliance information for NDMP
- About NAS appliances support
- Non-vendor-specific information
- Vendor-specific information
- Dell EMC Isilon
- Dell EMC VNX
- Dell EMC Unity
- EMC Celerra
- Hitachi HDI/VFP
- Hitachi NAS (HNAS)
- HP X9000 NAS
- Huawei OceanStor V3
- IBM System Storage Nxxxx
- NEC Storage NV series
- NetApp
- Using NetBackup with NetApp's Data ONTAP 8.2 cluster mode
- Using a node name as the NDMP client name in all versions of NetBackup
- Using a data Vserver LIF as the NDMP client name in non-CAB-aware versions of NetBackup
- Using a cluster_mgmt vserver LIF as the NDMP client name in non-CAB-aware versions of NetBackup
- Using a cluster_mgmt Vserver LIF as the NDMP client name in CAB-aware versions of NetBackup
- Using NetBackup with NetApp's Data ONTAP 8.2 cluster mode
- Nexenta
- Nexsan
- Oracle Axiom Series
- Oracle Solaris Server
- Stratus V Series
- Backup and restore procedures
- Troubleshooting
- Using NetBackup for NDMP scripts
- About the NetBackup for NDMP scripts
- ndmp_start_notify script (UNIX)
- ndmp_start_notify.cmd script (Microsoft Windows)
- ndmp_end_notify script (UNIX)
- ndmp_end_notify.cmd script (Microsoft Windows)
- ndmp_start_path_notify script (UNIX)
- ndmp_start_path_notify.cmd script (Microsoft Windows)
- ndmp_end_path_notify script (UNIX)
- ndmp_end_path_notify.cmd script (Microsoft Windows)
- ndmp_moving_path_notify script (UNIX)
- ndmp_moving_path_notify.cmd script (Microsoft Windows)
- Introduction to NetBackup for NDMP
Sizing guidelines for D-NAS
The sizing for D-NAS environments is based on your business requirements. Sizing depends on the storage array. It also depends on the characteristics of the NAS data that you protect. You can configure the D-NAS policies to use the NetBackup media server as a backup host. As a result, D-NAS backup processes may organically scale in terms of both performance and throughput.
When a D-NAS policy runs, NetBackup uses the nbcs (crawler) and the bpbkar processes on the backup host. It uses the bpbrm and bptm on the media server. Each running process consumes CPU cycles. The nbcs process uses CPU the most. The nbcs is a multi-threaded crawler. It traverses the NAS share during backup and index operations. Multiple nbcs processes handle concurrent jobs for backup and indexing operations of NAS volumes. One nbcs process corresponds to one NAS volume backup. If you use multiple backup hosts to back up a single NAS volume, each backup host uses a separate nbcs process.
The crawler process is multi-threaded. Multiple threads traverse one NAS share during D-NAS policy execution. This can lead to spikes in CPU use for the nbcs process. You can ease CPU use by decreasing the number of threads used by the nbcs process. You can set the MULTI_THREADED_CRAWLER_THREADS parameter in the bp.conf file. This changes the thread count used by each nbcs process. The default value is 20, and you can specify a value in the range of 1 to 200. You must set this parameter on the backup hosts used for NAS backups. This is applicable for the hosts on NetBackup version 10.4 and above.
The amount of memory used by a backup job of a single NAS share depends on the number of streams configured in the D-NAS policy. Each backup stream on a host uses one bpbrm, bptm, and bpbkar process. For example, if the policy is set to use 10 streams, then a single NAS share backup runs 10 instances of the bpbrm, bptm, and bpbkar processes. It runs only one nbcs process.
The amount of memory used by the bpbrm, bptm, and bpbkar processes is static and does not fluctuate much. The memory used by the nbcs process depends on certain data traits. These include file system hierarchy, number of files, and folders in a NAS share. If a NAS share has a very dense directory structure, then the nbcs process uses 200 MB of memory at its peak. If a NAS share has a flat hierarchy with millions of files in its directories, then nbcs uses 20% - 30% additional memory at its peak. Note that memory usage is not always at peak and decreases as the backup progresses. You may observe spikes in memory consumption depending on the data characteristics.
Memory usage is the same for all backup types. These include index tasks, first full, incremental, and accelerated full backups.
Table: Memory consumption for a single NAS backup with 5, 10, and 20 backup streams
NAS share memory consumption | Memory for 5 backup streams (MB) | Memory for 10 backup streams (MB) | Memory for 20 backup streams (MB) |
|---|---|---|---|
On backup host | 115 + 200 (crawler) | 230 + 200 (crawler) | 460 + 200 (crawler) |
On media server * | 780 | 1560 | 3120 |
Total memory consumption (approximate) | 1095 | 1990 | 3780 |
* For index from snapshot operations, only the media server memory consumption is applicable.
You can estimate the approximate memory needed for D-NAS backups using the table Table: Memory consumption for a single NAS backup with 5, 10, and 20 backup streams. Using this table, you can also estimate the number of backup hosts and media server hosts that you need to provision for D-NAS backups. This also helps to schedule the NAS backup jobs. For example:
During backup, a policy with 10 streams and 10 NAS shares uses about 38 GB of system memory.
During backup, a policy with 20 streams and 10 NAS shares uses about 38 GB of system memory.
Consider the following:
When a single host serves as both the media server and the backup, all memory usage occurs on that host.
When you use the multi-host feature for NAS share backups, the memory utilization of the crawler is distributed equally among all backup hosts.
Use multiple media servers if the overall number of backup streams for D-NAS backups exceeds 200.