Veritas NetBackup™ Appliance Capacity Planning and Performance Tuning Guide

Last Published:
Product(s): Appliances (3.1.1, 3.1)
  1. About this Guide
    1.  
      About this guide
    2.  
      About the intended audience
    3.  
      About the NetBackup appliance documentation
  2. Section I. Capacity planning
    1. Analyzing your backup requirements
      1. Analyzing your backup requirements
        1.  
          What do you want to backup?
        2.  
          How much data do you want to back up?
        3.  
          When should the backup take place?
        4.  
          What is the retention period?
        5. Record your backup requirements
          1.  
            Template to record computer system information
          2.  
            Template to record database information
          3.  
            Template to record application server information
    2. Designing your backup system
      1.  
        Addressing use cases of backup systems for enterprises
      2.  
        Addressing use cases of backup systems for remote or branch offices
      3. About NetBackup appliances
        1.  
          About the Master Server role
        2.  
          About the Media Server role
      4.  
        About NetBackup 53xx High Availability solution
      5. Selecting new appliances
        1.  
          Selecting a media server
        2.  
          Selecting a master server
  3. Section II. Best Practices
    1. About the best practices section
      1.  
        About best practices
      2.  
        References to maintenance sites
    2. About implementing deduplication solutions
      1.  
        About implementing deduplication solutions
      2.  
        General recommendations
      3.  
        Oracle
      4.  
        Microsoft SQL
      5.  
        DB2
      6.  
        Sybase
      7.  
        Lotus Notes
    3. Network consideration
      1.  
        About network considerations
      2.  
        About Fibre Channel connectivity
      3. About SAN zone configurations
        1.  
          About zoning the SAN for NetBackup appliances
      4.  
        Validating network bandwidth
    4. Storage configuration
      1.  
        About storage configuration
      2. About configuring a shared storage pool
        1.  
          Calculating the basic stream count for backups
      3. About moving a storage partition for better performance
        1. Moving a partition
          1.  
            Move <partition> dialog
        2.  
          Moving a partition using the NetBackup Appliance Shell Menu
        3.  
          Moving the MSDP partition from a base disk to an expansion disk for optimum performance
    5. Generic best practices
      1.  
        Generic best practices
      2.  
        About Notification settings
      3.  
        About IPMI configuration
      4.  
        Disaster recovery best practices
      5.  
        Job performance
      6.  
        Architecture
      7.  
        NetBackup Catalog Backup
      8.  
        Patching with the SLP (storage lifecycle policies)
      9.  
        VMware backups using appliances
      10.  
        Improving NetBackup Appliance restore performance
  4. Section III. Performance tuning
    1. Role-based Performance Monitoring
      1.  
        Role-based configuration as a factor affecting performance
      2.  
        What affects the performance of a Master Server?
      3.  
        What affects the performance of a media server (MSDP)?
    2. Optimize network settings and improve performance
      1.  
        Optimize network settings and improve performance
      2.  
        SAN Fiber Channel setup
      3.  
        Network bonding
      4.  
        VMware VADP
      5.  
        Jumbo frame implementation for increased MTU
    3. Storage configurations
      1.  
        Storage configurations
      2.  
        Deduplication disk I/O and RAID level settings
      3. RAID Controller operations
        1.  
          RAID Controller commands
      4.  
        Deduplication load balancing
      5.  
        Storage Lifecycle Policies
      6.  
        Auto Image Replication (AIR)
      7.  
        AdvancedDisk settings
      8.  
        Tape Out operations
    4. NetBackup Appliance tuning procedures and performance monitoring
      1. About diagnosing performance issues
        1.  
          About CPU monitoring and tuning
        2.  
          About memory monitoring and tuning
        3.  
          About network monitoring and tuning
        4.  
          About I/O monitoring and tuning
        5.  
          General guidelines to spot a resource bottleneck
      2. About performance tuning practices
        1.  
          About I/O performance tuning
        2.  
          About Oracle backup and restore performance tuning
        3.  
          Setting NET_BUFFER_SZ to 0 on the NetBackup client for better WAN Optimization performance
      3. About tuning procedures and performance monitoring
        1. NetBackup Client performance
          1.  
            Using nbperfchk to validate disk performance on NetBackup Appliances
        2.  
          Other Performance Monitoring commands
  5. Section IV. Quick reference to Capacity planning and Performance tuning
    1. Capacity Planning checklist
      1.  
        Checklist for Capacity planning
      2.  
        Capacity measuring worksheet
    2. Best practices checklist
      1.  
        Best practices checklist
    3. How to monitor the performance of your appliance
      1.  
        About monitoring the performance of your appliance
      2.  
        Performance Monitoring matrix

What affects the performance of a media server (MSDP)?

NetBackup 52xx appliance as the dedicated MSDP media server is the most common type of deployment. In this kind of scenario there are many factors that influence performance of the media server:

There are two distinctive types of deduplication scenarios that can be major performance differentiators:

  • NetBackup Client deduplication

    In this scenario NetBackup client does part of the deduplication work. NetBackup Client will process backup data with the integrated deduplication plug-in (segments data and creates fingerprints) and send generated fingerprints to the NetBackup appliance for database lookup. This activity reduces the workload on the appliance and reduces the amount of data sent over the LAN from the NetBackup Client to NetBackup Appliance while creating minimal load on the client.

  • NetBackup Media Server deduplication

    Media server-based deduplication places far greater workload on the appliance than the client-based deduplication since server processor is performing fingerprinting operations as well. Media server deduplication is a resource-intensive workload and running other concurrent operations that are resource-intensive will affect performance significantly. The appliance CPU cores play a primary role in the performance followed by RAM and disk I/O.

Table: Parameters influencing the performance of a media server

Which are the process executed for this role?

Which are the resources used / affected due to the process?

How NetBackup 52xx help to optimally perform these processes?

Comments

In both types of deduplication scenarios the simplified workflow of standard deduplication load consists of the following tasks:

  • Backup tasks

  • Segmenting

  • Hashing backup streams

  • Looking up in the deduplication segment Database - Metabase

  • Finally receiving and storing deduplicated segments on the disk .

Deduplication as described places strain on the system resources

  • CPU clock and CPU cores - Each backup stream is assigned to a single CPU core while the speed of processing of the streams is limited by CPU clock. Number of the CPU cores and sustained high CPU clock frequency are important for deduplication performance.

  • RAM - The RAM is important for processing of deduplication segments and for Metabase performance,

  • Disk I/O - while disk I/O have to be capable of handling incoming data processed by CPU and then sent to the file system where deduplicated segments are stored.

  • Veritas Filesystem (VxFS) - used for deduplicated segments storage on the appliance is capable of achieving high performance. It is important to keep in mind that file system performance will degrade as free space approaches 100% utilization, with 90% utilization being the recommended watermark level.

NetBackup 5220 Backup Appliance with its Intel Xeon quad core CPU and NetBackup 5230 with its latest generation Intel Xeon hexacore (six cores) CPU's provide powerful processing capabilities.

NetBackup 5240 with its Intel Xeon CPUs with eight cores provide powerful processing capabilities.

To avoid resource congestion, ensure that when rehydration of data takes place no other concurrent operations run in parallel.

During POC planning, the amount of client data has to be considered to not fill up the appliance file system and subsequently reduce both the backup and restore performance.

All major subsystems of the appliance that are CPU, RAM, and Disk play an important role when it comes to deduplication performance. Running client-based deduplication which is lighter on the CPU than media server deduplication is a good practice, however careful consideration has to be taken to avoid running out of free memory.

Note:

In some specific cases there is a possibility that Client side deduplication performs slower than Media server deduplication. One such rare example is, backup of SQL Server transaction logs on the underpowered SQL Server. These cases are rare but possible and they are mentioned in the context of the exception that proves the rule.

Scheduled rebasing

According to a predetermined schedule, once a day, rebasing is run to group segments from the same backup together on the disk to improve the restore performance.

Operation like rebasing has a very positive effect on performance, backup image segments are grouped together on the disk which improves disk I/O throughput.

It is important to keep in mind that file system performance will degrade as free space approaches 100 % utilization. The watermark level is 90% utilization.

Restore

Restore operation requires full rehydration of data which is the most resource intensive process on the NetBackup MSDP.

NetBackup 52xx backup appliance can restore data using multiple restore streams.

Tape out from MSDP

Tape Out operation is very resource-intensive operation and requires full rehydration of the backup image. Performance of the tape out operation is limited by how tape drives handle multiple streams. Unlike restore operations that can benefit from appliance performance with multiple concurrent restore streams, tape drives can handle only one stream per tape drive thus limiting tape out performance.

Limit the number of I/O streams to the recommended value of 96. This can be done in the properties of storage unit under Max I/O streams text box.

CRQP (Content Router Queue Processing)

It is one of the regular maintenance operations on MSDP that processes fingerprint database (CRDB) transaction logs (tlogs). This operation is necessary for the maintenance of the deduplication storage pool and is scheduled to run twice a day.

During CRQP activity there is a hit on the disk I/O and CPU/RAM resources in the range of 10% - 20% depending on the amount of tlogs to process and this has to be accounted for when planning for high performance tasks that will run concurrently with CRQP. Details of the CRQP activity can be monitored through spooled log: /disk/log/spoold/storaged.log. For more information, refer to TECH156743 for more details.

Initial Optimized Duplication

Initial Optimized Duplication is an resource-intensive process and places a stress on the operating system. This severely affects the deduplication performance if executed concurrently with the backup.

See What affects the performance of a Master Server?.