How to upgrade to NetBackup Appliance Release 3.1.2

How to upgrade to NetBackup Appliance Release 3.1.2

Article: 100043606
Last Published: 2019-02-08
Ratings: 8 14
Product(s): Appliances

NOTICE:

Veritas has re-posted an updated patch for the 3.1.2 release.  This is an update to the upgrade rpm packages only and does not impact new installations of appliances that shipped with version 3.1.2 from the factory.

For those customers that have already successfully upgraded to version 3.1.2 using the original upgrade rpm packages, you do not need to upgrade again.

The following describes the issues that existed in the initial 3.1.2 release, and are now fixed in the updated 3.1.2 release:

  • Post upgrade Self-Test failure due to a "Split-Brain" issue
  • Failure to restore 3rd party certificates during the upgrade
  • New megasr driver that minimizes an OS RAID offline issue that was causing a boot failure during the upgrade process
  • Appliance rollback fails to roll back the root volume because of errors in the snapshot LV system/root_SNAP_PRE_UPGRADE file
  • Upgrade fails at 10% and rolls back successfully, caused by installation of the following EEBs before the upgrade:
    For appliances upgraded from version 3.1.1 - ET3945082, ET3942191
    For appliances upgraded from version 3.1 - ET3941382
  • Issues related to rollback of Cloud Catalyst and Copilot shares in the event of an upgrade failure and rolling back to the previous version
 

Description

NetBackup Appliance software version 3.1.2 supports direct upgrades for appliance models 5230, 5240, 5330, and 5340 that currently use software versions 2.7.1, 2.7.2, 2.7.3, 3.0, 3.1, or 3.1.1.

Master server upgrades from software versions 3.1.1 and earlier require you to provide a registration key for the Veritas Smart Meter feature. The upgrade procedure below includes the steps to obtain the key file and upload it to the appliance. For more information about Smart Reader functionality, see the Veritas Smart Reader Getting Started Guide.

Upgrade restrictions

  • NetBackup 5200 appliances cannot be upgraded to software versions 2.7.1 and later.
  • The NetBackup 5220 Appliance has reached its end-of-support life as of August 14, 2018 and cannot be upgraded to software versions 3.1.2 and later.

Starting with NetBackup appliance software version 2.7.1, Red Hat Enterprise Linux (RHEL) replaces the SUSE Linux Enterprise Server (SLES) operating system. Before you upgrade appliances with versions 2.6.1, 2.6.1.1, or 2.6.1.2, certain pre-upgrade tasks must be performed to help ensure a successful upgrade. For complete details, see the NetBackup Appliance Upgrade Guide - Red Hat Enterprise Linux (RHEL) Operating System.
For additional information about new features, product fixes and enhancements, known issues, and the current release content included in this software update, refer to the NetBackup Appliance Release Notes.

To access the complete NetBackup Appliance documentation set, click on the following link:
https://www.veritas.com/content/support/en_US/DocumentBrowsing.html?product=Appliances
 

Note: The 3.1.2 release update (.rpm) packages are not attached to this file. The following procedure includes links to the Veritas SORT website where the packages are located.

Table of contents

Product dependencies
Downloading and installation instructions
Links

Product dependencies

  • For appliances that are configured as a media server, this upgrade requires a NetBackup Appliance 3.1.2 master server appliance or a traditional NetBackup 8.1.2 master server. Master servers must be upgraded before media servers.
  • This release supports a direct upgrade from versions 2.7.1, 2.7.2, 2.7.3, 3.0, 3.1, or 3.1.1. For complete details about upgrades to version 3.1.2, see the NetBackup Appliance Upgrade Guide - Red Hat Enterprise Linux (RHEL) Operating System.
  • After a successful upgrade, rollback from this version of NetBackup appliance software is not supported.
  • Before you begin the upgrade process, make sure that there are no backup jobs currently running or scheduled to run during the upgrade.
  • If you have enabled the STIG feature on an appliance and you need to upgrade it or install an EEB on it, do not plan such installations during the 4:00am - 4:30am time frame. By following this best practice, you can avoid interrupting the automatic update of the AIDE database and any monitored files, which can cause multiple alert messages from the appliance.
  • Before you begin the upgrade process, see the NetBackup Appliance Upgrade Guide for important pre-upgrade tasks that you may need to perform.
  • During installation of this release update, all NetBackup services and web services are shut down and restarted automatically.
  • Make sure that the NetBackup master server is turned on and running throughout the duration of the media server appliance upgrade. In addition, make sure that the NetBackup processes are started on both the master server and the media server.
  • Starting with software version 3.1, the Appliance Management Console lets you manage multiple 3.1 and later NetBackup appliances. If you want to upgrade appliances with versions 2.7.3 or 3.0 from the Appliance Management Console, you must first apply the following EEBs on those appliances:
    For appliances with version 2.7.3:
    https://sort.veritas.com/public/appliance/nba/patches/3.1/SYMC_NBAPP_EEB_ET3929998-2.7.3.0-85.x86_64.rpm

    For appliances with version 3.0:
    https://sort.veritas.com/public/appliance/nba/patches/3.1/NBAPP_EEB_ET3930454-3.0.0.0-59.x86_64.rpm

    Installing the applicable EEBs on NetBackup appliance versions 2.7.3 and 3.0 enables you to add these appliances as agents to the Appliance Management Console. See the following link for instructions on how to add the appliances to an Appliance Management Console:

    https://www.veritas.com/content/support/en_US/doc/126736400-130432641-0/v126586933-130432641

    Once the 2.7.3 and 3.0 appliances are added, they can be upgraded from the Appliance Management Console. See the Appliance Management Guide for more information.

    Note: The Appliance Management Console lets you upgrade and install an EEB on multiple 3.1 and later NetBackup appliances. However, installing an EEB on the 2.7.3 and 3.0 appliances from the Appliance Management Console is not supported.

Downloading and installation instructions

The server, client, and add-on packages are located on the Veritas SORT website, along with a text file that contains the MD5 and SHA1 checksums. These instructions include links to access all of those items.

Manually downloading NetBackup appliance server packages


Perform this task from a computer that can access the Internet and can also communicate with the appliance. Internet access is required to download the release update files from the Veritas Support web site to the appliance.

Due to the unique file name extensions of the split server packages, monitor your browser behavior closely during the file downloads. When you right-click a file link and select Save link as... or Save target as..., make sure that the file names retain the .xof3 extension. For example: .2of3.


To download appliance software release updates using a CIFS or NFS share

  1. Open an SSH session and log on to the appliance as an administrator using the NetBackup Appliance Shell Menu.
  2. Open an NFS or a CIFS share by entering the following command:
    Main_Menu > Manage > Software > Share Open
  3. Map or mount the appliance share directory as follows:
    Windows
    Map the following appliance CIFS share on your computer:
    \\<appliance-name>\incoming_patches
    Windows systems prompt you for the admin user name and its corresponding password.
    UNIX
    Mount the following appliance NFS share:
    mkdir -p /mount/<appliance-name>
    mount <appliance-name>:/inst/patch/incoming /mount/<appliance-name>
  4. This step describes downloading the upgrade package files and where to find the MD5 and SHA1 checksums.

The following links are to download the split tar server files from the Veritas SORT website.

https://sort.veritas.com/public/appliance/nba/patches/3.1.2/NB_Appliance_N_3.1.2-2.x86_64-tar-split.1of3
https://sort.veritas.com/public/appliance/nba/patches/3.1.2/NB_Appliance_N_3.1.2-2.x86_64-tar-split.2of3
https://sort.veritas.com/public/appliance/nba/patches/3.1.2/NB_Appliance_N_3.1.2-2.x86_64-tar-split.3of3


* Click on the following link to a text file on the Veritas SORT website that contains the MD5 and SHA1 checksums:
https://sort.veritas.com/public/appliance/nba/patches/3.1.2/NetBackup_Appliance_Release_312_MD5_SHA1.txt
Verify that the downloaded MD5 or SHA1 checksums match those in the text file on the Veritas SORT website.

  1. Use one of the following commands to join (and extract) the release update .rpm files:
    Windows
    copy /b NB_Appliance_N_<release-version>.x86_64-tar-split.1of3+NB_Appliance_N_<release-version>.x86_64-tar-split.2of3+NB_Appliance_N_<release-version>.x86_64-tar-split.3of3 NB_Appliance_N_<release-version>.tar
    Note: This command must be entered as one string. Make sure that the only space in the name is after  .3of3. In addition, <release-version> is the software release number, such as 3.1.2, and the version number of the software release, such as -1.
    Use Windows WinRAR utilities to uncompress the NB_Appliance_N_<release-version>.tar file. The resulting files are as follows:
    SYMC_NBAPP_update-<release-version>.x86_64.rpm
    update.rpm.md5_checksum
    update.rpm.sha1_checksum

    UNIX
    cat NB_Appliance_N_<release-version>.x86_64-tar-split.1of3<space>NB_Appliance_N_<release-version>.x86_64-tar-split.2of3<space>NB_Appliance_N_<release-version>.x86_64-tar-split.3of3 | tar xvf -
    Where <release-version> is the software release number, such as 3.1.2, and the version number of the software release, such as -1.
    Note: This command is one string. In this example, there is one space between each split package that is identified with a "<space>".
    The resulting files are as follows:
    SYMC_NBAPP_update-<release-version>.x86_64.rpm
    update.rpm.md5_checksum
    update.rpm.sha1_checksum

    Note: To extract packages on UNIX systems, Veritas recommends that you use GNU tar version 1.16 or higher instead of tar. See the following article for more information about extracting images:
    https://www.veritas.com/docs/000012145
  2. For UNIX systems, run one of the following commands to compute the checksum value for the .rpm file:
    md5sum SYMC_NBAPP_update-<release-version>.x86_64.rpm
    Or:
    sha1sum SYMC_NBAPP_update-<release-version>.x86_64.rpm
    Verify that the checksum value matches the content of the update.rpm.md5_checksum file or the update.rpm.sha1_checksum file.
  3. Copy this release update .rpm to the mounted share.
    Note: During the copy process, do not run any commands on the appliance. Doing so can cause the copy operation to fail.
  4. After you have successfully copied the release update .rpm package into the mounted share, unmap or unmount the shared directory.
  5. On the appliance, enter the following command to close the NFS and the CIFS shares:
    Main_Menu > Manage > Software > Share Close
    Note: If you run any of the following commands before you close the share, the downloaded release update or client package is moved from the share directory location to its proper location. However, you must still run the Share Close command to ensure that the NFS and the CIFS shares are closed.
    List Version
    List Details All
    List Details Base
    Share Open
    Share Close
  6. To list the available release updates on the appliance, enter the following command and note the name of the downloaded files:
    Main_Menu > Manage > Software > List Downloaded
    Running this command validates and moves the release update or the client package from the share directory to its proper location. You are not notified that this move has occurred. If the command shows a status of Pending, wait a few minutes and try it again.
  7. Check to make sure that the following pre-upgrade tasks have already been performed:
    * All jobs have been stopped or suspended and all SLPs have been paused.
    * The Support > Test Software command has been run and it returned a Pass result.
    * All of the necessary RHEL plug-in packages have been copied into the appropriate location.
  8. Log in to the NetBackup Appliance Shell Menu from the IPMI console.
  9. To install the software release update, run the following command:
    Main_Menu > Manage > Software > Install SYMC_NBAPP_update-<release-version>.x86_64.rpm
  10. Monitor the preflight check and watch for any Check failed messages.
    After the preflight check has finished, proceed as follows:
    * If no Check failed messages appear, you are prompted to continue to the next step to start the upgrade.
    * If any Check failed messages appear, the upgrade is not allowed. You must resolve the reported failures, then launch the upgrade script again so that the preflight check can verify that the failures have been resolved. Click on the UMI links (V-409-xxx-xxxx) for information about how to resolve the reported issues.
    * If any Check failed messages indicate that a RHEL version third-party plug-in was not found, you must obtain the plug-in from the appropriate vendor.
  11. After all preflight check items have passed, you may need to trust the CA certificate and the host ID-based certificate to start the upgrade process. To trust and deploy the CA certificates, do the following:
    * Verify the CA certificate detail and enter yes to trust the CA certificate, as follows:
    To continue with the upgrade, verify the following CA certificate detail and enter "yes" to trust the CA certificate.
    CA Certificate Details:
    Subject Name : /CN=nbatd/OU=root@abc.example.com/O=vx
    Start Date : Jul 14 12:59:18 2017 GMT
    Expiry Date : Jul 09 14:14:18 2037 GMT
    SHA1 Fingerprint : 31:E9:97:2E:50:11:51:7C:D6:25:7F:32:86:3D:
    6B:D5:33:5C:11:E2
    >> Do you want to trust the CA certificate? [yes, no] (yes)
    * If the security level of the master server is Very High, you must manually enter an authorization token to deploy the host ID-based certificate on the appliance, as follows:
    >> Enter token:

    Note: If the appliance is ever factory reset or re-imaged after it has been upgraded to version 3.1 or later, a reissue token is required for the next upgrade.
    * If the security level of the master server is High or Medium, the authentication token is not required. The host ID-based certificate is automatically deployed onto the appliance.
    For more information about security certificates, refer to the chapter "Security certificates in NetBackup" in the NetBackup Security and Encryption Guide.
  12. To check the upgrade status before the AIM window appears, enter the following command:
    Main_Menu > Manage > Software > UpgradeStatus
    The system reboots several times during the upgrade process. After the first reboot, the NetBackup Appliance Web Console and any SSH-based connections to the server are unavailable until the reboot process has completed. This condition may last two hours or more, depending on the complexity of the appliance configuration. It is important that you do not attempt to manually reboot the appliance during this time. You can use the Veritas Remote Management interface (IPMI) to view the system status. In addition, you may view the logs under /log or wait for the appliance to send an email upon completion of the upgrade process.
    During the upgrade process, you can open the AIM window to view the upgrade progress and the estimated remaining time.
  13. If problems are detected during the post-upgrade self-test, the AIM window shows the upgrade status as Paused. Other SSH sessions and email notifications also indicate this status.
    To clear the Paused status, perform the following tasks:
    * Press the V key to switch to the Verbose view to see the logs. If there are any Unique Message Identification (UMI) codes for the errors, search for them on the Veritas Support website to get more detailed information.
    * Try to fix the problem that the AIM window reports. If you need to use the shell menu, log on to the NetBackup Appliance Shell Menu through an SSH session. When the AIM window appears, press the S key to close it.
    * Go back to the AIM window on the IPMI console. If you tried fixing the problem, press the A key to attempt the self-test again. If you cannot fix the problem, contact Veritas Technical Support or press the R key to roll back the appliance to the previous software version.
    Note:
    If the post-upgrade self-test fails, an automatic rollback is no longer enforced. If you select A (Attempt) again and the self-test still fails, the upgrade pauses again and prompts with the same options.
  14. After the upgrade has completed, the AIM window shows a summary of the upgrade results. After the upgrade has completed and the disk pools are back online, the appliance runs a self-diagnostic test. Refer to the following file for the test results:
    /log/selftest_report_<appliance_serial>_<timedate>.txt
    If SMTP is configured, an email notification that contains the self-test result is sent.
  15. Complete this step only if your backup environment includes SAN client computers.
    The Fibre Channel (FC) ports must be re-scanned to allow any SAN client computers to reconnect to the Fibre Transport (FT) devices. The re-scan must be done from the NetBackup CLI view on the appliance.
    To re-scan the FC ports:
    * Enter the following command to see a list of NetBackup user accounts:
    Manage > NetBackupCLI > List
    * Log on to this appliance as one of the listed NetBackup users.
    * Run the following command to rescan the FC ports:
    nbftconfig -rescanallclients
    If any SAN clients still do not work, run the following commands on each of those clients in the order as shown:
    UNIX clients
    /usr/openv/netbackup/bin/bp.kill_all
    /usr/openv/netbackup/bin/bp.start_all

    Windows clients
    <install_path>\NetBackup\bin\bpdown
    <install_path>\NetBackup\bin\bpup

    If any SAN clients still do not work, manually initiate a SCSI device refresh at the OS level. The refresh method depends on the operating system of the client. Once the refresh has completed, attempt the nbftconfigrescanallclients command again.
    If any SAN clients still do not work, restart those clients.
    Note: If you have SLES 10 or SLES 11 SAN clients that still do not work, Veritas recommends upgrading the QLogic driver on those clients. For the affected SLES 10 clients, upgrade to version 8.04.00.06.10.3-K. For the affected SLES 11 clients, upgrade to version 8.04.00.06.11.1.
  16. Perform any necessary post-upgrade tasks as described in the NetBackup Appliance Upgrade Guide. Refer to the topic "Post upgrade tasks for 3.1.2 upgrades".

Was this content helpful?