NetBackup™ Deployment Guide for Kubernetes Clusters
- Introduction
- Section I. Deployment
- Prerequisites for Kubernetes cluster configuration
- Deployment with environment operators
- Deploying NetBackup
- Preparing the environment for NetBackup installation on Kubernetes cluster
- Recommendations of NetBackup deployment on Kubernetes cluster
- Limitations of NetBackup deployment on Kubernetes cluster
- Primary and media server CR
- Configuring NetBackup IT Analytics for NetBackup deployment
- Managing NetBackup deployment using VxUpdate
- Migrating the cloud node for primary or media servers
- Deploying NetBackup using Helm charts
- Deploying MSDP Scaleout
- Deploying MSDP Scaleout
- Prerequisites for AKS
- Prerequisites for EKS
- Installing the docker images and binaries
- Initializing the MSDP operator
- Configuring MSDP Scaleout
- Using MSDP Scaleout as a single storage pool in NetBackup
- Configuring the MSDP cloud in MSDP Scaleout
- Using S3 service in MSDP Scaleout for AKS
- Enabling MSDP S3 service after MSDP Scaleout is deployed for AKS
- Deploying Snapshot Manager
- Verifying Cloud Scale deployment
- Section II. Monitoring and Management
- Monitoring NetBackup
- Monitoring MSDP Scaleout
- Monitoring Snapshot Manager
- Managing the Load Balancer service
- Managing MSDP Scaleout
- Managing PostrgreSQL DBaaS
- Performing catalog backup and recovery
- Setting key parameters in Cloud Scale deployments
- Section III. Maintenance
- MSDP Scaleout Maintenance
- PostgreSQL DBaaS Maintenance
- Upgrading
- Uninstalling
- Troubleshooting
- Troubleshooting AKS and EKS issues
- View the list of operator resources
- View the list of product resources
- View operator logs
- View primary logs
- Socket connection failure
- Resolving an issue where external IP address is not assigned to a NetBackup server's load balancer services
- Resolving the issue where the NetBackup server pod is not scheduled for long time
- Resolving an issue where the Storage class does not exist
- Resolving an issue where the primary server or media server deployment does not proceed
- Resolving an issue of failed probes
- Resolving token issues
- Resolving an issue related to insufficient storage
- Resolving an issue related to invalid nodepool
- Resolving a token expiry issue
- Resolve an issue related to KMS database
- Resolve an issue related to pulling an image from the container registry
- Resolving an issue related to recovery of data
- Check primary server status
- Pod status field shows as pending
- Ensure that the container is running the patched image
- Getting EEB information from an image, a running container, or persistent data
- Resolving the certificate error issue in NetBackup operator pod logs
- Pod restart failure due to liveness probe time-out
- NetBackup messaging queue broker take more time to start
- Host mapping conflict in NetBackup
- Issue with capacity licensing reporting which takes longer time
- Local connection is getting treated as insecure connection
- Primary pod is in pending state for a long duration
- Backing up data from Primary server's /mnt/nbdata/ directory fails with primary server as a client
- Storage server not supporting Instant Access capability on Web UI after upgrading NetBackup
- Taint, Toleration, and Node affinity related issues in cpServer
- Operations performed on cpServer in environment.yaml file are not reflected
- Elastic media server related issues
- Failed to register Snapshot Manager with NetBackup
- Pods unable to connect to flexsnap-rabbitmq post Kubernetes cluster restart
- Troubleshooting AKS-specific issues
- Troubleshooting EKS-specific issues
- Troubleshooting AKS and EKS issues
- Appendix A. CR template
Upgrade NetBackup from previous versions
Ensure that all the steps mentioned for data migration in the section are performed before upgrading to the latest NetBackup or installing the latest :
See Preparing the environment for NetBackup installation on Kubernetes cluster.
User must have deployed NetBackupon Azure with
Azure disksas its storage class.While upgrading to latest NetBackup, data migration would happen only if existing storage class has been changed. The existing catalog data of primary server will be migrated (copied) from
Azure diskstoAzure premium files. Also new data volume would be created onAzure disksfor NetBackup database. If is changed for log, migration from azure disk NetBackupto azure disk will be triggered for logs.Fresh deployment: If user is deploying NetBackup for the first time, then
Azure premium fileswill be used for primary server's catalog andAzure diskswill be used for log and data volume for any backup and restore operation.
(AKS-specific) Perform the following steps when upgrading NetBackup from version 10.2 or lower on AKS cluster version 1.25
- Pause the primary and media server spec by setting the value as paused: true in primaryServer and mediaServer sections in environment CR using the following command:
Kubectl edit environments -n <namespace>
- Change the value of primary and server statefulset to 0 using the following command:
kubectl scale statefulsets <stateful-set-name> --replicas=0 -n <namespace>
- Change the value of media server statefulset to 0 using the following command:
kubectl scale statefulsets <stateful-set-name> --replicas=0 -n <namespace>
- Delete the revertfix yaml file using the following command:
kubectl delete -f <revertfix_yaml>
- Restart the AKS cluster or set the scale node to 0 and rescale it.
- Upgrade to the latest versions of NetBackup and MSDP operator.
- Un pause the primary and media server spec by changing the value as paused: falsein primaryServer and mediaServer sections in environment CR using the following command:
kubectl edit environments -n <namespace>
- Change the imageTag to the latest imageTag for primary and media servers together and save it.
Ensure that all the steps mentioned for data migration in the following section are performed before upgrading to the latest NetBackup or installing the latest :
See Preparing the environment for NetBackup installation on Kubernetes cluster.
User must have deployed NetBackup on AWS with
EBSas its storage class.While upgrading to latest NetBackup, the existing catalog data of primary server will be migrated (copied) from
EBStoAmazon elastic files.Fresh NetBackup deployment: If user is deploying NetBackup for the first time, then
Amazon elastic fileswill be used for primary server's catalog volume for any backup and restore operations.
(EKS-specific) Perform the following steps when upgrading NetBackup from version 10.1
- Make primary environment controller paused to true as follows:
Edit the environment custom resource using the kubectl edit Environment <environmentCR_name> -n <namespace> command.
To pause the reconciler of the particular custom resource, change the paused: false value to paused: true in the primaryServer or mediaServer section and save the changes.
Scale down the primary server using the following commands:
To get statefulset name: kubectl get sts -n <namespace>
To scale down the STS: kubectl scale sts --replicas=0 < STS name of primary server> -n <Namespace>
- Upgrade the MSDP with new build and image tag. Apply the following command to MSDP:
./kubectl-msdp init --image <Image name:Tag> --storageclass <Storage Class Name> --namespace <Namespace>
- Edit the
sample/environment.yamlfile from new build and perform the following changes:Add the
tag: <new_tag_of_upgrade_image>tag separately under primary sections.Provide the EFS ID for storageClassName of catalog volume in primary section.
Note:
The provided EFS ID for storageClassName of catalog volume must be same as previously used EFS ID to create PV and PVC.
Use the following command to retrieve the previously used EFS ID from PV and PVC:
kubectl get pvc -n <namespace>
From the output, copy the name of catalog PVC which is of the following format:
catalog-<resource name prefix>-primary-0
Describe catalog PVC using the following command:
kubectl describe pvc <pvc name> -n <namespace>
Note down the value of Volume field from the output.
Describe PV using the following command:
kubectl describe pv <value of Volume obtained from above step>
Note down the value of VolumeHandle field from the output which is the previously used EFS ID.
For data and logs volume, provide the storageClassNameand then apply
environment.yamlfile using the following command and ensure that the primary server is upgraded successfully:kubectl apply -f environment.yaml
Upgrade the MSDP Scaleout by updating the new image tag in msdpscaleout section in
environment.yamlfile.Apply
environment.yamlfile using the following command and ensure that MSDP is deployed successfully:kubectl apply -f environment.yaml
Edit the
environment.yamlfile and update the image tag for Media Server in mediaServer section.Apply
environment.yamlfile using the following command and ensure that the Media Server is deployed successfully:kubectl apply -f environment.yaml