NetBackup™ Deployment Guide for Kubernetes Clusters
- Introduction
- Section I. Configurations
- Prerequisites
- Preparing the environment for NetBackup installation on Kubernetes cluster
- Prerequisites for Snapshot Manager (AKS/EKS)
- Prerequisites for Kubernetes cluster configuration
- Prerequisites for Cloud Scale configuration
- Prerequisites for deploying environment operators
- Prerequisites for using private registry
- Recommendations and Limitations
- Configurations
- Configuration of key parameters in Cloud Scale deployments
- Tuning touch files
- Setting maximum jobs per client
- Setting maximum jobs per media server
- Enabling intelligent catalog archiving
- Enabling security settings
- Configuring email server
- Reducing catalog storage management
- Configuring zone redundancy
- Enabling client-side deduplication capabilities
- Parameters for logging (fluentbit)
- Managing media server configurations in Web UI
- Prerequisites
- Section II. Deployment
- Section III. Monitoring and Management
- Monitoring NetBackup
- Monitoring Snapshot Manager
- Monitoring fluentbit
- Monitoring MSDP Scaleout
- Managing NetBackup
- Managing the Load Balancer service
- Managing PostrgreSQL DBaaS
- Managing logging
- Performing catalog backup and recovery
- Section IV. Maintenance
- PostgreSQL DBaaS Maintenance
- Patching mechanism for primary, media servers, fluentbit pods, and postgres pods
- Upgrading
- Cloud Scale Disaster Recovery
- Uninstalling
- Troubleshooting
- Troubleshooting AKS and EKS issues
- View the list of operator resources
- View the list of product resources
- View operator logs
- View primary logs
- Socket connection failure
- Resolving an issue where external IP address is not assigned to a NetBackup server's load balancer services
- Resolving the issue where the NetBackup server pod is not scheduled for long time
- Resolving an issue where the Storage class does not exist
- Resolving an issue where the primary server or media server deployment does not proceed
- Resolving an issue of failed probes
- Resolving issues when media server PVs are deleted
- Resolving an issue related to insufficient storage
- Resolving an issue related to invalid nodepool
- Resolve an issue related to KMS database
- Resolve an issue related to pulling an image from the container registry
- Resolving an issue related to recovery of data
- Check primary server status
- Pod status field shows as pending
- Ensure that the container is running the patched image
- Getting EEB information from an image, a running container, or persistent data
- Resolving the certificate error issue in NetBackup operator pod logs
- Pod restart failure due to liveness probe time-out
- NetBackup messaging queue broker take more time to start
- Host mapping conflict in NetBackup
- Issue with capacity licensing reporting which takes longer time
- Local connection is getting treated as insecure connection
- Backing up data from Primary server's /mnt/nbdata/ directory fails with primary server as a client
- Storage server not supporting Instant Access capability on Web UI after upgrading NetBackup
- Taint, Toleration, and Node affinity related issues in cpServer
- Operations performed on cpServer in environment.yaml file are not reflected
- Elastic media server related issues
- Failed to register Snapshot Manager with NetBackup
- Post Kubernetes cluster restart, flexsnap-listener pod went into CrashLoopBackoff state or pods were unable to connect to flexsnap-rabbitmq
- Post Kubernetes cluster restart, issues observed in case of containerized Postgres deployment
- Request router logs
- Issues with NBPEM/NBJM
- Issues with logging feature for Cloud Scale
- The flexsnap-listener pod is unable to communicate with RabbitMQ
- Job remains in queue for long time
- Extracting logs if the nbwsapp or log-viewer pods are down
- Troubleshooting AKS-specific issues
- Troubleshooting EKS-specific issues
- Troubleshooting issue for bootstrapper pod
- Troubleshooting AKS and EKS issues
- Appendix A. CR template
- Appendix B. MSDP Scaleout
- About MSDP Scaleout
- Prerequisites for MSDP Scaleout (AKS\EKS)
- Limitations in MSDP Scaleout
- MSDP Scaleout configuration
- Installing the docker images and binaries for MSDP Scaleout (without environment operators or Helm charts)
- Deploying MSDP Scaleout
- Managing MSDP Scaleout
- MSDP Scaleout maintenance
Uninstalling Snapshot Manager from Kubernetes cluster
When you uninstall Snapshot Manager from Kubernetes cluster, the Snapshot Manager related services are deleted from the cluster.
Delete cpServer related parameters from
environment.yamlfile and apply it.# NOTE: Following steps does not remove flexsnap (Snapshot Manager) operator. OPERATOR_NAMESPACE="netbackup-operator-system" ENVIRONMENT_NAMESPACE="nbux" # Comment out / remove cpServer part from environment.yaml
Following commands can be used to remove and disable the Snapshot Manager from NetBackup:
kubectl apply -f environment.yaml -n $ENVIRONMENT_NAMESPACE sleep 10s
Ensure that you get the uninstall message in
flexsnap-operatoroperator log.To clean-up cpServer component, delete flexsnap specific persistent volumes (PVs), persistent volume claims (PVCs) and config maps. Note that these resources contain metadata of current cpServer installation and would be deleted.
Use the following respective commands to delete these resources:
kubectl delete cm flexsnap-conf nbuconf pdconf -n $ENVIRONMENT_NAMESPACE kubectl delete pvc data-flexsnap-rabbitmq-0 fluentd-pvc cloudpoint-pvc certauth-pvc -n $ENVIRONMENT_NAMESPACE kubectl delete pv $(kubectl get pv | grep flexsnap | awk '{printf $1" " }') kubectl delete pv $(kubectl get pv | grep fluentd-pvc | awk '{printf $1" " }') kubectl delete pv $(kubectl get pv | grep cloudpoint-pvc | awk '{printf $1" " }') kubectl delete pv $(kubectl get pv | grep certauth-pvc | awk '{printf $1" " }')NetBackup Snapshot Manager databases are present in
nb-postgresqlpod. Delete these databases manually.Use the following commands to exec into
nb-postgresqlpod, connect to the database and delete the flexsnap databases:kubectl exec -it nb-postgresql-0 -- bash psql "port=13787 dbname=postgres user=postgres sslmode=verify-full sslcert='/netbackup/postgresql/keys/server/tls.crt' sslkey='/netbackup/postgresql/keys/server/tls.key' sslrootcert=/netbackup/postgresql/keys/server/ca.crt" drop database alertservice with (force); drop database flexsnap with (force); drop database flexworkflow with (force); drop database identity_manager_service with (force); drop database kms with (force);
NetBackup Snapshot Manager uses it's own pod (
flexsnap-postgresql) to store data when NetBackup uses cloud native database.When
flexsnap-postgresqlpod is deployed, use the following command to delete the database pvc:kubectl delete pvc psql-pvc -n $ENVIRONMENT_NAMESPACE
kubectl delete pv $(kubectl get pv | grep psql-pvc | awk '{printf $1" " }')