NetBackup maintenance mode feature
NetBackup needs a “maintenance mode”. The product is complex enough that to shut it down for maintenance requires a bunch of steps, man of which have to occur in a specific order.
It would be nice to have a maintenance mode button on the gui (and a command line command) that would:
- Suspend all backup requests – similar to the “nbpemreq –suspend_scheduling”.
- Suspend Storage LifeCycle Policies (SLP’s)
- Suspend PureDisk operations.
- Suspend running backups (those that can be suspended.)
- List running backups that cannot be suspended and give option to kill the jobs or wait until finished.
- List running duplications – SLP’s or other – and give option to kill the duplications or wait until they finish.
- Wait for all tape drives to empty.
- Allow the maintenance mode to stay in effect over a reboot (or a re-cycle of the NetBackup daemons.)
We have a manual process we go through to make sure we can work on tape libraries, VTL’s, media servers, etc. It would be very nice to have a single point for this control. And having the ability to keep the system quiet when the master server has to be rebooted would be very beneficial as well. Many times you need to verify device configurations after a reboot, and having to pause everything after the reboot can be painful and time consuming.
Once you are done with the maintenance, you would also need to resume NetBackup operations.
- Wait for all media servers to become active for tape and disk.
- Resume scheduling - "nbpemreq -resume_scheduling".
- Resume all PD activities.
- Resume suspended backups.
- Restart killed backups (optional on a case by case basis.)
- Resume SLP's.
- Resume duplications.
There are probably some things I'm forgetting here, but this would be a good start. Oftentimes, after maintenance and reboots, there are a lot of things to clean up. And you end up with a lot of failed backups that really shouldn't be reported as failed. (Especially when you have automatic ticketing systems involved.)