Storage Lifecycle Policy (SLP) Cheat Sheet for NetBackup 7.6

Storage Lifecycle Policy (SLP) Cheat Sheet for NetBackup 7.6

Article: 100032502
Last Published: 2016-05-25
Ratings: 3 0
Product(s): NetBackup

Problem

Cheat sheet for SLP (Storage Lifecycle Policy) for NetBackup 7.6

Solution

Show EMM Image list of Images that were backed up to an SLP STU [ -I / -U ]

nbstlutil list
nbstlutil list -lifecycle <name>
nbstlutil list -backupid <value>
nbstlutil list -image_state <value>
nbstlutil list -copy_state <value>
nbstlutil list -frag_state <value>
nbstlutil list -mediaid <value> -image_state 3

Activate / Inactivate SLP operations

nbstlutil inactive -lifecycle <name>
nbstlutil inactive -backupid <backupid>
nbstlutil active -lifecycle <name>
nbstlutil active -backupid <backupid>

Cancel pending operations on selected image

nbstlutil cancel -backupid <value>
nbstlutil cancel -lifecycle <name>

Show status on Incomplete copies of Lifecycle Managed images

nbstlutil stlilist -lifecycle <name>
nbstlutil stlilist -backupid <value>
nbstlutil stlilist -image_state <value>
nbstlutil stlilist -image_incomplete
nbstlutil stlilist -image_inactive

List Storage Units

bpstulist -L
 

States

State image Copy Frag
1 NOT_STARTED NOT_STARTED ACTIVE
2 IN_PROCESS IN_PROCESS TO_BE_DELETED
3 JOB COMPLETE   ELIGIBLE_FOR_EXPIRATION
5   COPY COMPLETE  
6   CANCELLED  
7   CANNOT PROCESS  
8   Deferred  
9 NOT_STARTED & INACTIVE NOT_STARTED & INACTIVE N/A
10 IN_PROCESS & INACTIVE IN_PROCESS & INACTIVE N/A


Logging

SLP Unified (VX) Logs

Master Server

vxlogcfg -a -p 51216 -o 111 -s DebugLevel=6 -s DiagnosticLevel=6 (nbemm)
vxlogcfg -a -p 51216 -o 143 -s DebugLevel=6 -s DiagnosticLevel=6 (mds / Included in 111, no separate log)
vxlogcfg -a -p 51216 -o 116 -s DebugLevel=6 -s DiagnosticLevel=6 (nbpem)
vxlogcfg -a -p 51216 -o 117 -s DebugLevel=6 -s DiagnosticLevel=6 (nbjm )
vxlogcfg -a -p 51216 -o 118 -s DebugLevel=6 -s DiagnosticLevel=6 (nbrb)
vxlogcfg -a -p 51216 -o 226 -s DebugLevel=6 -s DiagnosticLevel=6 (nbstserv)
vxlogcfg -a -p 51216 -o 272 -s DebugLevel=6 -s DiagnosticLevel=6 (expmgr – Included in 226, no separate log)
vxlogcfg -a -p 51216 -o 219 -s DebugLevel=6 -s DiagnosticLevel=6 (rem – Included in 111, no separate log)
vxlogcfg -a -p 51216 -o 230 -s DebugLevel=6 -s DiagnosticLevel=6 (rdsm / part of nbrmms)
vxlogcfg -a -p 51216 -o 137 -s DebugLevel=6 -s DiagnosticLevel=6 (libraries / no separate log file)
vxlogcfg -a -p 51216 -o 156 -s DebugLevel=6 -s DiagnosticLevel=6 (nbace / no separate log file)
vxlogcfg -a -p 51216 -o 369 -s DebugLevel=6 -s DiagnosticLevel=6 (importmgr / no separate log file)

Media Server

vxlogcfg -a -p 51216 -o 220 -s DebugLevel=6 -s DiagnosticLevel=6 (dps / media - Included in 222, no separate log)
vxlogcfg -a -p 51216 -o 221 -s DebugLevel=6 -s DiagnosticLevel=6 (mpms / media - Included in 222, no separate log)
vxlogcfg -a -p 51216 -o 202 -s DebugLevel=6 -s DiagnosticLevel=6 (stssvc /media - included in 222, no separate log)
vxlogcfg -a -p 51216 -o 222 -s DebugLevel=6 -s DiagnosticLevel=6 (nbrmms / media)
vxlogcfg -a -p 51216 -o 230 -s DebugLevel=6 -s DiagnosticLevel=6 (rdsm / media + master)
vxlogcfg -a -p 51216 -o 137 -s DebugLevel=6 -s DiagnosticLevel=6 (libraries / no separate log file)
vxlogcfg -a -p 51216 -o 156 -s DebugLevel=6 -s DiagnosticLevel=6 (nbace / no separate log file)
vxlogcfg -a -p 51216 -o 395 -s DebugLevel=6 -s DiagnosticLevel=6 (stsem / media - included in 222, no separate log)

SLP Legacy Logs

Master Server

/usr/openv/netbackup/logs/admin
/usr/openv/netbackup/logs/bpdbm

Media Server

/usr/openv/netbackup/logs/bpbrm
/usr/openv/netbackup/logs/bptm
/usr/openv/netbackup/logs/bpdm
/usr/openv/netbackup/logs/bpbkar

Additional Information to gather from the master server:

/usr/openv/var/global/nbcl.conf
/usr/openv/netbackup/db/jobs/trylogs
/usr/openv/netbackup/db/error/log_<ctime>

SLPMgr and ExpMgr

SLPMgr is the top level service and manages the various subsystems that run within the nbstserv daemon.
It runs on a fixed interval (image processing interval) and while it is processing it is in a “duplication/replication session”:
The image processing interval starts when a session ends and is the amount of time to wait before starting the next session (default is 5 minutes).
The SLPMGR manages image duplications, replications, imports, and snapshots for SLP only.

ExpMgr runs in response to:
Events submitted by REM (oid = 219) in nbemm OR
by “diskfull” status in bptm

SLPMgr and ExpMgr can and do run in parallel:
While a session is in progress, a high water mark (HWM) event will be processed and not wait on the session to complete
Only one session will be active at any given time.
Multiple HWM events can be processed in parallel.

Database Tables

DBM_Image / DBM_ImageCopy / DBM_ImageFragment
EMM_TargetSLP / EMM_TargetSLP_Volume
PEM_SLP / PEM_SLPDestinations
SLP_AttentionNeededImage / SLP_JobInfo /SLP_TargetCopyInfo / SLP_WorkGroup

 

How to change the image processing interval

By default, the SLP manager in nbstserv starts a new session 300 seconds after the previous session ends. The session timer can be modified without cycling nbstserv.  To update open the administration console and go to the SLP parameters in the master server host properties where
you can change it.
To change from command line:
# bpsetconfig
bpsetconfig>  SLP.IMAGE_PROCESSING_INTERVAL = 600
cntrl-d

The changes made by bpsetconfig are stored in the nbcl.conf file.  Please note the nbcl.conf file should not be manually edited.

SLP policy definitions are stored in the NBDB database

Use the nbstl command to view or modify policy information.
nbstl -L                                         List the current copy of each SLP policy
nbstl -L -all_versions                    List all versions of all of the SLP policies
nbstl <SLP policy name> -L         View a particular SLP policy's configuration

SLP Windows

With NetBackup 7.6 SLP Windows were introduced to define a start window for when an SLP policy can run.
The SLP Window definitions are stored under the following directory on the master server:
UNIX: /usr/openv/netbackup/db/class_internal
Windows: <install dir> \netbackup\db\class_internal

To view the policies:
bppllist SLP_Internal_Policy -L -internal

 

Create Advanced Diskpool

nbdevconfig -creatests -storage_server <server name> -stype AdvancedDisk -st 5 -media_server <media server>
tpconfig -add -storage_server <server name> -stype AdvancedDisk -sts_user_id ANYTHING -password ANYTHING -st 1
nbdevconfig -previewdv -stype AdvancedDisk -storage_server <server name> -media_server <media server> -dvlist /tmp/dvlist
nbdevconfig -createdp -stype AdvancedDisk -dp Advance_DiskPool -storage_servers <server name> -dvlist /tmp/dvlist



 

Configuring a common server to perform duplications from disk to tape or tape to tape

common_server_for_dup Setting (Default, Preferred, Required)
nbemmcmd -changesetting -common_server_for_dup  <default |preferred |required> -machinename master_server_name

default - The default option (default) instructs NetBackup to try to match the destination media server with the source media server
preferred - The preferred option instructs NetBackup to search all matching media server selections for the source
required - The required option instructs NetBackup to search all media server selections for the matching source

Note: this setting does not apply for disk to disk duplications.
 

LIFECYCLE_PARAMETERS

With NetBackup 7.6 there is no longer a LIFECYCLE_PARAMETERS file.  The SLP parameters
now are stored within the NetBackup NBDB database.

To view the SLP parameters run the the command bpgetconfig or view them via the
administration console under host properties -> master server -> SLP Parameters

To modify the SLP parameters either use the administration console or the bpsetconfig command.
e.g.
# bpsetconfig
bpsetconfig> SLP.MAX_SIZE_PER_DUPLICATION_JOB = 1000
cntrl-d

Minimum size per duplication job: The smallest batch size that can run as a single duplication job.
The job does not run until enough images accumulate to reach this minimum batch size or until the Force interval
for small jobs time is reached. Minimum: 1 kilobyte;; no maximum size.
Adjusting this value, affects the number and size of duplication jobs. If the setting is small,
more duplication jobs are created. If it is large, fewer, larger duplication jobs are created.
Default: 8 gigabytes.
Configuration option default: SLP.MIN_SIZE_PER_DUPLICATION_JOB = 8 GB

Maximum size per duplication job: The largest batch size that can run as a single duplication job. Minimum: 1 kilobyte;;
no maximum size. It is important to remember that the larger the duplication job is, the more efficient it will be.
Keep in mind too large a duplication job will consume resources for an extended period of time.
Default: 100 gigabytes.
Configuration entry default: SLP.MAX_SIZE_PER_DUPLICATION_JOB = 100 GB

Maximum size per A.I.R. replication job: The largest batch size that can run as
a single job for Auto Image Replication. Minimum: 1 kilobyte;; no maximum size.
Default: 100 gigabytes.
Configuration entry default: SLP.MAX_SIZE_PER_BACKUP_REPLICATION_JOB = 100 GB

Maximum images per snapshot replication job: The largest number of images in a single batch that can run as a single job.
No minimum or maximum number. Can be used in a Replication Director configuration to control how many snapshot jobs are
sent to the disk array to avoid overloading the replication infrastructure of the OpenStorage partner.
Default: 50 images.
Configuration entry default: SLP.MAX_IMAGES_PER_SNAPSHOT_REPLICATION_JOB = 50

Minimum images per A.I.R. Import job: The fewest number of images in a single batch that can run as an Auto Image Replication
import job. The job does not run until either the minimum size is reached or the Force interval for small jobs time is reached.
Minimum: 1 image;; no maximum number of images.
Default: 1 image.
Configuration entry default: SLP.MIN_IMAGES_PER_IMPORT_JOB = 1

Maximum images per A.I.R. Import job: The largest number of images in a single batch that can run as an Auto Image Replication
import job. Minimum: 1 job;; no maximum number of images.
Default: 250 images.
Configuration entry default: SLP.MAX_IMAGES_PER_IMPORT_JOB = 250

Force interval for small jobs: The age that the oldest image in a batch must reach after which the batch is submitted
as a duplication job. This prevents many small duplication jobs from running at one time or running too frequently.
It also prevents NetBackup from waiting too long before it submits a small job. No minimum or maximum number.
Default: 30 minutes.
Configuration entry default: SLP.MAX_TIME_TIL_FORCE_SMALL_DUPLICATION_JOB = 30 MINUTES

Job submission interval: Indicates the frequency of the job submission for all operations. No minimum or maximum interval.
Default: 5 minutes.
Configuration entry default: SLP.JOB_SUBMISSION_INTERVAL = 5 MINUTES

Image processing interval: The number of minutes between image processing sessions. Set the interval when newly created
images are recognized and set up for SLP processing.
Default: 5 minutes.
Configuration entry default: SLP.IMAGE_PROCESSING_INTERVAL = 5 MINUTES

Cleanup interval: The time between when a job finishes and before NetBackup removes the job artifacts for the completed job.
No minimum or maximum interval.
Default: 24 hours.
Configuration entry default: SLP.CLEANUP_SESSION_INTERVAL = 24 HOURS

Extended image retry interval: The number of hours to wait before an unsuccessful operation is added to the next
duplication job. The extra time gives the administrator additional time to solve a problem that prevents job completion.
No minimum or maximum interval. After duplication of an image fails 3 times, this is the time interval between subsequent retries.
Default: 2 hours.
Configuration entry default: SLP.IMAGE_EXTENDED_RETRY_PERIOD = 2 HOURS

Unused SLP definition version cleanup delay: Concerns the deletion of SLP versions where a more recent version exists.
The setting controls how long a version must be inactive before NetBackup deletes it.
Default: 14 days.
Configuration entry default: SLP.VERSION_CLEANUP_DELAY = 14 DAYS

Tape resource multiplier: Limits the number of concurrently active duplication jobs that can access a single tape media
storage unit to xx times the number of available drives. Allows tuning to avoid overloading the Resource Broker, yet makes
sure that the devices are not idle. No minimum or maximum multiplier.
Default: 2 (multiply access to the write drives by two).
Configuration entry default: SLP.TAPE_RESOURCE_MULTIPLIER = 2

Disk resource multiplier: Limits the number of concurrently active duplication jobs that can access a single
disk storage unit to xx times the number of available drives. Allows tuning to avoid overloading the Resource Broker,
yet makes sure that the devices are not idle. No minimum or maximum multiplier.
Default: 2 (multiply access to the write drives by two).
Configuration entry default: SLP.DISK_RESOURCE_MULTIPLIER = 2

Group images across SLPs: If set to Yes (1,default), multiple SLPs of the same priority can be processed in the same job.
If No (0), batching can occur only within a single SLP.
Default: 1
Configuration entry for no, do not allow batching:SLP.DUPLICATION_GROUP_CRITERIA = 0

Window close buffer time: Sets the amount of time before a window
closes when new jobs using that window will no longer be submitted. Minimum 2 minute;; maximum: 60 minutes.
Default: 15 minutes.
Configuration entry default: SLP.WINDOW_CLOSE_BUFFER_TIME = 15 MINUTES

Deferred duplication offset time: For deferred operations, jobs are submitted x time before the source copy is
due to expire. Default: 4 hours.
Configuration entry default: SLP.DEFERRED_DUPLICATION_OFFSET_TIME = 4 HOURS

Auto create A.I.R. Import SLP: Used for Auto Image Replication, indicates whether
an SLP (that contains an Import operation) is created automatically in the target domain if no SLP is configured there.
Default: Yes, an SLP is created in the target domain.
Configuration entry default: SLP.AUTO_CREATE_IMPORT_SLP = 1

How long to retry failed A.I.R. import jobs: How long NetBackup retries an Import job before it stops and deletes
the record. After the initial four attempts, the retries become less frequent.
Default: 0 (do not retry after the initial four attempts).
Configuration entry default: SLP.REPLICA_METADATA_CLEANUP_TIMER = 0 HOURS

An additional SLP tunable that is not included in the host properties but can be changed via bpsetconfig is
SLP.BIDFILE_CLEANUP_DELAY   This defines how many days to keep a bidfile created by nbstserv.  A bidfile contains the list
of images to be processed for a duplication or replication job.  The default is 3 days

Additional Notes
 
You cannot specify Any_Available in the storage unit field of an SLP operation.  It does not appear in the pick list in the user interface.

Add the -force_not_complete option to the bpexpdate command to force the expiration of an image, even if the image or copy is not SLP-complete.

Was this content helpful?