Database backups failing with status 29: failed trying to exec a command

Problem

Database backups failing with status 29: failed trying to exec a command

The command bpclntcmd -pn -verbose fails with the below error:

Can't connect to host nbmaster : cannot connect on socket (25)

Error Message

Job Details:

Apr 27, 2021 5:07:50 AM - Error bpbrm (pid=5292) from client client01: ERR - bphdb exit status = 29: failed trying to exec a command
Apr 27, 2021 5:07:51 AM - Info bphdb (pid=6514) done. status: 29: failed trying to exec a command
Apr 27, 2021 5:07:51 AM - end writing
failed trying to exec a command  (29)
 

Below errors can be seen in bpclntcmd logs on the client:

05:07:27.273 [6294.6294] <8> vnet_connect_to_service: [vnet_connect.c:340] connect_to_service() failed 12 0xc
05:07:27.273 [6294.6294] <2> bprd_connect: vnet_connect_to_service(nbmaster) failed: 12
05:07:27.273 [6294.6294] <16> do_request: Can't connect to host nbmaster: cannot connect on socket (25)

Errors in dbclient logs:

05:07:47.950 [6569] <2> bprd_connect: vnet_connect_to_service(nbmaster) failed: 12
05:07:47.951 [6569] <2> bprd_get_features: bprd_connect(nbmaster) failed, cannot connect on socket (25)
05:07:47.951 [6569] <16> bsa_checkFeatureId: unable to check if feature <36> is licensed
05:07:47.951 [6569] <16> bsa_checkFeatureId: Server exit status = 25: cannot connect on socket

Cause

Missing entries for Netbackup product ID under /etc/vx/vrtslog.conf

The vxlogcfg -l the command will give the below output (Netbackup Product will not be listed):

List of all configured products...
50936         VxICS,ics

The content of /etc/vx/vrtslog.conf file will look like this:

###############################################
# Caution! Do not update/modify file by hand. 
# Use vxlogcfg tool to update/modify this file
###############################################
50936.Configuration=/etc/vx/VxICS/icsul.conf
50936.Names=VxICS

Solution

Run the below command to add the missing entries:

vxlogcfg -a -p 51216 -c /usr/openv/netbackup/nblog.conf -n NB,nb 

The content of /etc/vx/vrtslog.conf file should look like this now:

###############################################
# Caution! Do not update/modify file by hand. 
# Use vxlogcfg tool to update/modify this file
###############################################

51216.Configuration=/usr/openv/netbackup/nblog.conf
51216.Names=NB,nb
50936.Configuration=/etc/vx/VxICS/icsul.conf
50936.Names=VxICS

Restart the Netbackup services on the client and the bpclntcmd -pn command should now be successful.