Veritas agents not sending out trap notification via snmp

Problem

Veritas agents not sending out trap notification via snmp

Error Message

2012/07/30 11:31:31 VCS WARNING V-16-20055-111 (hostname) TPC4R_Monitor:TPC4R_Monitor:monitor:TPC4R Status is Yellow
2012/07/30 11:31:31 VCS WARNING V-16-20055-114 (hostname) TPC4R_Monitor:TPC4R_Monitor:monitor:Primary Server [999.999.99.999] notified the following Active TPC4R: [tpcr-ph-ccm.sede.corp.sanpaoloimi.com] Port: [5120] Status: [disconnected consistent]
2012/07/30 11:31:31 VCS WARNING V-16-20055-115 (hostname) TPC4R_Monitor:TPC4R_Monitor:monitor:Primary Server [999.999.99.999] notified the following Stand-by TPC4R: [tpcr-ph-cam] Port: [5120] Status: [disconnected consistent]
2012/07/30 11:31:31 VCS WARNING V-16-20055-114 (hostname) TPC4R_Monitor:TPC4R_Monitor:monitor:Secondary Server [99.9.999.99] notified the following Active TPC4R: [] Port: [] Status: []
2012/07/30 11:31:31 VCS WARNING V-16-20055-115 (hostname) TPC4R_Monitor:TPC4R_Monitor:monitor:Secondary Server [[99.9.999.99] notified the following Stand-by TPC4R: [] Port: [] Status: []
2012/07/30 11:36:31 VCS ERROR V-16-20055-132 (hostname) TPC4R_Monitor:TPC4R_Monitor:monitor:Execution of csmcli command: [/opt/IBM/replication/CSMCLI/csmcli.sh -server 99.9.999.99 -port 5110 lshaservers -fmt delim -delim ';' -hdr off -p off-v off -noinfo] failed on the DR TPC4R Server returning:
Login failed for: username=root, server=99.9.999.99, and port=5110.

Cause

Incomplete configuration for VCS, hosts, and network

Solution

Configuration determined to be incomplete for VCS, hosts, and network.
main.cf
NotifierMngr notifier (
SnmpConsoles = { "999.999.999.999" = Warning }
)
-------------------------------------------------
Example of what it should be:
NotifierMngr ntfr (
SnmpdTrapPort = 1162
SnmpConsoles = { host1 = Error, host2 = Error }
SmtpServer = "company.com"
)


Recommendation:
1.) From the OS prespective:
-- Add linux system IP and hostname to /etc/hosts on the AIX cluster nodes
-- Add AIX IPs and hostnames to the linux server's /etc/hosts file.

2.) VCS configuration for this is not complete. Please review the following:
https://sort.Veritas.com/public/documents/sfha/5.1sp1/aix/productguides/pdf/vcs_install_51sp1_aix.pdf
Page 135: Configuring SNMP trap notification
You can choose to configure VCS to send event notifications to SNMP management consoles. You need to provide theSNMPmanagement console name to be notified
and message severity levels.
Note that this can also be configured the notification after installation.
Refer to the Veritas Cluster Server Administrator’s Guide for more information.

SNMP trap notification for VCS events
There is an option to configure SNMP trap notification of VCS events by the VCS Notifier component. If choosing SNMP notification, be ready to answer prompts for the following information:
- The port number, 162 by default, for the SNMP trap daemon.
- The system name for each SNMP console.
- The minimum severity of events for SNMP trap notification. Events have four levels of severity: Information, Warning, Error, and SevereError.
- Refer to the Veritas Cluster Server User's Guide for more information on SNMP notification.

Applies To

Machine Summary:
Release: AIX 1 6
OS Level: 6100-07
Architecture: IBM,9119-FHB

Products installed:
VRTSamf 5.1.112.0 COMMITTED Veritas AMF by Veritas
VRTSaslapm 5.1.100.0 COMMITTED Array Support Libraries and
VRTSat.client 5.0.32.0 COMMITTED Veritas Product
VRTSat.server 5.0.32.0 COMMITTED Veritas Product
VRTSdbed 5.1.112.0 COMMITTED Veritas Storage Foundation for
VRTSgab 5.1.112.0 COMMITTED Veritas Group Membership and
VRTSllt 5.1.112.0 COMMITTED Veritas Low Latency Transport
VRTSob 3.4.312.0 COMMITTED Veritas Enterprise
VRTSodm 5.1.112.0 COMMITTED Veritas Extension for Oracle
VRTSpbx 1.5.0.6 COMMITTED Veritas Private Branch
VRTSperl 5.10.0.9 COMMITTED Perl 5.10.0 for Veritas
VRTSsfmh 4.1.119.0 COMMITTED Veritas Operations Manager
VRTSspt 5.5.0.5 COMMITTED Veritas Support Tools by
VRTSvbs 6.0.0.0 COMMITTED Virtual Business Services by
VRTSvcs 5.1.112.0 COMMITTED Veritas Cluster Server by
VRTSvcsag 5.1.112.0 COMMITTED Veritas Cluster Server Bundled
VRTSvcsea 5.1.112.0 COMMITTED Veritas High Availability
VRTSveki 5.1.100.0 COMMITTED Veritas Kernel Interface by
VRTSvlic 3.2.51.10 COMMITTED Veritas License Utilities
VRTSvxfen 5.1.112.0 COMMITTED Veritas I/O Fencing by
VRTSvxfs 5.1.112.0 COMMITTED Veritas File System by
VRTSvxvm 5.1.112.200 COMMITTED Veritas Volume Manager by