VxFEN fails to start after abnormal shutdown

Problem

Fencing will not start after the server crashes (abnormal shutdown).

Error Message

VXFEN INFO V-11-1-VxFEN configured at protocol version 10
GAB INFO V-15-1-20026 Port b gen 816603 k_jeopardy ;1
VXFEN WARNING V-11-1-12 Potentially a
preexisting split-brain.
Dropping out of cluster.

Cause

SCSI-3 keys were not cleared during the server reboot (abnormal shutdown). 

Solution

Manually clear Fencing Keys using the following example:

# vxfenadm -s /dev/rdsk/c2t0d19s2
Reading SCSI Registration Keys...
Device Name: /dev/rdsk/c2t0d19s2
Total Number Of Keys: 2 <<== 2 keys.
key[0]:
Key Value [Numeric Format]: 65,80,71,82,48,48,48,51
Key Value [Character Format]: APGR0003
key[1]:
Key Value [Numeric Format]: 65,80,71,82,48,48,48,51
Key Value [Character Format]: APGR0003


Create a file /tmp/disks as follows for the disks that have a key:
/dev/rdsk/c2t0d19s2
/dev/rdsk/c2t0d27s2
/dev/rdsk/c2t0d23s2

Execute the following commands
# /sbin/vxfenadm –a –k TMP –f /tmp/disks
# /sbin/vxfenadm –c –k TMP –f /tmp/disks

Example:
# /sbin/vxfenadm -a -k TMP -f /tmp/disks
Registration and Ignore completed for disk path: /dev/rdsk/c2t0d27s2
Registration and Ignore completed for disk path: /dev/rdsk/c2t0d19s2
Registration and Ignore completed for disk path: /dev/rdsk/c2t0d23s2


# /sbin/vxfenadm –c –k TMP –f /tmp/disks
Clear completed for disk path: /dev/rdsk/c2t0d19s2
Clear completed for disk path: /dev/rdsk/c2t0d23s2
Clear completed for disk path: /dev/rdsk/c2t0d27s2


Verify that the previous keys have been removed:
# vxfenadm -s /dev/rdsk/c2t0d19s2
Reading SCSI Registration Keys...
Device Name: /dev/rdsk/c2t0d19s2
Total Number Of Keys: 0 <<== No keys.
No keys...

Manually start fencing:
# /etc/init.d/vxfen start

Started VCS:
# hastart