Storage Foundation for Oracle® RAC 7.4.1 Administrator's Guide - Linux

To replace a disk in the coordinator disk group when the cluster is offline

1. Log in as superuser on one of the cluster nodes.
2. If VCS is running, shut it down:

   # hastop -all

   Make sure that the port h is closed on all the nodes. Run the following command to verify that the port h is closed:

   # gabconfig -a

3. Stop the VCSMM driver on each node:

   For RHEL 7, SLES 12, and supported RHEL distributions:

   # systemctl stop vcsmm

   For earlier versions of RHEL, SLES, and supported RHEL distributions:

   # /etc/init.d/vcsmm stop

4. Stop I/O fencing on each node:

   For RHEL 7, SLES 12, and supported RHEL distributions:

   # systemctl stop vxfen

   For earlier versions of RHEL, SLES, and supported RHEL distributions:

   # /etc/init.d/vxfen stop

   This removes any registration keys on the disks.

5. Import the coordinator disk group. The file /etc/vxfendg includes the name of the disk group (typically, vxfencoorddg) that contains the coordinator disks, so use the command:

   # vxdg -tfC import 'cat /etc/vxfendg'

   where:

   -t specifies that the disk group is imported only until the node restarts.

   -f specifies that the import is to be done forcibly, which is necessary if one or more disks is not accessible.

   -C specifies that any import locks are removed.

6. To remove disks from the disk group, use the VxVM disk administrator utility, vxdiskadm.

   You may also destroy the existing coordinator disk group. For example:

   • Verify whether the coordinator attribute is set to on.

     # vxdg list vxfencoorddg |  grep flags: | grep coordinator

   • Destroy the coordinator disk group.

     # vxdg -o coordinator destroy vxfencoorddg

7. Add the new disk to the node and initialize it as a VxVM disk.

   Then, add the new disk to the vxfencoorddg disk group:

   • If you destroyed the disk group in step 6, then create the disk group again and add the new disk to it.

     See the Storage Foundation for Oracle RAC Configuration and Upgrade Guide for detailed instructions.

   • If the diskgroup already exists, then add the new disk to it.

     # vxdg -g vxfencoorddg -o coordinator adddisk disk_name

8. Test the recreated disk group for SCSI-3 persistent reservations compliance.

   See Testing the coordinator disk group using the -c option of vxfentsthdw.

9. After replacing disks in a coordinator disk group, deport the disk group:

   # vxdg deport 'cat /etc/vxfendg'

10. On each node, start the I/O fencing driver:

    For RHEL 7, SLES 12, and supported RHEL distributions:

    # systemctl start vxfen

    For earlier versions of RHEL, SLES, and supported RHEL distributions:

    # /etc/init.d/vxfen start

11. On each node, start the VCSMM driver:

    For RHEL 7, SLES 12, and supported RHEL distributions:

    # systemctl start vcsmm

    For earlier versions of RHEL, SLES, and supported RHEL distributions:

    # /etc/init.d/vcsmm start

12. Verify that the I/O fencing module has started and is enabled.

    # gabconfig -a

    Make sure that port b and port o memberships exist in the output for all nodes in the cluster.

    # vxfenadm -d

    Make sure that I/O fencing mode is not disabled in the output.

13. If necessary, restart VCS on each node:

    # hastart