InfoScale™ 9.0 Storage Foundation and High Availability Configuration and Upgrade Guide - Solaris
- Section I. Introduction to SFHA
- Section II. Configuration of SFHA
- Preparing to configure
- Preparing to configure SFHA clusters for data integrity
- About planning to configure I/O fencing
- Setting up the CP server
- Planning your CP server setup
- Installing the CP server using the installer
- Configuring the CP server cluster in secure mode
- Setting up shared storage for the CP server database
- Configuring the CP server using the installer program
- Configuring the CP server manually
- Configuring CP server using response files
- Verifying the CP server configuration
- Configuring SFHA
- Configuring Storage Foundation High Availability using the installer
- Overview of tasks to configure SFHA using the product installer
- Required information for configuring Storage Foundation and High Availability Solutions
- Starting the software configuration
- Specifying systems for configuration
- Configuring the cluster name
- Configuring private heartbeat links
- Configuring the virtual IP of the cluster
- Configuring SFHA in secure mode
- Configuring a secure cluster node by node
- Adding VCS users
- Configuring SMTP email notification
- Configuring SNMP trap notification
- Configuring global clusters
- Completing the SFHA configuration
- About the License Audit Tool
- Verifying and updating licenses on the system
- Configuring SFDB
- Configuring Storage Foundation High Availability using the installer
- Configuring SFHA clusters for data integrity
- Setting up disk-based I/O fencing using installer
- Setting up server-based I/O fencing using installer
- Setting up non-SCSI-3 I/O fencing in virtual environments using installer
- Setting up majority-based I/O fencing using installer
- Enabling or disabling the preferred fencing policy
- Manually configuring SFHA clusters for data integrity
- Setting up disk-based I/O fencing manually
- Setting up server-based I/O fencing manually
- Preparing the CP servers manually for use by the SFHA cluster
- Generating the client key and certificates manually on the client nodes
- Configuring server-based fencing on the SFHA cluster manually
- Configuring CoordPoint agent to monitor coordination points
- Verifying server-based I/O fencing configuration
- Setting up non-SCSI-3 fencing in virtual environments manually
- Setting up majority-based I/O fencing manually
- Performing an automated SFHA configuration using response files
- Performing an automated I/O fencing configuration using response files
- Configuring I/O fencing using response files
- Response file variables to configure disk-based I/O fencing
- Sample response file for configuring disk-based I/O fencing
- Response file variables to configure server-based I/O fencing
- Sample response file for configuring server-based I/O fencing
- Response file variables to configure non-SCSI-3 I/O fencing
- Sample response file for configuring non-SCSI-3 I/O fencing
- Response file variables to configure majority-based I/O fencing
- Sample response file for configuring majority-based I/O fencing
- Section III. Upgrade of SFHA
- Planning to upgrade SFHA
- About the upgrade
- Supported upgrade paths
- Considerations for upgrading SFHA to 9.0 on systems configured with an Oracle resource
- Preparing to upgrade SFHA
- Considerations for upgrading REST server
- Using Install Bundles to simultaneously install or upgrade full releases (base, maintenance, rolling patch), and individual patches
- Upgrading Storage Foundation and High Availability
- Performing a rolling upgrade of SFHA
- Performing a phased upgrade of SFHA
- About phased upgrade
- Performing a phased upgrade using the product installer
- Moving the service groups to the second subcluster
- Upgrading the operating system on the first subcluster
- Upgrading the first subcluster
- Preparing the second subcluster
- Activating the first subcluster
- Upgrading the operating system on the second subcluster
- Upgrading the second subcluster
- Finishing the phased upgrade
- Performing an automated SFHA upgrade using response files
- Upgrading SFHA using Boot Environment upgrade
- Performing post-upgrade tasks
- Optional configuration steps
- Recovering VVR if automatic upgrade fails
- Post-upgrade tasks when VCS agents for VVR are configured
- Resetting DAS disk names to include host name in FSS environments
- Upgrading disk layout versions
- Upgrading VxVM disk group versions
- Updating variables
- Setting the default disk group
- Upgrading the Array Support Library
- Converting from QuickLog to Multi-Volume support
- About enabling LDAP authentication for clusters that run in secure mode
- Verifying the Storage Foundation and High Availability upgrade
- Planning to upgrade SFHA
- Section IV. Post-installation tasks
- Section V. Adding and removing nodes
- Adding a node to SFHA clusters
- About adding a node to a cluster
- Before adding a node to a cluster
- Adding a node to a cluster using the Veritas InfoScale installer
- Adding the node to a cluster manually
- Adding a node using response files
- Configuring server-based fencing on the new node
- After adding the new node
- Adding nodes to a cluster that is using authentication for SFDB tools
- Updating the Storage Foundation for Databases (SFDB) repository after adding a node
- Removing a node from SFHA clusters
- Removing a node from a SFHA cluster
- Verifying the status of nodes and service groups
- Deleting the departing node from SFHA configuration
- Modifying configuration files on each remaining node
- Removing the node configuration from the CP server
- Removing security credentials from the leaving node
- Unloading LLT and GAB and removing InfoScale Availability or Enterprise on the departing node
- Updating the Storage Foundation for Databases (SFDB) repository after removing a node
- Removing a node from a SFHA cluster
- Adding a node to SFHA clusters
- Section VI. Configuration and upgrade reference
- Appendix A. Installation scripts
- Appendix B. SFHA services and ports
- Appendix C. Configuration files
- Appendix D. Configuring the secure shell or the remote shell for communications
- About configuring secure shell or remote shell communication modes before installing products
- Manually configuring passwordless ssh
- Setting up ssh and rsh connection using the installer -comsetup command
- Setting up ssh and rsh connection using the pwdutil.pl utility
- Restarting the ssh session
- Enabling and disabling rsh for Solaris
- Appendix E. Sample SFHA cluster setup diagrams for CP server-based I/O fencing
- Appendix F. Reconciling major/minor numbers for NFS shared disks
- Appendix G. Configuring LLT over UDP
- Using the UDP layer for LLT
- Manually configuring LLT over UDP using IPv4
- Broadcast address in the /etc/llttab file
- The link command in the /etc/llttab file
- The set-addr command in the /etc/llttab file
- Selecting UDP ports
- Configuring the netmask for LLT
- Configuring the broadcast address for LLT
- Sample configuration: direct-attached links
- Sample configuration: links crossing IP routers
- Using the UDP layer of IPv6 for LLT
- Manually configuring LLT over UDP using IPv6
Converting a defined disk to auto:simple
In VxVM 4.0, and particularly in prior releases, EMCpower disks could be defined by a persistent disk access record (darec), and identified as simple disks. If an EMCpower disk is defined with a persistent darec, it must be manually converted to auto:simple format before upgrading to VxVM 9.0.
If the defined disk is defined on a slice other than s2, you must copy the partition entry for that slice to that for s0 and change the tag. If the tag of the original slice is changed, the status of the disk is seen as online:aliased after the upgrade.
The following example is used to illustrate the procedure. The ls command shows the mapping of the EMC disks to persistent disk access records:
# ls -l /dev/vx/dmp/emcdisk1 lrwxrwxrwx 1 root other 36 Sep 24 17:59 /dev/vx/dmp/emcdisk1-> /dev/dsk/c6t0d11s5 # ls -l /dev/vx/rdmp/emcdisk1 lrwxrwxrwx 1 root other 40Sep 24 17:59 /dev/vx/rdmp/emcdisk1-> /dev/dsk/c6t0d11s5
Here the fifth partition of c6t0d11s5 is defined as the persistent disk access record emcdisk1.
The vxdisk list command can be used to display the EMCpower disks that are known to VxVM:
# vxdisk list DEVICE TYPE DISK GROUP STATUS c6t0d12s2 auto:sliced - - online emcdisk1 simple fdisk fdg online ...
The vxprint command is used to display information about the disk group, fdg:
# vxprint Disk group: fdg TY NAME ASSOC KSTATE LENGTH PLOFFS STATE TUTIL0 PUTIL0 dg fdg fdg - - - - - - dm fdisk emcdisk1 - 17673456 - - - - ...
To convert a disk with a persistent disk access record to auto:simple format
- Stop all the volumes in the disk group, and then deport it:
# vxvol -g fdg stopall # vxdg deport fdg
- Use the vxdisk rm command to remove the persistent record definitions:
# vxdisk rm emcdisk1
If you now run the vxdisk list command, the EMCpower disk is no longer displayed:
# vxdisk list DEVICE TYPE DISK GROUP STATUS c6t0d12s2 auto:sliced - - online ...
- Use the vxprtvtoc command to retrieve the partition table entry for the device:
# /etc/vx/bin/vxprtvtoc -f /tmp/hdisk /dev/rdsk/c6t0d11s2
- Use the vxedvtoc command to modify the partition tag and update the VTOC:
# /etc/vx/bin/vxedvtoc -f /tmp/hdisk /dev/rdsk/c6t0d11s2 # THE ORIGINAL PARTITIONING IS AS FOLLOWS: # SLICE TAG FLAGS START SIZE 4 0x0 0x200 0 0 5 0x0 0x200 3591000 2100375 6 0x0 0x200 0 0 # THE NEW PARTITIONING WILL BE AS FOLLOWS: # SLICE TAG FLAGS START SIZE 4 0x0 0x200 0 0 5 0xf 0x200 3591000 2100375 6 0x0 0x200 0 0 DO YOU WANT TO WRITE THIS TO THE DISK ? [Y/N] :Y WRITING THE NEW VTOC TO THE DISK #
- Upgrade to VxVM 9.0 using the appropriate upgrade procedure.
- After upgrading VxVM, use the vxdisk list command to validate the conversion to auto:simple format:
# vxdisk list DEVICE TYPE DISK GROUP STATUS c6t0d12s2 auto:sliced - - online emcpower10s2 auto:simple - - online:aliased ...
To display the physical device that is associated with the metadevice, emcpower10s2, enter the following command:
# vxdmpadm getsubpaths dmpnodename=emcpower10s2
- Import the disk group and start the volumes:
# vxdg import fdg # vxvol -g fdg startall
You can use the vxdisk list command to confirm that the disk status is displayed as online:simple:
# vxdisk list DEVICE TYPE DISK GROUP STATUS c6t0d12s2 auto:sliced - - online emcpower10s2 auto:simple fdisk fdg online:aliased
To allow DMP to receive correct enquiry data, the common Serial Number (C-bit) Symmetrix Director parameter must be set to enabled.