InfoScale™ 9.0 Replication Administrator's Guide - AIX
- Section I. Getting started with Volume Replicator
- Introducing Volume Replicator
- Understanding how Volume Replicator works
- How VVR processes application writes
- How VVR uses kernel buffers for replication
- How data flows in VVR asynchronous mode
- About secondary logging enabled asynchronous mode
- About bulk transfer with secondary logging
- How data flows in VVR asynchronous mode with secondary logging
- How data flows in VVR synchronous mode
- How data flows in an RDS containing multiple Secondary hosts
- Replication in a shared disk group environment
- Assigning a slave node as a logowner
- Understanding how VVR logs writes to the SRL
- Understanding Storage Checkpoints
- Volume sets in VVR
- Changing membership of an RVG and a volume set
- Using SmartTier with VVR
- Cross-platform Data Sharing in VVR
- Understanding the VVR snapshot feature
- About VVR compression
- Planning and configuring replication
- Introduction to planning and configuring replication
- Before you begin configuring
- Choosing the mode of volume replication
- Choosing latency and SRL protection
- Planning the network
- Sizing the SRL
- Choosing the type of DCM logging
- Best practices for setting up replication
- How the agents for hybrid applications work
- Pre-requisites to enable data over wire encryption
- Enabling Data Change Object (DCO) for SRL Volumes
- Understanding replication settings for a Secondary
- Configuring VVR in a VCS environment
- Overview of how to configure VVR in a VCS environment
- Using the primary-elect feature to choose the primary site after a site disaster or network disruption
- Requirements for configuring VVR in a VCS environment
- Generic VVR setup in a VCS environment
- Example VVR configuration in a VCS environment
- Example RVG configuration for a failover application
- Example RVG configuration for a parallel application
- Example setting up VVR in a VCS environment
- Configuring the agents for a bunker replication configuration
- Administering VCS service groups
- Section II. Setting up and administering VVR
- Setting up replication
- About configuring VVR replication
- Enabling security certificate
- Setting up the certificate authority (CA) certificates in /etc/vx/vvr/cacert.pem
- Creating a Replicated Data Set
- Creating a Primary RVG of an RDS
- Adding a Secondary to an RDS
- Changing the replication settings for a Secondary
- Synchronizing the Secondary and starting replication
- Starting replication when the data volumes are zero initialized
- Starting replication over the wire when data volumes are encrypted
- Setting up replication with different sector-sized disks
- Displaying configuration information
- Displaying RVG and RDS information
- Displaying information about data volumes and volume sets
- Displaying information about Secondaries
- Displaying a list of Storage Checkpoints
- Displaying statistics with the vrstat display commands
- Displaying the consolidated statistics
- Displaying the RLINK information for all the hosts in the RDS
- Displaying information about all the data volumes for all the hosts in the RDS
- Displaying information about the SRL volumes for all the hosts in the RDS
- Displaying information about the memory tunable parameters for all the hosts in the RDS
- Determining VVR network bandwidth usage and compression ratio
- Collecting consolidated statistics of the VVR components
- Displaying network performance data
- VVR event notification
- Administering Volume Replicator
- Administering data volumes
- Associating a volume to a Replicated Data Set
- Associating a volume set to an RDS
- Associating a Data Change Map to a data volume in DCO
- Associating a Data Change Map to a data volume as a log plex
- Resizing a data volume in a Replicated Data Set
- Renaming a data volume in a Replicated Data Set
- Dissociating a data volume from its Replicated Data Set
- Mapping the name of a Secondary data volume to a differently named Primary data volume
- Mapping disk groups
- Administering the SRL
- Protecting from SRL overflow
- Incrementally synchronizing the Secondary after SRL overflow
- SRL overflow protection with DCM - flags and definitions
- Prerequisite for incrementally synchronizing the Secondary
- Breaking off mirrors before incremental synchronization
- Example - Resynchronizing the Secondary using break off mirrors
- Example - Recreating volumes if a disaster occurs during resynchronization
- Notes on using incremental synchronization on SRL overflow
- Changing the size of the SRL on the Primary and the Secondary
- Decreasing the size of the SRL on the Primary
- Administering replication
- Administering the Replicated Data Set
- Administering Storage Checkpoints
- Creating RVG snapshots
- Using the instant snapshot feature
- About instant full snapshots
- Prerequisites for creating instant full snapshots
- Creating snapshot volumes for data volumes in an RVG
- Preparing the volumes prior to using the instant snapshot feature
- Freezing or pausing replication prior to taking a snapshot
- Creating instant full snapshots
- Unfreezing or resuming replication after taking a snapshot
- About instant space-optimized snapshots
- Preparing the RVG volumes for snapshot operation
- Creating the cache object for instant space-optimized snapshots
- Freezing or pausing replication prior to creating an instant space-optimized snapshot
- Creating instant space-optimized snapshots
- Unfreezing or resuming replication after taking an instant space-optimized snapshot
- About instant plex-breakoff snapshots
- Administering snapshots
- Using the traditional snapshot feature
- Using Veritas Volume Manager FastResync
- Verifying the DR readiness of a VVR setup
- Backing up the Secondary
- Administering data volumes
- Using VVR for off-host processing
- Transferring the Primary role
- About transferring the Primary role
- Migrating the Primary
- About taking over from an original Primary
- Failing back to the original Primary
- About choosing the Primary site after a site disaster or network disruption
- Application availability in the case of a network disruption
- Configuring VCS global clustering so you can choose the Primary site
- Choosing the Primary site after a site disaster or network disruption
- Troubleshooting the primary-elect feature
- Primary-elect configuration limitations
- Replication using a bunker site
- Introduction to replication using a bunker site
- Sample bunker configuration
- Setting up replication using a bunker site
- Administering replication using a bunker site
- Using a bunker for disaster recovery
- Replication using a bunker site in a VCS environment
- Removing a bunker
- About bunker commands
- Configuring and administering VVR using System Management Interface Tool
- About SMIT for VVR
- Accessing Volume Replicator interface in SMIT
- Setting up a simple Volume Replicator configuration using SMIT
- Displaying configuration information using SMIT
- Administering Volume Replicator using SMIT
- Pausing replication to a Secondary using SMIT
- Resuming replication to a Secondary using SMIT
- Resynchronizing a Secondary using SMIT
- Taking traditional snapshot of data volumes of an RVG using SMIT
- Taking instant snapshot of data volumes of an RVG using SMIT
- Snapback of data volumes of an RVG using SMIT
- Associating a volume to a Replicated Data Set using SMIT
- Dissociating a data volume from a Replicated Data Set using SMIT
- Removing a Secondary from a Replicated Data Set using SMIT
- Removing a Primary from an RDS using SMIT
- Stopping replication to a Secondary using SMIT
- Transferring the Primary role using SMIT
- Troubleshooting VVR
- Recovery from RLINK connect problems
- Recovery from configuration errors
- Errors during an RLINK attach
- Errors during modification of an RVG
- Recovery on the Primary or Secondary
- About recovery from a Primary-host crash
- Recovering from Primary data volume error
- Primary SRL volume error cleanup and restart
- Primary SRL volume error at reboot
- Primary SRL volume overflow recovery
- Primary SRL header error cleanup and recovery
- Secondary data volume error cleanup and recovery
- Secondary SRL volume error cleanup and recovery
- Secondary SRL header error cleanup and recovery
- Secondary SRL header error at reboot
- Tuning replication performance
- Overview of replication tuning
- SRL layout
- Tuning Volume Replicator
- VVR buffer space
- Write buffer space on the Primary
- Readback buffer space on the Primary
- Buffer space on the Secondary
- Tunable parameters for the VVR buffer spaces
- Tunable parameters for the write buffer space on the Primary in a private disk group
- Tunable parameter for the readback buffer space
- Tunable parameters for the buffer space on the Primary in a shared disk group
- Tunable parameters for the buffer space on the Secondary
- DCM replay block size
- Heartbeat timeout
- Memory chunk size
- UDP replication tuning
- Tuning the number of TCP connections
- Message slots on the Secondary
- VVR and network address translation firewall
- Tuning VVR compression
- VVR buffer space
- Setting up replication
- Section III. Analyzing your environment with Volume Replicator Advisor
- Introducing Volume Replicator Advisor (VRAdvisor)
- Collecting the sample of data
- About collecting the sample of data
- Collecting the sample of data on UNIX
- Collecting the sample of data on Windows
- Analyzing the sample of data
- About analyzing the sample of data
- Launching the VRAdvisor wizard
- Analyzing the collected data
- Understanding the results of the analysis
- Viewing the analysis results
- Recalculating the analysis results
- Applying different parameters to the existing sample of data
- Performing What-if analysis
- Calculating the SRL Size for a specified Network Bandwidth and Outage
- Calculating the Network Bandwidth for data loss specified in bytes
- Calculating the Network Bandwidth for data loss specified in time duration
- Calculating the Network Bandwidth for Bunker and RTO
- Changing the value ranges on the slider bar
- Recording and viewing the results
- Installing Volume Replicator Advisor (VRAdvisor)
- Section IV. VVR reference
- Appendix A. VVR command reference
- Appendix B. Using the In-band Control Messaging utility vxibc and the IBC programming API
- About the IBC messaging utility vxibc
- In-band Control Messaging overview
- Using the IBC messaging command-line utility
- Registering an application name
- Displaying the registered application name for an RVG
- Receiving an IBC message
- Sending an IBC message
- Unfreezing the Secondary RVG
- Unregistering an application name
- Receiving and processing an IBC message using a single command
- Sending and processing an IBC message using a single command
- Examples - Off-host processing
- Example 1 - Decision support using the traditional snapshot feature and the vxibc utility
- Example 2 - Backing up using the snapshot feature and the vxibc utility
- Example 3 - Trial failover using the snapshot feature
- Example 4 - Decision support using the instant full snapshot feature and the vxibc utility
- In-band Control Messaging API
- Appendix C. Volume Replicator object states
- Appendix D. Alternate methods for synchronizing the Secondary
- Using the full synchronization feature
- Using block-level backup and Storage Checkpoint
- Using the Disk Group Split and Join feature
- Using difference-based synchronization
- Examples for setting up a simple Volume Replicator configuration
- Creating a Replicated Data Set for the examples
- Example for setting up replication using full synchronization
- Example for setting up replication using block-level backup and checkpointing
- Example for setting up replication using Disk Group Split and Join
- Example for setting up replication using differences-based synchronization
- Example for setting up replication when data volumes are initialized with zeroes
- Appendix E. Migrating VVR from IPv4 to IPv6
- Migrating VVR to support IPv6 or dual stack
- Overview of VVR migration from IPv4 to IPv6
- About migrating to IPv6 when VCS global clustering and VVR agents are not configured
- About migrating to IPv6 when VCS global clustering and VVR agents are configured
- Understanding the current IPv4 configuration when VCS global clustering and VVR agents are configured
- Migration prerequisites when VCS global clustering and VVR agents are configured
- Migrating to IPv6 when VCS global clustering and VVR agents are configured
- Migrating the VCS global clustering service group to IPv6 when VCS global clustering and VVR agents are configured
- Adding IP and NIC resources for IPv6 addresses in the RVG agent group when VCS global clustering and VVR agents are configured
- Migrating VVR RLINKs from IPv4 to IPv6 when VCS global clustering and VVR agents are configured
- Removing the IPv4 resources from the VCS configuration when VCS global clustering and VVR agents are configured
- About migrating to IPv6 when VCS global clustering and VVR agents are configured in the presence of a bunker
- Understanding the current IPv4 configuration when VCS global clustering and VVR agents are configured in the presence of a bunker
- Migration prerequisites when VCS global clustering and VVR agents are configured in the presence of a bunker
- Migrating to IPv6 when VCS global clustering and VVR agents are configured in the presence of a bunker
- Migrating the VCS global clustering service group to IPv6 when VCS global clustering and VVR agents are configured in the presence of a bunker
- Adding the IP and NIC resources for IPv6 addresses in the RVG agent group when VCS global clustering and VVR agents are configured in the presence of a bunker
- Migrating VVR RLINKs from IPv4 to IPv6 when VCS global clustering and VVR agents are configured in the presence of a bunker
- Removing the IPv4 resources from the VCS configuration when VCS global clustering and VVR agents are configured in the presence of a bunker
- Appendix F. Sample main.cf files
Configuring the agents when VCS is running
The example in this section explains how to configure the RVG and RVGPrimary agents when VCS is running.
Note:
Use this example as a reference when creating or changing your resources and attributes.
To add the agent resources to your existing VCS configuration when VCS is running, perform the following procedures:
Create the replication service group
Create the application service group
Create an online local hard dependency between the application service group and the replication service group
Configure the application service group for global failover
Perform the following steps on the client system seattle1 in the Primary cluster Seattle, and then repeat the steps (with minor changes as noted) on the client system london1 in Secondary cluster London:
To create the replication service group
- Log in as root.
- Set the VCS configuration mode to read/write by issuing the following command:
# haconf -makerw
- Add the replication service group, VVRGrp, to the cluster. This group will contain all the storage and replication resources. Modify the attributes SystemList and AutoStartList of the service group to populate SystemList and AutoStartList:
# hagrp -add VVRGrp # hagrp -modify VVRGrp SystemList seattle1 0 seattle2 1 # hagrp -modify VVRGrp AutoStartList seattle1 seattle2
On the Secondary cluster, replace seattle1 and seattle2 with london1 and london2
- Add the DiskGroup resource Hr_Dg to the service group VVRGrp and modify the attributes of the resource:
# hares -add Hr_Dg DiskGroup VVRGrp # hares -modify Hr_Dg DiskGroup hrdg
- Add a NIC resource vvrnic to the service group VVRGrp and modify the attributes of the resource:
# hares -add vvrnic NIC VVRGrp # hares -modify vvrnic Device en1
- Add the IP resource vvrip to the service group VVRGrp and modify the attributes of the resource:
# hares -add vvrip IP VVRGrp # hares -modify vvrip Device en1 # hares -modify vvrip Address 192.168.40.20 # hares -modify vvrip NetMask "255.255.248.0"
On the Secondary cluster, use the appropriate IP for the Address. For example:
# hares -modify vvrip Address 192.168.40.21
- Add the RVG resource Hr_Rvg in the VVRGrp and modify the attributes of the resource.
# hares -add Hr_Rvg RVG VVRGrp # hares -modify Hr_Rvg RVG hr_rvg # hares -modify Hr_Rvg DiskGroup hrdg
- Specify resource dependencies for the resources you added in the previous steps:
# hares -link Hr_Rvg vvrip # hares -link Hr_Rvg Hr_Dg # hares -link vvrip vvrnic
- Enable all resources in VVRGrp
# hagrp -enableresources VVRGrp
- Save and close the VCS configuration
# haconf -dump -makero
Perform the following steps on the system seattle1 in the Primary cluster Seattle, and then repeat the steps (with minor changes as noted) on the system london1 in Secondary cluster London:
To create the application service group
- Log in as root.
- Set the VCS configuration mode to read/write by issuing the following command:
# haconf -makerw
- Add a service group, ORAGrp, to the cluster Seattle. This group will contain all the application specific resources. Populate the attributes SystemList, AutoStartList and ClusterList of the service group.
# hagrp -add ORAGrp # hagrp -modify ORAGrp SystemList seattle1 0 seattle2 1 # hagrp -modify ORAGrp AutoStartList seattle1 seattle2 # hagrp -modify ORAGrp ClusterList Seattle 0 London 1
On the Secondary , replace seattle1 and seattle2 with london1 and london2, as follows:
# hagrp -add ORAGrp # hagrp -modify ORAGrp SystemList london1 0 london2 1 # hagrp -modify ORAGrp AutoStartList london1 london2 # hagrp -modify ORAGrp ClusterList Seattle 0 London 1
- Add a NIC resource oranic to the service group ORAGrp and modify the attributes of the resource:
# hares -add oranic NIC ORAGrp # hares -modify oranic Device en0
- Add an IP resource oraip to the service group ORAGrp and modify the attributes of the resource:
# hares -add oraip IP ORAGrp # hares -modify oraip Device en0 # hares -modify oraip Address 192.168.40.1 # hares -modify oraip NetMask "255.255.248.0"
On the Secondary, modify the Address attribute for the IP resource appropriately.
- Add the Mount resource Hr_Mount01 to mount the volume hr_dv01 in the RVG resource Hr_Rvg:
# hares -add Hr_Mount01 Mount ORAGrp # hares -modify Hr_Mount01 MountPoint /hr_mount01 # hares -modify Hr_Mount01 BlockDevice /dev/vx/dsk/Hr_Dg/hr_dv01 # hares -modify Hr_Mount01 FSType vxfs # hares -modify Hr_Mount01 FsckOpt %-n
- Add the Mount resource Hr_Mount02 to mount the volume hr_dv02 in the RVG resource Hr_Rvg:
# hares -add Hr_Mount02 Mount ORAGrp # hares -modify Hr_Mount02 MountPoint /hr_mount02 # hares -modify Hr_Mount02 BlockDevice /dev/vx/dsk/Hr_Dg/hr_dv02 # hares -modify Hr_Mount02 FSType vxfs # hares -modify Hr_Mount02 FsckOpt %-n
- Add the Mount resource Hr_Mount03 to mount the volume set hr_vset01 in the RVG resource Hr_Rvg:
# hares -add Hr_Mount03 Mount ORAGrp # hares -modify Hr_Mount03 MountPoint /hr_mount03 # hares -modify Hr_Mount03 BlockDevice /dev/vx/dsk/ Hr_Dg/hr_vset01 # hares -modify Hr_Mount03 FSType vxfs # hares -modify Hr_Mount03 FsckOpt %-n
- Add the Oracle resource Hr_Oracle
# hares -add Hr_Oracle Oracle ORAGrp # hares -modify Hr_Oracle Sid hr1 # hares -modify Hr_Oracle Owner oracle # hares -modify Hr_Oracle Home "/hr_mount01/OraHome1" # hares -modify Hr_Oracle Pfile "inithr1.ora" # hares -modify Hr_Oracle User dbtest # hares -modify Hr_Oracle Pword dbtest # hares -modify Hr_Oracle Table oratest # hares -modify Hr_Oracle MonScript "./bin/Oracle/SqlTest.pl" # hares -modify Hr_Oracle StartUpOpt STARTUP # hares -modify Hr_Oracle ShutDownOpt IMMEDIATE # hares -modify Hr_Oracle AutoEndBkup 1
- Add the Oracle listener resource LISTENER
# hares -add LISTENER Netlsnr ORAGrp # hares -modify LISTENER Owner oracle # hares -modify LISTENER Home "/hr_mount01/OraHome1" # hares -modify LISTENER Listener LISTENER # hares -modify LISTENER EnvFile "/oracle/.profile" # hares -modify LISTENER MonScript "./bin/Netlsnr/LsnrTest.pl"
- Add the RVGPrimary resource Hr_RvgPri
# hares -add Hr_RvgPri RVGPrimary ORAGrp # hares -modify Hr_RvgPri RvgResourceName Hr_Rvg
- Specify resource dependencies for the resources you added in the previous steps:
# hares -link LISTENER Hr_Oracle # hares -link LISTENER oraip # hares -link Hr_Oracle Hr_Mount01 # hares -link Hr_Oracle Hr_Mount02 # hares -link Hr_Mount01 rvg-pri # hares -link Hr_Mount02 rvg-pri # hares -link Hr_Mount03 rvg-pri # hares -link oraip oranic
- The application service group and the replication service group must both exist before doing this step. If you have not yet created the replication service group, do so now.
See Configuring the agents when VCS is running.
After you have created the application service group and the replication service group, specify an online local hard group dependency between ORAGrp and VVRGrp.
# hagrp -link ORAGrp VVRGrp online local hard
- Enable all resources in ORAGrp
# hagrp -enableresources ORAGrp
- Save and close the VCS configuration
# haconf -dump -makero
- Bring the service groups online, if not already online.
# hagrp -online VVRGrp -sys seattle1 # hagrp -online ORAGrp -sys seattle1
- Verify that the service group ORAGrp is ONLINE on the system seattle1 by issuing the following command:
# hagrp -state ORAGrp
Refer to the /var/VRTSvcs/engine.log file to identify configuration errors and to take actions accordingly.
More Information