Description
Tuning RVIO memory pools for VVR deployment appropriately for latest Infoscale Patches and releases.
Overview
In Infoscale 7.x and prior releases, the RVIO memory pool is shared across all Replicated Volume Groups (RVGs) on a system, whereas NMPOOL and RDBACK pools are per RVG basis. The recommendation was to keep the RVIO memory pool equal to the number of RVGs multiplied by the size of NMPOOL.
Change in Design (Recent Releases)
From the following InfoScale patches and versions onward, the RVIO memory pool is now configured per RVG basis.
- 7.4.2.4000 and onwards
- 8.0.0.2800 and onwards
- 8.0.2
- 9.0
Currently, the CPI upgrade process does not account for this design change, so post-upgrade, the RVIO memory pool remains set to the number of RVGs multiplied by the size of NMPOOL. If the upgrade path involves an OS upgrade, administrators may manually set the older tuned value, resulting in a larger RVIO memory pool setting for each RVG, which is unnecessary and can increase the memory footprint on the system.
For the patches and releases mentioned above, the RVIO memory pool should be set to a size equal to the NMPOOL size.
Solution: Changing the RVIO Memory pool value.
1. Deport all the disk groups that are configured with RVG resources for replication.
2. Set the RVIO Memory pool size on all the cluster nodes.
- vxtune vol_rvio_maxpool_sz <size>
3. Resume the replications or import the DGs.
- Once the RVIO Memory pool size is set, resume the replications or import the disk groups to continue normal operations.
Post-Tuning Verification
After tuning the RVIO Memory pool using the above steps, the vxmemstat output should display the memory pool for each RVG as shown in the sample below:
[root@server101 ~]# vxprint | grep ^rv
rv rvg-arctera-01 - ENABLED - - ACTIVE - -
[root@hostname ~]# vxmemstat -i1
Pool DG Min Max In Allocated Max Waiting
Size Size Use Used
---------- ------- -------- ---------- ---------- ---------- --------- -------
RDBCK-rvg-arctera-01 dg-arctera-01 1024 131072 0 1024 240 no
NMCOM-rvg-arctera-01 dg-arctera-01 1024 131072 0 1024 0 no
RVIO-rvg-arctera-01 dg-arctera-01 1024 131072 0 1024 24 no
Voliomem - 1024 131072 0 1024 0 no
SnapVol - 1024 131072 0 1024 0 no
SrcVol - 1024 131072 0 1024 0 no
WRSHIP - 1024 65536 0 1024 0 no
ATCPY - 1024 131072 0 1024 0 no
AdminIO - 4096 131072 0 4096 0 no
Other - 1024 65536 0 1024 0 no
Cloudd - 1024 131072 0 1024 0 no
Encrypt - 1024 131072 0 1024 0 no
---------------------------------------------------------------------------------------------