Storage Foundation for Oracle® RAC 7.4.1 Configuration and Upgrade Guide - Solaris

To create the directories on the local file system

1. Log in as the root user on each node.

2. Create a local file system and mount it using one of the following methods:

   • Using native operating system commands

     For instructions, see the operating system documentation.

   • Using Veritas File System (VxFS) commands

     As the root user, create a VxVM local diskgroup on each node.	# vxdg init vxvm_dg \ dg_name
     Create separate volumes for Oracle Clusterware/Oracle Grid Infrastructure binaries and Oracle binaries.	# vxassist -g vxvm_dg make clus_volname size # vxassist -g vxvm_dg make ora_volname size
     Create the file systems with the volumes.	# mkfs -F vxfs /dev/vx/rdsk/vxvm_dg/clus_volname # mkfs -F vxfs /dev/vx/rdsk/vxvm_dg/ora_volname
     Mount the file system.	# mount -F vxfs /dev/vx/dsk/vxvm_dg/clus_volname \ clus_home # mount -F vxfs /dev/vx/dsk/vxvm_dg/ora_volname \ oracle_home

3. Create the directories for Oracle RAC.

   # mkdir -p grid_base
   # mkdir -p clus_home
   # mkdir -p oracle_base
   # mkdir -p oracle_home

4. Set appropriate ownership and permissions for the directories.

   # chown -R grid:oinstall grid_base
   # chmod -R 775 grid_base
   # chown -R grid:oinstall clus_home
   # chmod -R 775 clus_home

   # chown -R oracle:oinstall oracle_base 
   # chmod -R 775 oracle_base
   # chown -R oracle:oinstall oracle_home
   # chmod -R 775 oracle_home

5. Add the resources to the VCS configuration.

   See “To add the storage resources created on VxFS to the VCS configuration”.

6. Repeat all the steps on each node of the cluster.

To add the storage resources created on VxFS to the VCS configuration

1. Change the permissions on the VCS configuration file:

   # haconf -makerw

2. Configure the VxVM volumes under VCS:

   # hares -add dg_resname DiskGroup cvm
   # hares -modify dg_resname DiskGroup vxvm_dg -sys node_name
   # hares -modify dg_resname Enabled 1

3. Set up the file system under VCS:

   # hares -add clusbin_mnt_resname Mount cvm

   # hares -modify clusbin_mnt_resname MountPoint \
   "clus_home"

   # hares -modify clusbin_mnt_resname BlockDevice \
   "/dev/vx/dsk/vxvm_dg/clus_volname" -sys node_name
   # hares -modify clusbin_mnt_resname FSType vxfs
   # hares -modify clusbin_mnt_resname FsckOpt "-n"
   # hares -modify clusbin_mnt_resname Enabled 1
   # hares -add orabin_mnt_resname Mount cvm

   # hares -modify orabin_mnt_resname MountPoint \
   "oracle_home"

   # hares -modify orabin_mnt_resname BlockDevice \
   "/dev/vx/dsk/vxvm_dg/ora_volname" -sys node_name
   # hares -modify orabin_mnt_resname FSType vxfs
   # hares -modify orabin_mnt_resname FsckOpt "-n"
   # hares -modify orabin_mnt_resname Enabled 1

4. Link the parent and child resources:

   # hares -link clusbin_mnt_resname vxvm_dg
   # hares -link orabin_mnt_resname vxvm_dg

5. Repeat all the steps on each node of the cluster.

To create the file system and directories on cluster file system for Oracle database

Perform the following steps on the CVM master node in the cluster.

1. As the root user, create a VxVM shared disk group:

   # vxdg -s init cvm_dg dg_name

2. Create the volume for Oracle database:

   # vxassist -g cvm_dg make ora_volname
   		size

3. Create the Oracle base directory and the Oracle home directory.

   # mkdir -p oracle_base
   # mkdir -p oracle_home

4. Create file system with the volume:

   # mkfs -F vxfs /dev/vx/rdsk/cvm_dg/ora_volname

5. Mount the file system. Perform this step on each node.

   # mount -F vxfs -o cluster /dev/vx/dsk/cvm_dg/ora_volname \
   oracle_home

6. Change the ownership and permissions on all nodes of the cluster.

   # chown -R oracle:oinstall oracle_base 
   # chmod -R 775 oracle_base
   # chown -R oracle:oinstall oracle_home
   # chmod -R 775 oracle_home

7. Add the CVMVolDg and CFSMount resources to the VCS configuration.

   See “To add the CFSMount and CVMVolDg resources to the VCS configuration using CLI”.

To add the CFSMount and CVMVolDg resources to the VCS configuration using CLI

1. Change the permissions on the VCS configuration file:

   # haconf -makerw

2. Configure the CVM volumes under VCS:

   # hares -add dg_resname CVMVolDg cvm

   # hares -modify dg_resname Critical 0

   # hares -modify dg_resname CVMDiskGroup cvm_dg

   # hares -modify dg_resname CVMVolume -add ora_volname

   # hares -modify dg_resname CVMActivation sw

3. Set up the file system under VCS:

   # hares -add orabin_mnt_resname CFSMount cvm
   # hares -modify orabin_mnt_resname Critical 0
   # hares -modify orabin_mnt_resname MountPoint \
   "oracle_home"
   # hares -modify orabin_mnt_resname BlockDevice  \ 
   "/dev/vx/dsk/cvm_dg/ora_volname"

4. Link the parent and child resources:

   # hares -link dg_resname cvm_clus

   # hares -link orabin_mnt_resname dg_resname

   # hares -link orabin_mnt_resname vxfsckd

5. Enable the resources:

   # hares -modify dg_resname Enabled 1

   # hares -modify orabin_mnt_resname Enabled 1

   # haconf -dump -makero

6. Verify the resource configuration in the main.cf file.
7. Verify that the resources are online on all systems in the cluster.

   # hares -state dg_resname

   # hares -state orabin_mnt_resname

   Note:

   At this point, the crsorabin_voldg resource is reported offline, and the underlying volumes are online. Therefore, you need to manually bring the resource online on each node.

   To bring the resource online manually:

   # hares -online dg_resname -sys node_name