Storage Foundation 7.4 Administrator's Guide - Linux

To migrate data from on-premise to cloud storage

1. Create the policy file policy.xml.

   See the chapter Administering SmartTier in this document.

   For a sample policy file:

   See Sample policy file.

2. Create a volume set with existing volumes.

   Note:

   Unmount the file system before creating the volume set. After creating the volume set, mount it at the same mount point.

   # umount mount_path_of_data_volume
   # vxvset -g dg_name make \
   vset_name local_data_volume
   # mount -t vxfs /dev/vx/dsk/dg_name/vset_name \
   mount_path_of_data_volume

3. Create buckets/containers in the cloud storage namespace. See the related cloud vendor documentation for instructions.
4. Configure the Cloud target.

   For S3 connectors:

   # vxcloud addtarget name=target_name type=S3 bucket=bucket_name \
   host=host_url secret_key=secret_key \
   access_key=access_key [https=true|false] [sig_version=v4|v2]

   Where secret_key and access_key are credentials to access the vendor cloud services

   By default, https is set to true and sig_version is set to v4.

   If required, you can edit the sig_version using the following command:

   # vxcloud addtarget name=target_name type=S3 bucket=bucket_name \
   host=host_url secret_key=secret_key \
   access_key=access_key [https=true|false] [sig_version=v4|v2]

   For BLOB connectors:

   # vxcloud addtarget name=target_name type=BLOB bucket=bucket_name \
   host=host_url endpoint=account_name \
   access_key=access_key [https=true|false] [sig_version=v4|v2]
   

   Where access_key is credential to access the vendor cloud Services and endpoint is the storage account name of user.

   By default, https is set to true.

5. Create the cloud volume:

   # vxassist -g dg_name make cloudvol_name size vxcloud=on

6. Associate the cloud volume with a Cloud target.

   # vxcloud -g dg_name connect target_name \
   cloudvol_name FS_Block_size

   where FS_Block_size is the block size of the file system mounted on the local volume from where you want to move data to the Cloud target.

7. Add the cloud volume to the volume set:

   # vxvset -g dg_name addvol vset_name cloudvol_name

8. Mount the volume set at the same mount point that was in use by the existing volume.

   # fsvoladm add mount_path_of_data_volume cloudvol_name \
   size

9. Mark the cloud volume as a dataonly volume to avoid metadata from being saved onto the cloud volume.

   # fsvoladm setflags dataonly mount_path_of_data_volume cloudvol_name

10. Verify that the cloud volume is appropriately tagged.

    # fsvoladm queryflags dataonly mount_path_of_data_volume cloudvol_name

11. Assign placement classes to the local and cloud volumes.

    # vxassist -g dg_name settag local_datavol_name \
    vxfs.placement_class.LOCAL
    vxassist -g dg_name settag cloudvol_name \
    vxfs.placement_class.CLOUD

12. Assign the policy to the file systems.

    # fsppadm assign mount_path_of_data_volume policy.xml

13. View an analysis report of the data transfer.

    # fsppadm analyze mount_path_of_data_volume

14. Enforce the policy to move the data between the local volume and the cloud volume.

    Note:

    You can create a cron job to schedule the migration of old data onto the cloud volume.

    # fsppadm enforce mount_path_of_data_volume

15. Verify the location of files on the local and cloud volumes:

    # fsmap -a list_file
    # fsmap -a /data1/*
    Volume    Extent Type     File Offset     Extent Size     File
    localvol         Data               0         1048576     /data1/reports-2016-03
    cloudvol         Data               0         1048576     /data1/reports-2016-04

16. Check the free space and used space across volumes in the volume set using

    # fsvoladm list mount_path_of_data_volume
    # fsvoladm list /data1
    devid   size                 used                 avail                name
    0       2097152              356360               1740792              localvol
    1       10737418240          40                   10737418200          cloudvol