Important Update: Cohesity Products Documentation


All Cohesity product documentation are now managed via the Cohesity Docs Portal: https://docs.cohesity.com/HomePage/Content/home.htm. Some documentation available here may not reflect the latest information or may no longer be accessible.

InfoScale™ for Kubernetes 9.1.0 - Linux

Last Published:
Product(s): InfoScale & Storage Foundation (9.1)
Platform: Linux
  1. Overview
    1.  
      Introduction
    2.  
      Features of InfoScale in Containerized environment
    3.  
      CSI Introduction
    4.  
      I/O fencing
    5.  
      Disaster Recovery
    6.  
      Licensing
    7.  
      Encryption
  2. System requirements
    1.  
      Introduction
    2.  
      Supported platforms
    3.  
      Disk space requirements
    4.  
      Hardware requirements
    5.  
      Number of nodes supported
    6.  
      DR support
  3. Preparing to install InfoScale on Containers
    1.  
      Setting up the private network
    2.  
      Guidelines for setting the media speed for LLT interconnects
    3.  
      Guidelines for setting the maximum transmission unit (MTU) for LLT
    4.  
      Synchronizing time settings on cluster nodes
    5.  
      Securing your InfoScale deployment
    6.  
      Configuring kdump
  4. Installing Arctera InfoScale on OpenShift
    1.  
      Introduction
    2. Prerequisites
      1.  
        Enabling kubelet inhibitor with systemd
      2.  
        Preflight checks before the product deployment
    3.  
      Considerations for configuring cluster or adding nodes to an existing cluster
    4.  
      Creating multiple InfoScale clusters
    5.  
      InfoScale for Kubernetes with Red Hat OpenShift virtualization platform
    6. Installing InfoScale on a system with Internet connectivity
      1.  
        Using IncludeDevices for selective storage management
      2.  
        Installing from OperatorHub by using web console
      3.  
        Installing from OperatorHub by using Command Line Interface (CLI)
      4.  
        Installing by using YAML
    7.  
      Using InfoScale storage with OpenShift virtualization
    8. InfoScale for Kubernetes support for Two-Node Arbiter (TNA) clusters
      1.  
        Prerequisites and compatibility requirements
      2.  
        Configuration
      3.  
        Installation
  5. Installing Arctera InfoScale on Kubernetes
    1.  
      Introduction
    2.  
      Prerequisites
    3.  
      Installing Node Feature Discovery (NFD) Operator and Cert-Manager on Kubernetes
    4.  
      Downloading Installer
    5. Tagging the InfoScale images on Kubernetes
      1.  
        Downloading side car images
    6.  
      Applying licenses
    7.  
      Considerations for configuring cluster or adding nodes to an existing cluster
    8.  
      Creating multiple InfoScale clusters
    9. Installing InfoScale on Kubernetes
      1.  
        Configuring cluster
    10.  
      Undeploying and uninstalling InfoScale
  6. Configuring KMS-based encryption on an OpenShift cluster
    1.  
      Introduction
    2.  
      Adding a custom CA certificate
    3.  
      Configuring InfoScale to enable transfer of keys
    4.  
      Renewing with an external CA certificate
  7. Configuring KMS-based encryption on an Kubernetes cluster
    1.  
      Introduction
    2.  
      Adding a custom CA certificate
    3.  
      Configuring InfoScale to enable transfer of keys
    4.  
      Renewing with an external CA certificate
  8. InfoScale CSI deployment in Container environment
    1.  
      CSI plugin deployment
    2.  
      Raw block volume support
    3.  
      Static provisioning
    4. Dynamic provisioning
      1.  
        Reclaiming provisioned storage
    5.  
      Resizing Persistent Volumes (CSI volume expansion)
    6. Snapshot provisioning (Creating volume snapshots)
      1.  
        Dynamic provisioning of a snapshot
      2.  
        Static provisioning of an existing snapshot
      3.  
        Using a snapshot
      4.  
        Restoring a snapshot to new PVC
      5.  
        Deleting a volume snapshot
      6.  
        Creating snapshot of a raw block volume
    7. Managing InfoScale volume snapshots with Velero
      1.  
        Setting up Velero with InfoScale CSI
      2.  
        Taking the Velero backup
      3.  
        Creating a schedule for a backup
      4.  
        Restoring from the Velero backup
    8. Volume cloning
      1.  
        Creating volume clones
      2.  
        Deleting a volume clone
    9.  
      Using InfoScale with non-root containers
    10.  
      Using InfoScale in SELinux environments
    11.  
      CSI Drivers
    12.  
      Creating CSI Objects for OpenShift
    13.  
      Creating ephemeral volumes
    14.  
      Creating node affine volumes
  9. Installing and configuring InfoScale DR Manager on OpenShift
    1.  
      Introduction
    2.  
      Prerequisites
    3.  
      Creating Persistent Volume for metadata backup
    4.  
      External dependencies
    5. Installing InfoScale DR Manager by using OLM
      1.  
        Installing InfoScale DR Manager by using web console
      2.  
        Configuring InfoScale DR Manager by using web console
      3.  
        Installing from OperatorHub by using Command Line Interface (CLI)
    6. Installing InfoScale DR Manager by using YAML
      1.  
        Configuring Global Cluster Membership (GCM)
      2.  
        Configuring Data Replication
      3.  
        Configuring DNS
      4.  
        Configuring Disaster Recovery Plan
    7. Tech Preview: Disaster recovery in OpenShift virtualization environment
      1.  
        Capturing and replicating VM resources
      2.  
        Graceful workload shutdown
      3. Prerequisites and compatibility requirements
        1.  
          Required operators on the DR site
      4.  
        Deployment behavior
      5.  
        Migration and failback considerations
  10. Installing and configuring InfoScale DR Manager on Kubernetes
    1.  
      Introduction
    2.  
      Prerequisites
    3.  
      Creating Persistent Volume for metadata backup
    4.  
      External dependencies
    5. Installing InfoScale DR Manager
      1.  
        Configuring Global Cluster Membership (GCM)
      2.  
        Configuring Data Replication
      3.  
        Additional requirements for replication on Cloud
      4.  
        Configuring DNS
      5.  
        Configuring Disaster Recovery Plan
  11. Disaster Recovery scenarios
    1.  
      Migration
    2.  
      Takeover
  12. Configuring InfoScale
    1.  
      Logging mechanism
    2.  
      Configuring Arctera Oracle Data Manager (VRTSodm)
    3.  
      Enabling user access and other pod-related logs in Container environment
  13. Administering InfoScale on Containers
    1.  
      Adding nodes to an existing cluster
    2.  
      Removing nodes from an existing cluster
    3.  
      Adding storage to an InfoScale cluster
    4.  
      Managing licenses
    5.  
      Monitoring InfoScale
    6.  
      Configuring Alerts for monitoring InfoScale
    7.  
      Draining InfoScale nodes
    8.  
      Using InfoScale toolset
    9.  
      Changing the peerinact value in a cluster
    10.  
      PV rebuild
  14. Troubleshooting
    1.  
      Adding a sort data collector utility
    2.  
      Collecting logs by using SORT Data Collector
    3.  
      Approving certificate signing requests (csr) for OpenShift
    4.  
      Cert Renewal related
    5.  
      PVC deletions after PV rebuilds
    6.  
      Troubleshooting when adding storage to InfoScale cluster
    7.  
      Known Issues
    8.  
      Limitations

Using InfoScale storage with OpenShift virtualization

VIKE is fully qualified for deployment with Red Hat OpenShift virtualization. InfoScale CSI StorageClasses and SnapshotClasses can be used to provision virtual machine disks that provide high performance, enterprise-level reliability, and consistent behavior across container and VM workloads.

Refer to https://www.veritas.com/support/en_US/article.100074725 to know more about configuration guidelines for OpenShift VMs.

The following is an example of a storage profile that references an InfoScale-based StorageClass and SnapshotClass to create virtual machines.

Note:

The cloneStrategy can be either snapshot or clone. If snapshot is chosen as the cloneStrategy, the user must create a VolumeSnapshotClass in advance, after deploying InfoScale.

Note:

Creating a large number of VMs (500+) in a single batch is not recommended. We suggest creating a smaller set of 4-5 VMs at a time and ensuring that each VM reaches the Running state before initiating the creation of the next batch.

Sample VolumeSnapshotClass yaml

These yamls can be found at: /infoscale-yamls-v9.1.0/infoscale-csi/dynamic-provisioning

---
apiVersion: snapshot.storage.k8s.io/v1
kind: VolumeSnapshotClass
metadata:
  name: csi-infoscale-snapclass
  annotations:
    snapshot.storage.kubernetes.io/is-default-class: "true"
driver: org.veritas.infoscale
deletionPolicy: Delete
parameters:
  # (optional) Specifies the type of the snapshot to be created.
  # If omitted, InfoScale by default creates space-optimized snapshot.
  # Supported values: space-optimized, full-instant
   snapType: space-optimized
  # (optional) Specifies the size of the cache volume to be created for space-optimized snapshots.
  # If omitted, InfoScale internally chooses the cacheSize as 30% of orignial volume size.
   cacheSize: 5g

Sample StorageClass yaml:

These yamls can be found at: /infoscale-yamls-v9.1.0/infoscale-csi/storage-class-templates

---
apiVersion: storage.k8s.io/v1
kind: StorageClass
metadata:
  name: csi-infoscale-sc-block 
  annotations:
    storageclass.kubernetes.io/is-default-class: "true"
provisioner: org.veritas.infoscale
reclaimPolicy: Delete
allowVolumeExpansion: true
parameters:
  # (optional) Specifies a volume layout type.
  # Supported layouts: stripe, mirror, stripe-mirror, mirror-stripe, concat, concat-mirror, mirror-concat
  layout: "concat"
  #nstripe: "4"
  # (optional) Specifies the number of disk or host failures a storage object can tolerate.
  #faultTolerance: "1"
  # (optional) Specifies disks with the specified media type. All disks with the given mediatype are selected for volume creation.
  # Supported values: hdd, ssd
  mediaType: "hdd"

Creating OpenShift virtual machines using InfoScale-backed storage

  1. Ensure that the InfoScale cluster is deployed and healthy by running oc get pods -n infoscale-vtas.

     
    
    NAME                                            READY   STATUS    RESTARTS   AGE
    
    infoscale-csi-controller-84488fd788-knfgf       5/5     Running   0          17h
    
    infoscale-csi-node-m27cc                        2/2     Running   0          17h
    
    infoscale-csi-node-mtc57                        2/2     Running   0          17h
    
    infoscale-csi-node-sk2jd                        2/2     Running   0          17h
    
    infoscale-fencing-controller-777ddd5cc8-qtjkc   1/1     Running   0          17h
    
    infoscale-fencing-enabler-mv5wr                 1/1     Running   0          17h
    
    infoscale-fencing-enabler-pmhcb                 1/1     Running   0          17h
    
    infoscale-fencing-enabler-tb69x                 1/1     Running   0          17h
    
    infoscale-licensing-operator-bd5bd97f5-46wwh    1/1     Running   0          17h
    
    infoscale-sds-35322-f836b69ee261cd15-gv5b2      1/1     Running   0          17h
    
    infoscale-sds-35322-f836b69ee261cd15-lzxfr      1/1     Running   0          17h
    
    infoscale-sds-35322-f836b69ee261cd15-zstw6      1/1     Running   0          17h
    
    infoscale-sds-operator-d4546c849-mttwc          1/1     Running   0          17h
    
    infoscale-toolset-35322-8988985cf-hlmws         1/1     Running   0          17h
    
    infoscale-toolset-35322-8988985cf-kxqbv         1/1     Running   0          17h
    
    infoscale-toolset-35322-8988985cf-njpth         1/1     Running   0          17h
    
    [root@ocp319-ba1 asavekar]# oc get infoscalecluster -A
    
    NAMESPACE      NAME                     VERSION CLUSTERID STATE   DISKGROUPS         STATUS  AGE
    
    infoscale-vtas infoscalecluster-dev-new 9.1.0   35322     Running vrts_kube_dg-35322 Healthy 17h
  2. Create a StorageClass using the sample template below. Any valid StorageClass configuration from the available options can be used.

    Note:

    Make the infoscale-concat-sc StorageClass the default by adding the appropriate annotation.

    ---
    apiVersion: storage.k8s.io/v1
    kind: StorageClass
    metadata:
      name: infoscale-concat-sc
      annotations:
        storageclass.kubernetes.io/is-default-class: "true"
    provisioner: org.veritas.infoscale
    reclaimPolicy: Delete
    allowVolumeExpansion: true
    parameters:
      layout: "concat"
      mediaType: "hdd"
  3. Run oc create -f infoscale-concat-sc.yaml.

  4. Install OpenShift Virtualization Operator and create HyperConverged from UI.

    Conditions:ReconcileComplete, Available, Upgradeable
  5. Before creating VMs, the StorageClasses within the storage profile for OpenShift Virtualization must be modified. The StorageClasses in the storage profile are copies of those defined in Step 3.

    • Navigate to OpenShift Console > Administration > CustomResourceDefinitions and search for storageprofile.

    • Click StorageProfile, then select the Instances tab. As mentioned earlier, when the OpenShift Virtualization operators were installed, copies of the StorageClasses defined in the previous section were created.

    • Click the StorageClass that you previously created and annotated as the default, then modify the spec section in the storageprofiles.cdi.kubevirt.io CustomResourceDefinition. Open infoscale-concat-sc, switch to the YAML tab, scroll to the bottom of the file, and delete all lines starting from spec:{} to the end. After removing them, insert the lines shown below if you want to use cloneStrategy as csi-clone.

      spec: 
        claimPropertySets:
        - accessModes:
            - ReadWriteMany
          volumeMode: Block
          cloneStrategy: csi-clone

      Insert the lines below if you want to use cloneStrategy as snapshot. Specify the name of the VolumeSnapshotClass you created earlier in the snapshotClass field.

      spec:
        claimPropertySets:
        - accessModes:
           - ReadWriteMany
          volumeMode: Block
          cloneStrategy: snapshot
          snapshotClass: csi-infoscale-snapclass

      To create a virtual machine using InfoScale-provisioned storage, the user must select the appropriate StorageClass for both the root disk and the data disk.

    • Click Save, and then Reload.

      Note:

      After reloading, the line storageClass: infoscale-concat-sc is added again.

  6. Navigate to Virtualization to create a new virtual machine.

  7. Select the boot source and click Customize VirtualMachine.

  8. Go to Disks and click Edit.

  9. Specify the InfoScale StorageClass for both the boot disk and the data disk, then click Save. After that, select Create VirtualMachine.

    This creates a virtual machine which has InfoScale backed PVC provisioned rootdisk.

  10. Select VirtualMmachines > Configuration > Storage > Add disk.

  11. Mention the InfoScale storage class while adding the data disk.