Important Update: Cohesity Products Documentation


All Cohesity product documentation are now managed via the Cohesity Docs Portal: https://docs.cohesity.com/HomePage/Content/home.htm. Some documentation available here may not reflect the latest information or may no longer be accessible.

InfoScale™ for Kubernetes 9.1.0 - Linux

Last Published:
Product(s): InfoScale & Storage Foundation (9.1)
Platform: Linux
  1. Overview
    1.  
      Introduction
    2.  
      Features of InfoScale in Containerized environment
    3.  
      CSI Introduction
    4.  
      I/O fencing
    5.  
      Disaster Recovery
    6.  
      Licensing
    7.  
      Encryption
  2. System requirements
    1.  
      Introduction
    2.  
      Supported platforms
    3.  
      Disk space requirements
    4.  
      Hardware requirements
    5.  
      Number of nodes supported
    6.  
      DR support
  3. Preparing to install InfoScale on Containers
    1.  
      Setting up the private network
    2.  
      Guidelines for setting the media speed for LLT interconnects
    3.  
      Guidelines for setting the maximum transmission unit (MTU) for LLT
    4.  
      Synchronizing time settings on cluster nodes
    5.  
      Securing your InfoScale deployment
    6.  
      Configuring kdump
  4. Installing Arctera InfoScale on OpenShift
    1.  
      Introduction
    2. Prerequisites
      1.  
        Enabling kubelet inhibitor with systemd
      2.  
        Preflight checks before the product deployment
    3.  
      Considerations for configuring cluster or adding nodes to an existing cluster
    4.  
      Creating multiple InfoScale clusters
    5.  
      InfoScale for Kubernetes with Red Hat OpenShift virtualization platform
    6. Installing InfoScale on a system with Internet connectivity
      1.  
        Using IncludeDevices for selective storage management
      2.  
        Installing from OperatorHub by using web console
      3.  
        Installing from OperatorHub by using Command Line Interface (CLI)
      4.  
        Installing by using YAML
    7.  
      Using InfoScale storage with OpenShift virtualization
    8. InfoScale for Kubernetes support for Two-Node Arbiter (TNA) clusters
      1.  
        Prerequisites and compatibility requirements
      2.  
        Configuration
      3.  
        Installation
  5. Installing Arctera InfoScale on Kubernetes
    1.  
      Introduction
    2.  
      Prerequisites
    3.  
      Installing Node Feature Discovery (NFD) Operator and Cert-Manager on Kubernetes
    4.  
      Downloading Installer
    5. Tagging the InfoScale images on Kubernetes
      1.  
        Downloading side car images
    6.  
      Applying licenses
    7.  
      Considerations for configuring cluster or adding nodes to an existing cluster
    8.  
      Creating multiple InfoScale clusters
    9. Installing InfoScale on Kubernetes
      1.  
        Configuring cluster
    10.  
      Undeploying and uninstalling InfoScale
  6. Configuring KMS-based encryption on an OpenShift cluster
    1.  
      Introduction
    2.  
      Adding a custom CA certificate
    3.  
      Configuring InfoScale to enable transfer of keys
    4.  
      Renewing with an external CA certificate
  7. Configuring KMS-based encryption on an Kubernetes cluster
    1.  
      Introduction
    2.  
      Adding a custom CA certificate
    3.  
      Configuring InfoScale to enable transfer of keys
    4.  
      Renewing with an external CA certificate
  8. InfoScale CSI deployment in Container environment
    1.  
      CSI plugin deployment
    2.  
      Raw block volume support
    3.  
      Static provisioning
    4. Dynamic provisioning
      1.  
        Reclaiming provisioned storage
    5.  
      Resizing Persistent Volumes (CSI volume expansion)
    6. Snapshot provisioning (Creating volume snapshots)
      1.  
        Dynamic provisioning of a snapshot
      2.  
        Static provisioning of an existing snapshot
      3.  
        Using a snapshot
      4.  
        Restoring a snapshot to new PVC
      5.  
        Deleting a volume snapshot
      6.  
        Creating snapshot of a raw block volume
    7. Managing InfoScale volume snapshots with Velero
      1.  
        Setting up Velero with InfoScale CSI
      2.  
        Taking the Velero backup
      3.  
        Creating a schedule for a backup
      4.  
        Restoring from the Velero backup
    8. Volume cloning
      1.  
        Creating volume clones
      2.  
        Deleting a volume clone
    9.  
      Using InfoScale with non-root containers
    10.  
      Using InfoScale in SELinux environments
    11.  
      CSI Drivers
    12.  
      Creating CSI Objects for OpenShift
    13.  
      Creating ephemeral volumes
    14.  
      Creating node affine volumes
  9. Installing and configuring InfoScale DR Manager on OpenShift
    1.  
      Introduction
    2.  
      Prerequisites
    3.  
      Creating Persistent Volume for metadata backup
    4.  
      External dependencies
    5. Installing InfoScale DR Manager by using OLM
      1.  
        Installing InfoScale DR Manager by using web console
      2.  
        Configuring InfoScale DR Manager by using web console
      3.  
        Installing from OperatorHub by using Command Line Interface (CLI)
    6. Installing InfoScale DR Manager by using YAML
      1.  
        Configuring Global Cluster Membership (GCM)
      2.  
        Configuring Data Replication
      3.  
        Configuring DNS
      4.  
        Configuring Disaster Recovery Plan
    7. Tech Preview: Disaster recovery in OpenShift virtualization environment
      1.  
        Capturing and replicating VM resources
      2.  
        Graceful workload shutdown
      3. Prerequisites and compatibility requirements
        1.  
          Required operators on the DR site
      4.  
        Deployment behavior
      5.  
        Migration and failback considerations
  10. Installing and configuring InfoScale DR Manager on Kubernetes
    1.  
      Introduction
    2.  
      Prerequisites
    3.  
      Creating Persistent Volume for metadata backup
    4.  
      External dependencies
    5. Installing InfoScale DR Manager
      1.  
        Configuring Global Cluster Membership (GCM)
      2.  
        Configuring Data Replication
      3.  
        Additional requirements for replication on Cloud
      4.  
        Configuring DNS
      5.  
        Configuring Disaster Recovery Plan
  11. Disaster Recovery scenarios
    1.  
      Migration
    2.  
      Takeover
  12. Configuring InfoScale
    1.  
      Logging mechanism
    2.  
      Configuring Arctera Oracle Data Manager (VRTSodm)
    3.  
      Enabling user access and other pod-related logs in Container environment
  13. Administering InfoScale on Containers
    1.  
      Adding nodes to an existing cluster
    2.  
      Removing nodes from an existing cluster
    3.  
      Adding storage to an InfoScale cluster
    4.  
      Managing licenses
    5.  
      Monitoring InfoScale
    6.  
      Configuring Alerts for monitoring InfoScale
    7.  
      Draining InfoScale nodes
    8.  
      Using InfoScale toolset
    9.  
      Changing the peerinact value in a cluster
    10.  
      PV rebuild
  14. Troubleshooting
    1.  
      Adding a sort data collector utility
    2.  
      Collecting logs by using SORT Data Collector
    3.  
      Approving certificate signing requests (csr) for OpenShift
    4.  
      Cert Renewal related
    5.  
      PVC deletions after PV rebuilds
    6.  
      Troubleshooting when adding storage to InfoScale cluster
    7.  
      Known Issues
    8.  
      Limitations

Configuring cluster

Complete the following steps for each cluster.

Note:

Ensure that you add a Kubernetes node only to a single InfoScale cluster.

  1. Edit clusterInfo section of the sample /infoscale-yamls-v9.1.0/kubernetes/cr.yaml for InfoScale specifications as under -

    ---
    apiVersion: infoscale.veritas.com/v1
    kind: InfoScaleCluster
    metadata:
      # Please change cluster name if required
      name: infoscalecluster-dev
      namespace: infoscale-vtas
    spec:
      # This denotes version of the InfoScale release
      version: 9.1.0
      # (optional) This denotes the user-provisioned ID for InfoScale
     cluster
      # The value can range from 1 to 65535
      # clusterID: <Cluster_ID>
      clusterInfo:
      # Please change worker node names according to your cluster
     configuration
      # Mention additional worker node names and corresponding node
     specific
      # parameters, as applicable.
      - nodeName: "<Hostname_of_worker_node>"
        # (optional) Specifies node IP address(es) to be used for
     InfoScale cluster.
        # If omitted, InfoScale chooses available IP address(es)
     for cluster config.
        # Please change worker IP address(es) according to your
     cluster configuration
        # ip:
        # - "<IP_Address_1>"
        # - "<IP_Address_2>"
        # (optional) Specifies a node-specific list of devices
     for InfoScale configuration.
        #
        # Only one of the following fields can be used at a time:
        # - `includeDevices`: List of devices to be explicitly 
    included in InfoScale configuration.
        # - `excludeDevice`: List of devices to be excluded from
     InfoScale configuration.
        #
        # Please update the device names according to your cluster
     setup.
        # includeDevices:
        # - "<Hardware_Path_to_device_to_be_included>"
        # excludeDevice:
        # - "<Hardware_Path_to_device_to_be_excluded>"
        # (optional) Specifies node specific list of devices to be
     used for fencing purpose
        # It is sufficient to provide fencing device information
     from one node
        # (optional) Specifies node specific list of devices to be
     used for fencing purpose
        # It is sufficient to provide fencing device information
     from one node
        # Please change device names according to your cluster
     configuration
        # fencingDevice:
        # - "<Hardware_Path_to_device_to_be_used_for_fencing>"
      - nodeName: "<Hostname_of_worker_node>"
        # (optional) Specifies node IP address(es) to be used for
     InfoScale cluster.
        # If omitted, InfoScale chooses available IP address(es)
     for cluster config.
        # Please change worker IP address(es) according to your
     cluster configuration
        # ip:
        # - "<IP_Address_1>"
        # - "<IP_Address_2>"
        # (optional) Specifies node specific list of devices to be
     excluded from
        # InfoScale configuration.
        # Please change device names according to your cluster
     configuration
        # excludeDevice:
        # - "<Hardware_Path_to_device_to_be_excluded>"
      # Please change below customImageRegistry according to your
     environment
      # This is mandatory for Kubernetes and Air gapped system
     deployments
      # This is optional for OCP deployments
      # customImageRegistry: "<Custom_Registry_Address>"
      # (optional) Specifies whether SCSI-3 Persistent Reservation
     should be enabled
      # If omitted, SCSI3-PR reserveation will be disabled by default.
      # Valid values are true or false.
      # enableScsi3pr : <true/false>
      # (optional) Specifies whether Disk Group Level Encryption
     should be enabled
      # If omitted, Disk Group Level Encryption will be disabled
     by default.
      # Valid values are true or false.
      # encrypted: <true|false>
      # (optional) Specifies whether Disk Group Level Encryption
     Key should be same for all volumes in the DG
      # If omitted, different key will be created for each volume
     by default.
      # Valid values are true or false.
      # sameEncKey: <true|false>
      # (optional) Specifies whether to create Shared NonFSS Disk
     Group.
      # With this option only the full shared disks will be included
     in Disk Group
      # If omitted, FSS Disk Group will be created by default.
      # Valid values are true or false.
      # isSharedStorage: <true|false>
    
    

    You can add up to 16 nodes.

    Note:

    Do not enclose parameter values in angle brackets (<>). For example, Primarynode is the name of the first node; for nodeName : <Name of the first node> , enter nodeName : Primarynode. InfoScale on Kubernetes is a keyless deployment.

  2. You can choose to rename cr.yaml. If you rename the file, ensure that you use that name in the next step.

    Note:

    Arctera recommends renaming cr.yaml and maintaining a custom resource for each cluster. The renamed cr.yaml is used to add more nodes to that InfoScale cluster.

  3. Run the following command on the master node.

    kubectl create -f /infoscale-yamls-v9.1.0/kubernetes/cr.yaml

  4. Run the following command on the master node to know the name and namespace of the cluster.

    kubectl get infoscalecluster -A

    Use the namespace from the output similar to the following -

    NAMESPACE   NAME                VERSION   CLUSTERID   STATE   AGE
    .
    .
    <Namespace> <Name of the 
                 InfoScale cluster> 9.1.0  <Cluster ID> Running 25h
    .
    .
  5. Run the following command on the master node to verify whether the pods are created successfully.

    kubectl get pods -n infoscale-vtas

    An output similar to the following indicates a successful creation of nodes

    
    NAME                                            READY   STATUS    RESTARTS      AGE
    
    infoscale-csi-controller-7b4b7bd899-4c786       5/5     Running   0             14m
    
    infoscale-csi-node-5rlr7                        2/2     Running   0             14m
    
    infoscale-csi-node-fl57f                        2/2     Running   0             14m
    
    infoscale-csi-node-srnh5                        2/2     Running   0             14m
    
    infoscale-fencing-controller-654f549565-d56jk   1/1     Running   0             14m
    
    infoscale-fencing-enabler-4xxx7                 1/1     Running   0             14m
    
    infoscale-fencing-enabler-hr26f                 1/1     Running   0             14m
    
    infoscale-fencing-enabler-qdx4v                 1/1     Running   0             14m
    
    infoscale-licensing-operator-cfff86577-kcpnl    1/1     Running   1 (43m ago)   100m
    
    infoscale-sds-22222-a924e23b0ed1ca1d-6t4fs      1/1     Running   0             14m
    
    infoscale-sds-22222-a924e23b0ed1ca1d-qhqzn      1/1     Running   0             14m
    
    infoscale-sds-22222-a924e23b0ed1ca1d-w48vz      1/1     Running   0             14m
    
    infoscale-sds-operator-7fd45465cc-cssmm         1/1     Running   0             22m
    
    infoscale-toolset-22222-b7c8cbf78-b9xnv         1/1     Running   0             14m
    
    infoscale-toolset-22222-b7c8cbf78-fb8vz         1/1     Running   0             14m
    
    infoscale-toolset-22222-b7c8cbf78-x5cjj         1/1     Running   0             14m
    
    # kubectl get infoscalecluster -A
    
    NAMESPACE        NAME                   VERSION   CLUSTERID   STATE     DISKGROUPS           STATUS    AGE
    
    infoscale-vtas   infoscalecluster-dev   9.1.0     22222       Running   vrts_kube_dg-22222   Healthy   14m

InfoScale SDS pods are created in the namespace you specify in cr.yaml. Fencing and CSI pods are created in the operator namespace.

After a successful InfoScale deployment, a disk group is automatically created. You can now create Persistent Volumes/ Persistent Volume Claims (PV / PVC) by using the corresponding Storage class.

See Adding nodes to an existing cluster.

See Removing nodes from an existing cluster.