Important Update: Cohesity Products Documentation

All Cohesity product documentation are now managed via the Cohesity Docs Portal: https://docs.cohesity.com/HomePage/Content/home.htm. Some documentation available here may not reflect the latest information or may no longer be accessible.

InfoScale™ for Kubernetes 9.1.0 - Linux

Last Published:
Product(s): InfoScale & Storage Foundation (9.1)
Platform: Linux
  1. Overview
    1.  
      Introduction
    2.  
      Features of InfoScale in Containerized environment
    3.  
      CSI Introduction
    4.  
      I/O fencing
    5.  
      Disaster Recovery
    6.  
      Licensing
    7.  
      Encryption
  2. System requirements
    1.  
      Introduction
    2.  
      Supported platforms
    3.  
      Disk space requirements
    4.  
      Hardware requirements
    5.  
      Number of nodes supported
    6.  
      DR support
  3. Preparing to install InfoScale on Containers
    1.  
      Setting up the private network
    2.  
      Guidelines for setting the media speed for LLT interconnects
    3.  
      Guidelines for setting the maximum transmission unit (MTU) for LLT
    4.  
      Synchronizing time settings on cluster nodes
    5.  
      Securing your InfoScale deployment
    6.  
      Configuring kdump
  4. Installing Arctera InfoScale on OpenShift
    1.  
      Introduction
    2. Prerequisites
      1.  
        Enabling kubelet inhibitor with systemd
      2.  
        Preflight checks before the product deployment
    3.  
      Considerations for configuring cluster or adding nodes to an existing cluster
    4.  
      Creating multiple InfoScale clusters
    5.  
      InfoScale for Kubernetes with Red Hat OpenShift virtualization platform
    6. Installing InfoScale on a system with Internet connectivity
      1.  
        Using IncludeDevices for selective storage management
      2.  
        Installing from OperatorHub by using web console
      3.  
        Installing from OperatorHub by using Command Line Interface (CLI)
      4.  
        Installing by using YAML
    7.  
      Using InfoScale storage with OpenShift virtualization
    8. InfoScale for Kubernetes support for Two-Node Arbiter (TNA) clusters
      1.  
        Prerequisites and compatibility requirements
      2.  
        Configuration
      3.  
        Installation
  5. Installing Arctera InfoScale on Kubernetes
    1.  
      Introduction
    2.  
      Prerequisites
    3.  
      Installing Node Feature Discovery (NFD) Operator and Cert-Manager on Kubernetes
    4.  
      Downloading Installer
    5. Tagging the InfoScale images on Kubernetes
      1.  
        Downloading side car images
    6.  
      Applying licenses
    7.  
      Considerations for configuring cluster or adding nodes to an existing cluster
    8.  
      Creating multiple InfoScale clusters
    9. Installing InfoScale on Kubernetes
      1.  
        Configuring cluster
    10.  
      Undeploying and uninstalling InfoScale
  6. Configuring KMS-based encryption on an OpenShift cluster
    1.  
      Introduction
    2.  
      Adding a custom CA certificate
    3.  
      Configuring InfoScale to enable transfer of keys
    4.  
      Renewing with an external CA certificate
  7. Configuring KMS-based encryption on an Kubernetes cluster
    1.  
      Introduction
    2.  
      Adding a custom CA certificate
    3.  
      Configuring InfoScale to enable transfer of keys
    4.  
      Renewing with an external CA certificate
  8. InfoScale CSI deployment in Container environment
    1.  
      CSI plugin deployment
    2.  
      Raw block volume support
    3.  
      Static provisioning
    4. Dynamic provisioning
      1.  
        Reclaiming provisioned storage
    5.  
      Resizing Persistent Volumes (CSI volume expansion)
    6. Snapshot provisioning (Creating volume snapshots)
      1.  
        Dynamic provisioning of a snapshot
      2.  
        Static provisioning of an existing snapshot
      3.  
        Using a snapshot
      4.  
        Restoring a snapshot to new PVC
      5.  
        Deleting a volume snapshot
      6.  
        Creating snapshot of a raw block volume
    7. Managing InfoScale volume snapshots with Velero
      1.  
        Setting up Velero with InfoScale CSI
      2.  
        Taking the Velero backup
      3.  
        Creating a schedule for a backup
      4.  
        Restoring from the Velero backup
    8. Volume cloning
      1.  
        Creating volume clones
      2.  
        Deleting a volume clone
    9.  
      Using InfoScale with non-root containers
    10.  
      Using InfoScale in SELinux environments
    11.  
      CSI Drivers
    12.  
      Creating CSI Objects for OpenShift
    13.  
      Creating ephemeral volumes
    14.  
      Creating node affine volumes
  9. Installing and configuring InfoScale DR Manager on OpenShift
    1.  
      Introduction
    2.  
      Prerequisites
    3.  
      Creating Persistent Volume for metadata backup
    4.  
      External dependencies
    5. Installing InfoScale DR Manager by using OLM
      1.  
        Installing InfoScale DR Manager by using web console
      2.  
        Configuring InfoScale DR Manager by using web console
      3.  
        Installing from OperatorHub by using Command Line Interface (CLI)
    6. Installing InfoScale DR Manager by using YAML
      1.  
        Configuring Global Cluster Membership (GCM)
      2.  
        Configuring Data Replication
      3.  
        Configuring DNS
      4.  
        Configuring Disaster Recovery Plan
    7. Tech Preview: Disaster recovery in OpenShift virtualization environment
      1.  
        Capturing and replicating VM resources
      2.  
        Graceful workload shutdown
      3. Prerequisites and compatibility requirements
        1.  
          Required operators on the DR site
      4.  
        Deployment behavior
      5.  
        Migration and failback considerations
  10. Installing and configuring InfoScale DR Manager on Kubernetes
    1.  
      Introduction
    2.  
      Prerequisites
    3.  
      Creating Persistent Volume for metadata backup
    4.  
      External dependencies
    5. Installing InfoScale DR Manager
      1.  
        Configuring Global Cluster Membership (GCM)
      2.  
        Configuring Data Replication
      3.  
        Additional requirements for replication on Cloud
      4.  
        Configuring DNS
      5.  
        Configuring Disaster Recovery Plan
  11. Disaster Recovery scenarios
    1.  
      Migration
    2.  
      Takeover
  12. Configuring InfoScale
    1.  
      Logging mechanism
    2.  
      Configuring Arctera Oracle Data Manager (VRTSodm)
    3.  
      Enabling user access and other pod-related logs in Container environment
  13. Administering InfoScale on Containers
    1.  
      Adding nodes to an existing cluster
    2.  
      Removing nodes from an existing cluster
    3.  
      Adding storage to an InfoScale cluster
    4.  
      Managing licenses
    5.  
      Monitoring InfoScale
    6.  
      Configuring Alerts for monitoring InfoScale
    7.  
      Draining InfoScale nodes
    8.  
      Using InfoScale toolset
    9.  
      Changing the peerinact value in a cluster
    10.  
      PV rebuild
  14. Troubleshooting
    1.  
      Adding a sort data collector utility
    2.  
      Collecting logs by using SORT Data Collector
    3.  
      Approving certificate signing requests (csr) for OpenShift
    4.  
      Cert Renewal related
    5.  
      PVC deletions after PV rebuilds
    6.  
      Troubleshooting when adding storage to InfoScale cluster
    7.  
      Known Issues
    8.  
      Limitations

Using IncludeDevices for selective storage management

The IncludeDevices feature enables selective storage management within an InfoScale cluster. Administrators can specify which devices (paths) are to be included in the storage pool. Only the listed devices are managed by InfoScale, allowing partial control over node-level storage consumption.

YAML configuration example

apiVersion: infoscale.veritas.com/v1
kind: InfoScaleCluster
metadata:
  name: infoscalecluster-dev
  namespace: infoscale-vtas
spec:
  version: 9.1.0
  clusterID: 1116
  isSharedStorage: false
  encrypted: false
  enableScsi3pr: false
  clusterInfo:
  - nodeName: ocp304-w01.eng.internal
    includeDevices:
    - /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:4:0
    - /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:3:0
  - nodeName: ocp304-w02.eng.internal
    includeDevices:
    - /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:4:0
  customImageRegistry: infoscale-registry.arctera.io/9_1_0/lxrt-9.1.0

Note:

In case if the device has multipaths, then specify only one path of the device in the IncludeDevices list.

Behavior for storage types

  • FSS/DAS: You can specify includeDevices list for all or subset of nodes. For the nodes where includeDevices is not specified all the locally attached storage from that specify node will be consumed.

  • Shared storage: The list can be specified under any one node, and InfoScale automatically applies it across all nodes.

Scaling up storage

To add new devices after cluster creation:

  1. Add the required disks to the host and verify OS discovery.
  2. From the bastion node, run:

    oc get pods -n infoscale-vtas --field-selector spec.nodeName=<node> \ -o jsonpath='{range .items[*]}{.metadata.namespace}{" "}{.metadata.name}{"\n"}{end}' | grep infoscale-sds-<clusterID>

    Example output:

    infoscale-vtas infoscale-sds-2222-22fc374c159d6dd4-549cw
  3. Execute:

    oc exec infoscale-sds-2222-22fc374c159d6dd4-549cw -n infoscale-vtas -- /etc/vx/vxpath_links ALL

  4. Add new device paths under includeDevices in the YAML and reapply:

    oc apply -f cr.yaml

Note:

Removal of devices from the IncludeDevices list is not supported. Only addition of new devices is supported.

The IncludeDevices functionality can be only used for fresh VIKE deployments and not for already deployed clusters.

Usability and supportability

  • Run oc describe infoscalecluster -n infoscale-vtas to view the configured IncludeDevices list.

    Sample output:

    Name:         infoscalecluster-dev
Namespace:    infoscale-vtas
...
Status:
...
Cluster Name:  infoscalecluster-dev
  Cluster Nodes:
    Node Name:  ocp304-w02.eng.internal
    Role:       Joined,Slave
    Include Devices:
      /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:4:0
      /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:3:0
      /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:5:0
    Node Name:  ocp304-w01.eng.internal
    Role:       Joined,Master
    Node Name:  ocp304-w03.eng.internal
    Role:       Joined,Slave

  • If a listed device cannot be found or added to the disk group, the operator emits a warning event that is visible in oc describe:

    Events:
  Type     Reason                          Age                   From
  ----     ------                          ----                  ----
  Warning  Included Devices Not Found      52s (x1744 over 21h)  InfoScaleCluster

    Message
Disks missing on node ocp-w-1.lab.ocp.lan: [/dev/disk/by-path/ip-10.210.201.219:3260-iscsi-iqn.1992-08.com.netapp:sn.288c0083ed0411ef8721d039eabd8aa7:vs.3-lun-01]