Veritas Data Insight Administrator's Guide
- Section I. Getting started
- Introduction to Veritas Data Insight administration
- Configuring Data Insight global settings
- Overview of Data Insight licensing
- Configuring SMTP server settings
- About scanning and event monitoring
- About filtering certain accounts, IP addresses, and paths
- About archiving data
- About Data Insight integration with Symantec Data Loss Prevention (DLP)
- Importing sensitive files information through CSV
- Configuring advanced analytics
- About open shares
- Configuring file groups
- Configuring Workspace data owner policy
- Configuring Management Console settings
- About bulk assignment of custodians
- Configuring Watchlist settings
- Section II. Configuring Data Insight
- Configuring Data Insight product users
- Configuring Data Insight product servers
- About Data Insight product servers
- Adding a new Data Insight server
- Managing Data Insight product servers
- Viewing Data Insight server details
- About node templates
- Adding Portal role to a Data Insight server
- Adding Classification Server role to a Data Insight server
- Assigning Classification Server to a Collector
- Associating a Classification Server pool to a Collector
- Viewing in-progress scans
- Configuring Data Insight services
- Configuring advanced settings
- Monitoring Data Insight jobs
- Rotating the encryption keys
- Viewing Data Insight server statistics
- About automated alerts for patches and upgrades
- Deploying upgrades and patches remotely
- Using the Upload Manager utility
- About migrating storage devices across Indexers
- Viewing the status of a remote installation
- Configuring saved credentials
- Configuring directory service domains
- Configuring containers
- Section III. Configuring native file systems in Data Insight
- Configuring NetApp file server monitoring
- About configuring NetApp file server monitoring
- Prerequisites for configuring NetApp file servers
- Credentials required for configuring NetApp filers
- Credentials required for configuring NetApp NFS filers
- Configuring SMB signing
- About FPolicy
- Preparing Data Insight for FPolicy
- Preparing the NetApp filer for Fpolicy
- Preparing the NetApp vfiler for Fpolicy
- Configuring NetApp audit settings for performance improvement
- Preparing a non-administrator domain user on the NetApp filer for Data Insight
- Enabling export of NFS shares on a NetApp file server
- Excluding volumes on a NetApp file server
- Handling NetApp home directories in Data Insight
- Configuring clustered NetApp file server monitoring
- About configuring a clustered NetApp file server
- About configuring FPolicy in Cluster-Mode
- Pre-requisites for configuring clustered NetApp file servers
- Credentials required for configuring a clustered NetApp file server
- Preparing a non-administrator local user on the clustered NetApp filer
- Preparing a non-administrator domain user on a NetApp cluster for Data Insight
- Preparing Data Insight for FPolicy in NetApp Cluster-Mode
- Preparing the ONTAP cluster for FPolicy
- About configuring secure communication between Data Insight and cluster-mode NetApp devices
- Enabling export of NFS shares on a NetApp Cluster-Mode file server
- Configuring EMC Celerra or VNX monitoring
- Configuring EMC Isilon monitoring
- About configuring EMC Isilon filers
- Prerequisites for configuration of Isilon or Unity VSA file server monitoring
- Credentials required for configuring an EMC Isilon cluster
- Configuring audit settings on EMC Isilon cluster using OneFS GUI console
- Configuring audit settings on EMC Isilon cluster using the OneFS CLI
- Configuring Isilon audit settings for performance improvement
- Preparing Veritas Data Insight to receive event notifications from an EMC Isilon or Unity VSA cluster
- Creating a non-administrator user for an EMC Isilon cluster
- Using SmartConnect mapping for access zones
- Purging the audit logs in an Isilon filer
- Configuring EMC Unity VSA file servers
- Configuring Hitachi NAS file server monitoring
- Configuring Windows File Server monitoring
- Configuring Veritas File System (VxFS) file server monitoring
- Configuring monitoring of a generic device
- Managing file servers
- About configuring filers
- Viewing configured filers
- Adding filers
- Add/Edit NetApp filer options
- Add/Edit NetApp cluster file server options
- Add/Edit EMC Celerra filer options
- Add/Edit EMC Isilon file server options
- Add/Edit EMC Unity VSA file server options
- Add/Edit Windows File Server options
- Add/Edit Veritas File System server options
- Add/Edit a generic storage device options
- Add/Edit Hitachi NAS file server options
- Custom schedule options
- Editing filer configuration
- Deleting filers
- Viewing performance statistics for file servers
- About disabled shares
- Adding shares
- Managing shares
- Editing share configuration
- Deleting shares
- About configuring a DFS target
- Adding a configuration attribute for devices
- Configuring a DFS target
- About the DFS utility
- Running the DFS utility
- Importing DFS mapping
- Renaming storage devices
- Configuring NetApp file server monitoring
- Section IV. Configuring SharePoint data sources
- Configuring monitoring of SharePoint web applications
- About SharePoint server monitoring
- Credentials required for configuring SharePoint servers
- Configuring a web application policy
- About the Data Insight web service for SharePoint
- Adding web applications
- Editing web applications
- Deleting web applications
- Adding site collections
- Managing site collections
- Removing a configured web application
- Configuring monitoring of SharePoint Online accounts
- About SharePoint Online account monitoring
- Registering Data Insight with Microsoft to enable SharePoint Online account monitoring
- Configuring an administrator account for Data Insight
- Adding SharePoint Online accounts
- Managing a SharePoint Online account
- Adding site collections to SharePoint Online accounts
- Managing site collections
- Configuring monitoring of SharePoint web applications
- Section V. Configuring cloud data sources
- Section VI. Configuring ECM data sources
- Section VII. Health and monitoring
- Section VIII. Alerts and policies
- Section IX. Remediation
- Section X. Reference
- Appendix A. Backing up and restoring data
- Appendix B. Data Insight health checks
- Appendix C. Command File Reference
- Appendix D. Data Insight jobs
- Appendix E. Troubleshooting
- About general troubleshooting procedures
- About the Health Audit report
- Location of Data Insight logs
- Downloading Data Insight logs
- Migrating the data directory to a new location
- Troubleshooting FPolicy issues on NetApp devices
- Troubleshooting EMC Celera or VNX configuration issues
- Troubleshooting EMC Isilon configuration issues
- Troubleshooting SharePoint configuration issues
- Troubleshooting Hitachi NAS configuration issues
- Troubleshooting installation of Tesseract software
- Index
Understanding Data Insight best practices
The following topics describe the common practices and sizing guidelines:
Common practices
General sizing guidelines
Use 64-bit server architecture for better Data Insight performance.
Use high performance disks for indexers, SAN disk for ease of expansion and backup
Disk concatenation or RAID 4 may generate hotspots in the array subsystem. Ensure proper distribution to avoid hotspots.
Use separate disks for Install and Data directories.
Assign faster and bigger Temp directory for indexers.
Temp directory (for example, in Windows, the directories that are indicated by TMP and TEMP system environment variables) must be on disk other than system disk (operating system disk). This best practice improves index vacuum (like defrag for segments) performance, and overall performance.
Assign indexer memory of 1 GB per thread.
Assign indexer memory sizing of 1 GB per 10 million audit events.
Assign low latency high bandwidth (or dedicated) network links for Collector-Filer communication.
Create exclude rules to ensure that the information that is reported is relevant and useful.
If a third-party application that generates a lot of events, resides on a volume, exclude that volume from auditing (like NetApp FPolicy) to restrict events.
Schedule scans at off peak hours to minimize effect on users accessing the shares.
Disable scans from running during peak usage.
Manage job scheduling as per load.
Assign appropriate roles and access for Data Insight users.
Deploy DFS mappings to ensure that all names are recognizable and meaningful.
Create containers to logically group related objects together for administration and reporting purposes.
Set up event notifications to ensure that errors and warnings are reported.
Define retention policies to ensure the database and log files are maintained over time.
Define report retention in when configuring reports ("Reports to preserve" setting).
Maintain adequate proximity - Management Server close to indexers, Collector close to filers.
Use Chrome for faster UI.
Refer to the Veritas Data Insight Installation Guide for the latest platform and version support information.
The following sizing guidelines are typically recommended for Data Insight setups. The recommendations may change based on environment.
Management Server
Up to 16 indexers
Indexers
Up to 20,000 shares
Allocate 100 MB of disk space per million files
Allocate 20 MB of disk space per million events
Typical storage size range is 40 GB to 400 GB depending upon environment. Large deployments may even need more space.
Collectors
Up to 10,000 shares or ten filers, whichever comes first
Up to 150 Windows NAS agents
Up to 20 SharePoint web front-end servers
Typical storage size range is 60-80 GB per collector. Additional space may also help in case of network outages where data is staged before it is transferred to Indexer.
Indexer storage
100 MB/1 million files
20 MB/1 million events
Scan times
200 files per second per thread
If you enable the computation of the Risk Dossier, there will be an overall increase in the space required for the index folder.
For the Management Server, the dossier database size can be calculated as:
Number of users * 2 MB (to store dossier date for 6 months)
Thus, for 50000 users, provision up to 100 GB space to store dossier data of 6 months.