System Discovery and Archive Analyzer for File Systems - Collecting Data

Table of Contents

Before You Begin

  • You must have a user account on the Cloud Services Web site. To create a user account, register your CommServe computer. If you already have a user account, you still might need to register your CommServe computer. For instructions, see Getting Access to the Cloud Services Web Site.

  • To collect file access times on Microsoft Windows Vista or later, you must enable a registry key. For instructions, see Collect File Access Time.

Notes:

  • For each discovery job, a .cvf file is produced. The .cvf file is 325 MB for every 1,000,000 files. For example, if you discover 3,000,000 files, the .cvf file will be 975 MB. The .cvf file size is an estimate and is affected by the length of the file path, length of the file name, and whether User and Owner information is collected.
  • Usually, the System Discovery and Archive Analyzer for File Systems processes 1,000,000 files in approximately five minutes. There will be a slight increase in both Memory and CPU use on the servers being scanned while the discovery job runs.
  • The temporary file that is created on each server during the scanning operation can become large, depending on the number of files on the server. If you have limited space on the C: drive where the temporary files are stored, you can change the location. For instructions, see Setting the Location for Temporary System Discovery and Archive Analyzer Files.

Downloading the System Discovery and Archive Analyzer Tool

To download the System Discovery and Archive Analyzer for File Systems:

  1. In your web browser, go to https://cloud.commvault.com/webconsole/applications/cloudApps.jsp.
  2. Log into Cloud Services.
  3. Click System Discovery and Archive Analyzer > Files.
  4. To download the 32-bit version, under Download the tool, click 32-bit Tool.
  5. To download the 64-bit version, under Download the tool, click 64-bit Tool.
  6. Save the file to a location on your local computer.

Running the System Discovery and Archive Analyzer Tool for File Systems

  1. Go to the location in which you saved the System Discovery and Archive Analyzer for File Systems, and then open the application.
  2. Under Select Type of Scan, select Server Capacity with/without File Level Data, and then click Next.
  3. Under Select Operating System, select the operating system on the computer you will scan:
    • Windows and NAS
    • UNIX and Linux
  4. To automatically detect all computers, under Computer Selection, click Automatically detect computers, and then click Next.
    1. On the Directory Server Selection page, in the Directory service list, select a directory service.

      For example: Windows Active Directory.

    2. In the Domain or Server Name box, type the fully qualified domain name.

      For example: mydomain.mycompany.com.

    3. Enter domain administrator credentials.

      The domain administrator credentials must have access to all computers in the environment.

    4. Optional: in the LDAP Filter box, enter a filter for the computer names on the server.

      For example:

      (&(objectClass=Computer)(name=ida*))

    5. Click Next.
  5. To manually specify a list of computers, under Computer Selection Options, select Manually select computers.
    1. On the Manual Computer Selection page, in the box, enter the names of the computers.

      Type one entry per line. You can enter host names, UNC paths, or both. The manual entry for File Servers should be in the following format: \\file_server\share.

    2. To import computer names from a file, create a .txt file with a list of host names or UNC paths, click Import From File, and then specify the location of the .txt file.

      Type one host name or UNC path per line. Use only .txt format.

    3. On the Administrator Credentials Information page, enter the administrator credentials, and then click Next.

      The administrator credentials must have access to all computers in the environment.

      Note: If you select NIS for UNIX, all selected clients must have a user with root privileges created on each of the clients with same password.

      If a SUDO user has been created for root access, the following commands must be added for all clients:

      Linux - /sbin/fdisk, /sbin/vgdisplay, /usr/sbin/exportfs, /usr/bin/rpm, /usr/sbin/parted, /usr/sbin/vxdisk, /usr/sbin/vxprint

      Solaris - /usr/sbin/format, /usr/sbin/vxdisk, /usr/sbin/vxprint, /usr/sbin/psrinfo, /usr/sbin/prtvtoc, /usr/sbin/repquota, /usr/sbin/metastat

      AIX - /usr/sbin/repquota, /usr/sbin/vxdisk, /usr/sbin/vxprint

      HPUX - /usr/sbin/ioscan, /usr/sbin/diskinfo, /usr/sbin/vxdisk, /usr/sbin/vxprint, /usr/sbin/repquota

  6. To collect file owner names and mask file names in discovered data, on the File Level Information page, select Yes, and then click Next.
    1. To collect the user and group names for each file owner, on the File Level Data Collection Options page, select Collect File Owner User/Group Information.

      User and group information for the file owner is collected, but does not appear in any of the reports.

    2. To make file names unreadable in the discovered data, select Obfuscate file and folder names.

      File and folder names are replaced with numbers, so that the actual file and folder names are not recorded in the log.

    3. Click Next.

      Note: The administrator credentials must have read and write permissions to collect file level data.

    4. On the Discovered Computers page, select the computers where you want to discover data, and then click Next.

      If you used the LDAP Filter on the Directory Server Selection page, then only computers that match the filter criteria you specified appear in the Discovered Computers list.

  7. To skip file level data in the discovery job, on the File Level Information page, select No, and then click Next.

    If you already have a Cloud Services account, you can upload the results automatically.

  8. To upload the results automatically, select Yes, and then enter your Cloud Services credentials:
    1. In the Cloud services username box, enter your user name.
    2. In the Cloud services password box, enter your password.
    3. In the Company Name box, enter the name of your organization.
    4. Optional: To notify other people about this operation, in the Also notify box, enter one or more email addresses, separated by commas.
    5. Click Next.

      Your credentials are verified immediately. This might take some time.

      After the scan completes, the results are automatically uploaded to the Cloud Services website under your user name.

  9. To upload the results manually, select No.

    For instructions on how to manually upload the results, see Uploading the File.

  10. On the Summary page, verify your selections, in the Output directory box, specify the directory where the .zip file will be saved, and then click Discover.

    Warning: The output directory that you specify must have a minimum of 325 MB free space for every 1,000,000 files discovered. For example, if you discover 3,000,000 files, then you must have 975 MB of free space.

    The computers are analyzed and a .zip file is created.

    After the scan completes, a Summary dialog box appears.

    Note: If you are scanning for file level data using UNC paths on a filer, and the following message appears on the Summary page: "No method found to perform system information discovery" then the discovery was successful. The data was discovered.

    If the message, "No method found to perform system information discovery" appears on the Summary page in any other situation, then send an e-mail to CloudFilesDiscovery@commvault.com for assistance.

  11. Click Close to close the Summary dialog box.
  12. Click Close to close the System Discovery and Archive Analyzer.

What Data Types Are Discovered?

UNIX

All UNIX Operating Systems

During the discovery operation, the System Discovery and Archive Analyzer for File Systems skips NFS mounts and files with the following extensions:

  • .a
  • .csh
  • .ksh
  • .la
  • .lib
  • .ln
  • .o
  • .sh
  • .sl
  • .so

However, you can remove the NFS scanning restriction by configuring a registry key. For instructions, see Removing the NFS Mount Scanning Restriction.

In addition, the System Discovery and Archive Analyzer for File Systems skips all files under the following folders.

  • /bin
  • /boot
  • /dev
  • /devices
  • /etc
  • /kernel
  • /lib
  • /lib64
  • /opt
  • /proc
  • /sbin
  • /selinux
  • /stand
  • /sys
  • /tmp
  • /usr
  • /var

However, you can allow scanning for these file systems by configuring a registry key. For instructions, see Allowing Scanning for Skipped Files.

Linux

The System Discovery and Archive Analyzer for File Systems scans Linux OES NSS FS operating systems when you configure a registry key. For instructions, see Allowing Scanning for Linux OES NSS FS.

AIX

The System Discovery and Archive Analyzer for File Systems skips the following folders and file types.

  • /**/*.imp
  • /**/*.exp

Solaris

The System Discovery and Archive Analyzer for File Systems skips all files under the /platform folder.

Scanning LOFS file systems is not supported.

Windows

All files on Windows Server/File Server are discovered. The System Discovery and Archive Analyzer for File Systems follows all local volumes and mount paths, including imbedded mount paths.

Uploading the File

Once you have collected the data, you must upload the .zip file to the cloud site.

If you have multiple .zip files, compress all of the .zip files into a single .zip file, and then upload. Upload only .zip files to the cloud site.

To upload the .zip file:

  1. In your Web browser, go to https://cloud.commvault.com/webconsole/applications/cloudApps.jsp
  2. Log into the cloud site.
  3. Under System Discovery and Archive Analyzer, click the Files tab.
  4. Under Upload Data for Analysis, click Upload Now.

    The Upload Files dialog box appears.

  5. In the Company box, enter the name of your organization, click Add Files, and then in the Choose file to upload box, enter the location of the .zip file.
  6. If you have multiple .zip files created from multiple directories, click Add Another File, and then add up to a total of 10 .zip files.

    If you have more than 10 .zip files, combine all of your .zip files into a maximum of 10 larger .zip files, and then upload the larger .zip files.

  7. Click Submit.

    The .zip file is uploaded. You will receive an e-mail that includes reports about your system.