Auxiliary Copy - Advanced

Table of Contents

How Auxiliary Copy Works

During the Auxiliary Copy job, all the data from a selected source copy gets copied to the selected secondary copy. By default, the source copy is the primary copy. However, you can select any secondary copy as a source copy.

Before performing an Auxiliary Copy job, you must configure a secondary copy. You can configure different types of secondary copies.

Defer Auxiliary Copy

Deferred Copy allows you to defer Auxiliary Copy operations on the copy. You can specify the number of days by which the copy can be deferred once data becomes available on the source copy

To defer Auxiliary Copy .

  1. From the CommCell Browser, expand Policies | Storage Policies | <Storage Policy>.
  2. Right-click the appropriate storage policy copy, and click Properties.
  3. In the Copy Properties dialog box, select the Defer Auxiliary Copy for <n> days check box, enter the number of days to defer the Auxiliary Copy job and then click OK.

Managing Streams during Auxiliary Copy Operations

A data stream can be thought of as a data channel that connects the client file system or database to the storage media. Multiple streams provide for multiple channels through which data can flow.

The following sections describe how you can manage data streams used for an Auxiliary Copy job.

Setting the Number of Streams for an Auxiliary Copy

By default, all the data streams on the primary copy are simultaneously copied to a secondary copy. The data gets copied stream by stream. If there are four data streams on the primary copy then the Auxiliary Copy job will use four data streams on the secondary copy.

If sufficient storage resources are not available, or you do not want to use all available resources, you can select the number of data streams that will be copied simultaneously during an Auxiliary Copy job.  Follow the steps given below to specify the number of data streams:

  1. From the CommCell Browser, expand Policies | Storage Policies.
  2. Right-click the appropriate storage policy, point to All Tasks, and then click Run Auxiliary Copy.
  3. Select the Number of Streams option and specify the number of data streams.

    If enough storage resources are available, you can use the Allow Maximum option so that all data streams are copied concurrently during an auxiliary copy operation.

  4. Click OK.

Performing Auxiliary Copy with Combined Streams

When the secondary copy has less number of data streams than the primary copy, you can use the combine streams from the secondary copy while performing the Auxiliary Copy job. If you enable this option, the secondary copy of the data reside on less media than the media required for the backup data. This improves media usage as the media storage is optimized. Media recycling is also more efficient, as data aging is more effective.

Follow the steps given below to enable the combine streams option for a secondary copy:

  1. From the CommCell Browser, expand Policies | Storage Policies | <Storage_Policy>.
  2. Right-click the appropriate storage policy copy, and then click Properties.
  3. Click the Media tab.
  4. Select the Combine source data streams to check box and select the Stream(s).

    Notes:

    • The DB2, DB2 MultiNode and Sybase agents use same number of streams for restore operation that are used during backup even if Combined Streams option is configured on the storage policy copy.
    • If you are performing a restore operation from a secondary copy that has the Combined Source Data Stream option enabled:
  5. Click OK.

Combining Streams Using Data Multiplexing

When you enable the Combine source data streams option for a secondary copy, you can also enable multiplexing for the secondary copy. When you enable data Multiplexing, multiple data streams will get copied concurrently to the same media. 

  1. From the CommCell Browser, navigate to Policies | Storage Policies | <Storage_Policy>.
  2. Right-click the appropriate storage policy copy, and then click Properties.
  3. Click the Media tab.
  4. Select the Combine source data streams to check box and select the Stream(s).
  5. Select the Multiplexing source streams check box and select the Multiplexing Factor.

    You can enable this option when the storage policy copy has been configured to combine streams, and the copies do not contain deduplicated data.

  6. Click OK.

Performing Auxiliary Copy with Stream Randomization

When a storage policy is configured to use more than one data stream, it is important that the data streams are equally used. If you enable the stream randomization feature, the system chooses the data streams randomly. This increases the rate of data transfer by copying data from different streams in parallel.

Follow the steps given below to enable stream randomization:

  1. From the CommCell Browser, expand Policies | Storage Policies.
  2. Right-click the appropriate storage policy, and then click Properties.
  3. Select the Enable Stream Randomization check box.
  4. Click OK.

You configure the tuning parameters to evenly distribute the data across all the streams. You can specify the interval to check the data size in the streams and the threshold to decide data distribution among the streams. Refer to Tunable Parameters for more information on tuning stream randomization.

Performing Auxiliary Copy with Dynamic Stream Allocation

When data is not equally distributed across all streams on the source copy, then one stream might take longer to copy than another. Using this feature, you can avoid this situation by distributing data across multiple streams.

Auxiliary Copy operation is performed with a fixed mapping between the source and destination streams. If the original backup data was not evenly distributed in the source streams, the Auxiliary Copy operation may not use all the available streams simultaneously. In such a situation, enabling Stream Randomization will help to distribute data evenly among streams. However, if sufficient drives are not available for each stream during an Auxiliary Copy operation, the stream randomization may become ineffective. In such a scenario, Dynamic Stream Allocation feature allows to distribute data evenly across available streams. Dynamic Stream Allocation will be more effective when the source copy is on a disk. Note that this feature cannot be used when source copy is on tape as it cannot read randomly from tape media.

Dynamic Stream Allocation feature can also be used for the following operations to distribute the data between streams:

  • Content Indexing
  • Data Verification
  • Deduplication Database (DDB) Reconstruction

    When this feature is enabled, for above operations, the stream settings specified on the Copy Properties - Media tab will have no effect and will use the maximum device streams set on the Storage Policy properties.

You can also enable this feature in the following scenarios:

  • Multiple Storage Policies are using same library and Auxiliary Copy jobs for all the storage policies are scheduled at the same time.
  • Some drives from the tape library are offline for long time.

Use the following steps to enable distribute data evenly across multiple streams for Auxiliary Copy:

  1. From the CommCell Browser, expand Policies | Storage Policies.
  2. Right-click the appropriate storage policy, and then click Properties.
  3. Select the Distribute data evenly among multiple streams for offline read operations check box to distribute backup data evenly across multiple streams.
  4. Click OK.

    When this option is enabled, during Auxiliary Copy operation, in the Auxiliary Copy Job Details the values of Total data to Process in the General tab and the sum of Total Data to Copy values will differ.

Auxiliary Copy Encryption

You can enable data encryption for a secondary copy. The data will get encrypted during an auxiliary copy operation. This is useful in the following scenarios:

  • You are sending media to an off-site location and want to ensure the data on that media is not readable should the media be lost or stolen.
  • You are performing a backup to a disk library and wish to copy that data to a tape in encrypted form, but do not want to consume the time and resources required to encrypt the data during the backup.
  • You are protecting data from multiple organizations and want to ensure one organization cannot read the data from another.
  • You wish to encrypt a portion of the source copy for off-site or long-term storage. For example, if you create a selective copy with a certain set of criteria established, the auxiliary copy encryption process will encrypt only the data satisfying that criteria

The following table illustrates the data encrypted with auxiliary copy encryption:

Storage Policy is... Auxiliary Copy Encryption will...
Not encrypted Encrypt all data.
Partially encrypted Encrypt only the data that has not already been encrypted.
Fully encrypted Retain existing encryption, unless configured to use a different algorithm.

The Auxiliary Copy operation encrypts any portion of the data that has not already been encrypted during a backup. If any data on the source copy is already encrypted, the software retains that data's existing encryption, unless configured to re-encrypt the data using a different data encryption algorithm.

To enable data encryption on the storage policy copy.

  • Pass-phrase option is not supported with deduplication.

  1. From the CommCell Browser, expand Policies | Storage Policies | <Storage_Policy>.
  2. Right-click the appropriate storage policy copy, and click Properties.
  3. In the Copy Properties dialog box, click the Advanced tab, select the Encrypt Data check box, and then select the appropriate encryption settings.

    All encryption keys are supported for Auxiliary Copy encryption and are created on an individual basis for each backup.

  4. Click OK.

Auxiliary Copy Job Options

The following sections describe the available Auxiliary Copy job options.

Select a Source MediaAgent

If a source copy used for the Auxiliary Copy job is configured with a shared library, you can select a MediaAgent to read the data during the Auxiliary Copy operation. Follow the steps given below to select a source MediaAgent:
  1. From the CommCell Browser, expand Policies | Storage Policies.
  2. Right-click the appropriate storage policy, point to All Tasks, and then click Run Auxiliary Copy.
  3. Select a MediaAgent from the Select Source MediaAgent list. This list displays all the MediaAgents configured in a CommCell.

    If the source copy is not configured with the selected MediaAgent the auxiliary copy operation may fail.

  4. Click OK.

Run an Auxiliary Copy Job to the New Media

Follow the steps given below to create a secondary copy on a new media from the drive pool:
  1. From the CommCell Browser, expand Policies | Storage Policies.
  2. Right-click the appropriate storage policy, point to All Tasks, and then click Run Auxiliary Copy.
  3. Select the Start New Media check box.
  4. Click OK.

Use Most Recent Full Backup for Auxiliary Copy

You can include the most recent full backup in a secondary copy as follows:

  1. From the CommCell Browser, expand Policies | Storage Policies.
  2. Right-click the appropriate storage policy, point to All Tasks, and then click Run Auxiliary Copy.
  3. Select the Use Most Recent Full Backup for Auxcopy check box.
    Note: This option is applicable only for Selective Copies when Do not Automatically select jobs option is enabled on the Selective Copy tab of the selective Copy Properties dialog box.
  4. Click OK.

    When enabled during Auxiliary Copy operation the following jobs are copied:

    • The most recent full backup for all subclients associated with the storage policy.
    • The partial jobs available on the selective copy.
    • The jobs that are manually selected for copy.

Mark Media Full

After the Auxiliary Copy operation completes successfully, you can mark the destination media as full. This media will not be used for further backups or Auxiliary Copy operations. Follow the steps give below to mark the media full:
  1. From the CommCell Browser, expand Policies | Storage Policies.
  2. Right-click the appropriate storage policy, point to All Tasks, and then click Run Auxiliary Copy.
  3. Select the Start New Media check box.
  4. Click OK.

Startup Options

The Startup Options are used by the Job Manager to set priority for resource allocation. This is useful to give higher priority to certain jobs. You can set the priority as follows:
  1. From the CommCell Browser, expand Policies | Storage Policies.
  2. Right-click the appropriate storage policy, point to All Tasks, and then click Run Auxiliary Copy.
  3. Click Advanced and click Startup tab.
  4. Select the Change Priority checkbox.
  5. Enter a priority number - 0 is the highest priority and 999 is the lowest priority.
  6. Select the Start up in suspended State check box to start the job in a suspended state.
  7. Click OK.

Vault Tracker

This feature provides the facility to manage media that is removed from a library and stored in offsite locations. Depending on your Vault Tracker setup, select the required options.
  1. From the CommCell Browser, expand Policies | Storage Policies.
  2. Right-click the appropriate storage policy, point to All Tasks, and then click Run Auxiliary Copy.
  3. Click Advanced.
  4. Click the Vault Tracking tab.
  5. Select the required options.
  6. Click OK.

Preventing an Ongoing Backup Data from Being Copied

Auxiliary Copy operations copy all eligible data, even from backup that have finished after the auxiliary copy operation has started. Auxiliary Copy operations can be prevented from copying this new data by configuring the AUXCOPY_NOT_PICK_NEW_BACKUPS additional setting. This is applicable if you have upgraded from the previous version of SnapProtect .

Use the following steps to prevent the ongoing backup data from being copied:

  1. From the CommCell Browser, right-click the <CommServe node> and then click Properties.
  2. Click the Additional Settings tab.
  3. Click Add.
  4. In the Name box, type AUXCOPY_NOT_PICK_NEW_BACKUPS.
  5. In the Category list, select CommServe.
  6. In the Type list, select INTEGER.
  7. In the Value field, type 1.
  8. Click OK.

Scheduling an Auxiliary Copy Operation

You can schedule an auxiliary copy operation to ensure that the data is copied to the secondary copy on a regular basis without user intervention.

Time-Based Schedule

You can create a time based schedule if you want to perform auxiliary copy operation on a specific time (For example: specific time in a day or a specific day in a week). Follow the steps give below to specify the time based schedule for an auxiliary copy job:

  1. From the CommCell Browser, expand Policies | Storage Policies.
  2. Right-click the appropriate storage policy, point to All Tasks, and then click Run Auxiliary Copy.
  3. Select the Select A Copy option and select a secondary copy for which you wan to create a schedule.
  4. Click the Job Initiation tab.
  5. Select Schedule and click Configure.
  6. Click OK.
  7. Select the appropriate scheduling options. 

    For example, use the following steps to create a weekly schedule:

    1. Type a name for the schedule in the Schedule Name box.
    2. Click Weekly.
    3. In the Start Time box type or select the schedule start time.
    4. Click and select the days to run the schedule.
    5. Click OK.

Automatic Copy Schedule

You can create the automatic schedule if you want to perform the auxiliary copy operation at specific frequency (For example: after every 2 hours). This ensures that you will have regular additional copies of data. Follow the steps given below to specify the automatic schedule for the auxiliary copy job:

  1. From the CommCell Browser, expand Policies | Storage Policies.
  2. Right-click the appropriate storage policy, point to All Tasks, and then click Run Auxiliary Copy.
  3. Select the Select A Copy option and select a secondary copy for which you wan to create a schedule.
  4. Click the Job Initiation tab.
  5. Select Automatic Copy.
  6. In the Interval box, enter the time interval at which you want to perform the auxiliary copy operation.

    By default, the auxiliary copy operations will be performed at 30 minutes interval. You can set the time interval between 15 to 1440 minutes.

    Note that these operations will be performed only when new data that needs to be copied is found on the primary copy (or source copy).

  7. Click OK.

Edit Automatic Copy Schedule

By default, the automatic auxiliary copy operation will:

  • copy maximum number of data streams simultaneously
  • not start on new media
  • not mark the media full after successful completion

You can change these options as follows:

  1. From the CommCell Browser, expand Policies | Storage Policies.
  2. Right-click the appropriate storage policy, point to All Tasks, and then click Run Auxiliary Copy.
  3. All the schedules for the secondary copy are displayed in the Schedules window.
  4. Right-click the Automatic Copy schedule and click Edit.
  5. Click the General Tab and select the required options as follows:
    • Number of Streams - Specify the number of data streams which can be used for auxiliary copy operations.
    • Start New Media - Select this option to create a secondary copy on a new media.
    • Mark Media Full on Success - Select this option to mark the destination media as full after the successful completion of the auxiliary copy operation.
  6. Click OK.

Deduplicating Multiplexed Data

You can deduplicate existing multiplexed data to a storage policy copy with deduplication enabled. This operation is useful when there are clients pointing to non-deduplication storage policy copy with Data Multiplexing settings.

Use the following steps to deduplicate the multiplexed data:

  1. Enable the Allow multiplexed data to be copied to deduplication enabled storage policy copy option. This option is enabled by default. You can verify using the steps below:
    1. On the ribbon in the CommCell Console, click the Storage tab, and then click Media Management.
    2. Click the Auxiliary Copy Configuration tab.
    3. The Allow multiplexed data to be copied to deduplication enabled storage policy copy option should be enabled with value 1.
    4. Click OK.
  2. Create a secondary copy by enabling deduplication on the copy.

    See Creating a Storage Policy Copy with Deduplication for instructions.

  3. Run an Auxiliary Copy on the secondary copy.

Managing Jobs

The Auxiliary Copy jobs can be managed in a number of ways. The following sections provide information on the different job management options available:

Restarting Jobs

Jobs that fail to complete successfully are automatically restarted based on the job restartability configuration set in the Control Panel. By default, the Job Manager will retry the job up to a total of two days at 20-minute intervals for a maximum of 144 times.

Configure Job Restartability at the CommServe Level

You can change the restartability configuration from the control Panel as follows. Keep in mind that changes made to this configuration will affect all auxiliary copy jobs in the entire CommCell.

  1. On the ribbon in the CommCell Console, click the Configuration tab, and then click Job Management.
  2. Click the Job Restarts tab.
  3. Under Job Type section, select Auxiliary Copy.
  4. In the Max Restarts, type or select the value to modify the maximum number of times the Job Manager try to restart a job.
  5. In the Restart Interval (Mins), type or select the value to modify the time interval between attempts for the Job Manager to restart the job.
  6. Click OK.

Configure Job Restartability for an Individual Job

You can modify the retry settings for a specific job when initiating the job. This will override the setting in the Control Panel.

  1. From the CommCell Browser, expand Policies | Storage Policies.
  2. Right-click the appropriate storage policy, point to All Tasks, and then click Run Auxiliary Copy.
  1. Click Advanced.
  2. In the Advanced Auxiliary Copy Job Options dialog box, click the Job Retry tab.
  3. Select Enable Total Running Time check box and specify the maximum elapsed time before a job can be restarted or killed.

    Select Kill Running Jobs When Total Running Time Expires check box to kill the job after reaching the maximum elapsed time.

  4. Select Enable Number Of Retries check box and specify the number of retries.
  5. Click OK.

Updating the Status of a Job

Auxiliary Copy operations update the status of the jobs that are currently being copied. By default the status will be updated every 60 minutes, as well as at the end of the Auxiliary Copy operation. The time interval for the status updates can be modified as follows:

  1. From the CommCell Browser, navigate to <CommServe node>.
  2. Right-click <CommServe node> and then click Properties.
  1. Click the Additional Settings tab.
  2. Click Add.
  3. In the Name field, type AUXCOPY_MARKCOPIED_MINUTES.
  4. In the Location list, type HKEY_LOCAL_MACHINE\Software\CommVault Systems\Galaxy\Instance<xxx>\
  5. In the Type list, select DWORD Value.
  6. In the Value field, type the number of minutes after which you want to update the status.
  7. Click OK.

Controlling Jobs

The following controls are available for running jobs in the Job Controller window:

Suspend

Temporarily stops a job. A suspended job is not terminated; it can be restarted at a later time.

Resume

Resumes a job and returns the status to Waiting, Pending, Queued, or Running. The status depends on the availability of resources, the state of the Operation Windows, or the Activity Control setting.

Kill

Terminates a job.

Suspending a Job

  1. From the Job Controller of the CommCell Console, right-click the job and select Suspend.
  2. The job status may change to Suspend Pending for a few moments while the operation completes. The job status then changes to Suspended.

Resuming a Job

  1. From the Job Controller of the CommCell Console, right-click the job and select Resume.
  2. As the Job Manager attempts to restart the job, the job status changes to Waiting, Pending, or Running.

Killing a Job

  1. From the Job Controller of the CommCell Console, right-click the job and select Kill.
  2. Click Yes when the confirmation prompt appears if you are sure you want to kill the job. The job status may change to Kill Pending for a few moments while the operation completes. Once completed, the job status will change to Killed and it will be removed from the Job Controller window after five minutes.

Backup Jobs Associated with a Storage Policy Copy

You can view a list of all backup jobs that are available on a storage policy copy and that are going to be copied. This list is useful to ensure that all the backups on primary copy are copied to a secondary copy. When the primary copy has large data, we recommend to check this list.

View Backup Jobs Associated with a Secondary Copy

You can view the job associated with the copy as follows:

  1. From the CommCell Browser, navigate to Policies | Storage Policies | <Storage_Policy>.
  2. Right-click the <Storage Policy Copy> and then click View | Jobs.
  3. By default, the jobs initiated in the past 24 hours are displayed. To show all the jobs that are associated with a copy, clear the Specify Time Range check box from the Job Filter for Storage Policy dialog box.

  4. Click Advanced for additional filter options in the Jobs in Storage Policy Advanced Filter Options dialog box.
  5. Click OK on the Jobs in Storage Policy Advanced Filter Options dialog box.
  6. Click OK on the Job Filter for Storage Policy dialog box.

    A list of jobs associated with a storage policy copy is displayed in the Jobs for Storage Policy Copy pane of the CommCell browser.

View Backup Jobs That Need to Be Copied

When you view a list of backup jobs that associated with a storage policy copy, by default, following jobs are displayed:

  • Jobs that are already copied (Available on the secondary copy)
  • Jobs that need to be copied (Not available on the secondary copy)

You can use additional filter options to view a list of jobs that need to be copied. We recommend to view this list in the following scenario:

  • The auxiliary copy operation goes into pending state due to an invalid backup job or read errors in a backup job. You can check backup jobs that are causing the errors.
  • The auxiliary copy tunable parameters are set to ignore any invalid backup jobs. You can check backup jobs that are skipped during the operation.

Follow the steps given below to view the backup jobs that need to be copied to a secondary copy:

  1. From the CommCell Browser, expand Policies | Storage Policies.
  2. Right-click the appropriate storage policy, point to View, and then click Jobs.
  3. By default, the jobs initiated in the past 24 hours are displayed. To show all the jobs that are associated with a copy, clear the Specify Time Range check box from the Job Filter for Storage Policy dialog box.
  4. Click Advanced for additional filter options in the Job Filter for Storage Policy dialog box.
  5. Clear the Available check box and ensure that the Jobs that need to be copied check box is selected.
  6. Click OK on the Jobs in Storage Policy Advanced Filter Options dialog box.
  7. Click OK on the Job Filter for Storage Policy dialog box.

A list of jobs that are associated with a storage policy copy appears in the Jobs for Storage Policy Copy pane of the CommCell browser.

Severity Column

The Severity column appears in the in the Jobs for Storage Policy Copy pane of the CommCell browser. It indicates time period for which a job is not copied. Based on the severity column, you can classify the jobs as follows:

Icons Displayed in the Column Type of Job
Critical Jobs - Backup jobs that have not been copied in the past 90 days.
Major Jobs  - Backup jobs that have not been copied in the past 30 – 90 days.
Minor Jobs  - Backup jobs that have not been copied in the past 7 – 30 days.
No icon
  • Partially Copied Backup Jobs
  • Backup jobs that are not copied and ran less than 7 days ago

If you want to check the exact time period for which a job is not copied, move the mouse pointer over the Severity column. If you have selected the Available check box in the Jobs in Storage Policy Advanced Filter Options dialog box, the Severity column will not be displayed.

Tunable Parameters for an Auxiliary Copy Operation

You can improve performance of an Auxiliary Copy operation using the parameters described below:

Modify Chunk Size

A chunk is the unit of data that the MediaAgent software uses to store data on media. The default chunk size depends upon the type of backup data and the type of Media. See Performance Tuning for more information.

 You can modify the chunk size as follows:

  1. On the ribbon in the CommCell Console, click the Storage tab, and then click Media Management.
  2. Click the Chunk Size tab.
  3. Specify the Chunk Size for the required agents.
  4. Click OK.

Skip Job on Read Errors during Auxiliary Copy

If you have many backup jobs to be copied during an Auxiliary Copy operation and if one of the backup job encounters an error, the Auxiliary copy job may go into a Pending state. If you want skip such backup jobs and continue copying other backup jobs to be copied, follow the steps given below:
  1. On the ribbon in the CommCell Console, click the Storage tab, and then click Media Management.
  2. Click the Auxiliary Copy Configuration tab.
  3. Enter the Value 1 for Skip job on read errors during Auxiliary Copy parameter.
  4. Click OK.

    After enabling this parameter, the Auxiliary Copy job will skip backup jobs that encounter errors during auxiliary copy operations.

Tune Stream Randomization

When a storage policy is configured to use more than one data stream, it is important that the data streams are equally used. If you enable the stream randomization feature, the system chooses the data streams randomly. This increases the rate of data transfer by copying data from different streams in parallel.

You configure following parameters to evenly distribute the data across all the streams.

  1. On the ribbon in the CommCell Console, click the Storage tab, and then click Media Management.
  2. Click the Resource Manager Configuration tab.
  3. In the Interval (in minutes) to calculate valid data size for streams box, specify the interval to calculate the data size for streams.
  4. In the Threshold (in GB) to decide how to distribute data among streams for backup box, specify the threshold to decide data distribution among streams.
  5. Click OK.

Stream Retry Count during Auxiliary Copy

When Auxiliary Copy operation is performed, data from primary storage is copied to secondary storage through streams. During this process, if one of the job encounters stream failure due to intermittent or no-access to media/volume that is on a shared network path etc., the Auxiliary Copy job may go into pending state.

If you want to allow job to retry for every stream for failed data chunk before the job is marked as pending, the follow the steps given below:

  1. On the ribbon in the CommCell Console, click the Storage tab, and then click Media Management.
  2. Click the Auxiliary Copy Configuration tab.
  3. In the Maximum number of stream retry count box, specify the number of retries to be performed by a stream.
  4. Click OK.

Retry for Failed Data Stream during Auxiliary Copy

Use the following steps to retry a failed stream in specific interval for Auxiliary Copy operation:
  1. On the ribbon in the CommCell Console, click the Storage tab, and then click Media Management.
  2. Click the Auxiliary Configuration tab.
  3. In the Interval (in minutes) to retry a failed stream box, specify the interval to retry for failed data stream.
  4. Click OK.

Set Job Priorities to Copy during Auxiliary Copy

When Auxiliary Copy operation is performed, jobs (data) from primary copy are copied to secondary copy. By default, the jobs are copied sequentially from oldest to newest jobs. However, you can modify this default behavior and you can set the priorities for jobs to be copied to secondary storage in any other sequence.

Exception: Job priorities cannot be set for SnapProtect backup copy operation.

  1. Logon to the CommServe computer.
  2. Ensure that Copy first full jobs for new subclients on secondary copy with deduplication enabled before copying other data option is disabled in the Auxiliary Copy Configuration tab of Media Management Configuration dialog box.

    See Configure Auxiliary Copy to Copy First Full Backups of the Subclient to disable the option.

  3. Create a text file with the following name under <Software_Installation_Directory>\Base folder.

    <StoragePolicyName>_<CopyName>_Jobs.txt

  4. In the text file specify JobID and CommCellID in the following format:

    JobID, CommCellID

    Where:

    • JobID - The job id of the jobs for which you are setting up the priority
    • CommCellID - The CommCell ID of the CommServe. The value of this parameter is 2.

      Note that this value is not the same as the CommCell ID value in the License Administration dialog box

    For example:

    Job04, 2
    Job03, 2

  5. Perform the Auxiliary Copy operation on the Storage Policy that is specified in the text file name.
  6. Once the Auxiliary Copy operation is run, the jobs specified in the text file will be copied first and then the other jobs will be copied. Jobs may not necessarily be copied in the exact order as in the text file but will be copied before other jobs that are not listed in the text file.

    • During this process, if Auxiliary Copy job goes into Waiting/Suspended/Pending state (e.g., if the job is interrupted by Job Manager or suspended by the user), then the priority of the jobs using text file will not be considered when the Auxiliary Copy job is resumed. It will copy all the jobs sequentially to secondary storage.
    • During Auxiliary Copy operation, in the Auxiliary Copy Job Details dialog box, you may notice inaccurate value in the following fields:
      • Total Data Processed and Total Data to Process in the General tab.
      • Total Data to Copy and Data Copied in the Streams tab.

Configure Auxiliary Copy to Copy First Full Backups of the Subclient

By default, the auxiliary copy is configured to copy first full backup jobs of the subclient. After copying the first full backup, the auxiliary copy can be reinitialized to copy the rest of the backup jobs. However, if you have upgraded from the previous version, then you will have to configure the auxiliary copy to copy first full backup jobs of the subclient. This is useful in the following ways:
  • To reduce the data transfer over the network
  • To reduce the amount of data written size on the disk

This can be configured when there is a large amount of data to be transferred / copied in any one of the following situations:

  • When there is a new secondary deduplication copy
  • If there are no full backup jobs of the subclient available on the existing deduplicated secondary copy
  • If the deduplication database of the secondary copy is sealed

Use the following steps to configure Auxiliary Copy operation to copy first full backups of the subclient:

  1. On the ribbon in the CommCell Console, click the Storage tab, and then click Media Management.
  2. Click the Auxiliary Copy Configuration tab.
  3. In the Copy first full jobs for new subclients on secondary copy with deduplication enabled before copying other data box, specify the value as 1 to copy first full backup jobs of the subclient.

    Set 0 to disable the parameter or if you do not wish to copy only the first full backups of the subclient.

  4. Click OK.

During Auxiliary Copy operation,

  • Following event message appears in the Event Viewer that tells you that the first full backup jobs are copied to a secondary storage and the Auxiliary Copy job reinitiates to copy the rest of the backup jobs.

    Some backup jobs completed or some backup jobs were selected after this job started. Start copying/verifying more data.

  • In the Auxiliary Copy Job Details dialog box, you may notice inaccurate value in the following fields. You can ignore those value.
    • Total Data Processed and Total Data to Process in the General tab.
    • Total Data to Copy and Data Copied in the Streams tab.

Mark a Job Bad on Encountering Invalid Data

During the Auxiliary Copy operation you can skip the invalid jobs and continue to copy the other valid jobs. That is, if any invalid job is encountered on the media during Auxiliary Copy operation, those jobs can be skipped automatically and continue to copy the other jobs. During this process the invalid jobs are marked as bad on the source copy.
  1. On the ribbon in the CommCell Console, click the Storage tab, and then click Media Management.
  2. Click the Auxiliary Copy Configuration tab.
  3. For Mark a job bad on encountering corrupt data during auxiliary copy/data verification operation, enter 1 to enable the parameter.
  4. Click OK.

Increasing the Network Bandwidth Utilization on High Bandwidth Delay Product (BDP) Networks

You can increase the network bandwidth utilization for high BDP networks to ensure higher throughput for backups and auxiliary copy operations.

Procedure

  1. Ensure that TCP receive window auto tuning feature is supported on the operating system and is also enabled on the computer on which the MediaAgent is installed.

    For more information on verifying the TCP receive window auto tuning feature, see Enable/Disable TCP Receive Window Auto-Tuning.

  2. To switch off explicit setting of the TCP receive window size by SnapProtect, set the SDTTailRecvBufSizeInKB additional setting on the MediaAgent and set the value as zero. For more information on creating the additional setting, see Add or Modify an Additional Setting.

Allowing DDB Backup Jobs from Getting Copied to Secondary Copy

By default, the DDB Backup jobs are disabled for Auxiliary Copy operation and these jobs:

By default, the DDB Backup jobs are not copied to secondary copy during an auxiliary copy operation. DDB Backup jobs:

  • will appear as grayed out when viewed from the primary copy.

Disabling DDB backup jobs from copying to secondary copy saves the space on the secondary storage and reduce the network bandwidth usage.

To prevent or allow copy of DDB Backup jobs to secondary copy perform the following steps:

  1. On the ribbon in the CommCell Console, click the Storage tab, and then click Media Management.
  2. Click the Auxiliary Copy Configuration tab.
  3. In the Allow AuxCopy for deduplication database backup jobs box, by default the value is set to 0 to prevent the DDB backup jobs from Auxiliary Copy operation.

    Type 1 to enable the parameter or if you want to copy the DDB backup jobs during Auxiliary Copy operation.

  4. Click OK.

Alerts

Configuring Auxiliary Copy Fallen Behind Alert

Enabling Auxiliary Copy fallen behind alert will be useful if the auxiliary copy operation takes more time to copy the data. Once configured, an Auxiliary Copy Fallen Behind alert is generated when either one of the criteria has been met for the configured storage policy copy.
  • To be copied data is over the quantity specified in TB.
  • Jobs that are over number of specified days old and have not yet been fully copied.
  • More than the default value of 48 hrs is required to copy all data, based on the average throughput of previously run Auxiliary Copy jobs. It is recommended that you adjust this value with an estimated completion time so that the alert above will not be triggered.

If an alert is received, immediate attention should be given to any abnormal condition. Immediate action will prevent the Auxiliary Copy falling behind the source copy, in terms of amount of data to be copied. The alert will indicate the criteria that was met to trigger the alert, with one alert reason for each criteria above, respectively:

  • to be copied data exceeded
  • old jobs not copied
  • need more time to copy data

Assuming the Auxiliary copy has had no issues and is expected to run for that duration, use the throughput and application values from the Auxiliary Copy Job Summary Report to set the value for this third criteria. For example, application data size is 1000 GB and throughput is 500 GB/hr, set time to 2 hours. The example below shows how the throughput is calculated internally and can be followed to set the hours value for the third criteria:

  • Auxiliary Copy Job1 copied 4 TB in 2 hrs.
  • Auxiliary Copy Job2 copied 2 TB in 1 hour.
  • Average Throughput = (Total data copied by all jobs) / (Total time taken by all previous Auxiliary Copy jobs)

    In the example,

    • Total data copied = 6 TB
    • Total time taken = 3 hrs
    • Average throughput is 6/3 = 2 TB/hr

    To copy 4 TB, the calculation is 4/2, rounding up to the next hour set the alert to 2 hrs.

    If the amount of data to copy increases to 27 TB, set the alert to 14 hrs, if throughput is 2TB/hr.

    If throughput increases, for example 10 TB can be copied in 1 hr, then set the alert to 3 hrs, if data to be copied is 27TB.

  • New subclient associations to the storage policy is prevented if the data to be copied is more than three times the specified value in the Auxiliary Copy Fallen Behind criteria, or if any of the other specified criteria is exceeded by more than three times.
  • Fallen behind alert for Silo copy and Snap copy is not supported.
  • If you set the alert before SP4B, then click on Use default message in the Email tab when configuring a new alert so tokens are populated automatically. Also, if you set the alert before SP4B, then any GB values will be rounded up to the nearest and greater TB value (1TB is the minimum.

To configure the Auxiliary Copy Fallen Behind alert:

  1. From the CommCell Browser, navigate to Policies | Storage Policies | <Storage Policy>.
  2. Right-click the appropriate storage policy copy, and then click Properties.
  3. Click the Auxiliary Copy Fallen Behind tab.
  4. Select the Enable Auxiliary Copy fallen behind alert check box.
  5. Select the To be copied data is over check box, and enter the threshold of data size.

    If the data to be copied exceeds the specified threshold, you will receive an alert.

  6. Select the Jobs are not copied over check box, and specify the threshold for number of days.

    If a backup job is not copied for more than specified number of days, an alert will be triggered.

  7. Select the More than n Hour(s) required to copy all data check box, and then specify the number of hours.

    When selected, you receive an alert if the system predicts that the Auxiliary Copy operation will exceed the number of hours specified.

  8. Click OK.

To modify the interval time between alerts for above criteria:

  1. On the ribbon in the CommCell Console, click the Storage tab, and then click Media Management.
  2. In the Media Management Configuration dialog box, click the Auxiliary Copy Configuration tab, and then in the Interval (Hours) between Auxiliary Copy Fallen Behind alerts box, enter the appropriate time interval.

    The default interval is 24 hours.

  3. Click OK.

Generating Alert for an Auxiliary Copy Job

Alert enables users or user groups to get automatic notification on the status of the Auxiliary Copy job.

To set up the criteria to raise notifications/alerts:

  1. From the CommCell Browser, expand Policies | Storage Policies.
  2. Right-click the appropriate storage policy, point to All Tasks, and then click Run Auxiliary Copy.
  3. Click Advanced and select the Alert tab.
  4. Click Add Alert.
  5. From the Add Alert Wizard dialog box, select the required threshold and notification criteria and click Next.
  6. Select the required notification types and click Next.
  7. Select the recipients and click Next.
  8. Click Finish.
  9. Click OK.

Related Reports

The following reports are available for Auxiliary Copy.

Reports Description
Auxiliary Copy Job Summary Report You can use the Auxiliary Copy Job Summary Report to review information related to all auxiliary copy jobs that run in the CommCell during the specified time period. This report is useful if you need to know:
  • Whether auxiliary copy jobs ran during the specified period of time
  • The storage policy and destination copies of each job
  • The destination media (disk and tape) used for each job
  • The user who set up the job, data size, transfer time, and the throughput size
  • The start, end, and elapsed time of the job
  • The failure reasons and associated events, if applicable