4 4 3 Grolar:Configuring Si3 Deduplication Store: Difference between revisions

From SEPsesam
(Minor Jaglion-related update (currently commented out).)
(Marked this version for translation)
(11 intermediate revisions by the same user not shown)
Line 4: Line 4:


<!--T:2-->
<!--T:2-->
{{Navigation_latest|release=[[SEP_sesam_Release_Versions|4.4.3 ''Grolar''/4.4.3 ''Beefalo V2'']]|link=[[Special:MyLanguage/Si3_Deduplication|documentation archive]]}}</div></translate><br />
{{Navigation_previous|link=[[Special:MyLanguage/Configuring_Si3_NG_Deduplication_Store|Configuring Si3 NG Deduplication Store]]}}</div></translate><br />
<translate>===Overview=== <!--T:3--></translate>
<translate>===Information about deduplication store types=== <!--T:3--></translate>
<div class="boilerplate metadata" id="Additional resources" style="background-color: #f0f0f0; color:#636f73; border: 1px ridge #cdd3db; margin: 0.5em; padding: 0.5em; float: right; width: 35%; "><center><b>
<div class="boilerplate metadata" id="Additional resources" style="background-color: #f0f0f0; color:#636f73; border: 1px ridge #cdd3db; margin: 0.5em; padding: 0.5em; float: right; width: 35%; "><center><b>
<translate><!--T:4-->
<translate><!--T:4-->
Line 15: Line 15:
| style="padding:0px 40px 0px 10px; color: grey; font-size: 90%; text-align:left;" |  
| style="padding:0px 40px 0px 10px; color: grey; font-size: 90%; text-align:left;" |  
<translate><!--T:6-->
<translate><!--T:6-->
See also: [[Special:MyLanguage/4_4_3:Configuring_and_Administering_Si3_Deduplication_Store_by_using_CLI|Configuring and Administering Si3 Deduplication Store by using CLI]] – [[Special:MyLanguage/Encrypting_Si3_Deduplication_Store|Encrypting Si3 Deduplication Store]] – [[Special:MyLanguage/Source_Side_Dedup|Configuring Source-side Deduplication]] – [[Special:MyLanguage/Replication|Replication]] – [[Special:MyLanguage/Seeding_Si3_Deduplication_Store|Seeding Si3 Deduplication Store]] – [https://www.sepsoftware.com/sep-sesam/si3-tachometer-analysis/ SEP Tachometer] – [[Special:MyLanguage/Licensing|Licensing]]</translate>
See also: [[Special:MyLanguage/5_0_0:Configuring_Si3_NG_Deduplication_Store|Configuring Si3 NG Deduplication Store]] – [[Special:MyLanguage/4_4_3:Configuring_and_Administering_Si3_Deduplication_Store_by_using_CLI|Configuring and Administering Si3 Deduplication Store by using CLI]] – [[Special:MyLanguage/Encrypting_Si3_Deduplication_Store|Encrypting Si3 Deduplication Store]] – [[Special:MyLanguage/Source_Side_Dedup|Configuring Source-side Deduplication]] – [[Special:MyLanguage/Replication|Replication]] – [[Special:MyLanguage/Seeding_Si3_Deduplication_Store|Seeding Si3 Deduplication Store]] – [https://www.sepsoftware.com/sep-sesam/si3-tachometer-analysis/ SEP Tachometer] – [[Special:MyLanguage/Licensing|Licensing]]</translate>
|}
 
{|style="margin: auto; margin-bottom:1em; width:100%; border:0px solid grey;"
| rowspan="2" style="padding:0px 10px 0px;" | [[File:SEP_Video.png|45px|link=Video Tutorials & Screencasts]]
| style="padding:0px 40px 0px 10px; color: grey; font-size: 90%; text-align:left;" |<translate><!--T:58--> Watch SEP sesam video [https://www.youtube.com/watch?v=sSkfmufQkXU Why and how to use Deduplication with SEP sesam].</translate>
|}
|}


Line 21: Line 26:
| rowspan="2" style="padding:0px 10px 0px;" |  
| rowspan="2" style="padding:0px 10px 0px;" |  
<translate><!--T:7-->
<translate><!--T:7-->
[[File:SEP Tip.png|45px|link=Special:MyLanguage/FAQ|FAQ]]</translate>
[[File:SEP Tip.png|45px|link=Special:MyLanguage/4_4_3_Beefalo:FAQ|FAQ]]</translate>
| style="padding:0px 40px 0px 10px; color: grey; font-size: 90%; text-align:left;" |  
| style="padding:0px 40px 0px 10px; color: grey; font-size: 90%; text-align:left;" |  
<translate><!--T:8-->
<translate><!--T:8-->
Check [[Special:MyLanguage/FAQ|FAQ]] to find the answers to most common questions.</translate>
Check [[Special:MyLanguage/4_4_3_Beefalo:FAQ|FAQ]] to find the answers to most common questions.</translate>
|}
|}


Line 34: Line 39:
Problems? Check the [[Special:MyLanguage/Troubleshooting_Guide#Si3_Deduplication|Troubleshooting Guide]].</translate>
Problems? Check the [[Special:MyLanguage/Troubleshooting_Guide#Si3_Deduplication|Troubleshooting Guide]].</translate>
|}</div></noinclude>
|}</div></noinclude>
<translate><!--T:11-->
<span style="color:gray; font-size: 90%"><translate> <!--T:66--> SEP sesam [[SEP sesam Release Versions|v. 5.0.0 Jaglion]] has introduced a new generation Si3 deduplication store: [[Special:MyLanguage/5_0_0:Configuring_Si3_NG_Deduplication_Store|Si3 NG]]. The Si3-related information differs slightly depending on which datastore is used: Si3 or Si3 NG. The procedures presented in this article apply only to the older type of SEP Si3 deduplication store, which will soon be obsolete. To learn more about the new generation of Si3 NG, see [[Special:MyLanguage/Encrypting_Si3_NG_Deduplication_Store|Encrypting Si3 NG Deduplication Store]].</translate></span>
 
<translate><!--T:59-->
It is strongly recommended to use the newer type ''SEP Si3 NG deduplication store''. It offers significantly higher performance for backup, restore and migration, as well as [[5_0_0:Si3_NG_Direct_to_S3|direct backup to S3]] and backup to Azure, the new [[Special:MyLanguage/5_0_0:SEP_Immutable_Storage_–_SiS|immutable storage feature ''SiS'']], resulting in improved performance, scaling, and resource savings. For details, see the [[Special:MyLanguage/4_4_3_Grolar:Configuring_Si3_Deduplication_Store#comparison|Si3 and Si3 NG comparison]] section below. <br />To learn how to upgrade from Si3 to Si3 NG by configuring a new Si3 NG on the same host and creating a replication job to replicate from Si3 to Si3 NG, see [[Special:MyLanguage/5_0_0:Configuring_Si3_NG_Deduplication_Store|Configuring Si3 NG Deduplication Store]].
 
===Overview=== <!--T:60-->
 
<!--T:61-->
SEP sesam provides a target-based (Si3T) and [[Special:MyLanguage/Source_Side_Dedup|source-based deduplication (Si3S)]]. For details on deduplication concept and recommendations, see [[Special:MyLanguage/Deduplication|Deduplication]].  
SEP sesam provides a target-based (Si3T) and [[Special:MyLanguage/Source_Side_Dedup|source-based deduplication (Si3S)]]. For details on deduplication concept and recommendations, see [[Special:MyLanguage/Deduplication|Deduplication]].  


Line 65: Line 77:
==={{anchor|steps}}Steps=== <!--T:19-->
==={{anchor|steps}}Steps=== <!--T:19-->
   
   
The SEP sesam [[Special:MyLanguage/4_4_3_Beefalo:Data_Store|data store]] is a disk based storage that enables savesets (backed up data) to be backed up directly to the configured storage locations. SEP Si3 target deduplication is easily configured and ready to use by selecting '''Si3 deduplication data store''' type.</translate>
The SEP sesam [[Special:MyLanguage/4_4_3_Beefalo:Data_Store|data store]] is a disk based storage that enables savesets (backed-up data) to be backed up directly to the configured storage locations. SEP Si3 target deduplication is easy to configure and ready to use by selecting the '''Si3 deduplication store''' type.</translate>
<ol><li><translate><!--T:20-->
<ol><li><translate><!--T:20-->
In the '''Main selection''' -> '''Components''', click '''Data Stores''' to display the data store contents frame.</translate>
In the '''Main selection''' -> '''Components''', click '''Data Stores''' to display the data store contents frame.</translate>
Line 73: Line 85:
Under the ''Data store'' properties in the '''Name''' field, enter a meaningful name for the Si3 data store.</translate></li>
Under the ''Data store'' properties in the '''Name''' field, enter a meaningful name for the Si3 data store.</translate></li>
<li><translate><!--T:23-->
<li><translate><!--T:23-->
From the ''Store type'' drop-down list, select '''SEP Si3 Deduplication Store'''.</translate></li>
From the ''Store type'' drop-down list, select '''SEP Si3 Deduplication Store'''.
{{tip|As of SEP sesam v. [[Special:MyLanguage/SEP_sesam_Release_Versions|5.0.0 ''Jaglion'']], two Si3 data store types are available. SEP sesam recommends using the new generation Si3 NG when creating a new data store. To learn how to upgrade from Si3 to Si3 NG by configuring a new Si3 NG on the same host and creating a replication job to replicate from Si3 to Si3 NG, see [[Special:MyLanguage/5_0_0:Configuring_Si3_NG_Deduplication_Store|Configuring Si3 NG Deduplication Store]].}}</translate></li>
<translate><!--T:24-->
<translate><!--T:24-->
[[image:New_Si3_data_store_Beefalo_V2.jpg|850px|link=]]</translate>
[[image:Si3_data_store_select.jpg|850px|link=]]</translate>
<br clear=all>
<br clear=all>
<li><translate><!--T:25-->
<li><translate><!--T:25-->
Make sure that the option '''Create drive''' is checked under the ''Drive parameter'' properties. The predefined value for the drive is automatically added to the '''Drive number''' field.</translate></li>
Make sure that the option '''Create drive''' is checked under the ''Drive parameter'' properties. The predefined value for the drive is automatically inserted in the '''Drive number''' field.</translate></li>
<translate><!--T:55--> It is also recommended that the option '''Create second drive''' is checked. Without it, SEP sesam can only allocate a drive either for reading or writing, running one job at a time on the same drive. By using the additional dedicated drive for restore, you are able to run a backup on the first drive and restore your data from the second drive simultaneously. You can also add a third drive for migration.</translate>
<translate><!--T:55--> It is recommended that the option '''Create second drive''' is also enabled. Without it, SEP sesam can only allocate a drive for either reading or writing, running one job on the same drive at a time. By using the additional dedicated drive for restore, you can perform a backup on the first drive and restore your data from the second drive simultaneously. You can also add a third drive for migration.</translate>
<li><translate><!--T:30-->
<li><translate><!--T:30-->
Then select '''Create new drive group''' and '''enter the name''' for your Si3 deduplication store dedicated group.</translate></li>
Then select '''Create new drive group''' and '''enter the name''' for your Si3 deduplication store dedicated group.</translate></li>
Line 87: Line 100:
From the ''Device server'' drop-down list, select the '''device server''' for your data store.</translate></li>
From the ''Device server'' drop-down list, select the '''device server''' for your data store.</translate></li>
<li><translate><!--T:27-->
<li><translate><!--T:27-->
In the '''Path''' field, '''enter the location''' for your data store or use the '''Browse''' button to select the relevant folder. '''Check''' the relevant folder and click '''OK'''.</translate>
In the '''Path''' field, '''enter the location''' of your data store or use the '''Browse''' button to select the relevant folder. '''Check''' the relevant folder and click '''OK'''.</translate>
<br>
<br>
<translate><!--T:28-->
<translate><!--T:28-->
When using the ''Browse'' button to select the folder, the ''New Data Store'' information window appears with predefined recommended values for your Si3 deduplication store size. Click '''OK''' to confirm the selected location and the recommended size values. You can modify your data store size later under the '''Size''' properties (see step 10).</translate></li>
When using the ''Browse'' button to select the folder, the ''New Data Store'' information window appears with predefined recommended values for your Si3 deduplication store size. Click '''OK''' to confirm the selected location and recommended size values. You can modify your data store size later under the '''Size''' properties (see step 10).</translate></li>
<translate><!--T:29-->
<translate><!--T:29-->
[[image:GUI_new_data_store_information_Beefalo_V2.jpg|430px|link=]]</translate>
[[image:GUI_new_data_store_information_Beefalo_V2.jpg|430px|link=]]</translate>
Line 100: Line 113:
'''''Capacity''''': Specify the size (in GiB) of the partition for backups.</translate></li>
'''''Capacity''''': Specify the size (in GiB) of the partition for backups.</translate></li>
<li><translate><!--T:34-->
<li><translate><!--T:34-->
'''''High watermark''''': Specify the value (in GiB) for the high watermark (HWM). The HWM defines the upper value for the used disk space on the data store. When this value is reached, a purge process is triggered for all EOL-free (End-of-lifetime) savesets, thus freeing up the capacity of the data store. The oldest free savesets are deleted first.
'''''High watermark''''': Specify the value (in GiB) for the high watermark (HWM). The HWM defines the upper value for the used storage space. When this value is reached, the status of a datastore changes from ''OK'' to ''Warning'', but backups continue to be performed. Make sure that you provide enough storage space for your backed up data.</translate></li>
 
<!--T:53-->
{{Note|In previous versions of SEP sesam (≤ [[SEP sesam Release Versions|4.4.3.42 ''Tigon'']]), if HWM was set and exceeded, backups could no longer be started while running backups were allowed to finish. Purging is done until the low watermark is reached (if set). This behavior has changed with SEP sesam v. ≥ [[SEP sesam Release Versions|4.4.3.48 ''Tigon V2'']]; if HWM is set, exceeding it will only issue an information message but will no longer prevent backups to be started.}}</translate></li>
<li><translate><!--T:35-->
<li><translate><!--T:35-->
'''''Si3 repair area''''': Specify the value (in GiB) for the Si3 repair area. The Si3 repair area (subdirectory trash) defines space for Si3 files (DDLs) that were identified by a garbage collection job and are no longer used. These files are still kept in the repair area to enable possible repair of Si3 if there are any structural problems (may be caused by a file system error or by a crash of an operating system). The files in the repair area will be removed automatically after the specified amount of time (SEP sesam default: 4 days) or when the disk usage threshold is reached. Note that when the value is set to 0, then the Si3 repair functionality is turned off.</translate></li>
'''''Si3 repair area''''': Specify the value (in GiB) for the Si3 repair area. The Si3 repair area (subdirectory trash) defines space for Si3 files (DDLs) that were identified by a garbage collection job and are no longer used. These files are still kept in the repair area to enable possible repair of Si3 in case of structural problems (which may be caused by a file system error or an operating system crash)). The files in the repair area are automatically removed after the specified period of time (SEP sesam default: 4 days) or when or when the disk usage threshold is reached. Note that the Si3 repair function is disabled when the value is set to 0.</translate></li>
{{<translate><!--T:56--> note</translate>|<translate><!--T:57--> The ''Si3 repair area'' for managing disk space dedicated to Si3 files (DDLs) is only available in the [[Special:MyLanguage/SEP_sesam_Glossary#UI_mode|''Expert'' UI mode]]. So if you run the GUI in ''Basic'' or ''Advanced'' UI mode, you first have to change the mode to ''Expert'', as described in [[Special:MyLanguage/4_4_3_Beefalo:SEP_sesam_GUI#UI_mode|Selecting UI mode]].</translate>}}
{{<translate><!--T:56--> note</translate>|<translate><!--T:57--> The ''Si3 repair area'' for managing disk space dedicated to Si3 files (DDLs) is only available in the [[Special:MyLanguage/SEP_sesam_Glossary#UI_mode|''Expert'' UI mode]]. So if you run the GUI in ''Basic'' or ''Advanced'' UI mode, you first have to change the mode to ''Expert'', as described in [[Special:MyLanguage/4_4_3_Beefalo:SEP_sesam_GUI#UI_mode|Selecting UI mode]].</translate>}}
</ul>
</ul>
Line 121: Line 131:


<translate><!--T:41-->
<translate><!--T:41-->
You can view the properties of your Si3 deduplication by double-clicking relevant Si3 deduplication store.</translate>  
You can view the properties of your Si3 deduplication by double-clicking the corresponding Si3 deduplication store.</translate>  
{{anchor|drive}}<ul><li><translate><!--T:42-->
{{anchor|drive}}<ul><li><translate><!--T:42-->
You can modify existing and set additional drive options by double-clicking the first drive. In the ''Drive Properties'' window, you can browse the path for the data store. To configure Si3 data encryption, you have to create a deduplication security password file. For details, see [[Special:MyLanguage/Encrypting_Si3_Deduplication_Store|Encrypting Si3 Deduplication Store]].<br /> In v. ≥ [[SEP_sesam_Release_Versions|4.4.3 ''Beefalo'']], under the tab ''OS Access'' specify the credentials to access the respective systems. Use <tt>DOMAIN\USER</tt> format for domain accounts or <tt>HOST\USER</tt> for local accounts.</translate></li>
You can modify existing and set additional drive options by '''double-clicking the first drive'''. In the ''Drive Properties'' window, you can browse the path for the data store, set the [[Special:MyLanguage/4_4_3_Beefalo:Data_Store#access_mode|access mode for data store drives]], etc. To configure Si3 data encryption, you have to create a deduplication security password file. For details, see [[Special:MyLanguage/Encrypting_Si3_Deduplication_Store|Encrypting Si3 Deduplication Store]].<br /> Use the tab ''OS Access'' and specify the credentials to access the respective systems. Use <tt>DOMAIN\USER</tt> format for domain accounts or <tt>HOST\USER</tt> for local accounts.</translate></li>
<translate><!--T:43-->
<translate><!--T:43-->
[[image:Si3_drive_properties_Beefalo_V2.jpg|800px|link=]]</translate>
[[image:Si3_drive_properties_Beefalo_V2.jpg|800px|link=]]</translate>
<br clear=all>
<br clear=all></ul>
<li<translate><!--T:44-->
 
>You can view the status of your Si3 deduplication by clicking the '''Si3 State''' tab. You can check the last deduplication message, status of active tasks, encryption status, number of stored objects, data size before/after deduplication, DedDup ratio, saved storage space, etc.</translate></li>
<translate>=== Monitoring deduplication status === <!--T:62-->
 
<!--T:44-->
You can view the status of your Si3 deduplication in the GUI by clicking the '''Si3 State''' tab. You can check the last deduplication message, the status of active tasks, the encryption status, the number of stored objects, the data size before/after deduplication, the dedup ratio, the saved storage space, etc.</translate>
<translate><!--T:45-->
<translate><!--T:45-->
[[image:Si3_state_tab_Beefalo_V2.jpg|830px|link=]]</translate>
[[image:Si3_state_tab_Beefalo_V2.jpg|830px|link=]]</translate>
<br clear=all>
<br clear=all>
</ul>
{{<translate><!--T:63--> tip</translate>|<translate><!--T:64--> You can also check the status in [[Special:MyLanguage/5_0_0:SEP_sesam_Web_UI#data_store|SEP sesam Web UI]]. You can use the ''Dependencies'' tab to see the diagram of all dependencies of the datastore and drives, RDS, media pools, etc.,  and use other tabs to check the details of the data store operation.</translate>}}


{{<translate><!--T:46-->
{{<translate><!--T:46-->
note</translate>|<translate><!--T:47-->
note</translate>|<translate><!--T:47-->
If fsck (file system consistency check) detects irregularity in the Si3 file system, the affected pages and chunks are recorded in the <tt>recovery.log</tt>. The Si3 deduplication store in GUI <!--(and in v. [[Special:MyLanguage/SEP_sesam_Release _Versions|''5.0.0'' ''Jaglion'']] also in ''Web UI'') -->is marked red and the [[Special:MyLanguage/SEP_sesam_Glossary#Si3_purge|Si3 purge]] is no longer executed. The purge is stopped to prevent the files in the [[Special:MyLanguage/SEP_sesam_Glossary#repair_area|Si3 repair area]] to be deleted as they may be required to repair Si3 in case of problems. Once the errors are fixed and the <tt>recovery.log</tt> is empty, the Si3 data store is no longer marked red and the Si3 purge is working again.</translate>}}
If fsck (file system consistency check) detects an irregularity in the Si3 file system, the affected pages and chunks are recorded in <tt>recovery.log</tt>. The Si3 deduplication store in the GUI and ''Web UI''is highlighted in red and [[Special:MyLanguage/SEP_sesam_Glossary#Si3_purge|Si3 purge]] is no longer executed. The purge is stopped to prevent the files in the [[Special:MyLanguage/SEP_sesam_Glossary#repair_area|Si3 repair area]] from being deleted, as they may be needed to repair Si3 in case of problems. Once the errors are fixed and the <tt>recovery.log</tt> is empty, the Si3 data store is no longer marked in red and the Si3 purge works again.</translate>}}


<translate><!--T:48-->
<translate><!--T:48-->
Line 144: Line 157:
<noinclude><translate>===What is next?=== <!--T:49-->
<noinclude><translate>===What is next?=== <!--T:49-->
After configuring the Si3 deduplication store, configure the [[Special:MyLanguage/Configuring_a_Media_Pool|media pools]] first then set up your [[Special:MyLanguage/4_4_3_Beefalo:Backup|backup ]] strategy.
After configuring the Si3 deduplication store, configure the [[Special:MyLanguage/Configuring_a_Media_Pool|media pools]] first then set up your [[Special:MyLanguage/4_4_3_Beefalo:Backup|backup ]] strategy.
==={{anchor|comparison}}Comparison of Si3 and Si3 NG=== <!--T:65-->
{{Si3_and_Si3_NG_comparison}}


<div class="noprint">
<div class="noprint">
=== See also === <!--T:50-->
=== See also === <!--T:50-->
[[Special:MyLanguage/4_4_3:Configuring_and_Administering_Si3_Deduplication_Store_by_using_CLI|Configuring and Administering Si3 Deduplication Store by using CLI]] – [[Special:MyLanguage/Encrypting_Si3_Deduplication_Store|Encrypting Si3 Deduplication Store]] – [[Special:MyLanguage/Source_Side_Dedup|Configuring Source-side Deduplication]] – [[Special:MyLanguage/Replication|Replication]] – [[Special:MyLanguage/Seeding_Si3_Deduplication_Store|Seeding Si3 Deduplication Store]] – [https://www.sepsoftware.com/sep-sesam/si3-tachometer-analysis/ SEP Tachometer] – [[Special:MyLanguage/Licensing|Licensing]]</div></translate><noinclude>
[[Special:MyLanguage/5_0_0:Configuring_Si3_NG_Deduplication_Store|Configuring Si3 NG Deduplication Store]] – [[Special:MyLanguage/4_4_3:Configuring_and_Administering_Si3_Deduplication_Store_by_using_CLI|Configuring and Administering Si3 Deduplication Store by using CLI]] – [[Special:MyLanguage/Encrypting_Si3_Deduplication_Store|Encrypting Si3 Deduplication Store]] – [[Special:MyLanguage/Source_Side_Dedup|Configuring Source-side Deduplication]] – [[Special:MyLanguage/Replication|Replication]] – [[Special:MyLanguage/Seeding_Si3_Deduplication_Store|Seeding Si3 Deduplication Store]] – [https://www.sepsoftware.com/sep-sesam/si3-tachometer-analysis/ SEP Tachometer] – [[Special:MyLanguage/Licensing|Licensing]]</div></translate><noinclude>

Revision as of 12:09, 4 May 2022

Other languages:

Template:Copyright SEP AG en

Icon archived docs.png This is not the latest version of SEP sesam documentation and, as such, does not provide information on features introduced in the latest release. For more information on SEP sesam releases, see SEP sesam Release Versions. For the latest documentation, check Configuring Si3 NG Deduplication Store.


Information about deduplication store types

SEP sesam v. 5.0.0 Jaglion has introduced a new generation Si3 deduplication store: Si3 NG. The Si3-related information differs slightly depending on which datastore is used: Si3 or Si3 NG. The procedures presented in this article apply only to the older type of SEP Si3 deduplication store, which will soon be obsolete. To learn more about the new generation of Si3 NG, see Encrypting Si3 NG Deduplication Store.

It is strongly recommended to use the newer type SEP Si3 NG deduplication store. It offers significantly higher performance for backup, restore and migration, as well as direct backup to S3 and backup to Azure, the new immutable storage feature SiS, resulting in improved performance, scaling, and resource savings. For details, see the Si3 and Si3 NG comparison section below.
To learn how to upgrade from Si3 to Si3 NG by configuring a new Si3 NG on the same host and creating a replication job to replicate from Si3 to Si3 NG, see Configuring Si3 NG Deduplication Store.

Overview

SEP sesam provides a target-based (Si3T) and source-based deduplication (Si3S). For details on deduplication concept and recommendations, see Deduplication.

Both, Si3T and Si3S require a configured Si3 deduplication store. Only one Si3 deduplication store can be configured on a server. A valid licence is required for each Si3 deduplication store. Note that you can also configure an Si3 deduplication store by using a command line. For details, see Configuring and Administering Si3 Deduplication Store by using CLI.

You can download SEP Tachometer to analyse the structure of your data and calculate potential savings with SEP sesam Si3 deduplication. Check SEP Tachometer.

Prerequisites

For the minimum Si3 hardware requirements that apply to SEP sesam Si3 deduplication server, see Hardware requirements. Keep in mind that these requirements represent the demand for deduplication only. In addition, the amount of memory for the operating system and other services should be taken into account.

In addition, the following prerequisites must be met to configure an Si3 deduplication store.

Additional RAM / CPU requirements

Si3 Deduplication Hardware Requirements/en

Steps

The SEP sesam data store is a disk based storage that enables savesets (backed-up data) to be backed up directly to the configured storage locations. SEP Si3 target deduplication is easy to configure and ready to use by selecting the Si3 deduplication store type.

  1. In the Main selection -> Components, click Data Stores to display the data store contents frame.
  2. From the Data Stores menu, select New Data Store. A New Data Store dialog appears.
  3. Under the Data store properties in the Name field, enter a meaningful name for the Si3 data store.
  4. From the Store type drop-down list, select SEP Si3 Deduplication Store.
    SEP Tip.png Tip
    As of SEP sesam v. 5.0.0 Jaglion, two Si3 data store types are available. SEP sesam recommends using the new generation Si3 NG when creating a new data store. To learn how to upgrade from Si3 to Si3 NG by configuring a new Si3 NG on the same host and creating a replication job to replicate from Si3 to Si3 NG, see Configuring Si3 NG Deduplication Store.
  5. File:Si3 data store select.jpg

  6. Make sure that the option Create drive is checked under the Drive parameter properties. The predefined value for the drive is automatically inserted in the Drive number field.
  7. It is recommended that the option Create second drive is also enabled. Without it, SEP sesam can only allocate a drive for either reading or writing, running one job on the same drive at a time. By using the additional dedicated drive for restore, you can perform a backup on the first drive and restore your data from the second drive simultaneously. You can also add a third drive for migration.
  8. Then select Create new drive group and enter the name for your Si3 deduplication store dedicated group.
  9. The predefined number of channels is already displayed in the Max. channels drop-down list. The number of available channels depends on your SEP sesam Server package. For details on licensing, see Licensing.
  10. From the Device server drop-down list, select the device server for your data store.
  11. In the Path field, enter the location of your data store or use the Browse button to select the relevant folder. Check the relevant folder and click OK.
    When using the Browse button to select the folder, the New Data Store information window appears with predefined recommended values for your Si3 deduplication store size. Click OK to confirm the selected location and recommended size values. You can modify your data store size later under the Size properties (see step 10).
  12. GUI new data store information Beefalo V2.jpg
  13. Under the Size properties, specify or modify the following:
    • Capacity: Specify the size (in GiB) of the partition for backups.
    • High watermark: Specify the value (in GiB) for the high watermark (HWM). The HWM defines the upper value for the used storage space. When this value is reached, the status of a datastore changes from OK to Warning, but backups continue to be performed. Make sure that you provide enough storage space for your backed up data.
    • Si3 repair area: Specify the value (in GiB) for the Si3 repair area. The Si3 repair area (subdirectory trash) defines space for Si3 files (DDLs) that were identified by a garbage collection job and are no longer used. These files are still kept in the repair area to enable possible repair of Si3 in case of structural problems (which may be caused by a file system error or an operating system crash)). The files in the repair area are automatically removed after the specified period of time (SEP sesam default: 4 days) or when or when the disk usage threshold is reached. Note that the Si3 repair function is disabled when the value is set to 0.
    • Information sign.png Note
      The Si3 repair area for managing disk space dedicated to Si3 files (DDLs) is only available in the Expert UI mode. So if you run the GUI in Basic or Advanced UI mode, you first have to change the mode to Expert, as described in Selecting UI mode.

    The Disk space usage properties are used by SEP sesam to report the following:

    • Used: Total used space (in GiB) on the partition.
    • Total: Maximum available space (in GiB) on the partition as reported by the operating system.
    • Free: Available disk space (in GiB) for SEP sesam.

You can view the properties of your Si3 deduplication by double-clicking the corresponding Si3 deduplication store.

  • You can modify existing and set additional drive options by double-clicking the first drive. In the Drive Properties window, you can browse the path for the data store, set the access mode for data store drives, etc. To configure Si3 data encryption, you have to create a deduplication security password file. For details, see Encrypting Si3 Deduplication Store.
    Use the tab OS Access and specify the credentials to access the respective systems. Use DOMAIN\USER format for domain accounts or HOST\USER for local accounts.
  • Si3 drive properties Beefalo V2.jpg

Monitoring deduplication status

You can view the status of your Si3 deduplication in the GUI by clicking the Si3 State tab. You can check the last deduplication message, the status of active tasks, the encryption status, the number of stored objects, the data size before/after deduplication, the dedup ratio, the saved storage space, etc. Si3 state tab Beefalo V2.jpg

SEP Tip.png Tip
You can also check the status in SEP sesam Web UI. You can use the Dependencies tab to see the diagram of all dependencies of the datastore and drives, RDS, media pools, etc., and use other tabs to check the details of the data store operation.
Information sign.png Note
If fsck (file system consistency check) detects an irregularity in the Si3 file system, the affected pages and chunks are recorded in recovery.log. The Si3 deduplication store in the GUI and Web UIis highlighted in red and Si3 purge is no longer executed. The purge is stopped to prevent the files in the Si3 repair area from being deleted, as they may be needed to repair Si3 in case of problems. Once the errors are fixed and the recovery.log is empty, the Si3 data store is no longer marked in red and the Si3 purge works again.

Si3 deduplication store red Beefalo.jpg

What is next?

After configuring the Si3 deduplication store, configure the media pools first then set up your backup strategy.

Comparison of Si3 and Si3 NG

SEP sesam v. 5.0.0 Jaglion has introduced a new generation Si3 deduplication store. Si3 offers significantly higher performance for backup, restore and migration, as well as backup to S3 cloud and backup to Azure, the new immutable storage feature SiS, resulting in improved performance, scaling, and resource savings.

Function Si3 Si3 NG
Si3 backup YesY YesY
Si3 deduplication (source-side and target-side) YesY YesY
Si3 replication: local to remote store Notea YesY Si3 V1 to Si3 V1 YesY Si3 V1 to Si3; Si3 to Si3
Si3 replication: to S3 cloud YesY NoN (provides more powerful features for backing up directly to the cloud, see the next two lines)
Backup to S3 Cloud Storage NoN YesY
Backup to Azure Storage NoN YesY (as of Jaglion V2)
SiS (SEP Immutable Storage) NoN YesY (as of Jaglion V2)
Si3 restore YesY YesY
Si3 encryption YesY YesY (as of Jaglion V2)
Seeding Si3 deduplication store Noteb YesY NoN
Usage of tachometer YesY NoN
Notea

SEP sesam does not support a direct upgrade from the Si3 V1 to new Si3. However, to use the new Si3 you can:

  • Back up all data again to the newly configured Si3 deduplication store.
  • After configuring a new Si3, you can also create a replication job to replicate from the Si3 V1 to the Si3 store. Replication reads all the data from the source-side store on the source-side RDS and sends it to the target store using the source-side deduplication function. For details, see Replicating from Si3 V1 to Si3.
  • You can also configure a new Si3 and an old Si3 V1 in parallel on the same host by enabling the key enable_gui_allow_multi_dedup.
Noteb

The Initial Seed feature does not work in v. 5.0.0 Jaglion, but you can use it in earlier SEP sesam versions.