Synology enable Deduplication

Description

Enable data deduplication with non-Synology SSDs and unsupported NAS models

• Works for any brand SATA SSD, SAS SSD and M.2 SSD drives in DSM 7.01 and later.
• Now works for HDDs in DSM 7.2.1 and later.
• Now works for M.2 drives in a PCIe adapter card (E10M20-T1, M2D20, M2D18 or M2D17) in DSM 7.2.1 and later.

It works on Synology models that do offically support data deduplication.

It also works in DSM 7.0.1 to 7.2.1 on models with one of the following CPU architectures: V1000, R1000, Geminilake and Broadwellnk.

It only works in DSM 7.2.1 on models with a Broadwellnkv2, Broadwell, Purley, Epyc7002 CPU.

It does NOT work for models with Apollolake, Avoton or Denverton CPUs.

Please leave a comment in this discussion if it works, or doesn't work, for you.

Requirements

• Btrfs Tiny Data Deduplication requires 4GB of memory or more.
• Btrfs Data Deduplication requires 16GB of memory or more.
• The volume needs Usage detail analysis enabled. See Enable and View Usage Details.

Works in DSM 7.2.1 for the following models

Models confirmed working with older DSM versions

Download the script

1. Download the latest version Source code (zip) from https://github.com/007revad/Synology_enable_Deduplication/releases
2. Save the download zip file to a folder on the Synology.
3. Unzip the zip file.

How to run the script

Running the script via SSH

How to enable SSH and login to DSM via SSH

Note: Replace /volume1/scripts/ with the path to where the script is located. Run the script then reboot the Synology:

sudo -s /volume1/scripts/syno_enable_dedupe.sh

Options:

  -c, --check           Check value in file and backup file
  -r, --restore         Undo all changes made by the script
  -t, --tiny            Enable tiny data deduplication (only needs 4GB RAM)
                          DSM 7.2.1 and later only
      --hdd             Enable data deduplication for HDDs.
                          Can cause files to become more fragmented,
                          resulting in decreased access performance.
  -e, --email           Disable colored text in output for scheduler emails
      --autoupdate=AGE  Auto update script (useful when script is scheduled)
                          AGE is how many days old a release must be before
                          auto-updating. AGE must be a number: 0 or greater
  -s, --skip            Skip memory amount check (for testing)
  -h, --help            Show this help message
  -v, --version         Show the script version

Extra Steps:

To get rid of drive database outdated notifications and unrecognised firmware warnings run Synology_HDD_db which will add your drives to DSM's compatibile drive databases, and prevent the drive compatability databases being updated between DSM updates.

sudo -s /path-to-script/syno_hdd_db.sh --noupdate

What about DSM updates?

After any DSM update you will need to run this script, and the Synology_HDD_db script again.

Schedule the script to run at shutdown

Or you can schedule both Synology_enable_Deduplication and Synology_HDD_db to run when the Synology shuts down, to avoid having to remember to run both scripts after a DSM update.

See How to schedule a script in Synology Task Scheduler

Screenshots

Here's the result after running the script and rebooting. Note that the DS1821+ is not officially listed as supporting deduplication, and non-Synology SSDs are being used.

Unsupported NAS model with enough memory

Non-Synology SSDs setup as a volume

Enable Data Deduplication option available after running this script and rebooting

Configure Data Deduplication

Deduplication finished notification

Deduplications works.

Deduplication for HDDs too.