search

gboudreau / Greyhole

Greyhole uses Samba to create a storage pool of all your available hard drives, and allows you to create redundant copies of the files you store.
http://www.greyhole.net
GNU General Public License v3.0
263 stars 34 forks source link

Looking to take advantage of 10GbE and overcome HD bottleneck #277

Open old-square-eyes opened 3 years ago

old-square-eyes commented 3 years ago

I am looking for a quick landing zone to take advantage of a new 10GbE network. Currently my LZ physical disk is 7200 rpm, with Open Media Vault managed Samba shares, and it also doubles as a GH target disk (one of several).

I'm thinking of moving my LZ to a NVMe SSD which will make Writes quick. Two questions...

  1. If I get a large SSD 1-2TB and also make it a GH target, will most Reads come from the SSD? Is there a way to make that drive fill up in preference - What will a balance do?
  2. Alternatively, is there a caching service in Debian that plays nice with GH? Where, somehow I could transparently cache common files.

Context and more info on my setup...

https://forum.openmediavault.org/index.php?thread/39953-looking-to-take-advantage-of-10gbe-and-overcome-hd-bottleneck/&postID=280769#post280818

gboudreau commented 3 years ago

  1. If for example you already have 4x 1TB drives in your pool, and they are almost full, and you add a 1TB SSD, a balance will spread the 4TB of data you have across 5 drives, so you'll end up with 4/5 TB per drive.
    If you don't do a balance, then your 4 previously filled drive will stay as they were, and new files will always be added to your new drive, since it will be the one with the most free space in your pool.

  2. No idea. But if you want some folders to always be on the speediest drive, you can use sticky_files in greyhole.conf; that allows you to decide with shares or folders should go on your SSD (as long as there is free space on that drive).
    Ref: https://github.com/gboudreau/Greyhole/blob/master/greyhole.example.conf#L172-L191

old-square-eyes commented 3 years ago

OK sticky folders could help. I'll check it out thanks.