madMAx43v3r / chia-gigahorse

221 stars 31 forks source link

FARMER - DELL T620 CONFIGURATION HELP #247

Open NewSunSEO opened 10 months ago

NewSunSEO commented 10 months ago

Hello, I am looking to add a Dell T620 as a dedicated farmer to my Chia farm. I am trying to figure out what would be able to handle more C18 plots better in one of these & this jumps between GH / BB when you try to compare the GPU's: https://xch.farm/max-farm-size

Dell T620 with FOUR RTX 3080's Dell T620 with TWO RTX 3090's

Thank you for anyone's help

madMAx43v3r commented 10 months ago

FOUR RTX 3080's should be faster

NewSunSEO commented 10 months ago

Thank you for your reply. Do you know if there is anywhere to find out how many TiB GPU's can handle of your new compressed plots? I'm trying to plan how to build out my farm & account for the halving coming up in June 2024. This does not go higher than C9: https://xch.farm/max-farm-size

Thank you

NewSunSEO commented 10 months ago

My farm has all 20TB drives in it, for density. I'm trying to figure out what a NetApp DS4246 with 24 20TB drives would need for GPU capacity after this coming June 2024 halvening. I have all Dell R720XD's & the biggest GPU I can fit into them is a 3070 / 3070 Ti. That's why I'm looking at the Dell T620's, because I could get 3080's / 3090's into those & connect the NetApp's to them... I wish the calculator I linked to above had your compressed plots in it...

Thank you

spleen911 commented 10 months ago

The readme of this repo has the information you seek https://github.com/madMAx43v3r/chia-gigahorse

image

NewSunSEO commented 10 months ago

Yes, I've seen that in the past. I was hoping to find information about 3070, 3080 & 3090 GPU's as we get closer to June 2024.

Thank you

spleen911 commented 10 months ago

24 20TB ~= 4.8PiB so after June you would need 2 3060Ti for C18.

30[7|8|9]0 will support more but assuming they don't support double you still need at least two GPUs so that's a starting point regardless of the GPU you pick. The higher beefier the GPU, the longer the time before you need a 3rd one.

Of course, that isn't based on "I have the hardware and tested it myself" but rather simple generalization. If you can afford 24 - 20s and a T620 ... just buy whatever GPUs you can justify in your own wallet.

NewSunSEO commented 10 months ago

I'm looking to build this out into the future. This is my current setup. I originally was intending on adding more NetApps with 20TB drives attached to my farmer, then adding one NetApp to each harvester with 24 20TB Drives. I was going to add more NetApps in a daisy chain, but with the current price of Chia & the halving coming up, as well as them missing going public, I've been rethinking how much I want to expand my farm & how. So I am trying to figure out if adding more NetApps would make sense & what GPU's I would need to support them, so the GPU's don't get overwhelmed... I was also thinking to load balance the GPU workloads between them using remote compute so they don't get overwhelmed too...

PLOTTER-01 Lenovo Thinkstation P620 Threadripper PRO 5945WX - Proxmox OS 2 SeaGate FireCuda 530 SSD's RAID 1 for OS 512GB 2666 RAM 3070 (Plotting GPU)

FARMER-01 Dell R620 2x E5-2680 v2 2.8ghz 10-Core - Proxmox OS 2 Samsung 870 2TB EVO SSD's RAID 1 for OS 384GB RAM TrueNAS - 8 20TB SATA HDD's RAID 0 - In 1 pool w 8 Disks 3090 (Farming GPU) FARMER-01 is setup in a Proxmox VM running Ubuntu Desktop / 32GiB RAM NetApp DS4246 with 24 20TB SATA HDD's in 4 Pools w 6 Drives Per Pool Raid 0

HARVESTER-01 Dell R720XD 24 Core 2X E5-2697 V2 - Proxmox OS 2 Samsung 870 2TB EVO SSD's RAID 1 for OS 512GB RAM TrueNAS - 12 20TB SATA HDD's RAID 0 - In 2 Pools w 6 Disks Per Pool 109TiB per Pool / 218TiB server total 3070 (Harvester GPU) HARVESTER-01 is setup in a Proxmox VM running Ubuntu Desktop / Gigahourse Farmer w 32GiB RAM

HARVESTER-02 Dell R720XD 24 Core 2X E5-2697 V2 - Proxmox OS 2 Samsung 870 2TB EVO SSD's RAID 1 for OS 512GB RAM TrueNAS - 12 20TB SATA HDD's RAID 0 - In 2 Pools w 6 Disks Per Pool 109TiB per Pool / 218TiB server total 3070 (Harvester GPU) HARVESTER-02 is setup in a Proxmox VM running Ubuntu Desktop / Gigahourse Farmer w 32GiB RAM

Thank you for your input.