CCI-MOC / ops-issues

2 stars 0 forks source link

Compile Wayfair donation for director level review #662

Closed msdisme closed 2 years ago

msdisme commented 2 years ago

Compiling hw into a more understandable set of information so directors and above may digest it.

hakasapl commented 2 years ago

I made a spreadsheet with rack layout proposals

msdisme commented 2 years ago

@hakasapl The rack layout is nice for a quick understanding of how this equipment can be organized and what each rack would provide/require. 

A short spreadsheet (even an additional sheet in the existing workbook) with specifics on each machine type would be great (CPU type, memory, nic interfaces, etc).

EG: we want to be able to say we have 5.3 racks worth of server X, where server X has Y cores of compute and Z GB of memory. and then a short description fo other kinds of servers we have, e.g., with GPUs…

Hoping to have wed AM so we can get Orran/Wayne to take another pass for feedback.

msdisme commented 2 years ago

also add the original data spreadsheet to this as a tab

msdisme commented 2 years ago

@hakasapl does this give you the necessary power and heat info: https://www.dell.com/support/manuals/en-us/poweredge-fm120/fx2ownersmanual/power-specifications?guid=guid-ce74709c-7ed1-4845-a975-7b3960ed667c&lang=en-us and https://www.dell.com/support/manuals/en-us/poweredge-fm120/fx2ownersmanual/environmental-specifications?guid=guid-cb32b282-fe4d-48b6-a3d1-f2a4b8d5d99e&lang=en-us

hakasapl commented 2 years ago

I've added a "Hardware Details" sheet to the spreadsheet, and copied over the full inventory in the "Hardware Inventory" sheet.

As for the power, this doesn't help too much because the wattage will vary greatly based on configuration. We're not sure what kind of PSUs are on the FX2s currently coming from wayfair, but that information would help.

waygil commented 2 years ago

Dell has a power planning tool located here - https://www.dell.com/en-us/dt/corporate/social-impact/advancing-sustainability/sustainable-products-and-services/energy-efficiency/energy-tools.htm

You can configure the FX nodes to match the wayfair ones to get an idea of power usage based on config.

hakasapl commented 2 years ago

I didn't know about that tool, super useful, thanks!

hakasapl commented 2 years ago

I've added some power metrics to the spreadsheet. It looks like most of the racks in the proposal are around 28kW, which is a bit too high for the current pods we have, especially if the cabinets are in the same pod.

If we were to spread out the hardware to more racks to reduce power density, we would be looking at about 14-15 racks of equipment (proposal has only 11), each of which at 19-21 kW each, which puts us in the sweet spot that the facility likes to keep average rack consumption at, 20 kW.

msdisme commented 2 years ago

@hakasapl plz see email subject: Re: MOC-A donation follow up from John Goodhue.

hakasapl commented 2 years ago

Waiting for reply from Dell to confirm power numbers...

hakasapl commented 2 years ago

Closing this for now