search

TechEmpower / FrameworkBenchmarks

Source for the TechEmpower Framework Benchmarks project
https://www.techempower.com/benchmarks/
Other
7.45k stars 1.92k forks source link

New Server Set up #8736

Closed NateBrady23 closed 1 month ago

NateBrady23 commented 5 months ago

Good morning, friends!

We are working through some issues with the new servers. Nothing serious, but it's required ordering some extra parts/cables and the delay will be a bit longer. I appreciate everyone's patience while we work through this. We're attempting to get the 40-gigabit fiber setup working, some power issues, and the SFP connectors don't fit in our current enclosure.

joanhey commented 2 months ago

Some clouds give free servers to open source projects, perhaps we could ask (Azure, Amazon, Digital Ocean, ...)

:thinking: But we have another option, now that we use Docker. Any container can be limited by CPU and memory. So we can run each quarter a limited run (simulating a cloud server). And without thermal issues :)

Only we need to decide the number of CPUs and memory to use.

synopse commented 2 months ago

So we can run each quarter a limited run (simulating a cloud server). And without thermal issues :)

Limiting CPU and RAM is not only what a cloud server do. RAM limitation does not change anything on most solutions (but perhaps Java). And it is very likely to have a separated cloud DB instance hosted by the provider, with some specific network abilities, and so on... And limiting CPU and memory won't necessarily fix the thermal issues. Perhaps preventing the shutdown, but not the CPU throttling. There should be no thermal issue at all, or the whole idea of fair benchmarking is pointless.

joanhey commented 2 months ago

I said "simulating a cloud server" but we can change it for "simulating commodity servers".

And yes, the CPU throttling is a problem actually.

joanhey commented 2 months ago

@synopse you are a new comer with a fast framework !! This bench have more than 10 years, than the Techempower people (and more people) used their free time for free, to have a fair benchmark !!

Always come problems, they had the same problem with the old servers, to fix the thermal issues. But later they fixed it. If we can help, it's better than say I don't like !! @NateBrady23 open a github sponsors for this bench !!

msmith-techempower commented 2 months ago

Update: the application server shut down due to heat again. I'm still looking into resolutions, but this is a blocker for the moment.

msmith-techempower commented 2 months ago

Update to the Update: I have redone the geometry of the machines, wires, and whatnot in the small rack and tried a few things to try and improve air-flow. I kicked off another run (and I see results coming into TFBStatus, now) and will continue to monitor throughout the week.

I am 99% certain that we will need to install some additional airflow measures (intake/exhaust fans, push/pull setup, etc), but we will cross that bridge when we get to it.

msmith-techempower commented 1 month ago

Okay, closing this issue. Looking like we're getting good runs reliably with thermal issues under control (we'll see when summer rolls in). Feel free to follow-up here if you have questions/concerns, but otherwise it'll be business as usual moving forward.