search

python / buildmaster-config

Configuration for buildbot.python.org
https://buildbot.python.org/
MIT License
32 stars 55 forks source link

New worker request: <diegorusso-aarch64-bigmem> #473

Open diegorusso opened 7 months ago

diegorusso commented 7 months ago

Username

diegorusso

GitHub username

No response

Name

Diego Russo

Email address

diego.russo@arm.com

Password status

I need a new owner password

Processor architecture

aarch64

Operating System

Ubuntu 22.04

Anything special about the worker?

This machine is an aarch64 Equinix machine and it is currently used to run benchmarks to be uploaded to speed.python.org. Given its spec, we'd like to run also bigmem tests. Tagging @ambv for visibility

zware commented 7 months ago

Hmm, if it's a benchmark runner, do we really want it running a buildbot as well? It seems that would impact its ability to run benchmarks effectively, or would require routinely stopping the buildbot worker process.

diegorusso commented 7 months ago

We have set up the machine with cpu isolation. The machine has 80 cores and we have isolated the last 14 cores for running benchmarks: to be precise we run benchmarks just on the odd cores in the range 65-79 (65, 67, 69..) using cpu affinity.

Daily benchmarks are run at midnight (UTC) only, the rest of the time the machine is idle.

The aim is to maximise the use of this machine. If we want to be on the safe side we could pause buildbot jobs 2 hours before and after midnight so it won't be scheduling jobs when benchmarks will be running.

zware commented 7 months ago

Ok. I'm no expert at benchmarks, so if that configuration is deemed sufficient from that side of things, I'm ok from the buildbot side of things :)

Can you create a PR adding the public configuration? #404 should be a reasonable template to follow, though there may be some extras needed to enable bigmem testing.

itamaro commented 7 months ago

@diegorusso I created a new owner password and emailed it to you.

vstinner commented 7 months ago

Related PR: https://github.com/python/buildmaster-config/pull/474

diegorusso commented 7 months ago

Thanks @itamaro. I confirmed I received it.

diegorusso commented 7 months ago

I have my hands blocked until this https://discuss.python.org/t/top-level-license-not-present-on-some-repos/47973 gets resolved.

itamaro commented 4 months ago

@ambv were you planning to add license and CLA bot?

ambv commented 2 weeks ago

MIT license added as all contributors were reached for acknowledgement and provided it.