nix-community / infra

nix-community infrastructure [maintainer=@zowoq]
https://nix-community.org
MIT License
104 stars 62 forks source link

hydra: build CUDA packages for the CUDA team #1335

Closed zimbatm closed 3 days ago

zimbatm commented 5 days ago

I don't know how much resources that would take, but we could give it a go.

CUDA packages are slow to build, and not cached by upstream due to upstream not building unfree packages. This could help the team quite a bit.

zowoq commented 5 days ago

I don't know how much resources that would take, but we could give it a go.

No objection. Maybe if this ends up too much for our current hardware we could consider upgrading.

Mic92 commented 5 days ago

I don't know how much resources that would take, but we could give it a go.

No objection. Maybe if this ends up too much for our current hardware we could consider upgrading.

If you tell companies that all they need to do to get CUDA packages for NixOS is to pay some monthly donations, than I am sure we get the funding pretty quick. Also we still haven't asked Hetzner for the discount they are offering to the NixOS foundation. This way we would probably still save money with bigger hardware.

zimbatm commented 5 days ago

First run: https://hydra.nix-community.org/eval/109915

ConnorBaker commented 4 days ago

I don't know how much resources that would take, but we could give it a go.

No objection. Maybe if this ends up too much for our current hardware we could consider upgrading.

If you tell companies that all they need to do to get CUDA packages for NixOS is to pay some monthly donations, than I am sure we get the funding pretty quick. Also we still haven't asked Hetzner for the discount they are offering to the NixOS foundation. This way we would probably still save money with bigger hardware.

They offer discounts? My Hetzner bill for part of the CUDA CI is like $400; I’d love to consolidate some of that stuff under the community, especially if you can get a discount and we can all benefit from it!

zimbatm commented 3 days ago

Merging the current state. We can still do follow-up PRs afterwards!

zimbatm commented 2 days ago

They offer discounts? My Hetzner bill for part of the CUDA CI is like $400; I’d love to consolidate some of that stuff under the community, especially if you can get a discount and we can all benefit from it!

Yes, but they ran out of the discount budget for this year. We'll have to contact them again next year.

zimbatm commented 2 days ago

If you want to donate hardware to the cause, we are discussing what the requirements would be in https://github.com/nix-community/infra/issues/1343

zowoq commented 2 days ago

My Hetzner bill for part of the CUDA CI is like $400

Could you go into some detail please? What hardware, what is built and what is the utilization like?