search

It4innovations / hyperqueue

Scheduler for sub-node tasks for HPC systems with batch scheduling
https://it4innovations.github.io/hyperqueue
MIT License
272 stars 21 forks source link

ARM build? #609

Closed vsoch closed 9 months ago

vsoch commented 1 year ago

Heyo! Any chance we could add an ARM build to the set?

image

I'd like to test my operator on ARM graviton instances on AWS, and I think it will error if it's not the right architecture. For the operators I maintain (for ARM images) the build is a little long to test for CI, but I have it build on merge into the main branch. You could do something similar with releases (or maybe you already do!)

Kobzol commented 1 year ago

Hi, would this target be OK for you? (taken from https://doc.rust-lang.org/nightly/rustc/platform-support.html)

aarch64-unknown-linux-gnu: ARM64 Linux (kernel 4.1, glibc 2.17+)

vsoch commented 1 year ago

yes, that looks like the right one!

vsoch commented 1 year ago

Also if you aren't able to provide a release here, if you show me the changes to do I could put them in the production container I'm using instead. I know building ARM on GitHub actions (well, at least with QEMU) is really slow.

Kobzol commented 1 year ago

Can you please check if this artifact works for you?

vsoch commented 1 year ago

Testing now!

vsoch commented 1 year ago

okay the initial container built - the executable looks OK to run (and lammps is good too) I need to next put them together in a Kubernetes setup with the hyperqueue-operator then I can give you a final answer if all is working!

Kobzol commented 12 months ago

So, did it work? :)

vsoch commented 12 months ago

Oh I forgot to post an update! And I'm forgetting now myself :laughing: I do remember that I added arm support https://github.com/converged-computing/hyperqueue-operator/pull/5/files and I vaguely remember testing, but I don't recall the details. I'm pretty booked until I can record two talks, but I (think?) it worked and I would say it's OK to make a proper release. I'll add a note to my TODO for after these talks to give it one more test. And darn I wish I had remembered to update here months ago - I don't remember to give you more detail than that!

vsoch commented 12 months ago

oh! I just remembered (right after I posted of course, lol). So we also needed JobSet for arm, but I haven't heard anything on that issue. https://github.com/kubernetes-sigs/jobset/issues/237. I think I was able to bring up the arm images but not actually get everything running. I'll ping them again now.