fmperf-project / fmperf

Cloud Native Benchmarking of Foundation Models
Apache License 2.0
21 stars 10 forks source link

Updates to Kind with GPUs setup #21

Open rohanarora opened 5 months ago

rohanarora commented 5 months ago

Thomas (@tdoublep), As a result of this development, the use of kind clusters with GPUs has been streamlined. The use of the forked version of kind can now be avoided.

But it requires the prerequisite steps to be done and those need sudo privileges. Should we consider switching to this approach?

tdoublep commented 5 months ago

@rohanarora We did have a valid reason for wanting to be able to set it up without sudo, because we did not have sudo on a bunch of the machines @mal-zurich was using for her experiments.

that said, looking at the pre-requisite steps here, I think this stuff is probably already there on those machines and if not, we could ask it to be setup. and it is indeed better to not be using a fork of kind.

rohanarora commented 5 months ago

Made the updates, Thomas (@tdoublep). Let me know how you wish to proceed on this one.