search

JuliaParallel / ClusterManagers.jl

Other
235 stars 74 forks source link

Possibly naive question: ClusterManagers work for kubernetes? #146

Closed nickeubank closed 3 years ago

nickeubank commented 3 years ago

Trying to get Julia up on an AzureML cluster, or if not that than a plain kubernetes cluster on Azure, but can't find much on how to do it in Julia. Don't see anything here, but maybe I'm just missing it -- can ClusterManagers be useful for scaling clusters?

bjarthur commented 3 years ago

https://juliacomputing.com/products/juliarun

nickeubank commented 3 years ago

@bjarthur No objection to Julia Computing making money providing support, but looking for an open source solution.

I take it that isn't in ClusterManagers then?

EDIT: (not just to save $$; I'm an instructor, and like to make all my materials public (e.g. here) so closed source isn't something I can bring to my courses unless I want to stop making them public resources).

juliohm commented 3 years ago

Thank you @nickeubank for opening the issue. I think you can find more resources in https://github.com/JuliaComputing/Kuber.jl ClusterManagers.jl is currently under review, but I assume that the workflow model we are seeking in this package here is biased towards classical MPI jobs.

I will close the issue given that you can find better answers elsewhere in the community forums.