search

beacon-biosignals / K8sClusterManagers.jl

A Julia cluster manager for Kubernetes
Other
31 stars 5 forks source link

Revise interface to be inline with Distributed.jl #13

Closed omus closed 3 years ago

omus commented 3 years ago

Currently the K8sClusterManager uses this interface to spawn workers:

pids = K8sClusterManagers.addprocs_pod(2; namespace="my-namespace")

An interface which would be more inline with Distributed.jl would be:

pids = addprocs(K8sClusterManager(2; namespace="my-namespace"))
omus commented 3 years ago

https://docs.julialang.org/en/v1/stdlib/Distributed/#Cluster-Manager-Interface

kolia commented 3 years ago

The current interface is modeled after what's been done in https://github.com/JuliaParallel/ClusterManagers.jl, which includes the addprocs(K8sClusterManager(...)) form, though I haven't been using it that way.