search

CNCLgithub / GalileoEvents

Galileo + Events
MIT License
2 stars 0 forks source link

distribute BO #8

Closed belledon closed 4 years ago

belledon commented 4 years ago

still profiling but we could use something like this https://github.com/JuliaParallel/ClusterManagers.jl

Originally posted by @belledon in https://github.com/CNCLgithub/galileo-ramp/issues/3#issuecomment-601691152

belledon commented 4 years ago

@eivinasbutkus lets keep track of progress here

belledon commented 4 years ago

tread lightly when you begin to scale your unit tests as task schedulers tend to hit clusters job schedulers hard.

also, do you remember how i had to jerry-rig commands like sbatch into the container using ssh? You might have to do something similar for ClusterManager (maybe for scancel). Just take a look at the Singularity file for an example

eivinasbutkus commented 4 years ago

https://github.com/magerton/julia-slurm-example

eivinasbutkus commented 4 years ago

can run the example by including scripts/analysis/bo/distributed_bo.jl in Julia REPL on Milgram

belledon commented 4 years ago

Excellent. I'll get to this tonight

On Thu, Mar 26, 2020, 2:13 PM Eivinas Butkus notifications@github.com wrote:

can run the example by including scripts/analysis/bo/distributed_bo.jl in Julia REPL on Milgram

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub https://github.com/CNCLgithub/galileo-ramp/issues/8#issuecomment-604591804, or unsubscribe https://github.com/notifications/unsubscribe-auth/AEXUUPRZMNPGJUHYA2IYUZTRJOLMHANCNFSM4LQR2WFQ .