JuliaParallel / Dagger.jl

A framework for out-of-core and parallel execution
Other
638 stars 67 forks source link

Add documentation on how to spawn workers over SSH #444

Open KronosTheLate opened 1 year ago

KronosTheLate commented 1 year ago

Can I use Dagger to spawn processes on another computer connected over ssh?

Distributed.addprocs has a method that "Add worker processes on remote machines via SSH.". Can I spawn workers with this, schedule tasks on them with Dagger, and expect it to work?

A few sentences on ssh and computations on other computers in the docs would be lovely ^_^

jpsamaroo commented 12 months ago

Yes, you would use the standard addprocs from Distributed to do this. Feel free to add a sentence or two to the docs to point this out (maybe in the Quickstart section?) if you have time :slightly_smiling_face: