E-CAM / jobqueue_features

This library provides some useful decorators for dask_jobqueue. It also expands it's scope to include MPI workloads, including extending configuration options for such workloads and heterogeneous resources.
6 stars 3 forks source link

[WIP] start_jobqueue_tutorial command (Dask-Jobqueue's tutorial) #96

Closed dwhswenson closed 3 years ago

dwhswenson commented 3 years ago

This slightly changes the commands in jupyter.sh. The goal here is to have an easy setup for the Dask-Jobqueue tutorial as well. Might revert these back after the workshop.

New setup:

The goal is to have a single command to be used for each tutorial session.

WIP until I do a run-through of much of the jobqueue tutorial.

ocaisa commented 3 years ago

I don't think we should have closed this just yet, this also requires updates to README.md and ideally a fork of the dask_jobqueue tutorial that actually works on the docker setup out of the box (and tells you when it won't work).

AdamWlodarczyk commented 3 years ago

@ocaisa OK, I reverted changes.

ocaisa commented 3 years ago

@dwhswenson Can you open a new PR for this, it's still a good idea