search

willirath / dask_jobqueue_workshop_materials

Materials for a workshop focusing on https://jobqueue.dask.org
28 stars 8 forks source link

Try binderization? #5

Open willirath opened 5 years ago

willirath commented 5 years ago

@lesteve has a working minimal example here: https://github.com/lesteve/test-binder

I"ll try and create a reduced version of the tutorials that are able to run on Binder.

(Also CC: @guillaumeeb)

guillaumeeb commented 5 years ago

Hey @willirath! This is a really nice repo! Please keep me up to date when you feel it's ready to be shared!

willirath commented 5 years ago

See #7. I'm happy to have people taking a look / comment.

Timeline for this to be finished is determined by the fact that I need to be ready to give the work shop on July 2 in the morning.

guillaumeeb commented 5 years ago

You take this really seriously, you will greatly help dask-jobqueue community!

lesteve commented 5 years ago

Sorry, no time to work on this since my initial work. How did the dask-jobqueue workshop go by the way?

willirath commented 5 years ago

Workshop was great. Link to videos here: https://twitter.com/RathWilli/status/1149716124227031040?s=19

guillaumeeb commented 5 years ago

Sorry also, did not find the time either, but taking a look at your material is still on my to do list!

lesteve commented 5 years ago

Workshop was great. Link to videos here: twitter.com/RathWilli/status/1149716124227031040?s=19

Nice, I think it would be great addition to our doc if we had the links to the dask-jobqueue doc. @willirath are you fine with that (I can do it).

willirath commented 5 years ago

Yes, sure. I'm fine with that.

lesteve commented 5 years ago

And by the way (sorry to hijack the issue but @guillaumeeb may be interested by this) about your federated dask cluster use case, I have seen https://github.com/jcrist/dask-gateway that seems to target this kind of use cases (IIUC both your federated use case and dask-gateway, which is not 100% ...) including on HPC clusters.