search

related-sciences / gwas-analysis

GWAS data analysis experiments
Apache License 2.0
24 stars 6 forks source link

Add single node dask cluster config notebook #27

Closed ravwojdyla closed 4 years ago

ravwojdyla commented 4 years ago

@eric-czech I wasn't really sure if yaml was the best format for this, so here I suggest a notebook, it would likely be a evolving notebook, and this would be just a start. wdyt?

review-notebook-app[bot] commented 4 years ago

Check out this pull request on  ReviewNB

You'll be able to see Jupyter notebook diff and discuss changes. Powered by ReviewNB.

eric-czech commented 4 years ago

I was thinking a dask.yaml file like in https://docs.dask.org/en/latest/configuration.html#configuration so I can point dask at that instead of using context managers. The notebook with explanation is helpful though so feel free to stick with that if you find other properties worth keeping in mind.

eric-czech commented 4 years ago

Though maybe that's the appropriate way to set some properties, inline and only for certain operations. In that case, the notebook makes sense. I guess we'll see how that list grows.