-
When I created a cluster on HPC using Slurm and dask-gateway-server, I encountered a problem. My understanding of the running process is as follows: when dask-gateway-server receives the new_cluster c…
-
In
https://github.com/ExaESM-WP4/dask-jobqueue-configs/blob/8318f739d97abc5064151121a2fd95c3120f4e6d/nesh/nesh-dask-jobqueue-config.yaml#L13
we might decide to go for `cores` higher than the req…
-
Hello everyone,
I am trying to run Dask on our cluster, however the following code produces an error i don't really know how to solve
```
from dask_jobqueue import SLURMCluster
cluster = SLUR…
-
For example, the memory request is very "optimistic". Here, rather choose the reported "available" value:
```shell
$ srun --account=??? --time=00:05:00 --partition=??? free -h
srun: job 2730378 q…
-
There is some talk of standardizing a "please get me the logs for this worker" interface for the different resource managers (kubernetes, yarn, jobqueue) here: https://github.com/dask/distributed/pull…
-
There are at least a few related packages that have significant overlap:
- [NCAR-jobqueue](https://github.com/NCAR/ncar-jobqueue)
- [dask-ctl](https://github.com/dask-contrib/dask-ctl)
Since in p…
-
Hello,
My name is Clément Buton, I am a Post-doc working at [IPNL](https://www.ipnl.in2p3.fr/?lang=en) on the[ Euclid European space telescope](https://www.euclid-ec.org).
I am currently trying…
-
I would like use a `values.yaml` that has all the packages needed to run the examples in https://github.com/dask/dask-docker/tree/master/notebook/examples
Perhaps it is suited for an examples page …
-
The current navbar has links to pages that I think mostly don't matter.
- distributed docs are way too technical for most users
- dask-ml is not actually all that focused on dask + ml users…
-
Some workflows might want a mixed CPU/GPU worker pool. Not sure how/if `dask-jobqueue` supports that.
No customers yet, so this is low priority.