-
Spinning up a `dask` cluster on Hobart requires specifying a `resource_spec` argument to `PBSCluster`.
```python
cluster = dask_jobqueue.PBSCluster(cores=48,
…
-
I was wondering why the default walltime for workers is set to 30 minutes instead of None?
For example, see https://github.com/dask/dask-jobqueue/blob/1f9ae1ecc79a5b76930e56c8801f3b8ace659877/dask_…
-
It seems that the dask.distributed has supported the ucx protocol for the communications between workers and schedulers, which seems to have large advantages over tcp when equipped with infiniband. Ho…
-
Assuming we decide to keep the wrapper code around `dask-jobqueue` #1 , we should publish `dask_chtc` as an actual Python package so that it can be easily used.
-
## Current behavior
Currently it is not possible to configure the dask cluster via the config file
## Proposed behavior
We should be able to configure it in this manner:
```toml
[engine.executo…
-
The documentation at https://jobqueue.dask.org/en/latest/generated/dask_jobqueue.SLURMCluster.html (and the one for the other schedulers) says
> interfacestr
> Network interface like ‘eth0’ or ‘ib…
-
I am currently chasing what appears to be a bug in the combination of `distributed` and `dask-jobqueue`.
Particularly, I find that this piece of code almost never completes when running a dask-jobq…
-
See examples for PBS, SGE and SLURM here https://github.com/dask/dask-jobqueue/tree/master/ci
I don't have any docker experience. However, people are welcome to point me to resources.
-
https://gateway.dask.org/install-jobqueue.html
May supersede the implementation in #7.
-
When I created a cluster on HPC using Slurm and dask-gateway-server, I encountered a problem. My understanding of the running process is as follows: when dask-gateway-server receives the new_cluster c…