comp-dev-cms-ita / dask-remote-jobqueue

A custom dask remote jobqueue for HTCondor.
MIT License
2 stars 1 forks source link

Version of dask-remote-jobqueue with Dask 2022.9.2 #61

Open tommasodiotalevi opened 1 year ago

tommasodiotalevi commented 1 year ago

What would you like to be added?

Version of dask-remote-jobqueue package with support to Dask 2022.9.2. In particular, fixing the following templates for the Dask scheduler:

https://github.com/comp-dev-cms-ita/dask-remote-jobqueue/blob/main/dask_remote_jobqueue/templates/scheduler.sh https://github.com/comp-dev-cms-ita/dask-remote-jobqueue/blob/8fe2823f21e846f2c30971288b44d3cf123705bc/dask_remote_jobqueue/templates/scheduler.sub#L8

Why is this needed?

Currently, singularity images with ROOT >= 6.28 require dask > 2022.X.Y. Therefore, to avoid mismatching, the Dask scheduler must be synchronised. For the moment, a patch script fixes those templates. However, for the new alma8 images, this should be implemented.