CHTC / dask-chtc

Spawn Dask workers in the CHTC HTCondor pool
https://dask-chtc.readthedocs.io
3 stars 3 forks source link

Use the same version of the dask image as the local version of distributed #37

Open matyasselmeci opened 3 years ago

matyasselmeci commented 3 years ago

There can be version incompatibilities between the dask-scheduler and the dask-worker, which lead to difficult-to-diagnose errors. Instead of using daskdev/dask:latest for the default Docker image for the workers, use daskdev/dask:$VERSION where $VERSION comes from:

from distributed.versions import get_versions; get_versions()

get_versions() might have a leading 0 in the month, whereas the image tag doesn't (and dask-scheduler --version doesn't).