RS-DAT / JupyterDaskOnSLURM

Apache License 2.0
16 stars 3 forks source link

Adapt to snellius usage #1

Closed rogerkuou closed 2 years ago

rogerkuou commented 2 years ago

adapt the SLURM job and Dask config to both Snellius and Spider

rogerkuou commented 2 years ago

Hi @fnattino, I have tested the scripts on Snellius, and created the Snellius version of the Dask config files and SLURM scripts. For now, I separated the Spider and Snellius one, and updated the README accordingly.

I verified the Dask dashboard and workers are working correctly. But did not try to run the whole stac2dcahce workflow since I do not have the macroon.dat file.

rogerkuou commented 2 years ago

@fnattino Thanks Francesco. I applied your suggestions. Can you have a final look?