Interactive parts of code (dem download) fail on cluster (slurm batch job)

ArcticSnow / TopoPyScale

TopoPyScale: a Python library to perform simplistic climate downscaling at the hillslope scale

https://topopyscale.readthedocs.io

MIT License

40 stars 9 forks source link

Interactive parts of code (dem download) fail on cluster (slurm batch job) #35

Open joelfiddes opened 2 years ago

joelfiddes commented 2 years ago

Use case: start new job as a slurm batch job on a cluster without dem What happens? fails as interactive statement "do you want to download..." can not be handled in a batch job

Solutions:

use keyword in config file
decide we do not support this usecase

ArcticSnow commented 2 years ago

Good point. What about if we add a flag in the YML file called interactive_shell: True? Simon

joelfiddes commented 2 years ago

good idea - also may be other cases as we go on. What do we do if false? we would then need to specify through keywords. Could be a separate section thats dedicated to non interactive mode

ArcticSnow commented 2 years ago

We can simply have an if statement checking for that flag right before the ìnput()`command. But then if it does not find the files it automatically downloads. Sounds good?