eWaterCycle / infra

Instructions for system administrators to deploy the eWaterCycle platform
Apache License 2.0
0 stars 0 forks source link

More pre-installed parameter sets #86

Open Peter9192 opened 3 years ago

Peter9192 commented 3 years ago

Currently, we only have the three example cases as pre-installed parameter sets. This is a good set for anyone installing the ewatercycle platform from scratch.

However, in the ewatercycle project, we use more parameter sets. It would be good to also pre-install these parameter sets on the infrastructure we host, so anyone contributing to the ewatercycle project with access to our resources can just use them.

This currently includes:

They should be available under /mnt/data/parameter-sets and configured in /etc/ewatercycle.yaml

Peter9192 commented 3 years ago

pcrglobwb global parameter sets are already downloaded to HPC Cloud machine, available under /mnt/data/examples/technical_paper/pcr-globwb/input/global*. Possible to move those files (but keep the custom .ini files somewhere safe)

One wflow example parameter set is available under /mnt/data/examples/technical_paper/wflow/merrimack/, but it may need to be clean up. Alternatively copy from Cartesius. Other catchments are available on Cartesius as well.

Peter9192 commented 3 years ago

Lisflood parameter sets are available on Cartesius: /projects/0/wtrcycle/comparison/lisflood_input/Lisflood01degree_masked/

Peter9192 commented 3 years ago

List of pre-installed parameter sets now extended to:

lisflood_fraser/
lisflood_global-masked_01degree/
pcrglobwb_global/ (contains both 05 and 30 minutes, and a couple of ini files and clonemaps for running catchments). pcrglobwb_rhinemeuse_30min/
wflow_doring_calibrated/
wflow_great-kei_calibrated/
wflow_merrimack_calibrated/
wflow_merrimack_techpaper/
wflow_meuse_calibrated/
wflow_rhine_calibrated/
wflow_rhine_sbm_nc/
wflow_savannah_calibrated/

But not all are added to /etc/ewatercycle.yaml yet.

Peter9192 commented 3 years ago

Now, the following parameter sets are available.

ewatercycle.CFG.reload()
ewatercycle.parameter_sets.available_parameter_sets()
('lisflood_fraser',
 'pcrglobwb_rhinemeuse_30min',
 'wflow_rhine_sbm_nc',
 'wflow_rhine_calibrated',
 'wflow_savannah_calibrated',
 'wflow_great-kei_calibrated',
 'wflow_doring_calibrated',
 'wflow_merrimack_calibrated',
 'wflow_meuse_calibrated',
 'lisflood_global-masked_01degree',
 'pcrglobwb_merrimack_05min',
 'wflow_merrimack_techpaper')

More can be added by putting custom .ini files in the pcrglob_global directory and adding them to the ewatercycle.yaml config file.

Peter9192 commented 3 years ago

Done for the tech example notebooks

Leaving this open because we might want to add even more for the comparison study.

sverhoeven commented 3 years ago

I copied the files to dcache as root@jupyter.ewatercycle.org with

cd /mnt/data
rclone copy lorentz-models dcache:lorentz-models;rclone copy examples dcache:examples;rclone copy forcing dcache:forcing;rclone copy parameter-sets dcache:parameter-sets
Peter9192 commented 3 years ago

I copied the files to dcache as root@jupyter.ewatercycle.org with

cd /mnt/data
rclone copy lorentz-models dcache:lorentz-models;rclone copy examples dcache:examples;rclone copy forcing dcache:forcing;rclone copy parameter-sets dcache:parameter-sets

We might want to deprecate the examples folder there.