search

euronion / trace

16 stars 3 forks source link

stop download_GEGIS_dataset/era5 #17

Open MurkyTheMurloc opened 2 years ago

MurkyTheMurloc commented 2 years ago

Is there a way too skip following steps in the model by placing the files already created with GlobalEnergyGIS in Trace?

[Sun Jul 10 15:19:05 2022]
rule download_GEGIS_era5:
output: resources/GEGIS/era5wind2013.h5, resources/GEGIS/era5solar2013.h5, resources/GEGIS/era5temp2013.h5
jobid: 5
reason: Missing output files: resources/GEGIS/era5temp2013.h5, resources/GEGIS/era5solar2013.h5, resources/GEGIS/era5wind2013.h5
wildcards: year=2013
resources: tmpdir=/tmp

[Sun Jul 10 15:19:05 2022]
rule download_GEGIS_dataset:
output: resources/GEGIS/protected.jld, resources/GEGIS/gadm.tif
jobid: 7
reason: Missing output files: resources/GEGIS/gadm.tif
resources: tmpdir=/tmp
euronion commented 2 years ago

In the config.default.yaml you can set the value

https://github.com/euronion/trace/blob/f429a811489e7a87346ea48d7956c219f4ba36b4/config/config.default.yaml#L103-L105

to false , then the rules are not executed. (But requires the files to be present).

If you already have the files you can place them in the appropriate locations in resources/GEGIS/...:

https://github.com/euronion/trace/blob/f429a811489e7a87346ea48d7956c219f4ba36b4/rules/gegis.smk#L26-L30

and

https://github.com/euronion/trace/blob/f429a811489e7a87346ea48d7956c219f4ba36b4/rules/gegis.smk#L18-L21

That should prevent the rules from running.

Note that the second list (rule download_GEGIS_dataset) is not complete (due to lazyness on my end), there are a lot of datasets being downloaded by GlobalEnergyGIS if you call that rule. You need all the files, not just the ones explicitly specified.