search

modex-flexmex / oemof-flexmex

oemof-flexmex is an oemof model built for model comparison within the Modex project FlexMex.
https://oemof-flexmex.readthedocs.io
MIT License
0 stars 0 forks source link

Result directories contain files from former runs #45

Closed unndreay closed 3 years ago

unndreay commented 4 years ago

The files in the result directories (most of all preprocessing but relates to other steps as well) are overwritten file by file if another run is performed. So it happens that files from previous runs survive and are processed maybe again. This can lead to unpredictable results and errors difficult to find. This is mostly due to the catch-them-all behaviour of some functions.

One solution is to delete the result directory before another run. This has to be done manually at the moment to ensure that there is no glitch between to runs!

How can we deal with that? Is there a downside if we just delete everything before a new run?

jnnr commented 4 years ago

I agree that it would be good if the directory is started fresh with no files in it.

jnnr commented 3 years ago

Will be addressed with #9

unndreay commented 3 years ago

Addressed with #139. It is one of Snakemake's principles to delete results from former runs.