search

payu-org / payu

A workflow management tool for numerical models on the NCI computing systems
Apache License 2.0
18 stars 25 forks source link

payu collate -i K collates outputK but restartK-1 #275

Closed aekiss closed 4 years ago

aekiss commented 4 years ago

payu collate -i K collates collates outputK but restartK-1. Is this the intended behaviour? If so, it could be helpful to explain this in https://payu.readthedocs.io/en/latest/usage.html#postprocessing

aidanheerdegen commented 4 years ago

Yes it is the intended behaviour. This means the current tiled restarts are used in the next submission, which should be faster.

Additionally it would not be possible to safely start the next run due to the possibility the restarts it would require are in some "half collated" state.

I you need to collate a specific restart dir you can use the -d option.

It is documented here:

https://payu.readthedocs.io/en/latest/config.html#collation

restart (Defaut: False)
   Collate restart files from previous run.

It isn't on by default, so I don't think it's strictly necessary in the usage section, but if you think it would help feel free to pop in a PR.

aekiss commented 4 years ago

OK thanks, that makes sense. I've enabled restart collation in all the new access-om2 configs (since it's so fast with mppnccombine-fast) so I've made a PR which (I think!) makes this behaviour a little clearer.

aidanheerdegen commented 4 years ago

FYI if you put "Fixes #275" in the PR it will auto close the issue.