search

ACCESS-NRI / model-config-tests

Tests for checking model configurations
Apache License 2.0
0 stars 1 forks source link

Check manifests/restart.yaml md5 hashes in repro test #86

Open aekiss opened 2 weeks ago

aekiss commented 2 weeks ago

payu generates manifests/restart.yaml files containing md5 hashes of all restart files.

Checking these would be a quick, easy and thorough way to confirm bitwise reproducibility of all model components, e.g. for ACCESS-OM3.

aekiss commented 2 weeks ago

manifests/restart.yaml records the input restarts for the run, so this test would require two consecutive runs and checking the second one, ie archive/output001/manifests/restart.yaml.

access-hive-bot commented 1 week ago

This issue has been mentioned on ACCESS Hive Community Forum. There might be relevant details there:

https://forum.access-hive.org.au/t/ocean-team-workshop-12-15th-november-2024/3857/7

anton-seaice commented 1 week ago

We weren't convinced about the completeness of comparing ocean.stats for reproducibility - it seemed like rounding errors differences may not get caught. As the restart.yml has checksums for the restart files, this is a more complete check.

As Andrew noted - the checksums are calculated during payu setup, so payu setup would need to be run after the model run to calculate the new checksums.