search

nesi / APSIM-HPC

Deploy APSIM (Agricultural Production Systems sIMulator - https://www.apsim.info/) on high performance computing clusters.
https://nesi.github.io/APSIM-HPC/
MIT License
0 stars 0 forks source link

investigate weather file deadlocking ? #23

Closed DininduSenanayake closed 2 months ago

DininduSenanayake commented 2 months ago

We have had a success rate ~40% with respect to creating the .db files with the "expected" file size. One of the hypothesis is "Weather file deadlocking"

One of the quickest way to verify this is to run a batch with "one weather file at any given time"

DininduSenanayake commented 2 months ago

This will be investigated once we address https://github.com/DininduSenanayake/APSIM-eri-mahuika/issues/24

DininduSenanayake commented 2 months ago

.met files were not responsible for the random fail rate. In fact, it was due to temp file belong to master .aspimx file "opening and closing" at irregular intervals as the array makes progress through the file list triggered the failures . This was identified and addressed in https://github.com/DininduSenanayake/APSIM-eri-mahuika/issues/31