When comparing to reference files, now only logfiles and the new precice-output will be considered.
To accomodate for the changed output, other adjustments have been made to several scripts:
The systemtesting.py script will deliberately ingore ...-events-summary.log and ldd.log files when starting a file comparison. This is done with a list of regex patterns which can be adjusted in the future.
The comparison bash script now checks if a numeric value is sufficiently large before attempting to compare. Currently, the threshold is set to 10E-12, values below that will be assumed to be zero and thus ignored.
Closes #252 .
This PR adjusts the output of all tests. Every participant now produces an additional output folder
precice-outputcontaining coupling data (see in https://github.com/precice/precice/wiki/Exports-Configuration).When comparing to reference files, now only logfiles and the new
precice-outputwill be considered. To accomodate for the changed output, other adjustments have been made to several scripts:The systemtesting.py script will deliberately ingore
...-events-summary.logandldd.logfiles when starting a file comparison. This is done with a list of regex patterns which can be adjusted in the future. The comparison bash script now checks if a numeric value is sufficiently large before attempting to compare. Currently, the threshold is set to 10E-12, values below that will be assumed to be zero and thus ignored.