search

precice / aste

Artificial Solver Testing Environment
https://precice.org/tooling-aste.html
GNU General Public License v3.0
10 stars 12 forks source link

Test mapping-tester output in CI #208

Open fsimonis opened 1 month ago

fsimonis commented 1 month ago

The mapping-tester uses the precice-profiling tool of the precice installation to extract runtime information about the executed mapping.

While we currently test the case generation and execution of the mapping-tester in the CI, we don't test the gathered stats for correctness.

It can easily happen that we end up with invalid data https://github.com/precice/aste/pull/207#issuecomment-2437299079

We need a way to test the output of gatherstats.py

davidscn commented 1 month ago

... this would not only apply for the runtimes, but also to test the correctness (error) of the performed mappings as such.