xcompact3d / x3d2

https://xcompact3d.github.io/x3d2
BSD 3-Clause "New" or "Revised" License
3 stars 4 forks source link

Separate verification from performance tests #119

Open Nanoseb opened 3 months ago

Nanoseb commented 3 months ago

Right now, tests both check the performance by computing BW, timing, running the same test n_iter times, as well as the accuracy of the solution by comparing the results to a known analytical solution.

Even if the implementation of the test is similar, the two type of tests require different input parameters. i.e. no need to run the same computation 1000 times to check its accuracy and performance tests require larger meshes for example.

Several options could be used:

Any other option to consider? @pbartholomew08 @semi-h

Nanoseb commented 3 months ago

(I think I'd vote for an environment variable as that's the easiest to handle and use in this kind of scenario)