Fail early on regression tests?

mrc-ide / covid-sim

This is the COVID-19 CovidSim microsimulation model developed by the MRC Centre for Global Infectious Disease Analysis hosted at Imperial College, London.

GNU General Public License v3.0

1.23k stars 257 forks source link

Fail early on regression tests? #452

Closed zebmason closed 3 years ago

zebmason commented 3 years ago

The unit and regression tests have just been split from one another. If I remember rightly this means that ctest is always used to run the tests and that it is possible to get the tests to stop on the first failed test.

If there is any interest I'll get the regression tests to stop on the first failed test - the unit tests will all run pass or fail.

weshinsley commented 3 years ago

Yes, I think that would be good - I was wondering if that might be possible, since unit tests are likely to fail (or indeed, succeed) faster than the regression tests...