JuliaTesting / ReferenceTests.jl

Utility package for comparing data against reference files
https://juliatesting.github.io/ReferenceTests.jl/latest/
Other
82 stars 14 forks source link

Fail test instead of erroring out when not interactive or updating #131

Open moble opened 3 months ago

moble commented 3 months ago

Admittedly, I don't understand all the subtleties of how people want these tests to work, so maybe this won't work for others. But for me, when a test fails in non-interactive non-updating mode, I still want to see all of the failures rather than just getting the whole testing framework to error out.

moble commented 3 months ago

Of course, a lot of the tests rely on an error being thrown, rather than just test failure... I'll need some guidance.