search

vincent-hugot / qtest

Inline (Unit) Tests for OCaml
GNU General Public License v3.0
67 stars 8 forks source link

feature request: non critical test #56

Open UnixJunkie opened 4 years ago

UnixJunkie commented 4 years ago

I.e. the ability to declare a test as non critical if failing. A warning could be generated and printed out, but the test suite should not fail just because of such test failing.

The long story, some users ran the batteries test suite on an overloaded computer, then complained that some of the tests fail in that situation...

c-cube commented 4 years ago

what would the test do, then? emit a warning?

I'm on the fence judging whether this is PEBKAC or a good idea.

UnixJunkie commented 4 years ago

Yes, just log a warning. This is not a "PEBKAC". Just a feature request. If some other people find it useful, then it might be. If not, then not (and dump it).

c-cube commented 4 years ago

I mean, about the person who tried to run the tests on an overloaded machine. I'd merge a PR for that but right now I have other things to do…