design to make the errors/stack traces less confusing and overwhelming - Githubissues

tarpas / pytest-testmon

Selects tests affected by changed files. Executes the right tests first. Continuous test runner when used with pytest-watch.

https://testmon.org

MIT License

823 stars 55 forks source link

design to make the errors/stack traces less confusing and overwhelming #148

Closed tarpas closed 1 year ago

tarpas commented 4 years ago

We have to avoid printing loads of failure reports because it's overwhelming. This is a general problem with any test runner, but we must not make it worse with testmon. At the moment testmon caches and reports all of the failures. Even when nothing is changed all of the reports are reported again (from cache).

My plan so far is:

Add all the FAIL/ERROR tests at the end of execution queue after "unstable" tests, even though they are "stable".
make -x default, so that after the first failure, the execution stops

fyi @blueyed re #135

tarpas commented 1 year ago

A lot of new functionality in v1.4.0. Let's see how ti affects usability.