search

yunojuno / django-juno-testrunner

A more useful (and slightly more glamorous) test runner for Django 1.6+ from the folks at YunoJuno
MIT License
7 stars 9 forks source link

Idea: order test results, inc by test size or traceback height #7

Open wodow opened 10 years ago

wodow commented 10 years ago

In a large codebase, a breaking change can cause many tests to fail.

To help find a root cause, it might be useful to sort test failures heuristically:

(a) length of tests (number of non-comment lines?) - the simpler the test the more likely it covers the root cause specifically, or (b) depths/heights of traceback - shorter the call depth the closer to the root cause.

stevejalim commented 10 years ago

Nice idea!

stevejalim commented 10 years ago

We should make this behaviour configurable, though. Least surprise and all that.

wodow commented 10 years ago

Any idea if any other tools do that? I bet they do.

stevejalim commented 10 years ago

Nose probably does. People keep telling me nose does everything that junorunner does, already. (Not 100% true, IIRC).

FWIW, nose wouldn't, I imagine, inherit/extend other DiscoverRunner implementations the way junorunner can.