search

Test-More / Test2-Harness

Alternative to Test::Harness
Other
23 stars 26 forks source link

Allow unsorted tests #217

Open ylavoie opened 3 years ago

ylavoie commented 3 years ago

yath sorts test files before testing.

There should be a way to either shuffle the selected tests or follow the order provided in the argument list.

exodist commented 3 years ago

I will look into this when I have a chance. The problem here is that yath was built around running tests concurrently, with tests re-ordered (when possible) so that the slowest run first on N-1 of the concurrency slots, in order to avoid running a single super long tests at the end with other slots being empty. So while your request is totally reasonable, the test-reordering design may make it difficult as things were built with the assumption that test order could be altered at any time, and thus the order is assumed unimportant in many places.

If there is an easy way to fix this I will do it.