redding / assert

Assertion style testing framework.
https://github.com/redding/assert
MIT License
10 stars 1 forks source link

random test running not so random... #19

Closed kellyredding closed 13 years ago

kellyredding commented 13 years ago

uhh, fix this.

jcredding commented 13 years ago

Not sure what's changed, but in my testing right now, this is working perfectly.

I set a single test to fail and ran rake test multiple times (5+) and the red F jumped around appropriately. I also confirmed the random ordering of the tests by writing out the tests collection after it was randomly sorted to a file. I then compared these files and saw they were randomizing their order appropriately.

Also checked minitest and this is basically the same algorithm, except you update the seed each time the suite is run, which I didn't see them doing. Gonna close for now.