search

YahooArchive / arrow

FE Test framework designed to promote TDD
http://yahoo.github.io/arrow/arrow_intro.html
BSD 3-Clause "New" or "Revised" License
55 stars 59 forks source link

Repeatedly executing a smoke test scenario #23

Closed lalau closed 12 years ago

lalau commented 12 years ago

One thing I want to add to the arrow command line is the ability to execute a smoke test scenario repeatedly for a specified number of times, say 100. We collect test result each time and report on how many times it fails. It would be useful to see if the feature is stable or the test setup itself is stable. Sometimes I write a test and it pass locally for once or twice but after checking in the code, it would pass and fail intermittently. If I can simulate the repeated testing in the pipeline environment locally, it would increase my confidence that my test and the feature is stable. What do you think about this? It would be something like "--repeat=100".

proverma commented 12 years ago

@ktslwy can we do this through some shell script outside arrow ? this does not add any feature, and sounds more like a test. Thoughts ?