search

StuntsPT / Structure_threader

A wrapper program to parallelize and automate runs of "Structure", "fastStructure" and "MavericK".
GNU General Public License v3.0
24 stars 11 forks source link

Improve field tests to try more parameter variations #61

Closed StuntsPT closed 7 years ago

StuntsPT commented 7 years ago

The "field tests" in our test suite are very static in the parameters they use, and therefore some bugs may fall through the cracks, as was pointed out by @bobverity during the review process. I propose that field tests have a few variant runs, and not always the same run. In order not to overload the CI server, I would suggest we use set up several different runs for each wrapped program and randomize which parameter set gets run on each CI run. Thoughts?

StuntsPT commented 7 years ago

This as addressed instead by thoroughly improving the test suite for the external program wrappers, which was done during the latest changes to the code (compartmentalizing and testing each unit).