Codeception / robo-paracept

Robo tasks for Codeception tests parallel execution
MIT License
57 stars 59 forks source link

Force SplitTestFilesByGroupsTask to sort files by name #43

Closed bboure closed 4 years ago

bboure commented 6 years ago

We are running our tests in CircleCi in 2 containers. We split our tests in different groups and run half of the groups in one container and the other half in the other. For some reason (that I still haven't figured out), Finder was returning the files in a different order in each container. As a result, groups were different in each container and some tests were running twice (and probably some tests were not running at all). Forcing sorting the files by name solves the issue.

bboure commented 6 years ago

@DavertMik Can we get a feedback on this ? Thank you