Ensure ordered traversals to avoid CI flakiness

googleapis / sample-tester

Tool for testing semantically equivalent samples in multiple languages and environments

Apache License 2.0

10 stars 12 forks source link

Closed vchudnov-g closed 5 years ago

vchudnov-g commented 5 years ago

CI runs have been failing more often because of apparently non-deterministic order. See https://circleci.com/gh/vchudnov-g/sample-tester/241 for example. We should

use OrderedDict , at least until we can locally require python 3.7 (where dict ordering is mandated)
deterministically order lists, such as file traversals