onflow / atree

Atree provides scalable arrays and scalable ordered maps.
https://onflow.org
Apache License 2.0
40 stars 16 forks source link

investigate flaky test #209

Closed fxamacker closed 2 years ago

fxamacker commented 2 years ago

Description

Investigate flaky test TestMapIterate/collision


fxamacker commented 2 years ago

After updating to the latest commit of stretchr/testify, the timeout hasn't resurfaced after 75 runs (25 x 3 versions of Go on Ubuntu) using the same seed that was previously able to cause one timeout every 3 or 6 runs.

With testify updated, 25 x 6 configs (150 runs) on GitHub ran successfully without a single timeout.

The seed for prng used time.Now().UnixNano().

However, there's a chance the problem was/is caused by a GitHub issue that has been resolved because the timeout no longer reproduces on GitHub using prior commits that failed every 3-6 runs.