Closed rsc closed 1 year ago
Found new matching flaky dashboard failures.
Sorry, but there were parse errors in the watchflakes script. The script I found was:
#!watchflakes
post <- goos == "openbsd" && `runtime.throw` || `Test ".*" ran over .* limit` ||
And the problems were:
script:3.1: unexpected end of script
Found new matching flaky dashboard failures for:
#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit`)
Found new matching flaky dashboard failures for:
#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit`)
Updated pattern to match panic test timed out.
Found new dashboard test flakes for:
#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
Because #34988 is still open these memory corruption issues are difficult to detangle from these being real runtime issues (vs. fork corruption).
@golang/openbsd Can you please take a look at these and let us know what you think?
Found new dashboard test flakes for:
#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
Found new dashboard test flakes for:
#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
Found new dashboard test flakes for:
#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
Found new dashboard test flakes for:
#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
@golang/openbsd, is anyone looking into this issue? It seems to affect all OpenBSD builders and TryBots to at least some extent.
Found new dashboard test flakes for:
#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
I'll do some poking - Is the process of adding build servers documented anywhere? 6.8 and 7.0 are both pretty old at this point (7.2 and 7.1 are the official OpenBSD supported releases atm), might not be worth tracking down issues on older releases that won't see fixes anyway (if it's an OpenBSD problem)
@qbit, see https://cs.opensource.google/go/x/build/+/master:env/openbsd-amd64/README. You'll likely need someone on @golang/release to help with deployment.
(The last OpenBSD builder upgrade was #48977.)
Found new dashboard test flakes for:
#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
Found new dashboard test flakes for:
#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
Found new dashboard test flakes for:
#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
Found new dashboard test flakes for:
#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
I have updates to the build script working. I will submit a PR for it here pretty quick (testing my doc changes).
Found new dashboard test flakes for:
#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
Found new dashboard test flakes for:
#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
Found new dashboard test flakes for:
#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
Change https://go.dev/cl/456295 mentions this issue: env,dashboard: add OpenBSD 7.1 and 7.2
Found new dashboard test flakes for:
#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
Found new dashboard test flakes for:
#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
Found new dashboard test flakes for:
#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
Found new dashboard test flakes for:
#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
The failures on the -71
builders appear to be mostly (or entirely?) systematic deadlocks, tracked separately in #57585.
Found new dashboard test flakes for:
#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
Found new dashboard test flakes for:
#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
@4a6f656c, openbsd-arm64-jsing
is the only one in that recent update that is not explained by #57585.
Found new dashboard test flakes for:
#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
Found new dashboard test flakes for:
#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
Found new dashboard test flakes for:
#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
Found new dashboard test flakes for:
#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
Found new dashboard test flakes for:
#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
Found new dashboard test flakes for:
#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
Found new dashboard test flakes for:
#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
Found new dashboard test flakes for:
#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
Found new dashboard test flakes for:
#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
Found new dashboard test flakes for:
#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
Found new dashboard test flakes for:
#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
Found new dashboard test flakes for:
#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
Found new dashboard test flakes for:
#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
Found new dashboard test flakes for:
#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
Found new dashboard test flakes for:
#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
Found new dashboard test flakes for:
#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
OpenBSD has been seeing a steady stream of what looks like memory corruption resulting in runtime throws.