Open gopherbot opened 1 year ago
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "misc/cgo/testsanitizers" && test == "TestMSAN"
This seems likely to be the same root cause as #59419.
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "misc/cgo/testsanitizers" && `exited with signal: segmentation fault`
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "misc/cgo/testsanitizers" && `exited with signal: segmentation fault`
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "misc/cgo/testsanitizers" && (`exited with signal: segmentation fault` || `exited with exit status 66`)
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "misc/cgo/testsanitizers" && (`exited with signal: segmentation fault` || `exited with exit status 66`)
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "misc/cgo/testsanitizers" && (`exited with signal: segmentation fault` || `exited with exit status 66`)
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "misc/cgo/testsanitizers" && (`exited with signal: segmentation fault` || `exited with exit status 66`)
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "misc/cgo/testsanitizers" && (`exited with signal: segmentation fault` || `exited with exit status 66`)
I believe this is resolved as of https://go.dev/cl/482195.
Just to write this down somewhere, it seems like a Linux kernel upgrade was the culprit. The aforementioned CL just pinned the container-optimized OS version we use to the previous LTS release.
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "misc/cgo/testsanitizers" && (`exited with signal: segmentation fault` || `exited with exit status 66`)
I started redeploying at 17:25 EST, so presumably these are old failures that just got picked up.
cos-101-lts
is gone now and we were forced to upgrade. These failures are now back.
This seems related to https://github.com/google/sanitizers/issues/1716, although I'm not sure if the kernel we upgraded to is quite that new.
Assuming that is the problem, we have a few options to move forward:
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "cmd/cgo/internal/testsanitizers" && (`exited with signal: segmentation fault` || `exited with exit status 66`)
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "cmd/cgo/internal/testsanitizers" && (`exited with signal: segmentation fault` || `exited with exit status 66`)
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "cmd/cgo/internal/testsanitizers" && (`exited with signal: segmentation fault` || `exited with exit status 66`)
Change https://go.dev/cl/623956 mentions this issue: cmd/cgo/internal/testsanitizers: disable ASLR for TSAN tests
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "cmd/cgo/internal/testsanitizers" && (`exited with signal: segmentation fault` || `exited with exit status 66`)
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "cmd/cgo/internal/testsanitizers" && (`exited with signal: segmentation fault` || `exited with exit status 66`)
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "cmd/cgo/internal/testsanitizers" && (`exited with signal: segmentation fault` || `exited with exit status 66`)
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "cmd/cgo/internal/testsanitizers" && (`exited with signal: segmentation fault` || `exited with exit status 66`)
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "cmd/cgo/internal/testsanitizers" && (`exited with signal: segmentation fault` || `exited with exit status 66`)
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "cmd/cgo/internal/testsanitizers" && (`exited with signal: segmentation fault` || `exited with exit status 66`)
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "cmd/cgo/internal/testsanitizers" && (`exited with signal: segmentation fault` || `exited with exit status 66`)
Issue created automatically to collect these failures.
Example (log):
— watchflakes