runtime: flaky corruption on openbsd

[rsc]

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out` || `fatal error: all goroutines are asleep`) && !(log ~ `unexpected fault address 0x349dc4`) && date < "2023-08-01"

OpenBSD has been seeing a steady stream of what looks like memory corruption resulting in runtime throws.

[gopherbot]

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)

2023-04-13 17:46 openbsd-arm64-jsing go@74c296b6 os/signal (log)

unexpected fault address 0x349dc4 fatal error: fault [signal SIGSEGV: segmentation violation code=0x2 addr=0x349dc4 pc=0x349c04] goroutine 1 [running]: runtime.throw({0x239a93?, 0x40000021a0?}) /home/gopher/build/go/src/runtime/panic.go:1076 +0x40 fp=0x400004b800 sp=0x400004b7d0 pc=0x35ee30 runtime.sigpanic() /home/gopher/build/go/src/runtime/signal_unix.go:866 +0x22c fp=0x400004b860 sp=0x400004b800 pc=0x37600c runtime.(*gcControllerState).startCycle(0x246b30?, 0x336064?, 0x400004b928?, {0x336078?, 0x400004b918?, 0x34aca0?}) ... testing.runTests(0x40001060a0?, {0x46a580, 0x13, 0x13}, {0x40000609c0?, 0x40?, 0x46e2c0?}) /home/gopher/build/go/src/testing/testing.go:2053 +0x3b4 fp=0x400004bc90 sp=0x400004bb90 pc=0x3ed594 testing.(*M).Run(0x40001060a0) /home/gopher/build/go/src/testing/testing.go:1925 +0x534 fp=0x400004bee0 sp=0x400004bc90 pc=0x3ec2b4 main.main() _testmain.go:87 +0x1a8 fp=0x400004bf70 sp=0x400004bee0 pc=0x42f808 runtime.main() /home/gopher/build/go/src/runtime/proc.go:261 +0x21c fp=0x400004bfd0 sp=0x400004bf70 pc=0x36146c runtime.goexit() /home/gopher/build/go/src/runtime/asm_arm64.s:1196 +0x4 fp=0x400004bfd0 sp=0x400004bfd0 pc=0x393514

— watchflakes

[gopherbot]

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)

2023-04-13 15:29 openbsd-arm64-jsing go@3f747d09 os/signal.TestDetectNohup (log)

unexpected fault address 0x349dc4 fatal error: fault [signal SIGSEGV: segmentation violation code=0x2 addr=0x349dc4 pc=0x349c04] runtime.throw({0x239a93?, 0x400011a4e0?}) /home/gopher/build/go/src/runtime/panic.go:1076 +0x40 fp=0x400004cad0 sp=0x400004caa0 pc=0x35ee30 runtime.sigpanic() /home/gopher/build/go/src/runtime/signal_unix.go:866 +0x22c fp=0x400004cb30 sp=0x400004cad0 pc=0x37600c runtime.(*gcControllerState).startCycle(0x246b30?, 0x336064?, 0x400004cbf8?, {0x336078?, 0x400004cbe8?, 0x34aca0?}) /home/gopher/build/go/src/runtime/mgcpacer.go:423 +0x144 fp=0x400004cba0 sp=0x400004cb40 pc=0x349c04 runtime.gcStart({0x0?, 0x0?, 0x0?}) /home/gopher/build/go/src/runtime/mgc.go:678 +0x3bc fp=0x400004cc50 sp=0x400004cba0 pc=0x34319c runtime.mallocgc(0x90, 0x233040, 0x1) /home/gopher/build/go/src/runtime/malloc.go:1175 +0x7a0 fp=0x400004ccc0 sp=0x400004cc50 pc=0x336960 runtime.newobject(0x4000096090?) /home/gopher/build/go/src/runtime/malloc.go:1257 +0x2c fp=0x400004ccf0 sp=0x400004ccc0 pc=0x336b8c os.(*Process).wait(0x40000c0000) /home/gopher/build/go/src/os/exec_unix.go:38 +0x38 fp=0x400004cd50 sp=0x400004ccf0 pc=0x3b29c8 os.(*Process).Wait(...) /home/gopher/build/go/src/os/exec.go:132 os/exec.(*Cmd).Wait(0x40000aa000) /home/gopher/build/go/src/os/exec/exec.go:890 +0x38 fp=0x400004cdc0 sp=0x400004cd50 pc=0x3f4ab8 os/exec.(*Cmd).Run(0x400004ced0?) /home/gopher/build/go/src/os/exec/exec.go:590 +0x38 fp=0x400004cde0 sp=0x400004cdc0 pc=0x3f3a98 os/exec.(*Cmd).CombinedOutput(0x40000aa000) /home/gopher/build/go/src/os/exec/exec.go:1005 +0x98 fp=0x400004ce10 sp=0x400004cde0 pc=0x3f50b8 os/signal.TestDetectNohup(0x4000184680) /home/gopher/build/go/src/os/signal/signal_test.go:307 +0x18c fp=0x400004cf60 sp=0x400004ce10 pc=0x3fa7cc testing.tRunner(0x4000184680, 0x2468f8)

— watchflakes

[gopherbot]

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)

2023-04-13 15:25 openbsd-arm64-jsing go@eed0cda4 os/signal (log)

unexpected fault address 0x349dc4 fatal error: fault [signal SIGSEGV: segmentation violation code=0x2 addr=0x349dc4 pc=0x349c04] goroutine 1 [running]: runtime.throw({0x239a93?, 0x40000021a0?}) /home/gopher/build/go/src/runtime/panic.go:1076 +0x40 fp=0x400004b800 sp=0x400004b7d0 pc=0x35ee30 runtime.sigpanic() /home/gopher/build/go/src/runtime/signal_unix.go:866 +0x22c fp=0x400004b860 sp=0x400004b800 pc=0x37600c runtime.(*gcControllerState).startCycle(0x246b30?, 0x336064?, 0x400004b928?, {0x336078?, 0x400004b918?, 0x34aca0?}) ... testing.runTests(0x40001060a0?, {0x46a580, 0x13, 0x13}, {0x40000609c0?, 0x40?, 0x46e2c0?}) /home/gopher/build/go/src/testing/testing.go:2053 +0x3b4 fp=0x400004bc90 sp=0x400004bb90 pc=0x3ed594 testing.(*M).Run(0x40001060a0) /home/gopher/build/go/src/testing/testing.go:1925 +0x534 fp=0x400004bee0 sp=0x400004bc90 pc=0x3ec2b4 main.main() _testmain.go:87 +0x1a8 fp=0x400004bf70 sp=0x400004bee0 pc=0x42f808 runtime.main() /home/gopher/build/go/src/runtime/proc.go:261 +0x21c fp=0x400004bfd0 sp=0x400004bf70 pc=0x36146c runtime.goexit() /home/gopher/build/go/src/runtime/asm_arm64.s:1196 +0x4 fp=0x400004bfd0 sp=0x400004bfd0 pc=0x393514

— watchflakes

[gopherbot]

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)

2023-04-12 20:33 openbsd-arm64-jsing go@f3e6f0f2 os/signal (log)

unexpected fault address 0x349dc4 fatal error: fault [signal SIGSEGV: segmentation violation code=0x2 addr=0x349dc4 pc=0x349c04] goroutine 1 [running]: runtime.throw({0x239a93?, 0x40000021a0?}) /home/gopher/build/go/src/runtime/panic.go:1076 +0x40 fp=0x400004b800 sp=0x400004b7d0 pc=0x35ee30 runtime.sigpanic() /home/gopher/build/go/src/runtime/signal_unix.go:866 +0x22c fp=0x400004b860 sp=0x400004b800 pc=0x37600c runtime.(*gcControllerState).startCycle(0x246b30?, 0x336064?, 0x400004b928?, {0x336078?, 0x400004b918?, 0x34aca0?}) ... testing.runTests(0x40001060a0?, {0x46a580, 0x13, 0x13}, {0x40000609c0?, 0x40?, 0x46e2c0?}) /home/gopher/build/go/src/testing/testing.go:2053 +0x3b4 fp=0x400004bc90 sp=0x400004bb90 pc=0x3ed594 testing.(*M).Run(0x40001060a0) /home/gopher/build/go/src/testing/testing.go:1925 +0x534 fp=0x400004bee0 sp=0x400004bc90 pc=0x3ec2b4 main.main() _testmain.go:87 +0x1a8 fp=0x400004bf70 sp=0x400004bee0 pc=0x42f808 runtime.main() /home/gopher/build/go/src/runtime/proc.go:261 +0x21c fp=0x400004bfd0 sp=0x400004bf70 pc=0x36146c runtime.goexit() /home/gopher/build/go/src/runtime/asm_arm64.s:1196 +0x4 fp=0x400004bfd0 sp=0x400004bfd0 pc=0x393514

— watchflakes

[gopherbot]

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)

2023-04-12 20:33 openbsd-arm64-jsing go@d528f72d os/signal (log)

unexpected fault address 0x349dc4 fatal error: fault [signal SIGSEGV: segmentation violation code=0x2 addr=0x349dc4 pc=0x349c04] goroutine 34 [running]: runtime.throw({0x239a93?, 0x400011a4e0?}) /home/gopher/build/go/src/runtime/panic.go:1076 +0x40 fp=0x400004cb00 sp=0x400004cad0 pc=0x35ee30 runtime.sigpanic() /home/gopher/build/go/src/runtime/signal_unix.go:866 +0x22c fp=0x400004cb60 sp=0x400004cb00 pc=0x37600c runtime.(*gcControllerState).startCycle(0x246b30?, 0x336064?, 0x400004cc28?, {0x336078?, 0x400004cc18?, 0x34aca0?}) ... testing.tRunner.func1() /home/gopher/build/go/src/testing/testing.go:1586 +0x414 fp=0x400004cf60 sp=0x400004cdf0 pc=0x3eb0c4 testing.tRunner(0x4000224000, 0x246970) /home/gopher/build/go/src/testing/testing.go:1601 +0x124 fp=0x400004cfb0 sp=0x400004cf60 pc=0x3eac24 testing.(*T).Run.func1() /home/gopher/build/go/src/testing/testing.go:1648 +0x2c fp=0x400004cfd0 sp=0x400004cfb0 pc=0x3eb9fc runtime.goexit() /home/gopher/build/go/src/runtime/asm_arm64.s:1196 +0x4 fp=0x400004cfd0 sp=0x400004cfd0 pc=0x393514 created by testing.(*T).Run in goroutine 1 /home/gopher/build/go/src/testing/testing.go:1648 +0x33c

— watchflakes

[gopherbot]

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)

2023-04-12 20:06 openbsd-arm64-jsing go@b3a194aa os/signal.TestDetectNohup (log)

unexpected fault address 0x349dc4 fatal error: fault [signal SIGSEGV: segmentation violation code=0x2 addr=0x349dc4 pc=0x349c04] runtime.throw({0x239a93?, 0x4000106d00?}) /home/gopher/build/go/src/runtime/panic.go:1076 +0x40 fp=0x4000047740 sp=0x4000047710 pc=0x35ee30 runtime.sigpanic() /home/gopher/build/go/src/runtime/signal_unix.go:866 +0x22c fp=0x40000477a0 sp=0x4000047740 pc=0x37600c runtime.(*gcControllerState).startCycle(0x246b30?, 0x336064?, 0x4000047868?, {0x336078?, 0x4000047858?, 0x34aca0?}) /home/gopher/build/go/src/runtime/mgcpacer.go:423 +0x144 fp=0x4000047810 sp=0x40000477b0 pc=0x349c04 ... /home/gopher/build/go/src/os/exec.go:109 +0x50 fp=0x4000047c40 sp=0x4000047bf0 pc=0x3b2380 os/exec.(*Cmd).Start(0x400015e000) /home/gopher/build/go/src/os/exec/exec.go:693 +0x4a0 fp=0x4000047dc0 sp=0x4000047c40 pc=0x3f3f60 os/exec.(*Cmd).Run(0x4000047ed0?) /home/gopher/build/go/src/os/exec/exec.go:587 +0x20 fp=0x4000047de0 sp=0x4000047dc0 pc=0x3f3a80 os/exec.(*Cmd).CombinedOutput(0x400015e000) /home/gopher/build/go/src/os/exec/exec.go:1005 +0x98 fp=0x4000047e10 sp=0x4000047de0 pc=0x3f50b8 os/signal.TestDetectNohup(0x4000082680) /home/gopher/build/go/src/os/signal/signal_test.go:307 +0x18c fp=0x4000047f60 sp=0x4000047e10 pc=0x3fa7cc testing.tRunner(0x4000082680, 0x2468f8)

— watchflakes

[gopherbot]

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)

2023-04-12 16:04 openbsd-arm64-jsing go@d91d8325 os/signal.test.TestReset [build] (log)

go.go(/home/gopher/build/tmp/go-link-2743407894/go.o:(syscall.libc_syscall_trampoline.abi0)): warning: syscall() may go away, please rewrite code to use direct calls unexpected fault address 0x349b64 fatal error: fault [signal SIGSEGV: segmentation violation code=0x2 addr=0x349b64 pc=0x3499a4] runtime.throw({0x239a73?, 0x400011a4e0?}) /home/gopher/build/go/src/runtime/panic.go:1076 +0x40 fp=0x400004cb70 sp=0x400004cb40 pc=0x35ebd0 runtime.sigpanic() /home/gopher/build/go/src/runtime/signal_unix.go:866 +0x22c fp=0x400004cbd0 sp=0x400004cb70 pc=0x375dac runtime.(*gcControllerState).startCycle(0x246b08?, 0x335e04?, 0x400004cc98?, {0x335e18?, 0x400004cc88?, 0x34aa40?}) /home/gopher/build/go/src/runtime/mgcpacer.go:423 +0x144 fp=0x400004cc40 sp=0x400004cbe0 pc=0x3499a4 runtime.gcStart({0x4e16a2a68?, 0xf?, 0x2fe65c08?}) /home/gopher/build/go/src/runtime/mgc.go:678 +0x3bc fp=0x400004ccf0 sp=0x400004cc40 pc=0x342f3c runtime.mallocgc(0x50, 0x227e60, 0x1) /home/gopher/build/go/src/runtime/malloc.go:1175 +0x7a0 fp=0x400004cd60 sp=0x400004ccf0 pc=0x336700 runtime.newobject(...) /home/gopher/build/go/src/runtime/malloc.go:1257 runtime.mapassign_fast64(0x217500, 0x4000198060, 0x3f92e0) /home/gopher/build/go/src/runtime/map_fast64.go:110 +0x90 fp=0x400004cda0 sp=0x400004cd60 pc=0x33a6b0 testing.(*common).Helper(0x4000083040) /home/gopher/build/go/src/testing/testing.go:1140 +0xe0 fp=0x400004ce00 sp=0x400004cda0 pc=0x3e9ab0 os/signal.waitSig(0x4000083040, 0x400004ced8?, {0x26bc30, 0x26ac00}) /home/gopher/build/go/src/os/signal/signal_test.go:67 +0x30 fp=0x400004ce40 sp=0x400004ce00 pc=0x3f92e0 os/signal.testCancel(0x4000083040, 0x0) /home/gopher/build/go/src/os/signal/signal_test.go:210 +0x12c fp=0x400004cf40 sp=0x400004ce40 pc=0x3f9efc os/signal.TestReset(0x0?) /home/gopher/build/go/src/os/signal/signal_test.go:261 +0x20 fp=0x400004cf60 sp=0x400004cf40 pc=0x3fa230 testing.tRunner(0x4000083040, 0x246920)

— watchflakes

[gopherbot]

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)

2023-04-12 15:45 openbsd-arm64-jsing go@b7428b7c os/signal.TestIgnore (log)

unexpected fault address 0x349b64 fatal error: fault [signal SIGSEGV: segmentation violation code=0x2 addr=0x349b64 pc=0x3499a4] runtime.throw({0x239a73?, 0x4000083040?}) /home/gopher/build/go/src/runtime/panic.go:1076 +0x40 fp=0x4000047ba0 sp=0x4000047b70 pc=0x35ebd0 runtime.sigpanic() /home/gopher/build/go/src/runtime/signal_unix.go:866 +0x22c fp=0x4000047c00 sp=0x4000047ba0 pc=0x375dac runtime.(*gcControllerState).startCycle(0x246b08?, 0x335e04?, 0x4000047cc8?, {0x335e18?, 0x4000047cb8?, 0x34aa40?}) /home/gopher/build/go/src/runtime/mgcpacer.go:423 +0x144 fp=0x4000047c70 sp=0x4000047c10 pc=0x3499a4 runtime.gcStart({0x465872f18?, 0x400003d005?, 0x47d88?}) /home/gopher/build/go/src/runtime/mgc.go:678 +0x3bc fp=0x4000047d20 sp=0x4000047c70 pc=0x342f3c runtime.mallocgc(0xc, 0x21bb40, 0x1) /home/gopher/build/go/src/runtime/malloc.go:1175 +0x7a0 fp=0x4000047d90 sp=0x4000047d20 pc=0x336700 runtime.newobject(0x689374b5?) /home/gopher/build/go/src/runtime/malloc.go:1257 +0x2c fp=0x4000047dc0 sp=0x4000047d90 pc=0x33692c os/signal.Notify(0x40000621e0, {0x4000047ed8, 0x1, 0x2699d0?}) /home/gopher/build/go/src/os/signal/signal.go:134 +0x13c fp=0x4000047e40 sp=0x4000047dc0 pc=0x3f7f7c os/signal.testCancel(0x4000186680, 0x1) /home/gopher/build/go/src/os/signal/signal_test.go:254 +0x2ec fp=0x4000047f40 sp=0x4000047e40 pc=0x3fa0bc os/signal.TestIgnore(0x0?) /home/gopher/build/go/src/os/signal/signal_test.go:266 +0x20 fp=0x4000047f60 sp=0x4000047f40 pc=0x3fa270 testing.tRunner(0x4000186680, 0x2468e0)

— watchflakes

[gopherbot]

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)

2023-04-11 20:56 openbsd-arm64-jsing go@319b75ed os/signal.test.TestDetectNohup [build] (log)

go.go(/home/gopher/build/tmp/go-link-3270113097/go.o:(syscall.libc_syscall_trampoline.abi0)): warning: syscall() may go away, please rewrite code to use direct calls unexpected fault address 0x349b64 fatal error: fault [signal SIGSEGV: segmentation violation code=0x2 addr=0x349b64 pc=0x3499a4] runtime.throw({0x239a73?, 0x400011a4e0?}) /home/gopher/build/go/src/runtime/panic.go:1076 +0x40 fp=0x400004c7a0 sp=0x400004c770 pc=0x35ebd0 runtime.sigpanic() /home/gopher/build/go/src/runtime/signal_unix.go:866 +0x22c fp=0x400004c800 sp=0x400004c7a0 pc=0x375dac runtime.(*gcControllerState).startCycle(0x246b08?, 0x335e04?, 0x400004c8c8?, {0x335e18?, 0x400004c8b8?, 0x34aa40?}) ... /home/gopher/build/go/src/os/exec/exec.go:1196 +0x174 fp=0x400004cc40 sp=0x400004cbb0 pc=0x3f50c4 os/exec.(*Cmd).Start(0x40000c4000) /home/gopher/build/go/src/os/exec/exec.go:688 +0x3fc fp=0x400004cdc0 sp=0x400004cc40 pc=0x3f3c5c os/exec.(*Cmd).Run(0x400004ced0?) /home/gopher/build/go/src/os/exec/exec.go:587 +0x20 fp=0x400004cde0 sp=0x400004cdc0 pc=0x3f3820 os/exec.(*Cmd).CombinedOutput(0x40000c4000) /home/gopher/build/go/src/os/exec/exec.go:1005 +0x98 fp=0x400004ce10 sp=0x400004cde0 pc=0x3f4e58 os/signal.TestDetectNohup(0x400011ad00) /home/gopher/build/go/src/os/signal/signal_test.go:307 +0x18c fp=0x400004cf60 sp=0x400004ce10 pc=0x3fa56c testing.tRunner(0x400011ad00, 0x2468d0)

— watchflakes

[gopherbot]

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)

2023-04-11 20:56 openbsd-arm64-jsing go@f7f0d395 os/signal.test.TestReset [build] (log)

go.go(/home/gopher/build/tmp/go-link-3860712551/go.o:(syscall.libc_syscall_trampoline.abi0)): warning: syscall() may go away, please rewrite code to use direct calls unexpected fault address 0x349b64 fatal error: fault [signal SIGSEGV: segmentation violation code=0x2 addr=0x349b64 pc=0x3499a4] runtime.throw({0x239a73?, 0x400011a4e0?}) /home/gopher/build/go/src/runtime/panic.go:1076 +0x40 fp=0x400004cb70 sp=0x400004cb40 pc=0x35ebd0 runtime.sigpanic() /home/gopher/build/go/src/runtime/signal_unix.go:866 +0x22c fp=0x400004cbd0 sp=0x400004cb70 pc=0x375dac runtime.(*gcControllerState).startCycle(0x246b08?, 0x335e04?, 0x400004cc98?, {0x335e18?, 0x400004cc88?, 0x34aa40?}) /home/gopher/build/go/src/runtime/mgcpacer.go:423 +0x144 fp=0x400004cc40 sp=0x400004cbe0 pc=0x3499a4 runtime.gcStart({0x452d01f18?, 0x3000000100000f?, 0xa3dcf448?}) /home/gopher/build/go/src/runtime/mgc.go:678 +0x3bc fp=0x400004ccf0 sp=0x400004cc40 pc=0x342f3c runtime.mallocgc(0x50, 0x227e60, 0x1) /home/gopher/build/go/src/runtime/malloc.go:1175 +0x7a0 fp=0x400004cd60 sp=0x400004ccf0 pc=0x336700 runtime.newobject(...) /home/gopher/build/go/src/runtime/malloc.go:1257 runtime.mapassign_fast64(0x217500, 0x4000218000, 0x3f92e0) /home/gopher/build/go/src/runtime/map_fast64.go:110 +0x90 fp=0x400004cda0 sp=0x400004cd60 pc=0x33a6b0 testing.(*common).Helper(0x4000082820) /home/gopher/build/go/src/testing/testing.go:1140 +0xe0 fp=0x400004ce00 sp=0x400004cda0 pc=0x3e9ab0 os/signal.waitSig(0x4000082820, 0x400004ced8?, {0x26bc30, 0x26ac00}) /home/gopher/build/go/src/os/signal/signal_test.go:67 +0x30 fp=0x400004ce40 sp=0x400004ce00 pc=0x3f92e0 os/signal.testCancel(0x4000082820, 0x0) /home/gopher/build/go/src/os/signal/signal_test.go:210 +0x12c fp=0x400004cf40 sp=0x400004ce40 pc=0x3f9efc os/signal.TestReset(0x0?) /home/gopher/build/go/src/os/signal/signal_test.go:261 +0x20 fp=0x400004cf60 sp=0x400004cf40 pc=0x3fa230 testing.tRunner(0x4000082820, 0x246920)

— watchflakes

[gopherbot]

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)

2023-04-11 20:54 openbsd-arm64-jsing go@ee591c84 os/signal.TestDetectNohup (log)

unexpected fault address 0x349b64 fatal error: fault [signal SIGSEGV: segmentation violation code=0x2 addr=0x349b64 pc=0x3499a4] runtime.throw({0x239a73?, 0x4000083040?}) /home/gopher/build/go/src/runtime/panic.go:1076 +0x40 fp=0x40000477a0 sp=0x4000047770 pc=0x35ebd0 runtime.sigpanic() /home/gopher/build/go/src/runtime/signal_unix.go:866 +0x22c fp=0x4000047800 sp=0x40000477a0 pc=0x375dac runtime.(*gcControllerState).startCycle(0x246b08?, 0x335e04?, 0x40000478c8?, {0x335e18?, 0x40000478b8?, 0x34aa40?}) /home/gopher/build/go/src/runtime/mgcpacer.go:423 +0x144 fp=0x4000047870 sp=0x4000047810 pc=0x3499a4 ... /home/gopher/build/go/src/os/exec/exec.go:1196 +0x174 fp=0x4000047c40 sp=0x4000047bb0 pc=0x3f50c4 os/exec.(*Cmd).Start(0x4000196000) /home/gopher/build/go/src/os/exec/exec.go:688 +0x3fc fp=0x4000047dc0 sp=0x4000047c40 pc=0x3f3c5c os/exec.(*Cmd).Run(0x4000047ed0?) /home/gopher/build/go/src/os/exec/exec.go:587 +0x20 fp=0x4000047de0 sp=0x4000047dc0 pc=0x3f3820 os/exec.(*Cmd).CombinedOutput(0x4000196000) /home/gopher/build/go/src/os/exec/exec.go:1005 +0x98 fp=0x4000047e10 sp=0x4000047de0 pc=0x3f4e58 os/signal.TestDetectNohup(0x4000083380) /home/gopher/build/go/src/os/signal/signal_test.go:307 +0x18c fp=0x4000047f60 sp=0x4000047e10 pc=0x3fa56c testing.tRunner(0x4000083380, 0x2468d0)

— watchflakes

[gopherbot]

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)

2023-05-09 12:49 openbsd-386-72 go@59d19ba7 net.TestNotTemporaryRead (log)

panic: test timed out after 3m0s running tests: TestNotTemporaryRead (2m54s) runtime.gopark(0x82c2d4c, 0x13fc5320, 0x2, 0x1b, 0x5) /tmp/workdir/go/src/runtime/proc.go:387 +0xfa fp=0x611a9e08 sp=0x611a9df4 pc=0x808413a runtime.netpollblock(0x13fc5310, 0x72, 0x0) /tmp/workdir/go/src/runtime/netpoll.go:556 +0xe4 fp=0x611a9e20 sp=0x611a9e08 pc=0x807d3f4 internal/poll.runtime_pollWait(0x13fc5310, 0x72) /tmp/workdir/go/src/runtime/netpoll.go:335 +0x4c fp=0x611a9e34 sp=0x611a9e20 pc=0x80b08ec internal/poll.(*pollDesc).wait(0x6119c568, 0x72, 0x0) /tmp/workdir/go/src/internal/poll/fd_poll_runtime.go:84 +0x31 fp=0x611a9e48 sp=0x611a9e34 pc=0x80d8a31 internal/poll.(*pollDesc).waitRead(...) /tmp/workdir/go/src/internal/poll/fd_poll_runtime.go:89 internal/poll.(*FD).Read(0x6119c550, {0x6138a3ba, 0x1, 0x1}) /tmp/workdir/go/src/internal/poll/fd_unix.go:167 +0x210 fp=0x611a9e98 sp=0x611a9e48 pc=0x80d9620 net.(*netFD).Read(0x6119c550, {0x6138a3ba, 0x1, 0x1}) /tmp/workdir/go/src/net/fd_posix.go:55 +0x39 fp=0x611a9ec4 sp=0x611a9e98 pc=0x818b219 net.(*conn).Read(0x61188230, {0x6138a3ba, 0x1, 0x1}) /tmp/workdir/go/src/net/net.go:179 +0x49 fp=0x611a9ef4 sp=0x611a9ec4 pc=0x819d7d9 net.(*TCPConn).Read(0x61188230, {0x6138a3ba, 0x1, 0x1}) :1 +0x3c fp=0x611a9f14 sp=0x611a9ef4 pc=0x824c12c net.TestNotTemporaryRead(0x612f2690) /tmp/workdir/go/src/net/net_test.go:557 +0x2e2 fp=0x611a9f98 sp=0x611a9f14 pc=0x8208e62 testing.tRunner(0x612f2690, 0x82c2604)

— watchflakes

[gopherbot]

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)

2023-05-11 16:11 openbsd-386-72 go@2e7d864f net.TestNotTemporaryRead (log)

panic: test timed out after 3m0s running tests: TestNotTemporaryRead (2m55s) runtime.gopark(0x82c6d64, 0x348452a0, 0x2, 0x1b, 0x5) /tmp/workdir/go/src/runtime/proc.go:387 +0xfa fp=0x588b8e08 sp=0x588b8df4 pc=0x8084caa runtime.netpollblock(0x34845290, 0x72, 0x0) /tmp/workdir/go/src/runtime/netpoll.go:556 +0xe4 fp=0x588b8e20 sp=0x588b8e08 pc=0x807df64 internal/poll.runtime_pollWait(0x34845290, 0x72) /tmp/workdir/go/src/runtime/netpoll.go:335 +0x4c fp=0x588b8e34 sp=0x588b8e20 pc=0x80b128c internal/poll.(*pollDesc).wait(0x58a185b8, 0x72, 0x0) /tmp/workdir/go/src/internal/poll/fd_poll_runtime.go:84 +0x31 fp=0x588b8e48 sp=0x588b8e34 pc=0x80d90c1 internal/poll.(*pollDesc).waitRead(...) /tmp/workdir/go/src/internal/poll/fd_poll_runtime.go:89 internal/poll.(*FD).Read(0x58a185a0, {0x58c820ac, 0x1, 0x1}) /tmp/workdir/go/src/internal/poll/fd_unix.go:167 +0x210 fp=0x588b8e98 sp=0x588b8e48 pc=0x80d9cb0 net.(*netFD).Read(0x58a185a0, {0x58c820ac, 0x1, 0x1}) /tmp/workdir/go/src/net/fd_posix.go:55 +0x39 fp=0x588b8ec4 sp=0x588b8e98 pc=0x818d879 net.(*conn).Read(0x58a900f8, {0x58c820ac, 0x1, 0x1}) /tmp/workdir/go/src/net/net.go:179 +0x49 fp=0x588b8ef4 sp=0x588b8ec4 pc=0x819fe39 net.(*TCPConn).Read(0x58a900f8, {0x58c820ac, 0x1, 0x1}) :1 +0x3c fp=0x588b8f14 sp=0x588b8ef4 pc=0x824e78c net.TestNotTemporaryRead(0x58c8a0f0) /tmp/workdir/go/src/net/net_test.go:557 +0x2e2 fp=0x588b8f98 sp=0x588b8f14 pc=0x820b4c2 testing.tRunner(0x58c8a0f0, 0x82c661c)

— watchflakes

[gopherbot]

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)

2023-05-26 16:17 openbsd-arm64-jsing go@4c1d8bf5 syscall.TestExecPtrace (log)

panic: test timed out after 15m0s running tests: TestExecPtrace (14m59s) syscall.syscall(0x8a180, 0x6, 0x40000a6cb0, 0x8) /home/gopher/build/go/src/runtime/sys_openbsd3.go:24 +0x1c fp=0x40000a6ba0 sp=0x40000a6b80 pc=0x77c6c syscall.syscall(0x40000a6c28?, 0x8476c?, 0x4d9?, 0x84ea0?) :1 +0x20 fp=0x40000a6bf0 sp=0x40000a6ba0 pc=0x7d020 syscall.readlen(0x6?, 0x40000a6cb0?, 0x8?) /home/gopher/build/go/src/syscall/zsyscall_openbsd_arm64.go:1698 +0x3c fp=0x40000a6c30 sp=0x40000a6bf0 pc=0x8948c syscall.forkExec({0x40000ae000?, 0x1c258?}, {0x40000a6f00, 0x1, 0x1}, 0x80?) /home/gopher/build/go/src/syscall/exec_unix.go:217 +0x374 fp=0x40000a6d50 sp=0x40000a6c30 pc=0x84854 syscall.StartProcess(...) /home/gopher/build/go/src/syscall/exec_unix.go:334 os.startProcess({0x40000ae000, 0x7}, {0x40000a6f00, 0x1, 0x1}, 0x40000a6f10) /home/gopher/build/go/src/os/exec_posix.go:54 +0x238 fp=0x40000a6e40 sp=0x40000a6d50 pc=0x9fba8 os.StartProcess({0x40000ae000, 0x7}, {0x40000a6f00, 0x1, 0x1}, 0x40000a6f18?) /home/gopher/build/go/src/os/exec.go:109 +0x50 fp=0x40000a6e90 sp=0x40000a6e40 pc=0x9f8c0 syscall_test.TestExecPtrace(0x4000082820) /home/gopher/build/go/src/syscall/syscall_ptrace_test.go:30 +0xc4 fp=0x40000a6f60 sp=0x40000a6e90 pc=0x1275e4 testing.tRunner(0x4000082820, 0x17caf0)

— watchflakes

[bcmills]

The unexpected fault address 0x349dc4 failure mode on openbsd-arm64-jsing is remarkably consistent. I've pulled that one out to a separate issue (#61048).

[gopherbot]

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out` || `fatal error: all goroutines are asleep`) && !(log ~ `unexpected fault address 0x349dc4`)

2023-07-18 19:54 openbsd-386-72 tools@03275ec1 go@813aad51 x/tools/go/packages.TestParseFileModifyAST (log)

--- FAIL: TestParseFileModifyAST (33.41s) --- FAIL: TestParseFileModifyAST/Modules (1.32s) packages_test.go:917: err: exit status 2: stderr: fatal error: all goroutines are asleep - deadlock! panic: runtime error: index out of range [0] with length 0 [recovered] panic: runtime error: index out of range [0] with length 0 goroutine 4024 [running]: testing.tRunner.func1.2({0x82e67a0, 0x6deda3e0}) /tmp/workdir/go/src/testing/testing.go:1545 +0x2a5 testing.tRunner.func1() /tmp/workdir/go/src/testing/testing.go:1548 +0x438 panic({0x82e67a0, 0x6deda3e0}) /tmp/workdir/go/src/runtime/panic.go:914 +0x1e0 golang.org/x/tools/go/packages_test.testParseFileModifyAST(0x6aed42d0, {0x83696b8, 0x84e56e0}) /tmp/workdir/gopath/src/golang.org/x/tools/go/packages/packages_test.go:921 +0x2f1 golang.org/x/tools/go/packages_test.testAllOrModulesParallel.func1(0x6aed42d0, {0x83696b8, 0x84e56e0}) /tmp/workdir/gopath/src/golang.org/x/tools/go/packages/packages_test.go:81 +0x185 golang.org/x/tools/go/packages/packagestest.TestAll.func1(0x6aed42d0) /tmp/workdir/gopath/src/golang.org/x/tools/go/packages/packagestest/export.go:162 +0x51 testing.tRunner(0x6aed42d0, 0x6a6a9e30) /tmp/workdir/go/src/testing/testing.go:1595 +0x11a created by testing.(*T).Run in goroutine 77 /tmp/workdir/go/src/testing/testing.go:1648 +0x3d7

2023-07-18 23:25 openbsd-amd64-72 tools@84f829e2 go@cd6c4e05 x/tools/go/packages.TestConfigFlags (log)

--- FAIL: TestConfigFlags (0.00s) --- FAIL: TestConfigFlags/Modules (1.95s) packages_test.go:537: err: exit status 2: stderr: fatal error: all goroutines are asleep - deadlock!

2023-07-18 23:51 openbsd-386-72 go@8e1ec1cb cmd/go.TestScript (log)

vcs-test.golang.org rerouted to http://127.0.0.1:6906 https://vcs-test.golang.org rerouted to https://127.0.0.1:27007 go test proxy running at GOPROXY=http://127.0.0.1:13589/mod --- FAIL: TestScript (0.49s) --- FAIL: TestScript/doc (8.59s) script_test.go:132: 2023-07-19T00:18:47Z script_test.go:134: $WORK=/tmp/workdir/tmp/cmd-go-test-1792972832/tmpdir3603819314/doc2905635927 script_test.go:156: # go doc --help (0.790s) # go help doc (0.133s) ... fatal error: all goroutines are asleep - deadlock! runtime stack: runtime.fatal({0x81b9055, 0x25}) runtime/panic.go:1096 +0x4d fp=0xcf7edb14 sp=0xcf7edb00 pc=0x807d3ed runtime.checkdead() runtime/proc.go:5498 +0x294 fp=0xcf7edb60 sp=0xcf7edb14 pc=0x808a784 runtime.mput(0x82b74a0) runtime/proc.go:5933 +0x2e fp=0xcf7edb64 sp=0xcf7edb60 pc=0x808bf2e runtime.stopm() runtime/proc.go:2534 +0x68 fp=0xcf7edb78 sp=0xcf7edb64 pc=0x80839e8 runtime.findRunnable() runtime/proc.go:3229 +0xb6d fp=0xcf7edc14 sp=0xcf7edb78 pc=0x808524d runtime.schedule() runtime/proc.go:3582 +0xb1 fp=0xcf7edc30 sp=0xcf7edc14 pc=0x8086381 runtime.park_m(0x62408100) runtime/proc.go:3745 +0x155 fp=0xcf7edc4c sp=0xcf7edc30 pc=0x8086a65 runtime.mcall() runtime/asm_386.s:329 +0x40 fp=0xcf7edc54 sp=0xcf7edc4c pc=0x80aaf00

— watchflakes

[gopherbot]

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out` || `fatal error: all goroutines are asleep`) && !(log ~ `unexpected fault address 0x349dc4`)

2023-08-07 22:48 openbsd-arm64-jsing go@b9153f6e context (log)

panic: test timed out after 15m0s goroutine 304 [running]: panic({0x161860?, 0x40001c4010?}) /home/gopher/build/go/src/runtime/panic.go:621 +0x140 fp=0x4000047f00 sp=0x4000047e50 pc=0x46800 testing.(*M).startAlarm.func1() /home/gopher/build/go/src/testing/testing.go:2259 +0x30c fp=0x4000047fd0 sp=0x4000047f00 pc=0xdd86c runtime.goexit() /home/gopher/build/go/src/runtime/asm_arm64.s:1197 +0x4 fp=0x4000047fd0 sp=0x4000047fd0 pc=0x7c4c4 created by time.goFunc /home/gopher/build/go/src/time/sleep.go:177 +0x38

— watchflakes

[gopherbot]

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out` || `fatal error: all goroutines are asleep`) && !(log ~ `unexpected fault address 0x349dc4`)

2023-08-20 05:56 openbsd-arm64-jsing go@a2ec545e strings (log)

runtime: g1: frame.sp=0x400011fe00 top=0x400013ffd0 stack=[0x4000100000-0x4000140000 fatal error: traceback did not unwind completely runtime stack: runtime.throw({0x171b13?, 0x400013ffb0?}) /home/gopher/build/go/src/runtime/panic.go:1018 +0x40 fp=0x4dff20360 sp=0x4dff20330 pc=0x452a0 runtime.(*unwinder).finishInternal(0x202f0?) /home/gopher/build/go/src/runtime/traceback.go:561 +0x110 fp=0x4dff203a0 sp=0x4dff20360 pc=0x6b7a0 runtime.(*unwinder).next(0x4dff20478?) /home/gopher/build/go/src/runtime/traceback.go:442 +0x2a4 fp=0x4dff20430 sp=0x4dff203a0 pc=0x6b5e4 runtime.scanstack(0x40000021a0, 0x7?) /home/gopher/build/go/src/runtime/mgcmark.go:802 +0x23c fp=0x4dff20870 sp=0x4dff20430 pc=0x2d8dc runtime.markroot.func1() /home/gopher/build/go/src/runtime/mgcmark.go:240 +0xb4 fp=0x4dff208c0 sp=0x4dff20870 pc=0x2c664 runtime.markroot(0x400002a140, 0x14, 0x1) /home/gopher/build/go/src/runtime/mgcmark.go:214 +0x1cc fp=0x4dff20970 sp=0x4dff208c0 pc=0x2c32c runtime.gcDrain(0x400002a140, 0x7) /home/gopher/build/go/src/runtime/mgcmark.go:1069 +0x3f8 fp=0x4dff209d0 sp=0x4dff20970 pc=0x2e308 runtime.gcBgMarkWorker.func2() /home/gopher/build/go/src/runtime/mgc.go:1405 +0x74 fp=0x4dff20a20 sp=0x4dff209d0 pc=0x2a504 runtime.systemstack() /home/gopher/build/go/src/runtime/asm_arm64.s:243 +0x6c fp=0x4dff20a30 sp=0x4dff20a20 pc=0x765bc

— watchflakes

[bcmills]

• The failures with fatal error: all goroutines are asleep - deadlock! are #61454.
• The timeout in context.ExampleAfterFunc_cond involves a condition variable, so my guess is it's a bug in the test. (I will follow up with a separate issue for that.)
• The fatal error: traceback did not unwind completely failure mode resembles a failure on linux-arm64-longtest in #62105. It's not obviously specific to openbsd.

I'm going to close this issue as obsolete, and add a date constraint on the watchflakes pattern.