search

golang / go

The Go programming language
https://go.dev
BSD 3-Clause "New" or "Revised" License
123.95k stars 17.66k forks source link

runtime: pageBits test failure on 386-linux #42053

Closed Whissi closed 4 years ago

Whissi commented 4 years ago

I was trying to build go-1.14.9 and go-1.14.10 on Gentoo, but tests failed. So I tried 1.15.3 and git master -- the same. See the failure below.

This is a x86 system.

Does this issue reproduce with the latest release?

Yes, I tried building from git master (

What operating system and processor architecture are you using (go env)?

go env Output
$ go env
GO111MODULE=""
GOARCH="386"
GOBIN=""
GOCACHE="/root/.cache/go-build"
GOENV="/root/.config/go/env"
GOEXE=""
GOFLAGS=""
GOHOSTARCH="386"
GOHOSTOS="linux"
GOINSECURE=""
GONOPROXY=""
GONOSUMDB=""
GOOS="linux"
GOPATH="/root/go"
GOPRIVATE=""
GOPROXY="https://proxy.golang.org,direct"
GOROOT="/usr/lib/go"
GOSUMDB="sum.golang.org"
GOTMPDIR=""
GOTOOLDIR="/usr/lib/go/pkg/tool/linux_386"
GCCGO="gccgo"
GO386="sse2"
AR="ar"
CC="i686-pc-linux-gnu-gcc"
CXX="i686-pc-linux-gnu-g++"
CGO_ENABLED="1"
GOMOD="/tmp/goroot/src/go.mod"
CGO_CFLAGS="-g -O2"
CGO_CPPFLAGS=""
CGO_CXXFLAGS="-g -O2"
CGO_FFLAGS="-g -O2"
CGO_LDFLAGS="-g -O2"
PKG_CONFIG="pkg-config"
GOGCCFLAGS="-fPIC -m32 -pthread -fmessage-length=0 -fdebug-prefix-map=/tmp/go-build584656141=/tmp/go-build -gno-record-gcc-switches"

What did you do?

I am trying to run test suite.

What did you expect to see?

No test failures.

What did you see instead?

Test failures Output
gentoo-x86 /tmp # git clone https://github.com/golang/go.git goroot
Cloning into 'goroot'...
remote: Enumerating objects: 89, done.
remote: Counting objects: 100% (89/89), done.
remote: Compressing objects: 100% (79/79), done.
remote: Total 439398 (delta 17), reused 22 (delta 10), pack-reused 439309
Receiving objects: 100% (439398/439398), 220.61 MiB | 7.90 MiB/s, done.
Resolving deltas: 100% (350107/350107), done.
gentoo-x86 /tmp # cd goroot/
gentoo-x86 /tmp/goroot # cd src/
gentoo-x86 /tmp/goroot/src # ./all.bash
Building Go cmd/dist using /usr/lib/go. (go1.14.7 linux/386)
Building Go toolchain1 using /usr/lib/go.
Building Go bootstrap cmd/go (go_bootstrap) using Go toolchain1.
Building Go toolchain2 using go_bootstrap and Go toolchain1.
Building Go toolchain3 using go_bootstrap and Go toolchain2.
Building packages and commands for linux/386.

##### Testing packages.
ok      archive/tar     0.050s
ok      archive/zip     0.105s
ok      bufio   0.098s
ok      bytes   0.238s
ok      compress/bzip2  0.135s
ok      compress/flate  0.647s
ok      compress/gzip   0.055s
ok      compress/lzw    0.019s
ok      compress/zlib   0.033s
ok      container/heap  0.048s
ok      container/list  0.021s
ok      container/ring  0.025s
ok      context 0.045s
ok      crypto  0.019s
ok      crypto/aes      0.041s
ok      crypto/cipher   0.018s
ok      crypto/des      0.026s
ok      crypto/dsa      0.019s
ok      crypto/ecdsa    0.215s
ok      crypto/ed25519  0.138s
ok      crypto/elliptic 0.036s
ok      crypto/hmac     0.031s
ok      crypto/internal/subtle  0.037s
ok      crypto/md5      0.012s
ok      crypto/rand     0.041s
ok      crypto/rc4      0.034s
ok      crypto/rsa      0.166s
ok      crypto/sha1     0.018s
ok      crypto/sha256   0.017s
ok      crypto/sha512   0.024s
ok      crypto/subtle   0.042s
ok      crypto/tls      1.360s
ok      crypto/x509     1.760s
ok      database/sql    0.629s
ok      database/sql/driver     0.043s
ok      debug/dwarf     0.038s
ok      debug/elf       0.017s
ok      debug/gosym     0.021s
ok      debug/macho     0.018s
ok      debug/pe        0.019s
ok      debug/plan9obj  0.022s
ok      encoding/ascii85        0.019s
ok      encoding/asn1   0.011s
ok      encoding/base32 0.043s
ok      encoding/base64 0.013s
ok      encoding/binary 0.053s
ok      encoding/csv    0.023s
ok      encoding/gob    0.040s
ok      encoding/hex    0.040s
ok      encoding/json   0.268s
ok      encoding/pem    0.015s
ok      encoding/xml    0.038s
ok      errors  0.032s
ok      expvar  0.042s
ok      flag    0.152s
ok      fmt     0.071s
ok      go/ast  0.014s
ok      go/build        0.911s
ok      go/constant     0.011s
ok      go/doc  0.059s
ok      go/format       0.010s
ok      go/importer     0.126s
ok      go/internal/gccgoimporter       0.045s
ok      go/internal/gcimporter  0.502s
ok      go/internal/srcimporter 5.334s
ok      go/parser       0.046s
ok      go/printer      0.261s
ok      go/scanner      0.025s
ok      go/token        0.050s
ok      go/types        0.683s
ok      hash    0.037s
ok      hash/adler32    0.042s
ok      hash/crc32      0.027s
ok      hash/crc64      0.024s
ok      hash/fnv        0.006s
ok      hash/maphash    0.035s
ok      html    0.038s
ok      html/template   0.115s
ok      image   0.064s
ok      image/color     0.019s
ok      image/draw      0.050s
ok      image/gif       0.431s
ok      image/jpeg      0.145s
ok      image/png       0.041s
ok      index/suffixarray       0.244s
ok      internal/cpu    0.065s
ok      internal/fmtsort        0.024s
ok      internal/poll   0.081s
ok      internal/profile        0.032s
ok      internal/reflectlite    0.053s
ok      internal/singleflight   0.025s
ok      internal/trace  0.072s
ok      internal/unsafeheader   0.005s
ok      internal/xcoff  0.015s
ok      io      0.081s
ok      io/ioutil       0.018s
ok      log     0.032s
ok      log/syslog      1.234s
ok      math    0.048s
ok      math/big        1.252s
ok      math/bits       0.012s
ok      math/cmplx      0.026s
ok      math/rand       0.121s
ok      mime    0.011s
ok      mime/multipart  0.152s
ok      mime/quotedprintable    0.029s
ok      net     5.019s
ok      net/http        8.356s
ok      net/http/cgi    0.701s
ok      net/http/cookiejar      0.031s
ok      net/http/fcgi   0.023s
ok      net/http/httptest       0.075s
ok      net/http/httptrace      0.030s
ok      net/http/httputil       0.129s
ok      net/http/internal       0.050s
ok      net/http/pprof  5.139s
ok      net/internal/socktest   0.018s
ok      net/mail        0.025s
ok      net/rpc 0.034s
ok      net/rpc/jsonrpc 0.010s
ok      net/smtp        0.030s
ok      net/textproto   0.012s
ok      net/url 0.027s
ok      os      0.848s
ok      os/exec 1.286s
ok      os/signal       2.410s
ok      os/user 0.026s
ok      path    0.043s
ok      path/filepath   0.050s
ok      plugin  0.058s
ok      reflect 0.374s
ok      regexp  0.099s
ok      regexp/syntax   0.383s
fatal error: index out of range

goroutine 23303 [running]:
runtime.throw(0x825f714, 0x12)
        /tmp/goroot/src/runtime/panic.go:1112 +0x6a fp=0x88ff6e0 sp=0x88ff6cc pc=0x807c6ca
runtime.panicCheck1(0x80725ee, 0x825f714, 0x12)
        /tmp/goroot/src/runtime/panic.go:34 +0xb7 fp=0x88ff6f4 sp=0x88ff6e0 pc=0x8079be7
runtime.goPanicIndexU(0x8, 0x8)
        /tmp/goroot/src/runtime/panic.go:91 +0x37 fp=0x88ff718 sp=0x88ff6f4 pc=0x8079d47
runtime.(*pageBits).setRange(0x8c98300, 0x202, 0xfffffffe)
        /tmp/goroot/src/runtime/mpallocbits.go:31 +0x2ce fp=0x88ff74c sp=0x88ff718 pc=0x80725ee
runtime.(*pallocBits).allocRange(...)
        /tmp/goroot/src/runtime/mpallocbits.go:340
runtime.(*pallocData).allocRange(0x8c98300, 0x202, 0xfffffffe)
        /tmp/goroot/src/runtime/mpallocbits.go:418 +0x33 fp=0x88ff75c sp=0x88ff74c pc=0x8074143
runtime.(*PallocData).AllocRange(...)
        /tmp/goroot/src/runtime/export_test.go:688
runtime_test.makePallocData(0x8a18868, 0x1, 0x1, 0x0, 0x0, 0x0, 0x83bc4a0)
        /tmp/goroot/src/runtime/mgcscavenge_test.go:24 +0x61 fp=0x88ff774 sp=0x88ff75c pc=0x81b4121
runtime_test.TestPallocDataFindScavengeCandidate.func1(0x8911b20)
        /tmp/goroot/src/runtime/mgcscavenge_test.go:263 +0x4b fp=0x88ff7a8 sp=0x88ff774 pc=0x81ee9db
testing.tRunner(0x8911b20, 0x8a220c0)
        /tmp/goroot/src/testing/testing.go:1173 +0xb7 fp=0x88ff7e8 sp=0x88ff7a8 pc=0x811c647
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x88ff7ec sp=0x88ff7e8 pc=0x80b1651
created by testing.(*T).Run
        /tmp/goroot/src/testing/testing.go:1218 +0x217

goroutine 1 [chan receive, locked to thread]:
runtime.gopark(0x826fc54, 0x8ccc4b0, 0x170e, 0x2)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x8847d48 sp=0x8847d34 pc=0x807ef34
runtime.chanrecv(0x8ccc480, 0x8847dc7, 0x8800001, 0x811c8e7)
        /tmp/goroot/src/runtime/chan.go:581 +0x28a fp=0x8847d90 sp=0x8847d48 pc=0x804e83a
runtime.chanrecv1(0x8ccc480, 0x8847dc7)
        /tmp/goroot/src/runtime/chan.go:443 +0x1c fp=0x8847da4 sp=0x8847d90 pc=0x804e57c
testing.(*T).Run(0x8b00620, 0x82683f7, 0x23, 0x8270914, 0x401)
        /tmp/goroot/src/testing/testing.go:1219 +0x236 fp=0x8847dec sp=0x8847da4 pc=0x811c906
testing.runTests.func1(0x8801420)
        /tmp/goroot/src/testing/testing.go:1491 +0x5a fp=0x8847e10 sp=0x8847dec pc=0x812071a
testing.tRunner(0x8801420, 0x8847ea0)
        /tmp/goroot/src/testing/testing.go:1173 +0xb7 fp=0x8847e50 sp=0x8847e10 pc=0x811c647
testing.runTests(0x880e080, 0x83ba940, 0x157, 0x157, 0x6b50f637, 0xbfdb4a8f, 0xba9bb2a0, 0x7d, 0x83bc4a0, 0x0)
        /tmp/goroot/src/testing/testing.go:1489 +0x25a fp=0x8847eb4 sp=0x8847e50 pc=0x811dc0a
testing.(*M).Run(0x8898000, 0x0)
        /tmp/goroot/src/testing/testing.go:1397 +0x178 fp=0x8847f4c sp=0x8847eb4 pc=0x811cdc8
runtime_test.TestMain(0x8898000)
        /tmp/goroot/src/runtime/crash_test.go:28 +0x21 fp=0x8847f70 sp=0x8847f4c pc=0x818b161
main.main()
        _testmain.go:1221 +0x110 fp=0x8847fc8 sp=0x8847f70 pc=0x81ff4f0
runtime.main()
        /tmp/goroot/src/runtime/proc.go:220 +0x232 fp=0x8847ff0 sp=0x8847fc8 pc=0x807eb72
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x8847ff4 sp=0x8847ff0 pc=0x80b1651

goroutine 2 [force gc (idle)]:
runtime.gopark(0x826fdc8, 0x83bc020, 0x1411, 0x1)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x8836fdc sp=0x8836fc8 pc=0x807ef34
runtime.goparkunlock(...)
        /tmp/goroot/src/runtime/proc.go:337
runtime.forcegchelper()
        /tmp/goroot/src/runtime/proc.go:271 +0xbf fp=0x8836ff0 sp=0x8836fdc pc=0x807eddf
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x8836ff4 sp=0x8836ff0 pc=0x80b1651
created by runtime.init.5
        /tmp/goroot/src/runtime/proc.go:259 +0x2b

goroutine 3 [GC sweep wait]:
runtime.gopark(0x826fdc8, 0x83bc340, 0x140c, 0x1)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x88377d4 sp=0x88377c0 pc=0x807ef34
runtime.goparkunlock(...)
        /tmp/goroot/src/runtime/proc.go:337
runtime.bgsweep(0x8820040)
        /tmp/goroot/src/runtime/mgcsweep.go:180 +0x11d fp=0x88377e8 sp=0x88377d4 pc=0x806abbd
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x88377ec sp=0x88377e8 pc=0x80b1651
created by runtime.gcenable
        /tmp/goroot/src/runtime/mgc.go:217 +0x4d

goroutine 4 [sleep]:
runtime.gopark(0x826fdc8, 0x83bc2c0, 0x1313, 0x2)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x8837f70 sp=0x8837f5c pc=0x807ef34
runtime.goparkunlock(...)
        /tmp/goroot/src/runtime/proc.go:337
runtime.scavengeSleep(0x28196, 0x0, 0x28196, 0x0)
        /tmp/goroot/src/runtime/mgcscavenge.go:241 +0xc9 fp=0x8837fac sp=0x8837f70 pc=0x8068c89
runtime.bgscavenge(0x8820040)
        /tmp/goroot/src/runtime/mgcscavenge.go:366 +0x1d4 fp=0x8837fe8 sp=0x8837fac pc=0x8068e94
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x8837fec sp=0x8837fe8 pc=0x80b1651
created by runtime.gcenable
        /tmp/goroot/src/runtime/mgc.go:218 +0x6b

goroutine 5 [finalizer wait]:
runtime.gopark(0x826fdc8, 0x83ce260, 0x8b71410, 0x1)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x88367a8 sp=0x8836794 pc=0x807ef34
runtime.goparkunlock(...)
        /tmp/goroot/src/runtime/proc.go:337
runtime.runfinq()
        /tmp/goroot/src/runtime/mfinal.go:175 +0x94 fp=0x88367f0 sp=0x88367a8 pc=0x805fab4
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x88367f4 sp=0x88367f0 pc=0x80b1651
created by runtime.createfing
        /tmp/goroot/src/runtime/mfinal.go:156 +0x60

goroutine 22939 [chan receive]:
runtime.gopark(0x826fc54, 0x88201f0, 0x827170e, 0x2)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x898963c sp=0x8989628 pc=0x807ef34
runtime.chanrecv(0x88201c0, 0x0, 0x811c301, 0x8810301)
        /tmp/goroot/src/runtime/chan.go:581 +0x28a fp=0x8989684 sp=0x898963c pc=0x804e83a
runtime.chanrecv1(0x88201c0, 0x0)
        /tmp/goroot/src/runtime/chan.go:443 +0x1c fp=0x8989698 sp=0x8989684 pc=0x804e57c
testing.(*T).Parallel(0x8800ee0)
        /tmp/goroot/src/testing/testing.go:1039 +0xfd fp=0x89896f4 sp=0x8989698 pc=0x811c36d
runtime_test.TestCheckPtr(0x8800ee0)
        /tmp/goroot/src/runtime/checkptr_test.go:15 +0x2f fp=0x89897a8 sp=0x89896f4 pc=0x8185eaf
testing.tRunner(0x8800ee0, 0x8270590)
        /tmp/goroot/src/testing/testing.go:1173 +0xb7 fp=0x89897e8 sp=0x89897a8 pc=0x811c647
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x89897ec sp=0x89897e8 pc=0x80b1651
created by testing.(*T).Run
        /tmp/goroot/src/testing/testing.go:1218 +0x217

goroutine 22952 [chan receive]:
runtime.gopark(0x826fc54, 0x88201f0, 0x827170e, 0x2)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x8988eac sp=0x8988e98 pc=0x807ef34
runtime.chanrecv(0x88201c0, 0x0, 0x811c301, 0x1)
        /tmp/goroot/src/runtime/chan.go:581 +0x28a fp=0x8988ef4 sp=0x8988eac pc=0x804e83a
runtime.chanrecv1(0x88201c0, 0x0)
        /tmp/goroot/src/runtime/chan.go:443 +0x1c fp=0x8988f08 sp=0x8988ef4 pc=0x804e57c
testing.(*T).Parallel(0x8910460)
        /tmp/goroot/src/testing/testing.go:1039 +0xfd fp=0x8988f64 sp=0x8988f08 pc=0x811c36d
runtime_test.TestCgoPanicDeadlock(0x8910460)
        /tmp/goroot/src/runtime/crash_cgo_test.go:222 +0x25 fp=0x8988fa8 sp=0x8988f64 pc=0x8188035
testing.tRunner(0x8910460, 0x827053c)
        /tmp/goroot/src/testing/testing.go:1173 +0xb7 fp=0x8988fe8 sp=0x8988fa8 pc=0x811c647
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x8988fec sp=0x8988fe8 pc=0x80b1651
created by testing.(*T).Run
        /tmp/goroot/src/testing/testing.go:1218 +0x217

goroutine 22951 [chan receive]:
runtime.gopark(0x826fc54, 0x88201f0, 0x827170e, 0x2)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x8989e54 sp=0x8989e40 pc=0x807ef34
runtime.chanrecv(0x88201c0, 0x0, 0x811c301, 0x1)
        /tmp/goroot/src/runtime/chan.go:581 +0x28a fp=0x8989e9c sp=0x8989e54 pc=0x804e83a
runtime.chanrecv1(0x88201c0, 0x0)
        /tmp/goroot/src/runtime/chan.go:443 +0x1c fp=0x8989eb0 sp=0x8989e9c pc=0x804e57c
testing.(*T).Parallel(0x8910380)
        /tmp/goroot/src/testing/testing.go:1039 +0xfd fp=0x8989f0c sp=0x8989eb0 pc=0x811c36d
runtime_test.TestCgoCheckBytes(0x8910380)
        /tmp/goroot/src/runtime/crash_cgo_test.go:182 +0x2f fp=0x8989fa8 sp=0x8989f0c pc=0x81879ff
testing.tRunner(0x8910380, 0x8270514)
        /tmp/goroot/src/testing/testing.go:1173 +0xb7 fp=0x8989fe8 sp=0x8989fa8 pc=0x811c647
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x8989fec sp=0x8989fe8 pc=0x80b1651
created by testing.(*T).Run
        /tmp/goroot/src/testing/testing.go:1218 +0x217

goroutine 22953 [chan receive]:
runtime.gopark(0x826fc54, 0x88201f0, 0x827170e, 0x2)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x8833eac sp=0x8833e98 pc=0x807ef34
runtime.chanrecv(0x88201c0, 0x0, 0x811c301, 0x1)
        /tmp/goroot/src/runtime/chan.go:581 +0x28a fp=0x8833ef4 sp=0x8833eac pc=0x804e83a
runtime.chanrecv1(0x88201c0, 0x0)
        /tmp/goroot/src/runtime/chan.go:443 +0x1c fp=0x8833f08 sp=0x8833ef4 pc=0x804e57c
testing.(*T).Parallel(0x8910540)
        /tmp/goroot/src/testing/testing.go:1039 +0xfd fp=0x8833f64 sp=0x8833f08 pc=0x811c36d
runtime_test.TestCgoCCodeSIGPROF(0x8910540)
        /tmp/goroot/src/runtime/crash_cgo_test.go:232 +0x25 fp=0x8833fa8 sp=0x8833f64 pc=0x81881b5
testing.tRunner(0x8910540, 0x827050c)
        /tmp/goroot/src/testing/testing.go:1173 +0xb7 fp=0x8833fe8 sp=0x8833fa8 pc=0x811c647
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x8833fec sp=0x8833fe8 pc=0x80b1651
created by testing.(*T).Run
        /tmp/goroot/src/testing/testing.go:1218 +0x217

goroutine 22949 [chan receive]:
runtime.gopark(0x826fc54, 0x88201f0, 0x827170e, 0x2)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x88356ac sp=0x8835698 pc=0x807ef34
runtime.chanrecv(0x88201c0, 0x0, 0x811c301, 0x1)
        /tmp/goroot/src/runtime/chan.go:581 +0x28a fp=0x88356f4 sp=0x88356ac pc=0x804e83a
runtime.chanrecv1(0x88201c0, 0x0)
        /tmp/goroot/src/runtime/chan.go:443 +0x1c fp=0x8835708 sp=0x88356f4 pc=0x804e57c
testing.(*T).Parallel(0x89101c0)
        /tmp/goroot/src/testing/testing.go:1039 +0xfd fp=0x8835764 sp=0x8835708 pc=0x811c36d
runtime_test.TestCgoExecSignalMask(0x89101c0)
        /tmp/goroot/src/runtime/crash_cgo_test.go:151 +0x25 fp=0x88357a8 sp=0x8835764 pc=0x8187735
testing.tRunner(0x89101c0, 0x8270524)
        /tmp/goroot/src/testing/testing.go:1173 +0xb7 fp=0x88357e8 sp=0x88357a8 pc=0x811c647
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x88357ec sp=0x88357e8 pc=0x80b1651
created by testing.(*T).Run
        /tmp/goroot/src/testing/testing.go:1218 +0x217

goroutine 23200 [chan receive]:
runtime.gopark(0x826fc54, 0x88201f0, 0x827170e, 0x2)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x8a4fe94 sp=0x8a4fe80 pc=0x807ef34
runtime.chanrecv(0x88201c0, 0x0, 0x811c301, 0x1)
        /tmp/goroot/src/runtime/chan.go:581 +0x28a fp=0x8a4fedc sp=0x8a4fe94 pc=0x804e83a
runtime.chanrecv1(0x88201c0, 0x0)
        /tmp/goroot/src/runtime/chan.go:443 +0x1c fp=0x8a4fef0 sp=0x8a4fedc pc=0x804e57c
testing.(*T).Parallel(0x8922d20)
        /tmp/goroot/src/testing/testing.go:1039 +0xfd fp=0x8a4ff4c sp=0x8a4fef0 pc=0x811c36d
runtime_test.TestMemmoveAlias(0x8922d20)
        /tmp/goroot/src/runtime/memmove_test.go:65 +0x36 fp=0x8a4ffa8 sp=0x8a4ff4c pc=0x81b0e66
testing.tRunner(0x8922d20, 0x827080c)
        /tmp/goroot/src/testing/testing.go:1173 +0xb7 fp=0x8a4ffe8 sp=0x8a4ffa8 pc=0x811c647
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x8a4ffec sp=0x8a4ffe8 pc=0x80b1651
created by testing.(*T).Run
        /tmp/goroot/src/testing/testing.go:1218 +0x217

goroutine 22947 [chan receive]:
runtime.gopark(0x826fc54, 0x88201f0, 0x827170e, 0x2)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x8a84e8c sp=0x8a84e78 pc=0x807ef34
runtime.chanrecv(0x88201c0, 0x0, 0x811c301, 0x1)
        /tmp/goroot/src/runtime/chan.go:581 +0x28a fp=0x8a84ed4 sp=0x8a84e8c pc=0x804e83a
runtime.chanrecv1(0x88201c0, 0x0)
        /tmp/goroot/src/runtime/chan.go:443 +0x1c fp=0x8a84ee8 sp=0x8a84ed4 pc=0x804e57c
testing.(*T).Parallel(0x88d0e00)
        /tmp/goroot/src/testing/testing.go:1039 +0xfd fp=0x8a84f44 sp=0x8a84ee8 pc=0x811c36d
runtime_test.TestCgoExternalThreadSignal(0x88d0e00)
        /tmp/goroot/src/runtime/crash_cgo_test.go:115 +0x25 fp=0x8a84fa8 sp=0x8a84f44 pc=0x8187285
testing.tRunner(0x88d0e00, 0x8270530)
        /tmp/goroot/src/testing/testing.go:1173 +0xb7 fp=0x8a84fe8 sp=0x8a84fa8 pc=0x811c647
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x8a84fec sp=0x8a84fe8 pc=0x80b1651
created by testing.(*T).Run
        /tmp/goroot/src/testing/testing.go:1218 +0x217

goroutine 22950 [chan receive]:
runtime.gopark(0x826fc54, 0x88201f0, 0x827170e, 0x2)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x88396ac sp=0x8839698 pc=0x807ef34
runtime.chanrecv(0x88201c0, 0x0, 0x811c301, 0x898f001)
        /tmp/goroot/src/runtime/chan.go:581 +0x28a fp=0x88396f4 sp=0x88396ac pc=0x804e83a
runtime.chanrecv1(0x88201c0, 0x0)
        /tmp/goroot/src/runtime/chan.go:443 +0x1c fp=0x8839708 sp=0x88396f4 pc=0x804e57c
testing.(*T).Parallel(0x89102a0)
        /tmp/goroot/src/testing/testing.go:1039 +0xfd fp=0x8839764 sp=0x8839708 pc=0x811c36d
runtime_test.TestEnsureDropM(0x89102a0)
        /tmp/goroot/src/runtime/crash_cgo_test.go:165 +0x25 fp=0x88397a8 sp=0x8839764 pc=0x8187895
testing.tRunner(0x89102a0, 0x8270638)
        /tmp/goroot/src/testing/testing.go:1173 +0xb7 fp=0x88397e8 sp=0x88397a8 pc=0x811c647
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x88397ec sp=0x88397e8 pc=0x80b1651
created by testing.(*T).Run
        /tmp/goroot/src/testing/testing.go:1218 +0x217

goroutine 23288 [chan receive]:
runtime.gopark(0x826fc54, 0x88201f0, 0x827170e, 0x2)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x8a52eb4 sp=0x8a52ea0 pc=0x807ef34
runtime.chanrecv(0x88201c0, 0x0, 0x811c301, 0x1)
        /tmp/goroot/src/runtime/chan.go:581 +0x28a fp=0x8a52efc sp=0x8a52eb4 pc=0x804e83a
runtime.chanrecv1(0x88201c0, 0x0)
        /tmp/goroot/src/runtime/chan.go:443 +0x1c fp=0x8a52f10 sp=0x8a52efc pc=0x804e57c
testing.(*T).Parallel(0x8b00460)
        /tmp/goroot/src/testing/testing.go:1039 +0xfd fp=0x8a52f6c sp=0x8a52f10 pc=0x811c36d
runtime_test.TestDeferKeepAlive(0x8b00460)
        /tmp/goroot/src/runtime/mfinal_test.go:251 +0x4c fp=0x8a52fa8 sp=0x8a52f6c pc=0x81b3f2c
testing.tRunner(0x8b00460, 0x82705fc)
        /tmp/goroot/src/testing/testing.go:1173 +0xb7 fp=0x8a52fe8 sp=0x8a52fa8 pc=0x811c647
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x8a52fec sp=0x8a52fe8 pc=0x80b1651
created by testing.(*T).Run
        /tmp/goroot/src/testing/testing.go:1218 +0x217

goroutine 306 [GC worker (idle)]:
runtime.gopark(0x826fcd4, 0x8a64008, 0xffff1418, 0x0)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x8a5379c sp=0x8a53788 pc=0x807ef34
runtime.gcBgMarkWorker(0x882a000)
        /tmp/goroot/src/runtime/mgc.go:1820 +0xe8 fp=0x8a537e8 sp=0x8a5379c pc=0x8063c08
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x8a537ec sp=0x8a537e8 pc=0x80b1651
created by runtime.gcBgMarkStartWorkers
        /tmp/goroot/src/runtime/mgc.go:1768 +0x61

goroutine 23290 [chan receive]:
runtime.gopark(0x826fc54, 0x8820470, 0x170e, 0x2)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x8844c58 sp=0x8844c44 pc=0x807ef34
runtime.chanrecv(0x8820440, 0x8844cd7, 0x88d0901, 0x811c8e7)
        /tmp/goroot/src/runtime/chan.go:581 +0x28a fp=0x8844ca0 sp=0x8844c58 pc=0x804e83a
runtime.chanrecv1(0x8820440, 0x8844cd7)
        /tmp/goroot/src/runtime/chan.go:443 +0x1c fp=0x8844cb4 sp=0x8844ca0 pc=0x804e57c
testing.(*T).Run(0x8911b20, 0x8261b3e, 0x16, 0x8a220c0, 0x89b7901)
        /tmp/goroot/src/testing/testing.go:1219 +0x236 fp=0x8844cfc sp=0x8844cb4 pc=0x811c906
runtime_test.TestPallocDataFindScavengeCandidate(0x8b00620)
        /tmp/goroot/src/runtime/mgcscavenge_test.go:262 +0x144b fp=0x8844fa8 sp=0x8844cfc pc=0x81b59db
testing.tRunner(0x8b00620, 0x8270914)
        /tmp/goroot/src/testing/testing.go:1173 +0xb7 fp=0x8844fe8 sp=0x8844fa8 pc=0x811c647
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x8844fec sp=0x8844fe8 pc=0x80b1651
created by testing.(*T).Run
        /tmp/goroot/src/testing/testing.go:1218 +0x217

goroutine 22946 [chan receive]:
runtime.gopark(0x826fc54, 0x88201f0, 0x827170e, 0x2)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x8be4690 sp=0x8be467c pc=0x807ef34
runtime.chanrecv(0x88201c0, 0x0, 0x811c301, 0x1)
        /tmp/goroot/src/runtime/chan.go:581 +0x28a fp=0x8be46d8 sp=0x8be4690 pc=0x804e83a
runtime.chanrecv1(0x88201c0, 0x0)
        /tmp/goroot/src/runtime/chan.go:443 +0x1c fp=0x8be46ec sp=0x8be46d8 pc=0x804e57c
testing.(*T).Parallel(0x88016c0)
        /tmp/goroot/src/testing/testing.go:1039 +0xfd fp=0x8be4748 sp=0x8be46ec pc=0x811c36d
runtime_test.TestCgoExternalThreadSIGPROF(0x88016c0)
        /tmp/goroot/src/runtime/crash_cgo_test.go:87 +0x25 fp=0x8be47a8 sp=0x8be4748 pc=0x8186fa5
testing.tRunner(0x88016c0, 0x827052c)
        /tmp/goroot/src/testing/testing.go:1173 +0xb7 fp=0x8be47e8 sp=0x8be47a8 pc=0x811c647
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x8be47ec sp=0x8be47e8 pc=0x80b1651
created by testing.(*T).Run
        /tmp/goroot/src/testing/testing.go:1218 +0x217

goroutine 23002 [chan receive]:
runtime.gopark(0x826fc54, 0x88201f0, 0x827170e, 0x2)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x88debb8 sp=0x88deba4 pc=0x807ef34
runtime.chanrecv(0x88201c0, 0x0, 0x811c301, 0x1)
        /tmp/goroot/src/runtime/chan.go:581 +0x28a fp=0x88dec00 sp=0x88debb8 pc=0x804e83a
runtime.chanrecv1(0x88201c0, 0x0)
        /tmp/goroot/src/runtime/chan.go:443 +0x1c fp=0x88dec14 sp=0x88dec00 pc=0x804e57c
testing.(*T).Parallel(0x8b00000)
        /tmp/goroot/src/testing/testing.go:1039 +0xfd fp=0x88dec70 sp=0x88dec14 pc=0x811c36d
runtime_test.TestCrashDumpsAllThreads(0x8b00000)
        /tmp/goroot/src/runtime/crash_unix_test.go:82 +0x94 fp=0x88defa8 sp=0x88dec70 pc=0x81918f4
testing.tRunner(0x8b00000, 0x82705c4)
        /tmp/goroot/src/testing/testing.go:1173 +0xb7 fp=0x88defe8 sp=0x88defa8 pc=0x811c647
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x88defec sp=0x88defe8 pc=0x80b1651
created by testing.(*T).Run
        /tmp/goroot/src/testing/testing.go:1218 +0x217

goroutine 23034 [chan receive]:
runtime.gopark(0x826fc54, 0x88201f0, 0x827170e, 0x2)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x8984eac sp=0x8984e98 pc=0x807ef34
runtime.chanrecv(0x88201c0, 0x0, 0x811c301, 0x1)
        /tmp/goroot/src/runtime/chan.go:581 +0x28a fp=0x8984ef4 sp=0x8984eac pc=0x804e83a
runtime.chanrecv1(0x88201c0, 0x0)
        /tmp/goroot/src/runtime/chan.go:443 +0x1c fp=0x8984f08 sp=0x8984ef4 pc=0x804e57c
testing.(*T).Parallel(0x8922620)
        /tmp/goroot/src/testing/testing.go:1039 +0xfd fp=0x8984f64 sp=0x8984f08 pc=0x811c36d
runtime_test.TestNetpollDeadlock(0x8922620)
        /tmp/goroot/src/runtime/crash_test.go:470 +0x4c fp=0x8984fa8 sp=0x8984f64 pc=0x818e4cc
testing.tRunner(0x8922620, 0x8270844)
        /tmp/goroot/src/testing/testing.go:1173 +0xb7 fp=0x8984fe8 sp=0x8984fa8 pc=0x811c647
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x8984fec sp=0x8984fe8 pc=0x80b1651
created by testing.(*T).Run
        /tmp/goroot/src/testing/testing.go:1218 +0x217

goroutine 22943 [chan receive]:
runtime.gopark(0x826fc54, 0x88201f0, 0x827170e, 0x2)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x88ffeac sp=0x88ffe98 pc=0x807ef34
runtime.chanrecv(0x88201c0, 0x0, 0x811c301, 0x8ca4301)
        /tmp/goroot/src/runtime/chan.go:581 +0x28a fp=0x88ffef4 sp=0x88ffeac pc=0x804e83a
runtime.chanrecv1(0x88201c0, 0x0)
        /tmp/goroot/src/runtime/chan.go:443 +0x1c fp=0x88fff08 sp=0x88ffef4 pc=0x804e57c
testing.(*T).Parallel(0x8801260)
        /tmp/goroot/src/testing/testing.go:1039 +0xfd fp=0x88fff64 sp=0x88fff08 pc=0x811c36d
runtime_test.TestCgoTraceback(0x8801260)
        /tmp/goroot/src/runtime/crash_cgo_test.go:43 +0x25 fp=0x88fffa8 sp=0x88fff64 pc=0x8186b35
testing.tRunner(0x8801260, 0x827055c)
        /tmp/goroot/src/testing/testing.go:1173 +0xb7 fp=0x88fffe8 sp=0x88fffa8 pc=0x811c647
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x88fffec sp=0x88fffe8 pc=0x80b1651
created by testing.(*T).Run
        /tmp/goroot/src/testing/testing.go:1218 +0x217

goroutine 22940 [chan receive]:
runtime.gopark(0x826fc54, 0x88201f0, 0x827170e, 0x2)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x8a87ee4 sp=0x8a87ed0 pc=0x807ef34
runtime.chanrecv(0x88201c0, 0x0, 0x811c301, 0x1)
        /tmp/goroot/src/runtime/chan.go:581 +0x28a fp=0x8a87f2c sp=0x8a87ee4 pc=0x804e83a
runtime.chanrecv1(0x88201c0, 0x0)
        /tmp/goroot/src/runtime/chan.go:443 +0x1c fp=0x8a87f40 sp=0x8a87f2c pc=0x804e57c
testing.(*T).Parallel(0x88010a0)
        /tmp/goroot/src/testing/testing.go:1039 +0xfd fp=0x8a87f9c sp=0x8a87f40 pc=0x811c36d
runtime_test.TestCgoCrashHandler(0x88010a0)
        /tmp/goroot/src/runtime/crash_cgo_test.go:23 +0x21 fp=0x8a87fa8 sp=0x8a87f9c pc=0x8186941
testing.tRunner(0x88010a0, 0x8270518)
        /tmp/goroot/src/testing/testing.go:1173 +0xb7 fp=0x8a87fe8 sp=0x8a87fa8 pc=0x811c647
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x8a87fec sp=0x8a87fe8 pc=0x80b1651
created by testing.(*T).Run
        /tmp/goroot/src/testing/testing.go:1218 +0x217

goroutine 23035 [chan receive]:
runtime.gopark(0x826fc54, 0x88201f0, 0x827170e, 0x2)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x88fd660 sp=0x88fd64c pc=0x807ef34
runtime.chanrecv(0x88201c0, 0x0, 0x811c301, 0x1)
        /tmp/goroot/src/runtime/chan.go:581 +0x28a fp=0x88fd6a8 sp=0x88fd660 pc=0x804e83a
runtime.chanrecv1(0x88201c0, 0x0)
        /tmp/goroot/src/runtime/chan.go:443 +0x1c fp=0x88fd6bc sp=0x88fd6a8 pc=0x804e57c
testing.(*T).Parallel(0x8922700)
        /tmp/goroot/src/testing/testing.go:1039 +0xfd fp=0x88fd718 sp=0x88fd6bc pc=0x811c36d
runtime_test.TestPanicTraceback(0x8922700)
        /tmp/goroot/src/runtime/crash_test.go:479 +0x2f fp=0x88fd7a8 sp=0x88fd718 pc=0x818e69f
testing.tRunner(0x8922700, 0x8270944)
        /tmp/goroot/src/testing/testing.go:1173 +0xb7 fp=0x88fd7e8 sp=0x88fd7a8 pc=0x811c647
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x88fd7ec sp=0x88fd7e8 pc=0x80b1651
created by testing.(*T).Run
        /tmp/goroot/src/testing/testing.go:1218 +0x217

goroutine 22955 [chan receive]:
runtime.gopark(0x826fc54, 0x88201f0, 0x827170e, 0x2)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x88fdeac sp=0x88fde98 pc=0x807ef34
runtime.chanrecv(0x88201c0, 0x0, 0x811c301, 0x1)
        /tmp/goroot/src/runtime/chan.go:581 +0x28a fp=0x88fdef4 sp=0x88fdeac pc=0x804e83a
runtime.chanrecv1(0x88201c0, 0x0)
        /tmp/goroot/src/runtime/chan.go:443 +0x1c fp=0x88fdf08 sp=0x88fdef4 pc=0x804e57c
testing.(*T).Parallel(0x8910700)
        /tmp/goroot/src/testing/testing.go:1039 +0xfd fp=0x88fdf64 sp=0x88fdf08 pc=0x811c36d
runtime_test.TestCgoTracebackContext(0x8910700)
        /tmp/goroot/src/runtime/crash_cgo_test.go:258 +0x25 fp=0x88fdfa8 sp=0x88fdf64 pc=0x8188535
testing.tRunner(0x8910700, 0x8270554)
        /tmp/goroot/src/testing/testing.go:1173 +0xb7 fp=0x88fdfe8 sp=0x88fdfa8 pc=0x811c647
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x88fdfec sp=0x88fdfe8 pc=0x80b1651
created by testing.(*T).Run
        /tmp/goroot/src/testing/testing.go:1218 +0x217

goroutine 22956 [chan receive]:
runtime.gopark(0x826fc54, 0x88201f0, 0x827170e, 0x2)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x8bd35d4 sp=0x8bd35c0 pc=0x807ef34
runtime.chanrecv(0x88201c0, 0x0, 0x811c301, 0x1)
        /tmp/goroot/src/runtime/chan.go:581 +0x28a fp=0x8bd361c sp=0x8bd35d4 pc=0x804e83a
runtime.chanrecv1(0x88201c0, 0x0)
        /tmp/goroot/src/runtime/chan.go:443 +0x1c fp=0x8bd3630 sp=0x8bd361c pc=0x804e57c
testing.(*T).Parallel(0x89107e0)
        /tmp/goroot/src/testing/testing.go:1039 +0xfd fp=0x8bd368c sp=0x8bd3630 pc=0x811c36d
runtime_test.testCgoPprof(0x89107e0, 0x0, 0x0, 0x825aa62, 0x8, 0x825a3f2, 0x6, 0x825c800, 0xc)
        /tmp/goroot/src/runtime/crash_cgo_test.go:267 +0x4e fp=0x8bd3780 sp=0x8bd368c pc=0x81886be
runtime_test.TestCgoPprof(0x89107e0)
        /tmp/goroot/src/runtime/crash_cgo_test.go:335 +0x67 fp=0x8bd37a8 sp=0x8bd3780 pc=0x81894a7
testing.tRunner(0x89107e0, 0x827054c)
        /tmp/goroot/src/testing/testing.go:1173 +0xb7 fp=0x8bd37e8 sp=0x8bd37a8 pc=0x811c647
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x8bd37ec sp=0x8bd37e8 pc=0x80b1651
created by testing.(*T).Run
        /tmp/goroot/src/testing/testing.go:1218 +0x217

goroutine 19216 [GC worker (idle)]:
runtime.gopark(0x826fcd4, 0x8b7a0d0, 0x1418, 0x0)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x898679c sp=0x8986788 pc=0x807ef34
runtime.gcBgMarkWorker(0x882e000)
        /tmp/goroot/src/runtime/mgc.go:1820 +0xe8 fp=0x89867e8 sp=0x898679c pc=0x8063c08
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x89867ec sp=0x89867e8 pc=0x80b1651
created by runtime.gcBgMarkStartWorkers
        /tmp/goroot/src/runtime/mgc.go:1768 +0x61

goroutine 19215 [GC worker (idle)]:
runtime.gopark(0x826fcd4, 0x8a18ef0, 0xffff1418, 0x0)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x8a5079c sp=0x8a50788 pc=0x807ef34
runtime.gcBgMarkWorker(0x882b500)
        /tmp/goroot/src/runtime/mgc.go:1820 +0xe8 fp=0x8a507e8 sp=0x8a5079c pc=0x8063c08
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x8a507ec sp=0x8a507e8 pc=0x80b1651
created by runtime.gcBgMarkStartWorkers
        /tmp/goroot/src/runtime/mgc.go:1768 +0x61

goroutine 23199 [chan receive]:
runtime.gopark(0x826fc54, 0x88201f0, 0x827170e, 0x2)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x8bede98 sp=0x8bede84 pc=0x807ef34
runtime.chanrecv(0x88201c0, 0x0, 0x811c301, 0x8c2e401)
        /tmp/goroot/src/runtime/chan.go:581 +0x28a fp=0x8bedee0 sp=0x8bede98 pc=0x804e83a
runtime.chanrecv1(0x88201c0, 0x0)
        /tmp/goroot/src/runtime/chan.go:443 +0x1c fp=0x8bedef4 sp=0x8bedee0 pc=0x804e57c
testing.(*T).Parallel(0x8922c40)
        /tmp/goroot/src/testing/testing.go:1039 +0xfd fp=0x8bedf50 sp=0x8bedef4 pc=0x811c36d
runtime_test.TestMemmove(0x8922c40)
        /tmp/goroot/src/runtime/memmove_test.go:23 +0x36 fp=0x8bedfa8 sp=0x8bedf50 pc=0x81b0926
testing.tRunner(0x8922c40, 0x8270820)
        /tmp/goroot/src/testing/testing.go:1173 +0xb7 fp=0x8bedfe8 sp=0x8bedfa8 pc=0x811c647
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x8bedfec sp=0x8bedfe8 pc=0x80b1651
created by testing.(*T).Run
        /tmp/goroot/src/testing/testing.go:1218 +0x217

goroutine 23246 [GC worker (idle)]:
runtime.gopark(0x826fcd4, 0x8a18ef8, 0xffff1418, 0x0)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x8a5579c sp=0x8a55788 pc=0x807ef34
runtime.gcBgMarkWorker(0x882ca00)
        /tmp/goroot/src/runtime/mgc.go:1820 +0xe8 fp=0x8a557e8 sp=0x8a5579c pc=0x8063c08
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x8a557ec sp=0x8a557e8 pc=0x80b1651
created by runtime.gcBgMarkStartWorkers
        /tmp/goroot/src/runtime/mgc.go:1768 +0x61

goroutine 23298 [GC worker (idle)]:
runtime.gopark(0x826fcd4, 0x8a64068, 0x8801418, 0x0)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x8839f9c sp=0x8839f88 pc=0x807ef34
runtime.gcBgMarkWorker(0x882f500)
        /tmp/goroot/src/runtime/mgc.go:1820 +0xe8 fp=0x8839fe8 sp=0x8839f9c pc=0x8063c08
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x8839fec sp=0x8839fe8 pc=0x80b1651
created by runtime.gcBgMarkStartWorkers
        /tmp/goroot/src/runtime/mgc.go:1768 +0x61

goroutine 23299 [GC worker (idle)]:
runtime.gopark(0x826fcd4, 0x8a64080, 0x8811418, 0x0)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x8be979c sp=0x8be9788 pc=0x807ef34
runtime.gcBgMarkWorker(0x8830a00)
        /tmp/goroot/src/runtime/mgc.go:1820 +0xe8 fp=0x8be97e8 sp=0x8be979c pc=0x8063c08
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x8be97ec sp=0x8be97e8 pc=0x80b1651
created by runtime.gcBgMarkStartWorkers
        /tmp/goroot/src/runtime/mgc.go:1768 +0x61

goroutine 23033 [chan receive]:
runtime.gopark(0x826fc54, 0x88201f0, 0x827170e, 0x2)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x8be9eac sp=0x8be9e98 pc=0x807ef34
runtime.chanrecv(0x88201c0, 0x0, 0x811c301, 0x1)
        /tmp/goroot/src/runtime/chan.go:581 +0x28a fp=0x8be9ef4 sp=0x8be9eac pc=0x804e83a
runtime.chanrecv1(0x88201c0, 0x0)
        /tmp/goroot/src/runtime/chan.go:443 +0x1c fp=0x8be9f08 sp=0x8be9ef4 pc=0x804e57c
testing.(*T).Parallel(0x8922540)
        /tmp/goroot/src/testing/testing.go:1039 +0xfd fp=0x8be9f64 sp=0x8be9f08 pc=0x811c36d
runtime_test.TestRecoverBeforePanicAfterGoexit2(0x8922540)
        /tmp/goroot/src/runtime/crash_test.go:453 +0x25 fp=0x8be9fa8 sp=0x8be9f64 pc=0x818e325
testing.tRunner(0x8922540, 0x82709c4)
        /tmp/goroot/src/testing/testing.go:1173 +0xb7 fp=0x8be9fe8 sp=0x8be9fa8 pc=0x811c647
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x8be9fec sp=0x8be9fe8 pc=0x80b1651
created by testing.(*T).Run
        /tmp/goroot/src/testing/testing.go:1218 +0x217

goroutine 23219 [chan receive]:
runtime.gopark(0x826fc54, 0x88201f0, 0x827170e, 0x2)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x8bec6a0 sp=0x8bec68c pc=0x807ef34
runtime.chanrecv(0x88201c0, 0x0, 0x811c301, 0x1)
        /tmp/goroot/src/runtime/chan.go:581 +0x28a fp=0x8bec6e8 sp=0x8bec6a0 pc=0x804e83a
runtime.chanrecv1(0x88201c0, 0x0)
        /tmp/goroot/src/runtime/chan.go:443 +0x1c fp=0x8bec6fc sp=0x8bec6e8 pc=0x804e57c
testing.(*T).Parallel(0x8b000e0)
        /tmp/goroot/src/testing/testing.go:1039 +0xfd fp=0x8bec758 sp=0x8bec6fc pc=0x811c36d
runtime_test.testConcurrentReadsAfterGrowth(0x8b000e0, 0x83a5600)
        /tmp/goroot/src/runtime/map_test.go:315 +0x33 fp=0x8bec79c sp=0x8bec758 pc=0x81aaa73
runtime_test.TestConcurrentReadsAfterGrowth(0x8b000e0)
        /tmp/goroot/src/runtime/map_test.go:361 +0x26 fp=0x8bec7a8 sp=0x8bec79c pc=0x81aad06
testing.tRunner(0x8b000e0, 0x82705b8)
        /tmp/goroot/src/testing/testing.go:1173 +0xb7 fp=0x8bec7e8 sp=0x8bec7a8 pc=0x811c647
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x8bec7ec sp=0x8bec7e8 pc=0x80b1651
created by testing.(*T).Run
        /tmp/goroot/src/testing/testing.go:1218 +0x217

goroutine 22945 [chan receive]:
runtime.gopark(0x826fc54, 0x88201f0, 0x827170e, 0x2)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x8be4eac sp=0x8be4e98 pc=0x807ef34
runtime.chanrecv(0x88201c0, 0x0, 0x811c301, 0x885a701)
        /tmp/goroot/src/runtime/chan.go:581 +0x28a fp=0x8be4ef4 sp=0x8be4eac pc=0x804e83a
runtime.chanrecv1(0x88201c0, 0x0)
        /tmp/goroot/src/runtime/chan.go:443 +0x1c fp=0x8be4f08 sp=0x8be4ef4 pc=0x804e57c
testing.(*T).Parallel(0x8801500)
        /tmp/goroot/src/testing/testing.go:1039 +0xfd fp=0x8be4f64 sp=0x8be4f08 pc=0x811c36d
runtime_test.TestCgoExternalThreadPanic(0x8801500)
        /tmp/goroot/src/runtime/crash_cgo_test.go:75 +0x25 fp=0x8be4fa8 sp=0x8be4f64 pc=0x8186e45
testing.tRunner(0x8801500, 0x8270528)
        /tmp/goroot/src/testing/testing.go:1173 +0xb7 fp=0x8be4fe8 sp=0x8be4fa8 pc=0x811c647
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x8be4fec sp=0x8be4fe8 pc=0x80b1651
created by testing.(*T).Run
        /tmp/goroot/src/testing/testing.go:1218 +0x217

goroutine 23220 [chan receive]:
runtime.gopark(0x826fc54, 0x88201f0, 0x827170e, 0x2)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x8bdfea0 sp=0x8bdfe8c pc=0x807ef34
runtime.chanrecv(0x88201c0, 0x0, 0x811c301, 0x1)
        /tmp/goroot/src/runtime/chan.go:581 +0x28a fp=0x8bdfee8 sp=0x8bdfea0 pc=0x804e83a
runtime.chanrecv1(0x88201c0, 0x0)
        /tmp/goroot/src/runtime/chan.go:443 +0x1c fp=0x8bdfefc sp=0x8bdfee8 pc=0x804e57c
testing.(*T).Parallel(0x8b001c0)
        /tmp/goroot/src/testing/testing.go:1039 +0xfd fp=0x8bdff58 sp=0x8bdfefc pc=0x811c36d
runtime_test.testConcurrentReadsAfterGrowth(0x8b001c0, 0x83a5601)
        /tmp/goroot/src/runtime/map_test.go:315 +0x33 fp=0x8bdff9c sp=0x8bdff58 pc=0x81aaa73
runtime_test.TestConcurrentReadsAfterGrowthReflect(0x8b001c0)
        /tmp/goroot/src/runtime/map_test.go:365 +0x26 fp=0x8bdffa8 sp=0x8bdff9c pc=0x81aad46
testing.tRunner(0x8b001c0, 0x82705b4)
        /tmp/goroot/src/testing/testing.go:1173 +0xb7 fp=0x8bdffe8 sp=0x8bdffa8 pc=0x811c647
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x8bdffec sp=0x8bdffe8 pc=0x80b1651
created by testing.(*T).Run
        /tmp/goroot/src/testing/testing.go:1218 +0x217

goroutine 22944 [chan receive]:
runtime.gopark(0x826fc54, 0x88201f0, 0x827170e, 0x2)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x8bd5eac sp=0x8bd5e98 pc=0x807ef34
runtime.chanrecv(0x88201c0, 0x0, 0x811c301, 0x1)
        /tmp/goroot/src/runtime/chan.go:581 +0x28a fp=0x8bd5ef4 sp=0x8bd5eac pc=0x804e83a
runtime.chanrecv1(0x88201c0, 0x0)
        /tmp/goroot/src/runtime/chan.go:443 +0x1c fp=0x8bd5f08 sp=0x8bd5ef4 pc=0x804e57c
testing.(*T).Parallel(0x8801340)
        /tmp/goroot/src/testing/testing.go:1039 +0xfd fp=0x8bd5f64 sp=0x8bd5f08 pc=0x811c36d
runtime_test.TestCgoCallbackGC(0x8801340)
        /tmp/goroot/src/runtime/crash_cgo_test.go:52 +0x25 fp=0x8bd5fa8 sp=0x8bd5f64 pc=0x8186c95
testing.tRunner(0x8801340, 0x8270510)
        /tmp/goroot/src/testing/testing.go:1173 +0xb7 fp=0x8bd5fe8 sp=0x8bd5fa8 pc=0x811c647
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x8bd5fec sp=0x8bd5fe8 pc=0x80b1651
created by testing.(*T).Run
        /tmp/goroot/src/testing/testing.go:1218 +0x217

goroutine 22957 [chan receive]:
runtime.gopark(0x826fc54, 0x88201f0, 0x827170e, 0x2)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x8bea5d4 sp=0x8bea5c0 pc=0x807ef34
runtime.chanrecv(0x88201c0, 0x0, 0x811c301, 0x1)
        /tmp/goroot/src/runtime/chan.go:581 +0x28a fp=0x8bea61c sp=0x8bea5d4 pc=0x804e83a
runtime.chanrecv1(0x88201c0, 0x0)
        /tmp/goroot/src/runtime/chan.go:443 +0x1c fp=0x8bea630 sp=0x8bea61c pc=0x804e57c
testing.(*T).Parallel(0x89108c0)
        /tmp/goroot/src/testing/testing.go:1039 +0xfd fp=0x8bea68c sp=0x8bea630 pc=0x811c36d
runtime_test.testCgoPprof(0x89108c0, 0x825cfca, 0xe, 0x825aa62, 0x8, 0x825a3f2, 0x6, 0x825c800, 0xc)
        /tmp/goroot/src/runtime/crash_cgo_test.go:267 +0x4e fp=0x8bea780 sp=0x8bea68c pc=0x81886be
runtime_test.TestCgoPprofPIE(0x89108c0)
        /tmp/goroot/src/runtime/crash_cgo_test.go:339 +0x69 fp=0x8bea7a8 sp=0x8bea780 pc=0x8189529
testing.tRunner(0x89108c0, 0x8270540)
        /tmp/goroot/src/testing/testing.go:1173 +0xb7 fp=0x8bea7e8 sp=0x8bea7a8 pc=0x811c647
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x8bea7ec sp=0x8bea7e8 pc=0x80b1651
created by testing.(*T).Run
        /tmp/goroot/src/testing/testing.go:1218 +0x217

goroutine 22954 [chan receive]:
runtime.gopark(0x826fc54, 0x88201f0, 0x827170e, 0x2)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x8beaeb0 sp=0x8beae9c pc=0x807ef34
runtime.chanrecv(0x88201c0, 0x0, 0x811c301, 0x1)
        /tmp/goroot/src/runtime/chan.go:581 +0x28a fp=0x8beaef8 sp=0x8beaeb0 pc=0x804e83a
runtime.chanrecv1(0x88201c0, 0x0)
        /tmp/goroot/src/runtime/chan.go:443 +0x1c fp=0x8beaf0c sp=0x8beaef8 pc=0x804e57c
testing.(*T).Parallel(0x8910620)
        /tmp/goroot/src/testing/testing.go:1039 +0xfd fp=0x8beaf68 sp=0x8beaf0c pc=0x811c36d
runtime_test.TestCgoCrashTraceback(0x8910620)
        /tmp/goroot/src/runtime/crash_cgo_test.go:241 +0x25 fp=0x8beafa8 sp=0x8beaf68 pc=0x8188315
testing.tRunner(0x8910620, 0x827051c)
        /tmp/goroot/src/testing/testing.go:1173 +0xb7 fp=0x8beafe8 sp=0x8beafa8 pc=0x811c647
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x8beafec sp=0x8beafe8 pc=0x80b1651
created by testing.(*T).Run
        /tmp/goroot/src/testing/testing.go:1218 +0x217

goroutine 22958 [chan receive]:
runtime.gopark(0x826fc54, 0x88201f0, 0x827170e, 0x2)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x88345d4 sp=0x88345c0 pc=0x807ef34
runtime.chanrecv(0x88201c0, 0x0, 0x811c301, 0x8884201)
        /tmp/goroot/src/runtime/chan.go:581 +0x28a fp=0x883461c sp=0x88345d4 pc=0x804e83a
runtime.chanrecv1(0x88201c0, 0x0)
        /tmp/goroot/src/runtime/chan.go:443 +0x1c fp=0x8834630 sp=0x883461c pc=0x804e57c
testing.(*T).Parallel(0x89109a0)
        /tmp/goroot/src/testing/testing.go:1039 +0xfd fp=0x883468c sp=0x8834630 pc=0x811c36d
runtime_test.testCgoPprof(0x89109a0, 0x0, 0x0, 0x825d09c, 0xe, 0x825c6c8, 0xc, 0x825cccc, 0xd)
        /tmp/goroot/src/runtime/crash_cgo_test.go:267 +0x4e fp=0x8834780 sp=0x883468c pc=0x81886be
runtime_test.TestCgoPprofThread(0x89109a0)
        /tmp/goroot/src/runtime/crash_cgo_test.go:343 +0x67 fp=0x88347a8 sp=0x8834780 pc=0x81895a7
testing.tRunner(0x89109a0, 0x8270548)
        /tmp/goroot/src/testing/testing.go:1173 +0xb7 fp=0x88347e8 sp=0x88347a8 pc=0x811c647
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x88347ec sp=0x88347e8 pc=0x80b1651
created by testing.(*T).Run
        /tmp/goroot/src/testing/testing.go:1218 +0x217

goroutine 22959 [chan receive]:
runtime.gopark(0x826fc54, 0x88201f0, 0x827170e, 0x2)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x88385d4 sp=0x88385c0 pc=0x807ef34
runtime.chanrecv(0x88201c0, 0x0, 0x811c301, 0x1)
        /tmp/goroot/src/runtime/chan.go:581 +0x28a fp=0x883861c sp=0x88385d4 pc=0x804e83a
runtime.chanrecv1(0x88201c0, 0x0)
        /tmp/goroot/src/runtime/chan.go:443 +0x1c fp=0x8838630 sp=0x883861c pc=0x804e57c
testing.(*T).Parallel(0x8910b60)
        /tmp/goroot/src/testing/testing.go:1039 +0xfd fp=0x883868c sp=0x8838630 pc=0x811c36d
runtime_test.testCgoPprof(0x8910b60, 0x0, 0x0, 0x8263877, 0x19, 0x825c6c8, 0xc, 0x826175f, 0x15)
        /tmp/goroot/src/runtime/crash_cgo_test.go:267 +0x4e fp=0x8838780 sp=0x883868c pc=0x81886be
runtime_test.TestCgoPprofThreadNoTraceback(0x8910b60)
        /tmp/goroot/src/runtime/crash_cgo_test.go:347 +0x67 fp=0x88387a8 sp=0x8838780 pc=0x8189627
testing.tRunner(0x8910b60, 0x8270544)
        /tmp/goroot/src/testing/testing.go:1173 +0xb7 fp=0x88387e8 sp=0x88387a8 pc=0x811c647
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x88387ec sp=0x88387e8 pc=0x80b1651
created by testing.(*T).Run
        /tmp/goroot/src/testing/testing.go:1218 +0x217

goroutine 22961 [chan receive]:
runtime.gopark(0x826fc54, 0x88201f0, 0x827170e, 0x2)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x8a51688 sp=0x8a51674 pc=0x807ef34
runtime.chanrecv(0x88201c0, 0x0, 0x811c301, 0x1)
        /tmp/goroot/src/runtime/chan.go:581 +0x28a fp=0x8a516d0 sp=0x8a51688 pc=0x804e83a
runtime.chanrecv1(0x88201c0, 0x0)
        /tmp/goroot/src/runtime/chan.go:443 +0x1c fp=0x8a516e4 sp=0x8a516d0 pc=0x804e57c
testing.(*T).Parallel(0x8910ee0)
        /tmp/goroot/src/testing/testing.go:1039 +0xfd fp=0x8a51740 sp=0x8a516e4 pc=0x811c36d
runtime_test.TestRaceSignal(0x8910ee0)
        /tmp/goroot/src/runtime/crash_cgo_test.go:379 +0x25 fp=0x8a517a8 sp=0x8a51740 pc=0x8189a25
testing.tRunner(0x8910ee0, 0x82709b8)
        /tmp/goroot/src/testing/testing.go:1173 +0xb7 fp=0x8a517e8 sp=0x8a517a8 pc=0x811c647
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x8a517ec sp=0x8a517e8 pc=0x80b1651
created by testing.(*T).Run
        /tmp/goroot/src/testing/testing.go:1218 +0x217

goroutine 22962 [chan receive]:
runtime.gopark(0x826fc54, 0x88201f0, 0x827170e, 0x2)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x8bde6ac sp=0x8bde698 pc=0x807ef34
runtime.chanrecv(0x88201c0, 0x0, 0x811c301, 0x1)
        /tmp/goroot/src/runtime/chan.go:581 +0x28a fp=0x8bde6f4 sp=0x8bde6ac pc=0x804e83a
runtime.chanrecv1(0x88201c0, 0x0)
        /tmp/goroot/src/runtime/chan.go:443 +0x1c fp=0x8bde708 sp=0x8bde6f4 pc=0x804e57c
testing.(*T).Parallel(0x8910fc0)
        /tmp/goroot/src/testing/testing.go:1039 +0xfd fp=0x8bde764 sp=0x8bde708 pc=0x811c36d
runtime_test.TestCgoNumGoroutine(0x8910fc0)
        /tmp/goroot/src/runtime/crash_cgo_test.go:413 +0x25 fp=0x8bde7a8 sp=0x8bde764 pc=0x8189e75
testing.tRunner(0x8910fc0, 0x8270538)
        /tmp/goroot/src/testing/testing.go:1173 +0xb7 fp=0x8bde7e8 sp=0x8bde7a8 pc=0x811c647
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x8bde7ec sp=0x8bde7e8 pc=0x80b1651
created by testing.(*T).Run
        /tmp/goroot/src/testing/testing.go:1218 +0x217

goroutine 22963 [chan receive]:
runtime.gopark(0x826fc54, 0x88201f0, 0x827170e, 0x2)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x8bdf68c sp=0x8bdf678 pc=0x807ef34
runtime.chanrecv(0x88201c0, 0x0, 0x811c301, 0x1)
        /tmp/goroot/src/runtime/chan.go:581 +0x28a fp=0x8bdf6d4 sp=0x8bdf68c pc=0x804e83a
runtime.chanrecv1(0x88201c0, 0x0)
        /tmp/goroot/src/runtime/chan.go:443 +0x1c fp=0x8bdf6e8 sp=0x8bdf6d4 pc=0x804e57c
testing.(*T).Parallel(0x8911180)
        /tmp/goroot/src/testing/testing.go:1039 +0xfd fp=0x8bdf744 sp=0x8bdf6e8 pc=0x811c36d
runtime_test.TestCatchPanic(0x8911180)
        /tmp/goroot/src/runtime/crash_cgo_test.go:422 +0x25 fp=0x8bdf7a8 sp=0x8bdf744 pc=0x8189fd5
testing.tRunner(0x8911180, 0x8270508)
        /tmp/goroot/src/testing/testing.go:1173 +0xb7 fp=0x8bdf7e8 sp=0x8bdf7a8 pc=0x811c647
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x8bdf7ec sp=0x8bdf7e8 pc=0x80b1651
created by testing.(*T).Run
        /tmp/goroot/src/testing/testing.go:1218 +0x217

goroutine 22964 [chan receive]:
runtime.gopark(0x826fc54, 0x88201f0, 0x827170e, 0x2)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x8be26e0 sp=0x8be26cc pc=0x807ef34
runtime.chanrecv(0x88201c0, 0x0, 0x811c301, 0x1)
        /tmp/goroot/src/runtime/chan.go:581 +0x28a fp=0x8be2728 sp=0x8be26e0 pc=0x804e83a
runtime.chanrecv1(0x88201c0, 0x0)
        /tmp/goroot/src/runtime/chan.go:443 +0x1c fp=0x8be273c sp=0x8be2728 pc=0x804e57c
testing.(*T).Parallel(0x8911340)
        /tmp/goroot/src/testing/testing.go:1039 +0xfd fp=0x8be2798 sp=0x8be273c pc=0x811c36d
runtime_test.TestCgoLockOSThreadExit(0x8911340)
        /tmp/goroot/src/runtime/crash_cgo_test.go:458 +0x21 fp=0x8be27a8 sp=0x8be2798 pc=0x818a361
testing.tRunner(0x8911340, 0x8270534)
        /tmp/goroot/src/testing/testing.go:1173 +0xb7 fp=0x8be27e8 sp=0x8be27a8 pc=0x811c647
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x8be27ec sp=0x8be27e8 pc=0x80b1651
created by testing.(*T).Run
        /tmp/goroot/src/testing/testing.go:1218 +0x217

goroutine 22966 [chan receive]:
runtime.gopark(0x826fc54, 0x88201f0, 0x827170e, 0x2)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x8bd16ac sp=0x8bd1698 pc=0x807ef34
runtime.chanrecv(0x88201c0, 0x0, 0x811c301, 0x1)
        /tmp/goroot/src/runtime/chan.go:581 +0x28a fp=0x8bd16f4 sp=0x8bd16ac pc=0x804e83a
runtime.chanrecv1(0x88201c0, 0x0)
        /tmp/goroot/src/runtime/chan.go:443 +0x1c fp=0x8bd1708 sp=0x8bd16f4 pc=0x804e57c
testing.(*T).Parallel(0x89116c0)
        /tmp/goroot/src/testing/testing.go:1039 +0xfd fp=0x8bd1764 sp=0x8bd1708 pc=0x811c36d
runtime_test.TestSigStackSwapping(0x89116c0)
        /tmp/goroot/src/runtime/crash_cgo_test.go:482 +0x25 fp=0x8bd17a8 sp=0x8bd1764 pc=0x818a5b5
testing.tRunner(0x89116c0, 0x8270a7c)
        /tmp/goroot/src/testing/testing.go:1173 +0xb7 fp=0x8bd17e8 sp=0x8bd17a8 pc=0x811c647
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x8bd17ec sp=0x8bd17e8 pc=0x80b1651
created by testing.(*T).Run
        /tmp/goroot/src/testing/testing.go:1218 +0x217

goroutine 22967 [chan receive]:
runtime.gopark(0x826fc54, 0x88201f0, 0x827170e, 0x2)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x8be7eac sp=0x8be7e98 pc=0x807ef34
runtime.chanrecv(0x88201c0, 0x0, 0x811c301, 0x1)
        /tmp/goroot/src/runtime/chan.go:581 +0x28a fp=0x8be7ef4 sp=0x8be7eac pc=0x804e83a
runtime.chanrecv1(0x88201c0, 0x0)
        /tmp/goroot/src/runtime/chan.go:443 +0x1c fp=0x8be7f08 sp=0x8be7ef4 pc=0x804e57c
testing.(*T).Parallel(0x89117a0)
        /tmp/goroot/src/testing/testing.go:1039 +0xfd fp=0x8be7f64 sp=0x8be7f08 pc=0x811c36d
runtime_test.TestCgoTracebackSigpanic(0x89117a0)
        /tmp/goroot/src/runtime/crash_cgo_test.go:499 +0x25 fp=0x8be7fa8 sp=0x8be7f64 pc=0x818a715
testing.tRunner(0x89117a0, 0x8270558)
        /tmp/goroot/src/testing/testing.go:1173 +0xb7 fp=0x8be7fe8 sp=0x8be7fa8 pc=0x811c647
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x8be7fec sp=0x8be7fe8 pc=0x80b1651
created by testing.(*T).Run
        /tmp/goroot/src/testing/testing.go:1218 +0x217

goroutine 22568 [chan receive]:
runtime.gopark(0x826fc54, 0x88201f0, 0x827170e, 0x2)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x8be76ac sp=0x8be7698 pc=0x807ef34
runtime.chanrecv(0x88201c0, 0x0, 0x811c301, 0x1)
        /tmp/goroot/src/runtime/chan.go:581 +0x28a fp=0x8be76f4 sp=0x8be76ac pc=0x804e83a
runtime.chanrecv1(0x88201c0, 0x0)
        /tmp/goroot/src/runtime/chan.go:443 +0x1c fp=0x8be7708 sp=0x8be76f4 pc=0x804e57c
testing.(*T).Parallel(0x899c000)
        /tmp/goroot/src/testing/testing.go:1039 +0xfd fp=0x8be7764 sp=0x8be7708 pc=0x811c36d
runtime_test.TestVDSO(0x899c000)
        /tmp/goroot/src/runtime/crash_test.go:155 +0x25 fp=0x8be77a8 sp=0x8be7764 pc=0x818c2e5
testing.tRunner(0x899c000, 0x8270bb0)
        /tmp/goroot/src/testing/testing.go:1173 +0xb7 fp=0x8be77e8 sp=0x8be77a8 pc=0x811c647
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x8be77ec sp=0x8be77e8 pc=0x80b1651
created by testing.(*T).Run
        /tmp/goroot/src/testing/testing.go:1218 +0x217

goroutine 23032 [chan receive]:
runtime.gopark(0x826fc54, 0x88201f0, 0x827170e, 0x2)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x8be66ac sp=0x8be6698 pc=0x807ef34
runtime.chanrecv(0x88201c0, 0x0, 0x811c301, 0x1)
        /tmp/goroot/src/runtime/chan.go:581 +0x28a fp=0x8be66f4 sp=0x8be66ac pc=0x804e83a
runtime.chanrecv1(0x88201c0, 0x0)
        /tmp/goroot/src/runtime/chan.go:443 +0x1c fp=0x8be6708 sp=0x8be66f4 pc=0x804e57c
testing.(*T).Parallel(0x8922460)
        /tmp/goroot/src/testing/testing.go:1039 +0xfd fp=0x8be6764 sp=0x8be6708 pc=0x811c36d
runtime_test.TestRecoverBeforePanicAfterGoexit(0x8922460)
        /tmp/goroot/src/runtime/crash_test.go:441 +0x25 fp=0x8be67a8 sp=0x8be6764 pc=0x818e1a5
testing.tRunner(0x8922460, 0x82709c8)
        /tmp/goroot/src/testing/testing.go:1173 +0xb7 fp=0x8be67e8 sp=0x8be67a8 pc=0x811c647
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x8be67ec sp=0x8be67e8 pc=0x80b1651
created by testing.(*T).Run
        /tmp/goroot/src/testing/testing.go:1218 +0x217
FAIL    runtime 10.377s
ok      runtime/debug   0.065s
ok      runtime/internal/atomic 0.056s
ok      runtime/internal/math   0.022s
ok      runtime/internal/sys    0.025s
ok      runtime/pprof   6.243s
ok      runtime/race    0.279s
ok      runtime/trace   1.437s
ok      sort    0.133s
ok      strconv 0.310s
ok      strings 0.110s
ok      sync    0.715s
ok      sync/atomic     0.122s
ok      syscall 2.396s
ok      testing 1.186s
ok      testing/iotest  0.015s
ok      testing/quick   0.029s
ok      text/scanner    0.018s
ok      text/tabwriter  0.012s
ok      text/template   0.034s
ok      text/template/parse     0.033s
ok      time    2.143s
ok      unicode 0.025s
ok      unicode/utf16   0.021s
ok      unicode/utf8    0.049s
ok      cmd/addr2line   5.174s
ok      cmd/api 6.244s
ok      cmd/asm/internal/asm    1.223s
ok      cmd/asm/internal/lex    0.071s
ok      cmd/compile     0.037s
ok      cmd/compile/internal/gc 7.534s
ok      cmd/compile/internal/logopt     0.342s
ok      cmd/compile/internal/ssa        0.512s
ok      cmd/compile/internal/syntax     0.074s
ok      cmd/compile/internal/test       0.020s [no tests to run]
ok      cmd/compile/internal/types      0.037s
ok      cmd/cover       3.107s
ok      cmd/doc 0.206s
ok      cmd/fix 3.418s
ok      cmd/go  42.145s
ok      cmd/go/internal/auth    0.034s
ok      cmd/go/internal/cache   0.277s
ok      cmd/go/internal/fsys    0.044s
ok      cmd/go/internal/generate        0.035s
ok      cmd/go/internal/get     0.065s
ok      cmd/go/internal/imports 0.049s
ok      cmd/go/internal/load    0.044s
ok      cmd/go/internal/lockedfile      0.182s
ok      cmd/go/internal/lockedfile/internal/filelock    0.093s
ok      cmd/go/internal/modconv 0.020s
ok      cmd/go/internal/modfetch        0.283s
ok      cmd/go/internal/modfetch/codehost       0.019s
ok      cmd/go/internal/modfetch/zip_sum_test   0.032s
ok      cmd/go/internal/modload 0.018s
ok      cmd/go/internal/mvs     0.019s
ok      cmd/go/internal/par     0.085s
ok      cmd/go/internal/renameio        0.529s
ok      cmd/go/internal/search  0.007s
ok      cmd/go/internal/str     0.025s
ok      cmd/go/internal/test    0.052s
ok      cmd/go/internal/txtar   0.015s
ok      cmd/go/internal/vcs     0.028s
ok      cmd/go/internal/web     0.058s
ok      cmd/go/internal/work    0.024s
ok      cmd/gofmt       0.117s
ok      cmd/internal/archive    1.222s
ok      cmd/internal/buildid    0.276s
ok      cmd/internal/dwarf      0.038s
ok      cmd/internal/edit       0.041s
ok      cmd/internal/goobj      0.010s
ok      cmd/internal/moddeps    2.026s
ok      cmd/internal/obj        0.021s
ok      cmd/internal/obj/arm64  0.203s
ok      cmd/internal/obj/ppc64  0.256s
ok      cmd/internal/obj/riscv  0.151s
ok      cmd/internal/obj/x86    5.914s
ok      cmd/internal/objabi     0.015s
ok      cmd/internal/pkgpath    0.101s
ok      cmd/internal/src        0.054s
ok      cmd/internal/sys        0.042s
ok      cmd/internal/test2json  0.166s
ok      cmd/link        20.535s
ok      cmd/link/internal/benchmark     0.049s
ok      cmd/link/internal/ld    5.406s
ok      cmd/link/internal/loader        0.112s
ok      cmd/nm  6.004s
ok      cmd/objdump     8.448s
ok      cmd/pack        4.123s
ok      cmd/trace       0.235s
ok      cmd/vet 12.521s
FAIL
go tool dist: Failed: exit status 1
ianlancetaylor commented 4 years ago

CC @mknyszek

mknyszek commented 4 years ago

Interestingly enough, this isn't a failure in the function being tested, but instead in actually generating the data structure for the test. As a result, I suspect this is benign (i.e. there likely isn't an actual non-test bug here), but I'm surprised that this isn't showing up on the trybots and in CI. I tried to reproduce locally and I was unable to at tip or at 1.15.3. Though, I don't have access to 386 hardware, just amd64 and GOARCH=386... I'm pretty sure the trybots and CI also just do this too. Are you running this on real 386 hardware?

Whissi commented 4 years ago

Failing everywhere: On virtualized x86 systems (Host is x86_64) and real x86 hardware (just finished testing on Pentium 4 Prescott which is 32bit only and Atom N550 which supports 64bit but is running x86 Linux).

mknyszek commented 4 years ago

There's only three tests where the layout for the bitmap to be tested is not constant, and they're the hugepage tests.

Can you please confirm that it's the hugepage tests that are failing by running the following command and sharing the output? (where "go" is in your development GOROOT at bin/go)

go test -v -run="TestPallocDataFindScavengeCandidate" runtime

Also, what's the hugepage size used for THP on these platforms?

cat /sys/kernel/mm/transparent_hugepage/hpage_pmd_size

That should help me track down what exactly the issue is and I can fix it.

Whissi commented 4 years ago 
/tmp/goroot/src # ./make.bash
Building Go cmd/dist using /usr/lib/go. (go1.14.7 linux/386)
Building Go toolchain1 using /usr/lib/go.
Building Go bootstrap cmd/go (go_bootstrap) using Go toolchain1.
Building Go toolchain2 using go_bootstrap and Go toolchain1.
Building Go toolchain3 using go_bootstrap and Go toolchain2.
Building packages and commands for linux/386.
---
Installed Go for linux/386 in /tmp/goroot
Installed commands in /tmp/goroot/bin
vm-gentoo-x86 /tmp/goroot/src # ./all.bash
Building Go cmd/dist using /usr/lib/go. (go1.14.7 linux/386)
Building Go toolchain1 using /usr/lib/go.
Building Go bootstrap cmd/go (go_bootstrap) using Go toolchain1.
Building Go toolchain2 using go_bootstrap and Go toolchain1.
Building Go toolchain3 using go_bootstrap and Go toolchain2.
Building packages and commands for linux/386.

##### Testing packages.
^C
gentoo-x86 /tmp/goroot/src # cd ..
gentoo-x86 /tmp/goroot # find . -name 'go'
./misc/cgo/testcshared/testdata/go2c2go/go
./pkg/linux_386/cmd/go
./pkg/linux_386/cmd/vendor/golang.org/x/tools/go
./pkg/linux_386/go
./bin/go
./src/cmd/go
./src/cmd/vendor/golang.org/x/tools/go
./src/go
gentoo-x86 /tmp/goroot # ./bin/go version
go version devel +5647d01ab7 Mon Oct 19 19:51:19 2020 +0000 linux/386

gentoo-x86 /tmp/goroot # ./bin/go test -v -run="TestPallocDataFindScavengeCandidate" runtime
=== RUN   TestPallocDataFindScavengeCandidate
=== RUN   TestPallocDataFindScavengeCandidate/NoneFreeMin1
=== RUN   TestPallocDataFindScavengeCandidate/BottomEdge64WithFullMin8
=== RUN   TestPallocDataFindScavengeCandidate/NoneFreeMin16
=== RUN   TestPallocDataFindScavengeCandidate/AllFreeMin32
=== RUN   TestPallocDataFindScavengeCandidate/StartFreeMin4
=== RUN   TestPallocDataFindScavengeCandidate/Straddle64Min8
=== RUN   TestPallocDataFindScavengeCandidate/PreserveHugePageBottom
fatal error: index out of range

goroutine 24 [running]:
runtime.throw(0x825f734, 0x12)
        /tmp/goroot/src/runtime/panic.go:1112 +0x6a fp=0x943a6e0 sp=0x943a6cc pc=0x807c6ca
runtime.panicCheck1(0x80725ee, 0x825f734, 0x12)
        /tmp/goroot/src/runtime/panic.go:34 +0xb7 fp=0x943a6f4 sp=0x943a6e0 pc=0x8079be7
runtime.goPanicIndexU(0x8, 0x8)
        /tmp/goroot/src/runtime/panic.go:91 +0x37 fp=0x943a718 sp=0x943a6f4 pc=0x8079d47
runtime.(*pageBits).setRange(0x950c380, 0x202, 0xfffffffe)
        /tmp/goroot/src/runtime/mpallocbits.go:31 +0x2ce fp=0x943a74c sp=0x943a718 pc=0x80725ee
runtime.(*pallocBits).allocRange(...)
        /tmp/goroot/src/runtime/mpallocbits.go:340
runtime.(*pallocData).allocRange(0x950c380, 0x202, 0xfffffffe)
        /tmp/goroot/src/runtime/mpallocbits.go:418 +0x33 fp=0x943a75c sp=0x943a74c pc=0x8074143
runtime.(*PallocData).AllocRange(...)
        /tmp/goroot/src/runtime/export_test.go:688
runtime_test.makePallocData(0x950e858, 0x1, 0x1, 0x0, 0x0, 0x0, 0x83bd4a0)
        /tmp/goroot/src/runtime/mgcscavenge_test.go:24 +0x61 fp=0x943a774 sp=0x943a75c pc=0x81b4121
runtime_test.TestPallocDataFindScavengeCandidate.func1(0x95027e0)
        /tmp/goroot/src/runtime/mgcscavenge_test.go:263 +0x4b fp=0x943a7a8 sp=0x943a774 pc=0x81ee9db
testing.tRunner(0x95027e0, 0x9530120)
        /tmp/goroot/src/testing/testing.go:1173 +0xb7 fp=0x943a7e8 sp=0x943a7a8 pc=0x811c647
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x943a7ec sp=0x943a7e8 pc=0x80b1651
created by testing.(*T).Run
        /tmp/goroot/src/testing/testing.go:1218 +0x217

goroutine 1 [chan receive, locked to thread]:
runtime.gopark(0x826fc74, 0x9420330, 0x170e, 0x2)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x944bd48 sp=0x944bd34 pc=0x807ef34
runtime.chanrecv(0x9420300, 0x944bdc7, 0x9400001, 0x811c8e7)
        /tmp/goroot/src/runtime/chan.go:581 +0x28a fp=0x944bd90 sp=0x944bd48 pc=0x804e83a
runtime.chanrecv1(0x9420300, 0x944bdc7)
        /tmp/goroot/src/runtime/chan.go:443 +0x1c fp=0x944bda4 sp=0x944bd90 pc=0x804e57c
testing.(*T).Run(0x9401500, 0x8268417, 0x23, 0x8270934, 0x401)
        /tmp/goroot/src/testing/testing.go:1219 +0x236 fp=0x944bdec sp=0x944bda4 pc=0x811c906
testing.runTests.func1(0x9401420)
        /tmp/goroot/src/testing/testing.go:1491 +0x5a fp=0x944be10 sp=0x944bdec pc=0x812071a
testing.tRunner(0x9401420, 0x944bea0)
        /tmp/goroot/src/testing/testing.go:1173 +0xb7 fp=0x944be50 sp=0x944be10 pc=0x811c647
testing.runTests(0x940e070, 0x83bb940, 0x157, 0x157, 0xc66c808d, 0xbfdb9c2c, 0xb2d0cce9, 0x8b, 0x83bd4a0, 0x0)
        /tmp/goroot/src/testing/testing.go:1489 +0x25a fp=0x944beb4 sp=0x944be50 pc=0x811dc0a
testing.(*M).Run(0x949a000, 0x0)
        /tmp/goroot/src/testing/testing.go:1397 +0x178 fp=0x944bf4c sp=0x944beb4 pc=0x811cdc8
runtime_test.TestMain(0x949a000)
        /tmp/goroot/src/runtime/crash_test.go:28 +0x21 fp=0x944bf70 sp=0x944bf4c pc=0x818b161
main.main()
        _testmain.go:1221 +0x110 fp=0x944bfc8 sp=0x944bf70 pc=0x81ff4f0
runtime.main()
        /tmp/goroot/src/runtime/proc.go:220 +0x232 fp=0x944bff0 sp=0x944bfc8 pc=0x807eb72
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x944bff4 sp=0x944bff0 pc=0x80b1651

goroutine 2 [force gc (idle)]:
runtime.gopark(0x826fde8, 0x83bd020, 0x1411, 0x1)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x9438fdc sp=0x9438fc8 pc=0x807ef34
runtime.goparkunlock(...)
        /tmp/goroot/src/runtime/proc.go:337
runtime.forcegchelper()
        /tmp/goroot/src/runtime/proc.go:271 +0xbf fp=0x9438ff0 sp=0x9438fdc pc=0x807eddf
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x9438ff4 sp=0x9438ff0 pc=0x80b1651
created by runtime.init.5
        /tmp/goroot/src/runtime/proc.go:259 +0x2b

goroutine 3 [GC sweep wait]:
runtime.gopark(0x826fde8, 0x83bd340, 0x140c, 0x1)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x94397d4 sp=0x94397c0 pc=0x807ef34
runtime.goparkunlock(...)
        /tmp/goroot/src/runtime/proc.go:337
runtime.bgsweep(0x9420040)
        /tmp/goroot/src/runtime/mgcsweep.go:161 +0x8f fp=0x94397e8 sp=0x94397d4 pc=0x806ab2f
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x94397ec sp=0x94397e8 pc=0x80b1651
created by runtime.gcenable
        /tmp/goroot/src/runtime/mgc.go:217 +0x4d

goroutine 4 [GC scavenge wait]:
runtime.gopark(0x826fde8, 0x83bd2c0, 0x140d, 0x1)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x9439fac sp=0x9439f98 pc=0x807ef34
runtime.goparkunlock(...)
        /tmp/goroot/src/runtime/proc.go:337
runtime.bgscavenge(0x9420040)
        /tmp/goroot/src/runtime/mgcscavenge.go:265 +0xbe fp=0x9439fe8 sp=0x9439fac pc=0x8068d7e
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x9439fec sp=0x9439fe8 pc=0x80b1651
created by runtime.gcenable
        /tmp/goroot/src/runtime/mgc.go:218 +0x6b

goroutine 5 [finalizer wait]:
runtime.gopark(0x826fde8, 0x83cf260, 0x8041410, 0x1)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x94387a8 sp=0x9438794 pc=0x807ef34
runtime.goparkunlock(...)
        /tmp/goroot/src/runtime/proc.go:337
runtime.runfinq()
        /tmp/goroot/src/runtime/mfinal.go:175 +0x94 fp=0x94387f0 sp=0x94387a8 pc=0x805fab4
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x94387f4 sp=0x94387f0 pc=0x80b1651
created by runtime.createfing
        /tmp/goroot/src/runtime/mfinal.go:156 +0x60

goroutine 6 [chan receive]:
runtime.gopark(0x826fc74, 0x95484b0, 0x170e, 0x2)
        /tmp/goroot/src/runtime/proc.go:331 +0xe4 fp=0x9446c58 sp=0x9446c44 pc=0x807ef34
runtime.chanrecv(0x9548480, 0x9446cd7, 0x9401501, 0x811c8e7)
        /tmp/goroot/src/runtime/chan.go:581 +0x28a fp=0x9446ca0 sp=0x9446c58 pc=0x804e83a
runtime.chanrecv1(0x9548480, 0x9446cd7)
        /tmp/goroot/src/runtime/chan.go:443 +0x1c fp=0x9446cb4 sp=0x9446ca0 pc=0x804e57c
testing.(*T).Run(0x95027e0, 0x8261b5e, 0x16, 0x9530120, 0x9524601)
        /tmp/goroot/src/testing/testing.go:1219 +0x236 fp=0x9446cfc sp=0x9446cb4 pc=0x811c906
runtime_test.TestPallocDataFindScavengeCandidate(0x9401500)
        /tmp/goroot/src/runtime/mgcscavenge_test.go:262 +0x144b fp=0x9446fa8 sp=0x9446cfc pc=0x81b59db
testing.tRunner(0x9401500, 0x8270934)
        /tmp/goroot/src/testing/testing.go:1173 +0xb7 fp=0x9446fe8 sp=0x9446fa8 pc=0x811c647
runtime.goexit()
        /tmp/goroot/src/runtime/asm_386.s:1333 +0x1 fp=0x9446fec sp=0x9446fe8 pc=0x80b1651
created by testing.(*T).Run
        /tmp/goroot/src/testing/testing.go:1218 +0x217
FAIL    runtime 0.011s
FAIL
gentoo-x86 /tmp/goroot # cat /sys/kernel/mm/transparent_hugepage/hpage_pmd_size
4194304
mknyszek commented 4 years ago

Great, thank you so much for the quick turnaround. That'll help a lot.

gopherbot commented 4 years ago

Change https://golang.org/cl/263837 mentions this issue: runtime: fix scavenging tests for pallocChunkBytes huge pages and larger

mknyszek commented 4 years ago

Sorry for the delayed response, the problem was fairly easy to find. The tests were assuming that a huge page wouldn't be exactly pallocChunkPages in size which is true in your case (4 MiB huge pages). The code already deals with this case, so I just added a test case for that.

Would you mind trying out https://golang.org/cl/263837 to ensure that the new test passes? I can stub the value in and show that it works, but I'd like to make sure the problem is solved on your end.

Whissi commented 4 years ago 
ALL TESTS PASSED

/tmp/goroot/bin/go version
go version devel +f015b07c24 Tue Oct 20 13:09:22 2020 +0000 linux/386

Thank you very much!

williamh commented 4 years ago

Hi,should this test failure be considered serious enough that it prevents go 1.14.x and 1.15.x from being sent to Gentoo's stable users on x86? If so, is there any chance of backporting the fix to these versions?

Thanks much,

William

mknyszek commented 4 years ago

It only affects folks working on Go itself (or a fork, I suppose) on one of these platforms. The actual code that a user would run works fine as there's no real bug here outside of tests. On the other hand, it's a very safe change because it only modifies test code so I'm certainly not opposed to backporting personally. I'm honestly not sure how the cost/benefit situation of another change in the point releases works out.

Let's ask @dmitshur maybe?

Whissi commented 4 years ago

Thank you for clarification, for Gentoo Linux, we will move on now that we know that this is just a test failure.

dmitshur commented 4 years ago

@mknyszek You're right that test-only fixes are generally safer to backport, which makes it an easier decision. That said, while okay in small numbers, we don't want to do it too frequently. We do it occasionally when there is a specific need, usually in order to fix false-positive failures during pre-release testing and trybots that run on cherry-pick CLs. If there's a good reason to backport a test-only fix, we will certainly consider it. You can do a search for test-only packports we've approved with this query.

In this case, it seems like the most important aspect here was to understand that this issue was in the test itself, and not a problem in the real code. So as I understand there isn't a strong need to backport the test fix anymore, especially since it doesn't affect testing done by our current builders. But if I'm missing something, please request a backport and provide a rationale.

Also CC @golang/release FYI.