Open bradfitz opened 5 years ago
Change https://golang.org/cl/158537 mentions this issue: dashboard: increase plan9's GO_TEST_TIMEOUT_SCALE
I'm not sure if it's related to this issue, or a separate issue, but there haven't been any plan9 builder results for any of the subrepos recently. I.e., https://build.golang.org/?repo=golang.org%2fx%2ftools has no entries for plan9/386
, despite the configuration suggesting there should be:
This came up in CL 162907. /cc @rhysh
Yes, there is currently an issue happening on the plan9/386 builder. It started on 2019-02-01 approximately. I'll investigate.
What's the status here? I haven't seen a plan9/386 build pass in a long time.
I'm currently investigating an issue with the runtime/trace test running out of memory on the plan9/amd64 builder.
The issue on the plan9/386 builder is different. I've not been able to reproduce it yet, since it runs successfully on my 386 machines at home. I'll have to try on GCE.
There was something very odd on the plan9/386 builder during the past few months. The builder started to fail in early February, then after 4 weeks of failure, the tests passed successfully in early March during 8 days, then it started to fail again.
I'm going to have to stop the plan9 builders. It's a waste of resources & distracting to have them always building and resulting in crashes, loops, timeouts, or other failures.
Could you try to disable the runtime/trace tests? It may be the same issue I'm currently encountering on plan9/amd64.
After a few more tests, it seems unlikely that the issue may be caused by the runtime/trace test. I'm suspecting something else. Please hang on.
I ran all.rc
in a loop on GCE (n1-highcpu-4
) during the night and the tests always passed successfully, except fixedbugs/issue30908.go
, which is a recent issue (issue #31503).
I'm still investigating.
cpu% all.rc
Building Go cmd/dist using /tmp/go-plan9-386-bootstrap
Building Go toolchain1 using /tmp/go-plan9-386-bootstrap.
Building Go bootstrap cmd/go (go_bootstrap) using Go toolchain1.
Building Go toolchain2 using go_bootstrap and Go toolchain1.
Building Go toolchain3 using go_bootstrap and Go toolchain2.
Building packages and commands for plan9/386.
##### Testing packages.
ok archive/tar 0.399s
ok archive/zip 3.933s
ok bufio 0.263s
ok bytes 0.460s
ok compress/bzip2 0.278s
ok compress/flate 1.615s
ok compress/gzip 0.249s
ok compress/lzw 0.095s
ok compress/zlib 0.153s
ok container/heap 0.101s
ok container/list 0.101s
ok container/ring 0.103s
ok context 1.181s
ok crypto 0.135s
ok crypto/aes 0.098s
ok crypto/cipher 24.318s
ok crypto/des 0.095s
ok crypto/dsa 0.101s
ok crypto/ecdsa 0.307s
ok crypto/elliptic 0.131s
ok crypto/hmac 0.093s
ok crypto/internal/subtle 0.097s
ok crypto/md5 0.113s
ok crypto/rand 0.350s
ok crypto/rc4 0.138s
ok crypto/rsa 0.309s
ok crypto/sha1 0.139s
ok crypto/sha256 0.107s
ok crypto/sha512 0.166s
ok crypto/subtle 0.100s
ok crypto/tls 14.739s
ok crypto/x509 7.937s
ok database/sql 0.924s
ok database/sql/driver 0.089s
ok debug/dwarf 0.356s
ok debug/elf 0.212s
ok debug/gosym 0.118s
ok debug/macho 0.174s
ok debug/pe 0.186s
ok debug/plan9obj 0.102s
ok encoding/ascii85 0.094s
ok encoding/asn1 0.132s
ok encoding/base32 0.121s
ok encoding/base64 0.091s
ok encoding/binary 0.105s
ok encoding/csv 0.127s
ok encoding/gob 0.164s
ok encoding/hex 0.098s
ok encoding/json 0.843s
ok encoding/pem 0.148s
ok encoding/xml 0.191s
ok errors 0.105s
ok expvar 0.155s
ok flag 0.101s
ok fmt 0.249s
ok go/ast 0.138s
ok go/build 4.557s
ok go/constant 0.110s
ok go/doc 0.583s
ok go/format 0.129s
ok go/importer 1.511s
ok go/internal/gccgoimporter 0.357s
ok go/internal/gcimporter 3.825s
ok go/internal/srcimporter 5.533s
ok go/parser 0.208s
ok go/printer 0.587s
ok go/scanner 0.191s
ok go/token 0.144s
ok go/types 3.114s
ok hash 0.098s
ok hash/adler32 0.090s
ok hash/crc32 0.101s
ok hash/crc64 0.119s
ok hash/fnv 0.092s
ok html 0.097s
ok html/template 0.323s
ok image 0.276s
ok image/color 0.099s
ok image/draw 0.164s
ok image/gif 0.653s
ok image/jpeg 0.382s
ok image/png 0.273s
ok index/suffixarray 0.102s
ok internal/cpu 0.091s
ok internal/fmtsort 0.089s
ok internal/poll 0.135s
ok internal/reflectlite 0.186s
ok internal/singleflight 0.107s
ok internal/trace 2.836s
ok internal/xcoff 0.243s
ok io 0.274s
ok io/ioutil 9.361s
ok log 0.150s
ok math 0.227s
ok math/big 2.275s
ok math/bits 0.095s
ok math/cmplx 0.096s
ok math/rand 0.334s
ok mime 0.129s
ok mime/multipart 4.919s
ok mime/quotedprintable 0.332s
ok net 20.813s
ok net/http 115.650s
ok net/http/cgi 0.353s
ok net/http/cookiejar 0.364s
ok net/http/fcgi 0.127s
ok net/http/httptest 2.517s
ok net/http/httptrace 0.137s
ok net/http/httputil 4.862s
ok net/http/internal 0.100s
ok net/http/pprof 2.209s
ok net/mail 0.112s
ok net/rpc 1.801s
ok net/rpc/jsonrpc 0.206s
ok net/smtp 1.553s
ok net/textproto 0.132s
ok net/url 0.140s
ok os 2.301s
ok os/exec 2.012s
ok os/signal 0.217s
ok os/user 0.092s
ok path 0.178s
ok path/filepath 1.355s
ok plugin 0.093s
ok reflect 0.421s
ok regexp 0.276s
ok regexp/syntax 0.450s
ok runtime 29.434s
ok runtime/debug 0.115s
ok runtime/internal/atomic 0.181s
ok runtime/internal/math 0.084s
ok runtime/internal/sys 0.081s
ok runtime/pprof 7.533s
ok runtime/pprof/internal/profile 0.093s
ok runtime/trace 95.536s
ok sort 0.115s
ok strconv 0.452s
ok strings 0.209s
ok sync 1.777s
ok sync/atomic 0.226s
ok syscall 0.066s
ok testing 0.931s
ok testing/quick 0.150s
ok text/scanner 0.087s
ok text/tabwriter 0.067s
ok text/template 0.405s
ok text/template/parse 0.069s
ok time 5.222s
ok unicode 0.070s
ok unicode/utf16 0.060s
ok unicode/utf8 0.069s
ok cmd/addr2line 10.317s
ok cmd/api 0.282s
ok cmd/asm/internal/asm 1.506s
ok cmd/asm/internal/lex 0.169s
ok cmd/compile 0.124s
ok cmd/compile/internal/gc 36.661s
ok cmd/compile/internal/ssa 2.809s
ok cmd/compile/internal/syntax 0.122s
ok cmd/compile/internal/test 0.052s [no tests to run]
ok cmd/compile/internal/types 0.083s
ok cmd/cover 32.063s
ok cmd/doc 0.384s
ok cmd/fix 23.168s
ok cmd/go 1056.432s
ok cmd/go/internal/cache 5.862s
ok cmd/go/internal/dirhash 0.113s
ok cmd/go/internal/generate 0.208s
ok cmd/go/internal/get 0.281s
ok cmd/go/internal/imports 0.239s
ok cmd/go/internal/load 0.140s
ok cmd/go/internal/lockedfile 0.146s
ok cmd/go/internal/modconv 0.382s
ok cmd/go/internal/modfetch 0.216s
ok cmd/go/internal/modfetch/codehost 0.120s
ok cmd/go/internal/modfile 0.235s
ok cmd/go/internal/modload 0.213s
ok cmd/go/internal/module 0.070s
ok cmd/go/internal/mvs 0.118s
ok cmd/go/internal/par 0.092s
ok cmd/go/internal/search 0.128s
ok cmd/go/internal/semver 0.080s
ok cmd/go/internal/txtar 0.081s
ok cmd/go/internal/web2 0.161s
ok cmd/go/internal/work 0.199s
ok cmd/gofmt 0.468s
ok cmd/internal/buildid 0.404s
ok cmd/internal/dwarf 0.108s
ok cmd/internal/edit 0.175s
ok cmd/internal/goobj 1.718s
ok cmd/internal/obj 0.083s
ok cmd/internal/obj/arm64 0.723s
ok cmd/internal/obj/x86 15.337s
ok cmd/internal/objabi 0.077s
ok cmd/internal/src 0.110s
ok cmd/internal/test2json 0.226s
ok cmd/link 4.910s
ok cmd/link/internal/ld 2.820s
ok cmd/link/internal/sym 0.092s
ok cmd/nm 10.848s
ok cmd/objdump 10.740s
ok cmd/pack 13.695s
ok cmd/trace 0.238s
ok cmd/vet 112.529s
##### os/user with tag osusergo
ok os/user 0.175s
##### GOMAXPROCS=2 runtime -cpu=1,2,4 -quick
ok runtime 63.371s
##### Testing without libgcc.
ok crypto/x509 25.206s
ok net 1.117s
ok os/user 0.087s
##### sync -cpu=10
ok sync 2.163s
##### ../test/bench/go1
testing: warning: no tests to run
PASS
ok test/bench/go1 57.044s
##### ../test
# go run run.go -- fixedbugs/issue30908.go
exit status: 'go 66926: 1'
cmd/link: while reading object for 'a': duplicate symbol 'go.info.go.builtin.error.Error', previous def at 'runtime', with mismatched payload: new length 52 != old length 40
cmd/link: while reading object for 'bytes': duplicate symbol 'go.isstmt.go.builtin.error.Error', previous def at 'a', with mismatched payload: new length 0 != old length 15
cmd/link: while reading object for 'path/filepath': duplicate symbol 'go.isstmt.go.builtin.error.Error', previous def at 'a', with mismatched payload: new length 0 != old length 15
cmd/link: while reading object for 'strconv': duplicate symbol 'go.isstmt.go.builtin.error.Error', previous def at 'a', with mismatched payload: new length 0 != old length 15
cmd/link: while reading object for 'strings': duplicate symbol 'go.isstmt.go.builtin.error.Error', previous def at 'a', with mismatched payload: new length 0 != old length 15
FAIL fixedbugs/issue30908.go 2.588s
2019/04/16 21:33:15 Failed: exit status: 'runtest.exe 41937: 1'
##### API check
+pkg database/sql, method (*NullTime) Scan(interface{}) error
+pkg database/sql, method (NullTime) Value() (driver.Value, error)
+pkg database/sql, type NullTime struct
+pkg database/sql, type NullTime struct, Time time.Time
+pkg database/sql, type NullTime struct, Valid bool
+pkg debug/dwarf, method (*UnsupportedType) Common() *CommonType
+pkg debug/dwarf, method (*UnsupportedType) Size() int64
+pkg debug/dwarf, method (*UnsupportedType) String() string
+pkg debug/dwarf, type UnsupportedType struct
+pkg debug/dwarf, type UnsupportedType struct, Tag Tag
+pkg debug/dwarf, type UnsupportedType struct, embedded CommonType
+pkg errors, func As(error, interface{}) bool
+pkg errors, func Caller(int) Frame
+pkg errors, func Is(error, error) bool
+pkg errors, func Opaque(error) error
+pkg errors, func Unwrap(error) error
+pkg errors, method (Frame) Format(Printer)
+pkg errors, type Formatter interface { Error, FormatError }
+pkg errors, type Formatter interface, Error() string
+pkg errors, type Formatter interface, FormatError(Printer) error
+pkg errors, type Frame struct
+pkg errors, type Printer interface { Detail, Print, Printf }
+pkg errors, type Printer interface, Detail() bool
+pkg errors, type Printer interface, Print(...interface{})
+pkg errors, type Printer interface, Printf(string, ...interface{})
+pkg errors, type Wrapper interface { Unwrap }
+pkg errors, type Wrapper interface, Unwrap() error
+pkg go/constant, func Make(interface{}) Value
+pkg go/constant, func Val(Value) interface{}
+pkg go/token, func IsExported(string) bool
+pkg go/token, func IsIdentifier(string) bool
+pkg go/token, func IsKeyword(string) bool
+pkg log, func Writer() io.Writer
+pkg math/big, method (*Int) TrailingZeroBits() uint
+pkg math/big, method (*Rat) SetUint64(uint64) *Rat
+pkg net, type ListenConfig struct, KeepAlive time.Duration
+pkg net/http, const StatusEarlyHints = 103
+pkg net/http, const StatusEarlyHints ideal-int
+pkg net/http, type Server struct, BaseContext func(net.Listener) context.Context
+pkg net/http, type Server struct, ConnContext func(context.Context, net.Conn) context.Context
+pkg net/http, type Transport struct, ForceAttemptHTTP2 bool
+pkg os, func UserConfigDir() (string, error)
+pkg os, method (*LinkError) Unwrap() error
+pkg os, method (*PathError) Unwrap() error
+pkg os, method (*SyscallError) Unwrap() error
+pkg os, var ErrTimeout error
+pkg os/exec, method (*Cmd) String() string
+pkg reflect, method (Value) IsZero() bool
+pkg syscall, method (Errno) Is(error) bool
+pkg testing, method (*B) ReportMetric(float64, string)
+pkg testing, type BenchmarkResult struct, Extra map[string]float64
+pkg time, method (Duration) Microseconds() int64
+pkg time, method (Duration) Milliseconds() int64
2019/04/16 21:33:38 FAILED
The builders don't run all.rc or all.bash, etc. They run make.ext and then use go tool dist test to run the tests. Maybe something's broken with Plan 9's subprocess handling.
Change https://golang.org/cl/172797 mentions this issue: dashboard: disable plan9-386 builder
Could you give me a builder key so I could run the plan9/386 buildlet on my side and debug it?
You can use the buildlet & debugnewvm (perhaps modified) to test it.
I figured how to use debugnewvm, then ran the plan9/386 build. The tests passed successfully, except the issue30908 test (issue #31503). Now, I'm puzzled.
$ go run debugnewvm.go -host host-plan9-386-gce -run-build plan9-386
2019/04/18 23:19:40 Creating debug-temp-1555622380 (with VM image "plan9")
2019/04/18 23:19:43 instance requested
2019/04/18 23:19:52 instance created
2019/04/18 23:19:52 got instance info
2019/04/18 23:19:52 About to hit http://34.76.96.122 to see if buildlet is up yet...
2019/04/18 23:19:53 SERIAL: SeaBIOS (version 1.8.2-20190322_093631-google)
Total RAM Size = 0x00000000e6600000 = 3686 MiB
CPUs found: 4 Max CPUs supported: 4
found virtio-scsi at 0:3
virtio-scsi vendor='Google' product='PersistentDisk' rev='1' type=0 removable=0
virtio-scsi blksize=512 sectors=20971520 = 10240 MiB
drive 0x000f2bf0: PCHS=0/0/0 translation=lba LCHS=1024/255/63 s=20971520
Booting from Hard Disk 0...
pcirouting: BIOS workaround: PCI.0.1.3 at pin 1 link 96 irq 10 -> 9
no vga; serial console only
disk loader
cpu0: 2298MHz GenuineIntel P6 (cpuid: AX 0x306F0 DX 0x1F8BFBFF)
ELCR: 0C00
497M memory: 497M kernel data, 0M user, 18M swap
found partition #S/sd01/data 0 20,971,520
disks: sd01
trying sd01....found 9pccpuf
.1178434...............................................................................................................................................+2414552.......................................................................................................................................................................................................................................................................................................+489820=4082806
entry: 0xf0100020
Plan 9
E820: 00000000 0009fc00 memory
E820: 0009fc00 000a0000 reserved
E820: 000f0000 00100000 reserved
E820: 00100000 bfffd000 memory
E820: bfffd000 c0000000 reserved
E820: fffbc000 100000000 reserved
E820: 100000000 126600000 memory
cpu0: 2301MHz GenuineIntel P6 (cpuid: AX 0x306F0 DX 0x1F8BFBFF)
ELCR: 0C00
#l0: virtio: 1Gbps port 0xC040 irq 11: 42010af00011
3072M memory: 208M kernel data, 2863M user, 3488M swap
usbinit...usbd.../boot/usbd: /dev/usb: no hubs
no /srv/usb...
2019/04/18 23:19:54 SERIAL: no usb disk...pickmethod...read #e/nobootprompt...pickmethod done
bind #æ...bind #S...partinit...auth...usbinit...usbd.../boot/usbd: /dev/usb: no hubs
2019/04/18 23:19:56 SERIAL: no /srv/usb...
2019/04/18 23:19:57 client buildlet probe error: Get http://34.76.96.122: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2019/04/18 23:19:58 SERIAL: no usb disk...mount usbd...boot: can't open /srv/usb: '/srv/usb' file does not exist
time...
fossil(#S/sd01/fossil)...version...can't stat /srv/partfs.sdXX: '/srv/partfs.sdXX' file does not exist
2019/04/18 23:19:58 About to hit http://34.76.96.122 to see if buildlet is up yet...
2019/04/18 23:20:01 client buildlet probe error: Get http://34.76.96.122: dial tcp 34.76.96.122:80: connect: connection refused
2019/04/18 23:20:02 About to hit http://34.76.96.122 to see if buildlet is up yet...
2019/04/18 23:20:02 client buildlet probe error: Get http://34.76.96.122: dial tcp 34.76.96.122:80: connect: connection refused
2019/04/18 23:20:03 SERIAL: aux/randfs: '/bin/aux/randfs' does not exist
downloading git
2019/04/18 23:20:03 SERIAL: starting buildlet script
2019/04/18 23:20:03 About to hit http://34.76.96.122 to see if buildlet is up yet...
2019/04/18 23:20:04 client buildlet probe error: Get http://34.76.96.122: dial tcp 34.76.96.122:80: connect: connection refused
2019/04/18 23:20:04 SERIAL: 2019/04/18 17:20:04 buildlet starting.
2019/04/18 17:20:04 Will listen on :80
2019/04/18 17:20:04 Adjusted MTU.
2019/04/18 17:20:04 Listening on :80 ...
2019/04/18 23:20:05 About to hit http://34.76.96.122 to see if buildlet is up yet...
2019/04/18 23:20:05 buildlet probe: 200 OK
2019/04/18 23:20:05 WorkDir: /tmp/workdir, <nil>
2019/04/18 23:20:05 Pushing 'go1.4' Go bootstrap dir ...
2019/04/18 23:20:07 SERIAL: 2019/04/18 17:20:05 writetgz: untarring https://storage.googleapis.com/go-builder-data/gobootstrap-plan9-386.tar.gz (got heade
2019/04/18 23:20:12 Pushing 'go' dir...
2019/04/18 23:20:14 SERIAL: 2019/04/18 17:20:12 extracted tarball into /tmp/workdir/go1.4: 3521 files, 479 dirs (6.645937499s)
2019/04/18 17:20:12 writetgz: untarring https://go.googlesource.com/go/+archive/master.tar.gz (got headers in 104.127133ms) in
2019/04/18 23:20:24 Running src/all.rc ...
:: Running /tmp/workdir/go/src/all.rc with args ["/tmp/workdir/go/src/all.rc"] and env ["terminal=generic /sys/src/9/pc/pccpuf" "cputype=386" "service=cpu" "bootfile=sd01!9fat!9pccpuf" "nobootprompt=local!#S/sd01/fossil" "bootargs=local!#S/sd01/fossil" "bootdisk=#S/sd01/fossil" "console=0 b115200" "debugboot=1" "dmamode=ask" "installurl=http://148.251.6.120/plan9/download" "partition=new" "mouseport=ps2intellimouse" "monitor=vesa" "vgasize=1280x1024x32" "user=glenda" "sd01part=plan9 63 20964825/9fat 63 204863/nvram 204863 204864/fossil 204864 19916249/swap 19916249 20964825" "rootdir=/root" "objtype=386" "timezone=EST -18000 EDT -14400\n 9943200 25664400 41392800 57718800 73447200 89168400\n 104896800 120618000 126669600 152067600 162352800 183517200\n 199245600 215571600 230695200 247021200 262749600 278470800\n 294199200 309920400 325648800 341370000 357098400 372819600\n 388548000 404874000 419997600 436323600 452052000 467773200\n 483501600 499222800 514951200 530672400 544586400 562122000\n 576036000 594176400 607485600 625626000 638935200 657075600\n 670989600 688525200 702439200 719974800 733888800 752029200\n 765338400 783478800 796788000 814928400 828842400 846378000\n 860292000 877827600 891741600 909277200 923191200 941331600\n 954640800 972781200 986090400 1004230800 1018144800 1035680400\n1049594400 1067130000 1081044000 1099184400 1112493600 1130634000\n1143943200 1162083600 1173578400 1194141600 1205028000 1225591200\n1236477600 1257040800 1268532000 1289095200 1299981600 1320544800\n1331431200 1351994400 1362880800 1383444000 1394330400 1414893600\n1425780000 1446343200 1457834400 1478397600 1489284000 1509847200\n1520733600 1541296800 1552183200 1572746400 1583632800 1604196000\n1615687200 1636250400 1647136800 1667700000 1678586400 1699149600\n1710036000 1730599200 1741485600 1762048800 1772935200 1793498400\n1804989600 1825552800 1836439200 1857002400 1867888800 1888452000\n1899338400 1919901600 1930788000 1951351200 1962842400 1983405600\n1994292000 2014855200 2025741600 2046304800 2057191200 2077754400\n2088640800 2109204000 2120090400 2140653600\n" "home=/usr/glenda" "path=.\x00/bin" "*=" "rcname=rc" "pid=112" "ifs= \t\n" "prompt=helix# \x00\t" "status=" "fn#sigexit=" "cflag=" "0=/rc/lib/rcmain" "boottime=Thu Apr 18 17:19:57 EDT 2019\n" "sysname=helix" "NPROC=1" "site=DOM.EXAMPLE.COM" "fileserver=kfs" "facedom=FACEDOM" "apid=102" "WORKDIR=/tmp/workdir" "GOROOT_BOOTSTRAP=/tmp/workdir/go1.4" "GO_BUILDER_NAME=plan9-386" "GO_TEST_TIMEOUT_SCALE=3"] in dir /tmp/workdir/go/src
Building Go cmd/dist using /tmp/workdir/go1.4
2019/04/18 23:20:25 SERIAL: 2019/04/18 17:20:24 extracted tarball into /tmp/workdir/go: 8614 files, 1064 dirs (11.982278599s)
2019/04/18 17:20:24 writetgz: untarring Request.Body into /tmp/workdir/go
2019/04/18 17:20:24 extracted tarball into /tmp/workdir/go: 1 files, 1 dirs (2.826895ms)
2019/04/18 17:20:24 [0x10c629a0] Running /tmp/workdir/go/src/all.rc with args ["/tmp/workdir/go/src/all.rc"] and env ["termina
Building Go toolchain1 using /tmp/workdir/go1.4.
Building Go bootstrap cmd/go (go_bootstrap) using Go toolchain1.
Building Go toolchain2 using go_bootstrap and Go toolchain1.
Building Go toolchain3 using go_bootstrap and Go toolchain2.
Building packages and commands for plan9/386.
##### Testing packages.
ok archive/tar 0.118s
ok archive/zip 1.655s
ok bufio 0.142s
ok bytes 1.941s
ok compress/bzip2 0.095s
ok compress/flate 1.322s
ok compress/gzip 6.907s
ok compress/lzw 0.129s
ok compress/zlib 0.706s
ok container/heap 0.040s
ok container/list 0.032s
ok container/ring 0.039s
ok context 1.141s
ok crypto 0.031s
ok crypto/aes 0.057s
ok crypto/cipher 23.235s
ok crypto/des 0.049s
ok crypto/dsa 0.035s
ok crypto/ecdsa 0.227s
ok crypto/elliptic 0.064s
ok crypto/hmac 0.034s
ok crypto/internal/subtle 0.029s
ok crypto/md5 0.035s
ok crypto/rand 0.241s
ok crypto/rc4 0.082s
ok crypto/rsa 0.184s
ok crypto/sha1 0.080s
ok crypto/sha256 0.039s
ok crypto/sha512 0.042s
ok crypto/subtle 0.033s
ok crypto/tls 13.546s
ok crypto/x509 5.982s
ok database/sql 0.762s
ok database/sql/driver 0.034s
ok debug/dwarf 0.079s
ok debug/elf 0.095s
ok debug/gosym 0.034s
ok debug/macho 0.038s
ok debug/pe 0.048s
ok debug/plan9obj 0.032s
ok encoding/ascii85 0.036s
ok encoding/asn1 0.043s
ok encoding/base32 0.056s
ok encoding/base64 0.039s
ok encoding/binary 0.039s
ok encoding/csv 0.043s
ok encoding/gob 0.075s
ok encoding/hex 0.037s
ok encoding/json 0.568s
ok encoding/pem 0.050s
ok encoding/xml 0.067s
ok errors 0.037s
ok expvar 0.045s
ok flag 0.039s
ok fmt 0.109s
ok go/ast 0.054s
ok go/build 1.847s
ok go/constant 0.039s
ok go/doc 0.108s
ok go/format 0.044s
ok go/importer 1.025s
ok go/internal/gccgoimporter 0.068s
ok go/internal/gcimporter 5.787s
ok go/internal/srcimporter 3.948s
ok go/parser 0.084s
ok go/printer 0.305s
ok go/scanner 0.037s
ok go/token 0.057s
ok go/types 4.557s
ok hash 0.038s
ok hash/adler32 0.038s
ok hash/crc32 0.039s
ok hash/crc64 0.033s
ok hash/fnv 0.034s
ok html 0.034s
ok html/template 0.195s
ok image 0.108s
ok image/color 0.050s
ok image/draw 0.084s
ok image/gif 0.312s
ok image/jpeg 0.239s
ok image/png 0.085s
ok index/suffixarray 0.037s
ok internal/cpu 0.036s
ok internal/fmtsort 0.037s
ok internal/poll 0.064s
ok internal/reflectlite 0.038s
ok internal/singleflight 0.045s
ok internal/trace 2.375s
ok internal/xcoff 0.132s
ok io 0.195s
ok io/ioutil 8.862s
ok log 0.041s
ok math 0.043s
ok math/big 2.025s
ok math/bits 0.044s
ok math/cmplx 0.039s
ok math/rand 0.675s
ok mime 0.048s
ok mime/multipart 2.198s
ok mime/quotedprintable 0.227s
ok net 26.394s
ok net/http 115.587s
ok net/http/cgi 0.213s
ok net/http/cookiejar 0.181s
ok net/http/fcgi 0.052s
ok net/http/httptest 2.130s
ok net/http/httptrace 0.050s
ok net/http/httputil 4.402s
ok net/http/internal 0.036s
ok net/http/pprof 2.081s
ok net/mail 0.042s
ok net/rpc 1.568s
ok net/rpc/jsonrpc 0.067s
ok net/smtp 1.307s
ok net/textproto 0.039s
ok net/url 0.051s
ok os 2.447s
ok os/exec 1.564s
ok os/signal 0.166s
ok os/user 0.039s
ok path 0.039s
ok path/filepath 0.311s
ok plugin 0.036s
ok reflect 0.240s
ok regexp 0.111s
ok regexp/syntax 0.384s
ok runtime 57.823s
ok runtime/debug 0.046s
ok runtime/internal/atomic 0.113s
ok runtime/internal/math 0.037s
ok runtime/internal/sys 0.036s
ok runtime/pprof 2.095s
ok runtime/pprof/internal/profile 0.082s
ok runtime/trace 50.495s
ok sort 0.107s
ok strconv 0.411s
ok strings 1.433s
ok sync 1.643s
ok sync/atomic 0.146s
ok syscall 0.040s
ok testing 1.224s
ok testing/quick 0.116s
ok text/scanner 0.045s
ok text/tabwriter 0.040s
ok text/template 0.313s
ok text/template/parse 0.051s
ok time 5.000s
ok unicode 0.042s
ok unicode/utf16 0.040s
ok unicode/utf8 0.044s
ok cmd/addr2line 6.971s
ok cmd/api 0.156s
ok cmd/asm/internal/asm 0.900s
ok cmd/asm/internal/lex 0.048s
ok cmd/compile 0.079s
ok cmd/compile/internal/gc 62.620s
ok cmd/compile/internal/ssa 1.932s
ok cmd/compile/internal/syntax 0.059s
ok cmd/compile/internal/test 0.037s [no tests to run]
ok cmd/compile/internal/types 0.046s
ok cmd/cover 22.182s
ok cmd/doc 0.211s
ok cmd/fix 19.757s
ok cmd/go 796.425s
ok cmd/go/internal/cache 8.344s
ok cmd/go/internal/dirhash 0.069s
ok cmd/go/internal/generate 0.097s
ok cmd/go/internal/get 0.175s
ok cmd/go/internal/imports 0.076s
ok cmd/go/internal/load 0.071s
ok cmd/go/internal/lockedfile 0.095s
ok cmd/go/internal/modconv 0.093s
ok cmd/go/internal/modfetch 0.106s
ok cmd/go/internal/modfetch/codehost 0.062s
ok cmd/go/internal/modfile 0.060s
ok cmd/go/internal/modload 0.098s
ok cmd/go/internal/module 0.043s
ok cmd/go/internal/mvs 0.065s
ok cmd/go/internal/par 0.060s
ok cmd/go/internal/search 0.063s
ok cmd/go/internal/semver 0.041s
ok cmd/go/internal/txtar 0.041s
ok cmd/go/internal/web2 0.078s
ok cmd/go/internal/work 0.132s
ok cmd/gofmt 0.207s
ok cmd/internal/buildid 0.291s
ok cmd/internal/dwarf 0.051s
ok cmd/internal/edit 0.039s
ok cmd/internal/goobj 0.957s
ok cmd/internal/obj 0.047s
ok cmd/internal/obj/arm64 0.339s
ok cmd/internal/obj/x86 10.816s
ok cmd/internal/objabi 0.047s
ok cmd/internal/src 0.041s
ok cmd/internal/test2json 0.144s
ok cmd/link 3.504s
ok cmd/link/internal/ld 1.406s
ok cmd/link/internal/sym 0.047s
ok cmd/nm 6.768s
ok cmd/objdump 7.406s
ok cmd/pack 9.205s
ok cmd/trace 0.091s
ok cmd/vet 79.344s
##### os/user with tag osusergo
ok os/user 0.047s
##### GOMAXPROCS=2 runtime -cpu=1,2,4 -quick
ok runtime 195.913s
##### Testing without libgcc.
ok crypto/x509 16.206s
ok net 0.318s
ok os/user 0.038s
##### sync -cpu=10
ok sync 1.713s
##### ../test/bench/go1
testing: warning: no tests to run
PASS
ok test/bench/go1 53.521s
##### ../test
# go run run.go -- fixedbugs/issue30908.go
exit status: 'go 56812: 1'
cmd/link: while reading object for 'a': duplicate symbol 'go.info.go.builtin.error.Error', previous def at 'runtime', with mismatched payload: new length 52 != old length 40
cmd/link: while reading object for 'bytes': duplicate symbol 'go.isstmt.go.builtin.error.Error', previous def at 'a', with mismatched payload: new length 0 != old length 15
cmd/link: while reading object for 'path/filepath': duplicate symbol 'go.isstmt.go.builtin.error.Error', previous def at 'a', with mismatched payload: new length 0 != old length 15
cmd/link: while reading object for 'strconv': duplicate symbol 'go.isstmt.go.builtin.error.Error', previous def at 'a', with mismatched payload: new length 0 != old length 15
cmd/link: while reading object for 'strings': duplicate symbol 'go.isstmt.go.builtin.error.Error', previous def at 'a', with mismatched payload: new length 0 != old length 15
FAIL fixedbugs/issue30908.go 1.449s
2019/04/18 18:53:13 Failed: exit status: 'runtest.exe 50122: 1'
##### API check
+pkg database/sql, method (*NullTime) Scan(interface{}) error
+pkg database/sql, method (NullTime) Value() (driver.Value, error)
+pkg database/sql, type NullTime struct
+pkg database/sql, type NullTime struct, Time time.Time
+pkg database/sql, type NullTime struct, Valid bool
+pkg debug/dwarf, method (*UnsupportedType) Common() *CommonType
+pkg debug/dwarf, method (*UnsupportedType) Size() int64
+pkg debug/dwarf, method (*UnsupportedType) String() string
+pkg debug/dwarf, type UnsupportedType struct
+pkg debug/dwarf, type UnsupportedType struct, Tag Tag
+pkg debug/dwarf, type UnsupportedType struct, embedded CommonType
+pkg errors, func As(error, interface{}) bool
+pkg errors, func Caller(int) Frame
+pkg errors, func Is(error, error) bool
+pkg errors, func Opaque(error) error
+pkg errors, func Unwrap(error) error
+pkg errors, method (Frame) Format(Printer)
+pkg errors, type Formatter interface { Error, FormatError }
+pkg errors, type Formatter interface, Error() string
+pkg errors, type Formatter interface, FormatError(Printer) error
+pkg errors, type Frame struct
+pkg errors, type Printer interface { Detail, Print, Printf }
+pkg errors, type Printer interface, Detail() bool
+pkg errors, type Printer interface, Print(...interface{})
+pkg errors, type Printer interface, Printf(string, ...interface{})
+pkg errors, type Wrapper interface { Unwrap }
+pkg errors, type Wrapper interface, Unwrap() error
+pkg go/constant, func Make(interface{}) Value
+pkg go/constant, func Val(Value) interface{}
+pkg go/token, func IsExported(string) bool
+pkg go/token, func IsIdentifier(string) bool
+pkg go/token, func IsKeyword(string) bool
+pkg log, func Writer() io.Writer
+pkg math/big, method (*Int) TrailingZeroBits() uint
+pkg math/big, method (*Rat) SetUint64(uint64) *Rat
+pkg net, type ListenConfig struct, KeepAlive time.Duration
+pkg net/http, const StatusEarlyHints = 103
+pkg net/http, const StatusEarlyHints ideal-int
+pkg net/http, type Server struct, BaseContext func(net.Listener) context.Context
+pkg net/http, type Server struct, ConnContext func(context.Context, net.Conn) context.Context
+pkg net/http, type Transport struct, ForceAttemptHTTP2 bool
+pkg os, func UserConfigDir() (string, error)
+pkg os, method (*LinkError) Unwrap() error
+pkg os, method (*PathError) Unwrap() error
+pkg os, method (*SyscallError) Unwrap() error
+pkg os, var ErrTimeout error
+pkg os/exec, method (*Cmd) String() string
+pkg reflect, method (Value) IsZero() bool
+pkg syscall, method (Errno) Is(error) bool
+pkg testing, method (*B) ReportMetric(float64, string)
+pkg testing, type BenchmarkResult struct, Extra map[string]float64
+pkg time, method (Duration) Microseconds() int64
+pkg time, method (Duration) Milliseconds() int64
2019/04/18 18:53:32 FAILED
2019/04/19 00:53:32 remote failure running src/all.rc: exit status: 'all.rc 148: go 3753: 1'
2019/04/19 00:53:32 done.
2019/04/19 00:53:33 SERIAL: 2019/04/18 18:53:32 [0x10c629a0] Run = exit status: 'all.rc 148: go 3753: 1', after 1h33m7.743124491s
2019/04/18 18:53:32 Halting in 1 second.
2019/04/19 00:53:33 SERIAL: 2019/04/18 18:53:33 Halting machine.
exit status 1
I ran the plan9/386 build in debugnewvm
during the whole night and the test always completed successfully (except issue30908).
I am using:
debugnewvm doesn't quite do what the coordinator does, either. It's much closer and is useful for debugging, but it's not 100% the same (yet?). It still runs all.rc instead of running each test separately. I wonder if that's related. I can't think of anything else.
I'm unfamiliar with the coordinator internals. How difficult would it be to change debugnewvm to run the tests separately and behave closer to the coordinator?
@bradfitz Would it be possible to send me a builder key for another plan9/386 builder, so I could run the buildlet on my side?
@0intro, sure, send a CL to dashboard/builders.go adding the new host type & builder (host-plan9-386-0intro
and plan9-386-0intro
) and I'll send you the host key.
Change https://golang.org/cl/175901 mentions this issue: dashboard: add plan9-386-0intro builder
Change https://go.dev/cl/408698 mentions this issue: dashboard: add known issues for plan9-386, plan9-386-0intro, and plan9-amd64-0intro
@golang/release I propose we try to re-enable the plan9/386 builder on GCE.
I will be able to provide:
I think we're waiting for #53383 to be resolved so we have some level of clarity on secondary ports.
I think we're waiting for https://github.com/golang/go/issues/53383 to be resolved so we have some level of clarity on secondary ports.
That proposal has been accepted, and to my knowledge the gomote
auth situation is now stable too. Can we make a decision about how to move forward with the plan9/386 builders?
We can spend some time giving it a shot. Ideally we would get a script we can use to create the image but we can settle for something that works for the moment.
Here are:
I will submit a change to update the make.bash script, to take into account the update of the Plan 9 ISO image from 2018-11-30 to 2022-08-08.
I have some time to work on this today. Ideally I'd like to produce the image, buildlet, and bootstrap myself; did you do anything special?
It looks like the bootstrap archive and buildlet were rebuilt when we bumped the bootstrap version requirement to 1.17. I'll try to use those versions.
I have some time to work on this today. Ideally I'd like to produce the image, buildlet, and bootstrap myself; did you do anything special?
To produce the image, you just have to run make.bash after updating the ISO image date. You also have to update the SHA1 file.
To produce the buildlet and bootstrap, I'm running personal scripts to cross-compile them automatically from Linux. I can share them if you want.
It looks like the bootstrap archive and buildlet were rebuilt when we bumped the bootstrap version requirement to 1.17. I'll try to use those versions.
It should work, but beware they seem a bit old. My latest builds are the most up-to-date.
This is a very, very slow builder -- it's been running for over an hour now and it's not done. Is there something that can be done to speed it up? I'm not sure we want to spend our GCE quota on this.
The disk I/O are very slow on GCE, especially on Plan 9. You should make sure the build (and GOCACHE) is done inside /tmp, which is served by the ramfs (in-memory) file system.
According to the comments in the buildlet, that's true by default. Any other ideas? It looks like there's an attempt to skip the cmd/go
tests, which definitely were the slowest single step I saw.
Yes, we are currently skipping the cmd/go
tests on the 386 and amd64 builders, to save a bit of time.
In the past, we were skipping the parallel runtime tests as well.
I see. debugnewvm
probably doesn't honor those skips so maybe it'll be better running for real. I guess the only thing to do is try it out.
@0intro, what's doing on here?
/cc @bcmills @dmitshur