search

golang / go

The Go programming language
https://go.dev
BSD 3-Clause "New" or "Revised" License
124.27k stars 17.7k forks source link

meta: intermittent `unexpected disconnect while reading sideband packet` when fetching golang.org/x repos since 2022-03-25 #52490

Open bcmills opened 2 years ago

bcmills commented 2 years ago 
#!watchflakes
post <- `unexpected disconnect while reading sideband packet`
                golang.org/x/sys/cpu: golang.org/x/sys@v0.0.0-20211216021012-1d35b9e2eb4e: invalid version: git fetch -f origin refs/heads/*:refs/heads/* refs/tags/*:refs/tags/* in $WORK/gopath/pkg/mod/cache/vcs/da0444fc0003f84a590bd6521553c0531086778bca13ec63ace9e0dd258f4b51: exit status 128:
                error: 46048 bytes of body are still expected
                fetch-pack: unexpected disconnect while reading sideband packet
                fatal: early EOF
                fatal: index-pack failed

greplogs --dashboard -md -l -e 'unexpected disconnect while reading sideband packet'

2022-04-21T16:18:44-b941a10/linux-amd64-longtest 2022-04-11T16:31:42-910a33a/linux-amd64-longtest 2022-04-11T16:31:40-6130b88/linux-386-longtest 2022-03-25T18:19:09-f25631b/linux-386-longtest

Since I assume we haven't recently changed the git version on the builders, this looks to me like either a networking issue on the builders or a regression in the Git server that hosts go.googlesource.com. @golang/release: could you investigate and/or escalate appropriately?

gopherbot commented 2 months ago

Found new dashboard test flakes for:

#!watchflakes
post <- `unexpected disconnect while reading sideband packet`
2024-09-17 20:44 gotip-darwin-amd64-longtest go@b049837d cmd/go.TestScript/mod_invalid_version (log) === RUN TestScript/mod_invalid_version === PAUSE TestScript/mod_invalid_version === CONT TestScript/mod_invalid_version script_test.go:135: 2024-09-17T22:21:20Z script_test.go:137: $WORK=/Users/swarming/.swarming/w/ir/x/t/cmd-go-test-413144188/tmpdir1444210132/mod_invalid_version687153796 script_test.go:159: PATH=/Users/swarming/.swarming/w/ir/x/t/cmd-go-test-413144188/tmpdir1444210132/testbin:/Users/swarming/.swarming/w/ir/x/w/goroot/bin:/Users/swarming/.swarming/w/ir/x/w/goroot/bin:/Users/swarming/.swarming/w/ir/x/w/goroot/bin:/Users/swarming/.swarming/w/ir/cache/tools/bin:/Users/swarming/.swarming/w/ir/bbagent_utility_packages:/Users/swarming/.swarming/w/ir/bbagent_utility_packages/bin:/Users/swarming/.swarming/w/ir/cipd_bin_packages:/Users/swarming/.swarming/w/ir/cipd_bin_packages/bin:/Users/swarming/.swarming/w/ir/cipd_bin_packages/cpython3:/Users/swarming/.swarming/w/ir/cipd_bin_packages/cpython3/bin:/Users/swarming/.swarming/w/ir/cache/cipd_client:/Users/swarming/.swarming/w/ir/cache/cipd_client/bin:/Users/swarming/.swarming/cipd_cache/bin:/usr/local/bin:/usr/bin:/bin:/usr/local/sbin:/usr/sbin:/sbin HOME=/no-home CCACHE_DISABLE=1 GOARCH=amd64 ... 15:23:30.401622 http.c:658 <= Recv header: 15:31:12.352043 http.c:699 == Info: transfer closed with outstanding read data remaining 15:31:12.352097 http.c:699 == Info: Closing connection 0 error: RPC failed; curl 18 transfer closed with outstanding read data remaining error: 380 bytes of body are still expected fetch-pack: unexpected disconnect while reading sideband packet fatal: early EOF fatal: fetch-pack: invalid index-pack output script_test.go:159: FAIL: testdata/script/mod_invalid_version.txt:187: go list -m github.com/pierrec/lz4: exit status 1 --- FAIL: TestScript/mod_invalid_version (592.51s)

— watchflakes

gopherbot commented 2 months ago

Found new dashboard test flakes for:

#!watchflakes
post <- `unexpected disconnect while reading sideband packet`
2024-09-18 16:23 gotip-windows-amd64-longtest go@db40d1a4 cmd/go.TestScript/mod_sumdb_golang (log) === RUN TestScript/mod_sumdb_golang === PAUSE TestScript/mod_sumdb_golang === CONT TestScript/mod_sumdb_golang script_test.go:135: 2024-09-18T16:38:07Z script_test.go:137: $WORK=C:\b\s\w\ir\x\t\cmd-go-test-1118896347\tmpdir753861501\mod_sumdb_golang1042410939 script_test.go:159: PATH=C:\b\s\w\ir\x\t\cmd-go-test-1118896347\tmpdir753861501\testbin;C:\b\s\w\ir\x\w\goroot\bin;C:\b\s\w\ir\x\w\goroot\bin;C:\b\s\w\ir\x\w\goroot\bin;C:\b\s\w\ir\cache\tools\bin;C:\b\s\w\ir\bbagent_utility_packages;C:\b\s\w\ir\bbagent_utility_packages\bin;C:\b\s\w\ir\cipd_bin_packages;C:\b\s\w\ir\cipd_bin_packages\bin;C:\b\s\w\ir\cipd_bin_packages\cpython3;C:\b\s\w\ir\cipd_bin_packages\cpython3\bin;C:\b\s\w\ir\cache\cipd_client;C:\b\s\w\ir\cache\cipd_client\bin;C:\b\s\cipd_cache\bin;C:\Program Files\OpenSSH\;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Windows\System32\OpenSSH\;C:\Program Files\Puppet Labs\Puppet\bin;C:\b\s\w\ir\cache\tools\cc\windows\gcc64\bin USERPROFILE=/no-home CCACHE_DISABLE=1 GOARCH=amd64 ... 09:38:20.311814 http.c:683 <= Recv header: date: Wed, 18 Sep 2024 16:38:19 GMT 09:38:20.311814 http.c:671 <= Recv header, 0000000002 bytes (0x00000002) 09:38:20.311814 http.c:683 <= Recv header: 09:38:22.782553 http.c:724 == Info: Connection #1 to host go.googlesource.com left intact error: 11248 bytes of body are still expected fetch-pack: unexpected disconnect while reading sideband packet fatal: early EOF fatal: fetch-pack: invalid index-pack output script_test.go:159: FAIL: testdata\script\mod_sumdb_golang.txt:20: go get rsc.io/quote@v1.5.2: exit status 1 --- FAIL: TestScript/mod_sumdb_golang (17.07s)

— watchflakes

gopherbot commented 1 month ago

Found new dashboard test flakes for:

#!watchflakes
post <- `unexpected disconnect while reading sideband packet`
2024-10-07 17:51 gotip-darwin-amd64-longtest go@1a955f5c cmd/go.TestScript/mod_invalid_version (log) === RUN TestScript/mod_invalid_version === PAUSE TestScript/mod_invalid_version === CONT TestScript/mod_invalid_version script_test.go:139: 2024-10-08T07:09:39Z script_test.go:141: $WORK=/Users/swarming/.swarming/w/ir/x/t/cmd-go-test-1823320888/tmpdir1363191438/mod_invalid_version3594770961 script_test.go:163: PATH=/Users/swarming/.swarming/w/ir/x/t/cmd-go-test-1823320888/tmpdir1363191438/testbin:/Users/swarming/.swarming/w/ir/x/w/goroot/bin:/Users/swarming/.swarming/w/ir/x/w/goroot/bin:/Users/swarming/.swarming/w/ir/x/w/goroot/bin:/Users/swarming/.swarming/w/ir/cache/tools/bin:/Users/swarming/.swarming/w/ir/bbagent_utility_packages:/Users/swarming/.swarming/w/ir/bbagent_utility_packages/bin:/Users/swarming/.swarming/w/ir/cipd_bin_packages:/Users/swarming/.swarming/w/ir/cipd_bin_packages/bin:/Users/swarming/.swarming/w/ir/cipd_bin_packages/cpython3:/Users/swarming/.swarming/w/ir/cipd_bin_packages/cpython3/bin:/Users/swarming/.swarming/w/ir/cache/cipd_client:/Users/swarming/.swarming/w/ir/cache/cipd_client/bin:/Users/swarming/.swarming/cipd_cache/bin:/usr/local/bin:/usr/bin:/bin:/usr/local/sbin:/usr/sbin:/sbin HOME=/no-home CCACHE_DISABLE=1 GOARCH=amd64 ... 00:13:35.543903 http.c:699 == Info: Closing connection 0 error: RPC failed; curl 18 transfer closed with outstanding read data remaining error: 448 bytes of body are still expected fetch-pack: unexpected disconnect while reading sideband packet fatal: early EOF fatal: fetch-pack: invalid index-pack output script_test.go:163: FAIL: testdata/script/mod_invalid_version.txt:187: go list -m github.com/pierrec/lz4: exit status 1 go proxy: no archive example.net v0.1.0: file does not exist go proxy: no archive example.net/c v0.1.0: file does not exist --- FAIL: TestScript/mod_invalid_version (236.80s)

— watchflakes

gopherbot commented 1 month ago

Found new dashboard test flakes for:

#!watchflakes
post <- `unexpected disconnect while reading sideband packet`
2024-10-07 15:33 gotip-darwin-amd64-longtest go@534d6a1a cmd/go.TestScript/mod_get_direct (log) === RUN TestScript/mod_get_direct === PAUSE TestScript/mod_get_direct === CONT TestScript/mod_get_direct script_test.go:139: 2024-10-08T21:52:59Z script_test.go:141: $WORK=/Users/swarming/.swarming/w/ir/x/t/cmd-go-test-3420354627/tmpdir3535011985/mod_get_direct1603733950 go proxy: no archive rsc.io v1.5.1: file does not exist go proxy: no archive rsc.io v1.0.0: file does not exist go proxy: no archive rsc.io v1.5.2: file does not exist go proxy: no archive rsc.io v1.0.0: file does not exist go proxy: open /Users/swarming/.swarming/w/ir/x/w/goroot/src/cmd/go/testdata/mod/rsc.io_v1.4.0.txt: no such file or directory ... 14:55:24.070784 http.c:658 <= Recv header: 15:00:25.618419 http.c:699 == Info: transfer closed with outstanding read data remaining 15:00:25.618545 http.c:699 == Info: Closing connection 0 error: RPC failed; curl 18 transfer closed with outstanding read data remaining error: 1092 bytes of body are still expected fetch-pack: unexpected disconnect while reading sideband packet fatal: early EOF fatal: fetch-pack: invalid index-pack output script_test.go:163: FAIL: testdata/script/mod_get_direct.txt:12: go list -m cloud.google.com/go@main: exit status 1 --- FAIL: TestScript/mod_get_direct (446.13s)

— watchflakes

gopherbot commented 1 month ago

Found new dashboard test flakes for:

#!watchflakes
post <- `unexpected disconnect while reading sideband packet`
2024-10-21 18:32 gotip-linux-amd64-longtest go@67f662b2 cmd/go.TestScript/mod_gonoproxy (log) === RUN TestScript/mod_gonoproxy === PAUSE TestScript/mod_gonoproxy === CONT TestScript/mod_gonoproxy script_test.go:139: 2024-10-21T18:42:58Z script_test.go:141: $WORK=/home/swarming/.swarming/w/ir/x/t/cmd-go-test-4100123143/tmpdir4083788283/mod_gonoproxy1343629696 script_test.go:163: PATH=/home/swarming/.swarming/w/ir/x/t/cmd-go-test-4100123143/tmpdir4083788283/testbin:/home/swarming/.swarming/w/ir/x/w/goroot/bin:/home/swarming/.swarming/w/ir/x/w/goroot/bin:/home/swarming/.swarming/w/ir/x/w/goroot/bin:/home/swarming/.swarming/w/ir/cache/tools/bin:/home/swarming/.swarming/w/ir/bbagent_utility_packages:/home/swarming/.swarming/w/ir/bbagent_utility_packages/bin:/home/swarming/.swarming/w/ir/cipd_bin_packages:/home/swarming/.swarming/w/ir/cipd_bin_packages/bin:/home/swarming/.swarming/w/ir/cipd_bin_packages/cpython3:/home/swarming/.swarming/w/ir/cipd_bin_packages/cpython3/bin:/home/swarming/.swarming/w/ir/cache/cipd_client:/home/swarming/.swarming/w/ir/cache/cipd_client/bin:/home/swarming/.swarming/cipd_cache/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin HOME=/no-home CCACHE_DISABLE=1 GOARCH=amd64 ... 18:43:22.338543 http.c:699 == Info: TLSv1.3 (IN), TLS Unknown, Unknown (23): 18:43:22.338573 http.c:699 == Info: TLSv1.3 (IN), TLS Unknown, Unknown (23): 18:43:22.694864 http.c:699 == Info: TLSv1.3 (IN), TLS Unknown, Unknown (23): 18:43:22.694892 http.c:699 == Info: Connection #0 to host go.googlesource.com left intact error: 20976 bytes of body are still expected fetch-pack: unexpected disconnect while reading sideband packet fatal: early EOF fatal: fetch-pack: invalid index-pack output script_test.go:163: FAIL: testdata/script/mod_gonoproxy.txt:51: go list -m all: exit status 1 --- FAIL: TestScript/mod_gonoproxy (24.38s)

— watchflakes

gopherbot commented 3 weeks ago

Found new dashboard test flakes for:

#!watchflakes
post <- `unexpected disconnect while reading sideband packet`
2024-10-30 17:05 go1.23-darwin-amd64-longtest release-branch.go1.23@a0d15cb9 cmd/go.TestScript/mod_invalid_version (log) === RUN TestScript/mod_invalid_version === PAUSE TestScript/mod_invalid_version === CONT TestScript/mod_invalid_version script_test.go:135: 2024-10-31T00:53:31Z script_test.go:137: $WORK=/Users/swarming/.swarming/w/ir/x/t/cmd-go-test-1810338610/tmpdir1437776016/mod_invalid_version906130486 script_test.go:159: PATH=/Users/swarming/.swarming/w/ir/x/t/cmd-go-test-1810338610/tmpdir1437776016/testbin:/Users/swarming/.swarming/w/ir/x/w/goroot/bin:/Users/swarming/.swarming/w/ir/x/w/goroot/bin:/Users/swarming/.swarming/w/ir/x/w/goroot/bin:/Users/swarming/.swarming/w/ir/cache/tools/bin:/Users/swarming/.swarming/w/ir/bbagent_utility_packages:/Users/swarming/.swarming/w/ir/bbagent_utility_packages/bin:/Users/swarming/.swarming/w/ir/cipd_bin_packages:/Users/swarming/.swarming/w/ir/cipd_bin_packages/bin:/Users/swarming/.swarming/w/ir/cipd_bin_packages/cpython3:/Users/swarming/.swarming/w/ir/cipd_bin_packages/cpython3/bin:/Users/swarming/.swarming/w/ir/cache/cipd_client:/Users/swarming/.swarming/w/ir/cache/cipd_client/bin:/Users/swarming/.swarming/cipd_cache/bin:/usr/local/bin:/usr/bin:/bin:/usr/local/sbin:/usr/sbin:/sbin HOME=/no-home CCACHE_DISABLE=1 GOARCH=amd64 ... 17:53:33.412826 http.c:658 <= Recv header: 18:02:38.950891 http.c:699 == Info: SSLRead() return error -36 18:02:38.950949 http.c:699 == Info: Closing connection 0 error: RPC failed; curl 56 SSLRead() return error -36 error: 20582 bytes of body are still expected fetch-pack: unexpected disconnect while reading sideband packet fatal: early EOF fatal: fetch-pack: invalid index-pack output script_test.go:159: FAIL: testdata/script/mod_invalid_version.txt:24: go list -m golang.org/x/text: exit status 1 --- FAIL: TestScript/mod_invalid_version (547.10s)

— watchflakes

gopherbot commented 4 days ago

Found new dashboard test flakes for:

#!watchflakes
post <- `unexpected disconnect while reading sideband packet`
2024-11-21 10:40 gotip-darwin-amd64-longtest go@28f4e14e cmd/go/internal/modfetch.TestCodeRepo/golang.org_x_text/4e4a3210bb (log) === RUN TestCodeRepo/golang.org_x_text/4e4a3210bb === PAUSE TestCodeRepo/golang.org_x_text/4e4a3210bb === CONT TestCodeRepo/golang.org_x_text/4e4a3210bb coderepo_test.go:623: repo.Stat("4e4a3210bb"): golang.org/x/text@4e4a3210bb: invalid version: git fetch -f origin refs/heads/*:refs/heads/* refs/tags/*:refs/tags/* in /Users/swarming/.swarming/w/ir/x/t/gitrepo-test-649382039/modcache/cache/vcs/38515699458adac9c8b61a0b44f9ad7a5f6edd7bcc2d7fae95930ec78f71e1b4: exit status 128: error: 13808 bytes of body are still expected fetch-pack: unexpected disconnect while reading sideband packet fatal: early EOF fatal: fetch-pack: invalid index-pack output --- FAIL: TestCodeRepo/golang.org_x_text/4e4a3210bb (114.23s)

— watchflakes