roachtest: backup/2TB/n10cpu4 failed

cockroach-teamcity commented 11 months ago

roachtest.backup/2TB/n10cpu4 failed with artifacts on release-23.1 @ e0983753ba31ec5f2f7f86071dbfd2c0e8b91e7f:

(cluster.go:2181).Run: full command output in run_112356.100134720_n1_cockroach-sql-insecu.log: COMMAND_PROBLEM: exit status 1
(monitor.go:153).Wait: monitor failure: monitor user task failed: t.Fatal() was called
test artifacts and logs in: /artifacts/backup/2TB/n10cpu4/run_1

Parameters: ROACHTEST_arch=amd64 , ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_encrypted=false , ROACHTEST_fs=ext4 , ROACHTEST_localSSD=true , ROACHTEST_metamorphicBuild=false , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7) See: [Grafana](https://go.crdb.dev/roachtest-grafana/teamcity-13074397/backup-2tb-n10cpu4/1702290578046/1702294020398)

/cc @cockroachdb/disaster-recovery

This test on roachdash | Improve this report!

Jira issue: CRDB-34383

adityamaru commented 11 months ago

Post "https://storage.googleapis.com/upload/storage/v1/b/cockroachdb-backup-testing/o?alt=json&name=teamcity-13074397-1702276074-31-n10cpu4%2Fdata%2F924789854958714884.sst&prettyPrint=false&projection=full&uploadType=resumable&upload_id=ABPtcPruRpRhAkV8l8jdVnHuIEHRU97ay-07uvAyAvrbudQlY7MDABgeRjruuE368FMNGWLVuUnKPEPEMExD_9bUyBjpW0jQo0kUaMij5iyJVY98": http2: client connection force closed via ClientConn.Close

adityamaru commented 11 months ago

I haven't found a definitive source of whether we should be retrying these errors. The documentation about this error is also sparse. There have been no Google SDK updates to 23.1 so I'm going to write this off as an infra flake.

cockroachdb / cockroach

roachtest: backup/2TB/n10cpu4 failed #116018