roachtest: backup/2TB/n10cpu4 failed [client connection force closed via ClientConn.Close]

[cockroach-teamcity]

roachtest.backup/2TB/n10cpu4 failed with artifacts on release-24.1 @ d2ac82658f68c96394a811a3eaecafcd808403f3:

(monitor.go:154).Wait: monitor failure: unexpectedly found job 957329283786145793 in state failed
test artifacts and logs in: /artifacts/backup/2TB/n10cpu4/run_1

Parameters:

• ROACHTEST_arch=amd64
• ROACHTEST_cloud=gce
• ROACHTEST_coverageBuild=false
• ROACHTEST_cpu=4
• ROACHTEST_encrypted=false
• ROACHTEST_fs=ext4
• ROACHTEST_localSSD=true
• ROACHTEST_metamorphicBuild=false
• ROACHTEST_ssd=0
  Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

/cc @cockroachdb/disaster-recovery

This test on roachdash | Improve this report!

Jira issue: CRDB-37495

[msbutler]

Looks like another pesky gcs networking flake:

Post ""https://storage.googleapis.com/upload/storage/v1/b/cockroachdb-backup-testing/o?alt=json&name=teamcity-14691376-1712208640-29-n10cpu4%2F2024%2F04%2F04-094832.08%2Fdata%2F957329888961593348.sst&prettyPrint=false&projection=full&uploadType=resumable&upload_id=ABPtcPoL-6-Hu4le5-grWW6MCTkssw0I-qZvaIAGBELnXV-B9yjEQpfMHr8OPesitqQsWoOiYMvc07xJmMBcgXW829mpMVzF3kW6bSJL58EjX8U66Q"": http2: client connection force closed via ClientConn.Close"