roachtest: restore/online/workload=true/tpcc/8TB/gce/inc-count=0/nodes=10/cpus=8 failed

[cockroach-teamcity]

roachtest.restore/online/workload=true/tpcc/8TB/gce/inc-count=0/nodes=10/cpus=8 failed with artifacts on master @ 8eeb7f2ae3b2cede564b46ca47e2353fd147c061:

(monitor.go:149).Wait: monitor failure: Workload context was not cancelled. Error returned by workload cmd: full command output in run_120404.377495078_n11_cockroach-workload-r.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/restore/online/workload=true/tpcc/8TB/gce/inc-count=0/nodes=10/cpus=8/run_1

Parameters:

• arch=amd64
• cloud=gce
• coverageBuild=false
• cpu=8
• encrypted=false
• fs=ext4
• localSSD=false
• runtimeAssertionsBuild=false
• ssd=0
  Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

- #129602 roachtest: restore/online/workload=true/tpcc/8TB/gce/inc-count=0/nodes=10/cpus=8 failed [C-test-failure O-roachtest O-robot P-3 T-disaster-recovery branch-release-24.2]

/cc @cockroachdb/disaster-recovery

This test on roachdash | Improve this report!

Jira issue: CRDB-44738

[msbutler]

workload flake unrelated to online restore:

E241120 12:04:07.156460 1 workload/cli/run.go:599  [-] 5  error in newOrder: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh due to encountered recently written committed value /Table/106/1/0/0 @1732104245.606613537,2): "sql txn" meta={id=12ed1426 key=/Table/107/1/0/6/0 iso=Serializable pri=0.01045363 epo=0 ts=1732104245.607239388,1 min=1732104245.606086353,0 seq=20} lock=true stat=PENDING rts=1732104245.606086353,0 wto=false gul=1732104246.106086353,0 (SQLSTATE 40001)
Error: error in newOrder: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh due to encountered recently written committed value /Table/106/1/0/0 @1732104245.606613537,2): "sql txn" meta={id=12ed1426 key=/Table/107/1/0/6/0 iso=Serializable pri=0.01045363 epo=0 ts=1732104245.607239388,1 min=1732104245.606086353,0 seq=20} lock=true stat=PENDING rts=1732104245.606086353,0 wto=false gul=1732104246.106086353,0 (SQLSTATE 40001)

[cockroach-teamcity]

roachtest.restore/online/workload=true/tpcc/8TB/gce/inc-count=0/nodes=10/cpus=8 failed with artifacts on master @ eb2d2e19eb29d2747d9e267bd0612a69d066adad:

(monitor.go:149).Wait: monitor failure: Workload context was not cancelled. Error returned by workload cmd: full command output in run_133144.936408532_n11_cockroach-workload-r.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/restore/online/workload=true/tpcc/8TB/gce/inc-count=0/nodes=10/cpus=8/run_1

Parameters:

• arch=amd64
• cloud=gce
• coverageBuild=false
• cpu=8
• encrypted=false
• fs=ext4
• localSSD=false
• runtimeAssertionsBuild=false
• ssd=0
  Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

- #135906 roachtest: restore/online/workload=true/tpcc/8TB/gce/inc-count=0/nodes=10/cpus=8 failed [A-disaster-recovery C-test-failure O-roachtest O-robot T-disaster-recovery branch-release-24.3 release-blocker] - #129602 roachtest: restore/online/workload=true/tpcc/8TB/gce/inc-count=0/nodes=10/cpus=8 failed [C-test-failure O-roachtest O-robot P-3 T-disaster-recovery branch-release-24.2]

This test on roachdash | Improve this report!

[blathers-crl[bot]]

Based on the specified backports for linked PR #135915, I applied the following new label(s) to this issue: branch-release-24.3. Please adjust the labels as needed to match the branches actually affected by this issue, including adding any known older branches.

_{:owl: Hoot! I am a Blathers, a bot for CockroachDB. My owner is dev-inf.}