roachtest: failover/chaos/read-write failed

cockroach-teamcity commented 2 months ago

roachtest.failover/chaos/read-write failed with artifacts on release-23.1 @ fbcb992a72c3ac2a9af96f6238a24b3978bcaadf:

(disk_stall.go:301).Setup: full command output in run_121454.290930856_n1-10_echo-0-sudo-blockdev.log: COMMAND_PROBLEM: exit status 1
(cluster.go:2144).Run: context canceled
(cluster.go:2144).Run: context canceled
(cluster.go:2144).Run: context canceled
test artifacts and logs in: /artifacts/failover/chaos/read-write/run_1

Parameters:

ROACHTEST_arch=amd64
ROACHTEST_cloud=gce
ROACHTEST_cpu=2
ROACHTEST_encrypted=false
ROACHTEST_fs=ext4
ROACHTEST_localSSD=false
ROACHTEST_metamorphicBuild=false
ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

- #125681 roachtest: failover/chaos/read-write failed [A-testing C-bug C-test-failure O-roachtest O-robot P-3 T-kv branch-release-24.1]

/cc @cockroachdb/kv-triage

This test on roachdash | Improve this report!

Jira issue: CRDB-39974

kvoli commented 2 months ago

Similar to other failures on 23.1, the issue is fixed on 23.2+, from:

Closing as this is on 23.1. This was fixed on the 23.2+ releases.

cockroach-teamcity commented 1 month ago

roachtest.failover/chaos/read-write failed with artifacts on release-23.1 @ 37ae9f7de15888db9e07696ca692fb0b772eedcd:

(cluster.go:2042).Start: context canceled
(monitor.go:153).Wait: monitor failure: monitor user task failed: t.Fatal() was called
unexpected node event: n5: cockroach process for system interface died (exit code 7)
(cluster.go:2144).Run: context canceled
(cluster.go:2144).Run: context canceled
(cluster.go:2144).Run: context canceled
(cluster.go:2144).Run: context canceled
test artifacts and logs in: /artifacts/failover/chaos/read-write/run_1

Parameters:

ROACHTEST_arch=amd64
ROACHTEST_cloud=gce
ROACHTEST_cpu=2
ROACHTEST_encrypted=false
ROACHTEST_fs=ext4
ROACHTEST_localSSD=false
ROACHTEST_metamorphicBuild=false
ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

_{This test on roachdash | Improve this report!}

cockroachdb / cockroach

roachtest: failover/chaos/read-write failed #126550