roachtest: c2c/BulkOps failed

Note: This build has runtime assertions enabled. If the same failure was hit in a run without assertions enabled, there should be a similar failure without this message. If there isn't one, then this failure is likely due to an assertion violation or (assertion) timeout.

roachtest.c2c/BulkOps failed with artifacts on master @ eb2d2e19eb29d2747d9e267bd0612a69d066adad:

(assertions.go:363).Fail: 
    Error Trace:    pkg/cmd/roachtest/tests/cluster_to_cluster.go:762
                                pkg/cmd/roachtest/tests/cluster_to_cluster.go:1012
                                pkg/cmd/roachtest/tests/cluster_to_cluster.go:1347
                                pkg/cmd/roachtest/monitor.go:115
                                external/org_golang_x_sync/errgroup/errgroup.go:78
                                src/runtime/asm_amd64.s:1695
    Error:          Received unexpected error:
                    expected job status succeeded, but got running
                    (1) attached stack trace
                      -- stack trace:
                      | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*replicationDriver).stopReplicationStream.func1
                      |     pkg/cmd/roachtest/tests/cluster_to_cluster.go:758
                      | github.com/cockroachdb/cockroach/pkg/util/retry.ForDuration
                      |     pkg/util/retry/retry.go:213
                      | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*replicationDriver).stopReplicationStream
                      |     pkg/cmd/roachtest/tests/cluster_to_cluster.go:740
                      | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*replicationDriver).main
                      |     pkg/cmd/roachtest/tests/cluster_to_cluster.go:1012
                      | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.registerClusterToCluster.func1.1
                      |     pkg/cmd/roachtest/tests/cluster_to_cluster.go:1347
                      | main.(*monitorImpl).Go.func1
                      |     pkg/cmd/roachtest/monitor.go:115
                      | golang.org/x/sync/errgroup.(*Group).Go.func1
                      |     external/org_golang_x_sync/errgroup/errgroup.go:78
                      | runtime.goexit
                      |     src/runtime/asm_amd64.s:1695
                    Wraps: (2) expected job status succeeded, but got running
                    Error types: (1) *withstack.withStack (2) *errutil.leafError
    Test:           c2c/BulkOps
(require.go:1357).NoError: FailNow called
(monitor.go:149).Wait: monitor failure: monitor user task failed: t.Fatal() was called
test artifacts and logs in: /artifacts/c2c/BulkOps/run_1

Parameters:

arch=amd64
cloud=gce
coverageBuild=false
cpu=8
encrypted=false
fs=ext4
localSSD=false
metamorphicLeases=leader
runtimeAssertionsBuild=true
ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

/cc @cockroachdb/disaster-recovery _{This test on roachdash | Improve this report!

Jira issue: CRDB-44758}

cockroachdb / cockroach

roachtest: c2c/BulkOps failed #135873