cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
https://www.cockroachlabs.com
Other
30.19k stars 3.82k forks source link

ccl/backupccl: TestBackupRestoreMultiNodeLocal failed #134303

Closed cockroach-teamcity closed 3 weeks ago

cockroach-teamcity commented 3 weeks ago

ccl/backupccl.TestBackupRestoreMultiNodeLocal failed on release-24.3 @ 6d792725ebcbb766255fc5561a465b997bfc390e:

=== RUN   TestBackupRestoreMultiNodeLocal
    test_log_scope.go:165: test logs captured to: outputs.zip/logTestBackupRestoreMultiNodeLocal300666624
    test_log_scope.go:76: use -show-logs to present logs inline
    test_server_shim.go:152: automatically injected a shared process virtual cluster under test; see comment at top of test_server_shim.go for details.
    backup_test.go:1007: error scanning '&{0xc0210a4fc0 <nil>}': pq: job 1018226816503808001: could not mark as succeeded: txn exec: context canceled
    testutils.go:296: no Invalid Descriptors
    panic.go:626: -- test log scope end --
test logs left over in: outputs.zip/logTestBackupRestoreMultiNodeLocal300666624
--- FAIL: TestBackupRestoreMultiNodeLocal (398.35s)

Parameters:

See also: How To Investigate a Go Test Failure (internal)

/cc @cockroachdb/disaster-recovery

This test on roachdash | Improve this report!

Jira issue: CRDB-44014

dt commented 3 weeks ago

failed node liveness heartbeat: aborted in DistSender: result is ambiguous: node unavailable

dt commented 3 weeks ago

between the nodes of a single process in memory test cluster: [T1,Vsystem,n3,rnode=1,raddr=‹127.0.0.1:39459›,class=default,rpc] 2223 latency jump (prev avg 131.51ms, current 247.08ms)