cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
https://www.cockroachlabs.com
Other
29.87k stars 3.77k forks source link

roachtest: failover/chaos/read-write failed #129217

Open cockroach-teamcity opened 3 weeks ago

cockroach-teamcity commented 3 weeks ago

roachtest.failover/chaos/read-write failed with artifacts on release-24.2.0-rc @ acb89a54d7923817d5fbdc11cadc91c60fe4345f:

(assertions.go:363).Fail: 
    Error Trace:    github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/failover.go:1465
                                github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/failover.go:343
                                main/pkg/cmd/roachtest/monitor.go:120
                                golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:78
                                src/runtime/asm_amd64.s:1695
    Error:          Received unexpected error:
                    pq: internal error while retrieving user account memberships: operation "get-user-session" timed out after 10.001s (given timeout 10s): internal error while retrieving user account: get auth info error: interrupted during singleflight load-value:authinfo-roachprod-2-2: context deadline exceeded
    Test:           failover/chaos/read-write
(require.go:1357).NoError: FailNow called
(monitor.go:154).Wait: monitor failure: monitor user task failed: t.Fatal() was called
(cluster.go:2434).Run: context canceled
(cluster.go:2434).Run: context canceled
(cluster.go:2434).Run: context canceled
(cluster.go:2434).Run: context canceled
test artifacts and logs in: /artifacts/failover/chaos/read-write/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

- #129047 roachtest: failover/chaos/read-write failed [C-test-failure O-roachtest O-robot P-3 T-kv X-duplicate branch-release-23.2] - #128761 roachtest: failover/chaos/read-write failed [A-storage A-testing C-bug C-test-failure O-roachtest O-robot T-storage branch-release-23.2.9-rc] - #126550 roachtest: failover/chaos/read-write failed [A-testing C-bug C-test-failure O-roachtest O-robot P-3 T-kv branch-release-23.1]

/cc @cockroachdb/kv-triage

This test on roachdash | Improve this report!

Jira issue: CRDB-41454

kvoli commented 3 weeks ago

Duplicate of https://github.com/cockroachdb/cockroach/issues/126927