cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
https://www.cockroachlabs.com
Other
30.12k stars 3.81k forks source link

roachtest: gossip/chaos/nodes=9 failed #131551

Closed cockroach-teamcity closed 6 days ago

cockroach-teamcity commented 1 month ago

roachtest.gossip/chaos/nodes=9 failed with artifacts on master @ 5400cb9a70e63bfe1aa2849a566c195ad63130d1:

(gossip.go:83).2: gossip did not stabilize (dead node 2) in 30.4s
test artifacts and logs in: /artifacts/gossip/chaos/nodes=9/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

/cc @cockroachdb/kv-triage

This test on roachdash | Improve this report!

Jira issue: CRDB-42595

kvoli commented 1 month ago

Same problem as https://github.com/cockroachdb/cockroach/issues/130737

2024/09/28 07:36:47 gossip.go:125: test status: waiting for gossip to exclude dead node 2
2024/09/28 07:36:47 gossip.go:128: checking if gossip excludes dead node 2 (0s)
2024/09/28 07:36:47 gossip.go:90: 1: checking gossip
2024/09/28 07:36:47 gossip.go:94: 1: gossip not ok (dead node 2 present) (0s)
2024/09/28 07:36:47 gossip.go:134: sleeping for 1s (0s)
2024/09/28 07:37:17 gossip.go:128: checking if gossip excludes dead node 2 (30s)

Copying labels.

github-actions[bot] commented 1 week ago

We have marked this test failure issue as stale because it has been inactive for 1 month. If this failure is still relevant, removing the stale label or adding a comment will keep it active. Otherwise, we'll close it in 5 days to keep the test failure queue tidy.