cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
https://www.cockroachlabs.com
Other
30.18k stars 3.82k forks source link

roachtest: cdc/tpcc-1000/sink=kafka failed #135980

Open cockroach-teamcity opened 3 days ago

cockroach-teamcity commented 3 days ago

roachtest.cdc/tpcc-1000/sink=kafka failed with artifacts on release-24.3 @ 82c427f7a58cec597a46a516a1d7d47b68296d18:

(cluster.go:2455).Run: full command output in run_071651.638423469_n4_cockroach-workload-r.log: COMMAND_PROBLEM: exit status 1
(cdc.go:394).Close: error shutting down prometheus/grafana: context canceled
test artifacts and logs in: /artifacts/cdc/tpcc-1000/sink=kafka/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for aws clusters

Same failure on other branches

- #135383 roachtest: cdc/tpcc-1000/sink=kafka failed [A-cdc C-test-failure O-roachtest O-robot P-2 T-cdc branch-master] - #135240 roachtest: cdc/tpcc-1000/sink=kafka failed [A-cdc C-test-failure O-roachtest O-robot T-cdc branch-release-24.3.0-rc release-blocker]

/cc @cockroachdb/cdc

This test on roachdash | Improve this report!

Jira issue: CRDB-44810

blathers-crl[bot] commented 3 days ago

This issue has multiple T-eam labels. Please make sure it only has one, or else issue synchronization will not work correctly.

:owl: Hoot! I am a Blathers, a bot for CockroachDB. My owner is dev-inf.

wenyihu6 commented 3 days ago
E241122 08:51:40.375306 1 workload/cli/run.go:599  [-] 4  error in delivery: failed to connect to `host=10.12.1.4 user=roachprod database=tpcc`: server error (ERROR: server is not accepting clients, try another node (SQLSTATE 57P01))
Error: error in delivery: failed to connect to `host=10.12.1.4 user=roachprod database=tpcc`: server error (ERROR: server is not accepting clients, try another node (SQLSTATE 57P01))
wenyihu6 commented 3 days ago

Removing release blocker given that this error happened in workload/cli/run.