cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
https://www.cockroachlabs.com
Other
29.89k stars 3.77k forks source link

roachtest: cdc/kafka-chaos-multiple-sink-nodes failed #127110

Open cockroach-teamcity opened 2 months ago

cockroach-teamcity commented 2 months ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ dc3ebba01015d2c7275aa27af2a54fe88b87e901:

(cluster.go:2417).Run: full command output in run_070318.119852687_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

/cc @cockroachdb/cdc

This test on roachdash | Improve this report!

Jira issue: CRDB-40275

cockroach-teamcity commented 2 weeks ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 4142920c2d5c50c0520c124764aeeda94ba043ae:

(cdc.go:387).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 weeks ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ f341fb5d738192dbd9ea55e3fd7ed9d52407f6f5:

(cluster.go:2446).Run: full command output in run_070108.397401451_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:387).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 week ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ b6862f42d3a229cad814b61d5a77a420afb540b5:

(cluster.go:2446).Run: full command output in run_071212.016877889_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:387).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 week ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ b6862f42d3a229cad814b61d5a77a420afb540b5:

(cdc.go:387).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 week ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 950a090603bffa9216f01b03aeeb7dd093c6be64:

(cluster.go:2451).Run: full command output in run_072814.491766553_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:387).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 week ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 950a090603bffa9216f01b03aeeb7dd093c6be64:

(cdc.go:387).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 week ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ fa9c0528fc0d06be1b4cfc534ec0501448111fbe:

(cluster.go:2451).Run: full command output in run_071113.335225350_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:387).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 week ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ fa9c0528fc0d06be1b4cfc534ec0501448111fbe:

(cdc.go:387).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 week ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ fa9c0528fc0d06be1b4cfc534ec0501448111fbe:

(cluster.go:2451).Run: full command output in run_064905.253846901_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:387).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 week ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ fa9c0528fc0d06be1b4cfc534ec0501448111fbe:

(monitor.go:154).Wait: monitor failure: changefeed[default]: max latency was more than allowed: 5m0.993933906s vs 5m0s
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 week ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 00edd9c46e7f3638846d0dc182a9dd50a0aa9cbc:

(cluster.go:2451).Run: full command output in run_065102.717651873_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:387).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 week ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 7571549d8772a087ab4577d1e770e02582ba5877:

(cluster.go:2451).Run: full command output in run_055843.583213706_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:387).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 week ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 7571549d8772a087ab4577d1e770e02582ba5877:

(monitor.go:154).Wait: monitor failure: changefeed[default]: max latency was more than allowed: 5m0.715037662s vs 5m0s
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 week ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 1b0a374fd2a101cebcfb24cff4b3b57795ad1df6:

(cluster.go:2451).Run: full command output in run_055950.923159412_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:387).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 week ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 1b0a374fd2a101cebcfb24cff4b3b57795ad1df6:

(cdc.go:387).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity commented 6 days ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 67e99ebec74c1f6a6dfbf1cc0bca2d255a55f867:

(cluster.go:2451).Run: full command output in run_055924.374202766_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:387).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 6 days ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 67e99ebec74c1f6a6dfbf1cc0bca2d255a55f867:

(cdc.go:387).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity commented 5 days ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 66ff4329d380562ec95466ba108b72be721ff6c9:

(cluster.go:2451).Run: full command output in run_055505.218127987_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:390).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 5 days ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 66ff4329d380562ec95466ba108b72be721ff6c9:

(monitor.go:154).Wait: monitor failure: changefeed[default]: max latency was more than allowed: 5m0.241703611s vs 5m0s
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity commented 4 days ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 5cc8013ada42f9ea03eda661a4f178c141f4f24d:

(cluster.go:2451).Run: full command output in run_064512.789240280_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:390).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 days ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 5cc8013ada42f9ea03eda661a4f178c141f4f24d:

(cdc.go:390).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 days ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 3f8226eb7f09eb93c26dda4cd47e023a8f56ea23:

(cluster.go:2451).Run: full command output in run_063016.192420911_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:390).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 days ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 3f8226eb7f09eb93c26dda4cd47e023a8f56ea23:

(cdc.go:390).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 days ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 128fcab4c07413513a05aea1d1494943f4bc3092:

(cluster.go:2451).Run: full command output in run_055612.955627003_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:390).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 days ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 128fcab4c07413513a05aea1d1494943f4bc3092:

(cdc.go:390).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 day ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 1a8e39cd3c488c5c583b75b2f6a8337568de618c:

(cluster.go:2451).Run: full command output in run_055449.973194887_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:390).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 day ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 1a8e39cd3c488c5c583b75b2f6a8337568de618c:

(monitor.go:154).Wait: monitor failure: changefeed[default]: max latency was more than allowed: 5m0.895165103s vs 5m0s
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 hour ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 197c6ee5537ffb211ebd8dbcbe49edc6d5c710e1:

(cluster.go:2473).Run: full command output in run_060555.040122113_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:390).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 26 minutes ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 197c6ee5537ffb211ebd8dbcbe49edc6d5c710e1:

(cdc.go:390).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!