search

cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
https://www.cockroachlabs.com
Other
29.77k stars 3.76k forks source link

roachtest: cdc/kafka-chaos-multiple-sink-nodes failed #127110

Open cockroach-teamcity opened 1 month ago

cockroach-teamcity commented 1 month ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ dc3ebba01015d2c7275aa27af2a54fe88b87e901:

(cluster.go:2417).Run: full command output in run_070318.119852687_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

/cc @cockroachdb/cdc

This test on roachdash | Improve this report!

Jira issue: CRDB-40275

cockroach-teamcity commented 1 month ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 1ebd9e1e105cd90ef0bcff47a47369681d165d14:

(cluster.go:2417).Run: full command output in run_070425.179591162_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 month ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 1ebd9e1e105cd90ef0bcff47a47369681d165d14:

(monitor.go:154).Wait: monitor failure: changefeed[default]: max latency was more than allowed: 5m0.065045824s vs 5m0s
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 month ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 67aa2613446c3c6b53bad21f01286c98290cc0a3:

(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 month ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ eccb77d2320955b477bb03bc1f1aee137bd1de76:

(cluster.go:2456).Run: full command output in run_200821.706454962_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 month ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 73ecc8b494c4e7f757bb35d68b3587a51af93b02:

(cdc.go:3572).validateMessage: topic consumer for warehouse encountered validator error(s): topic warehouse partition 1: saw new row timestamp 1721114722547786000.0000000000 after 1721114809196991345.0000000000 was seen
(cluster.go:2456).Run: context canceled
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 month ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 73ecc8b494c4e7f757bb35d68b3587a51af93b02:

(cluster.go:2456).Run: full command output in run_071243.250530868_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

asg0451 commented 1 month ago

this is a new test that seems to flake a lot on ci (works on my gceworker though..). investigation pending but it's not a release blocker

cockroach-teamcity commented 1 month ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ bcd4e5e37f2a95e73347f5ed83db5a24bebfd8d1:

(cdc.go:3572).validateMessage: topic consumer for warehouse encountered validator error(s): topic warehouse partition 1: saw new row timestamp 1721198789333437014.0000000000 after 1721198945113914998.0000000000 was seen
(cluster.go:2456).Run: context canceled
(cluster.go:2456).Run: context canceled
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 month ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ bcd4e5e37f2a95e73347f5ed83db5a24bebfd8d1:

(cluster.go:2456).Run: full command output in run_070634.543657724_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 month ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 46854026bc11b3870c8bbefc976f5550b18dd82c:

(cdc.go:3572).validateMessage: topic consumer for warehouse encountered validator error(s): topic warehouse partition 0: saw new row timestamp 1721284906681032015.0000000000 after 1721285123592838392.0000000000 was seen
(cluster.go:2456).Run: context canceled
(cluster.go:2456).Run: context canceled
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 month ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 46854026bc11b3870c8bbefc976f5550b18dd82c:

(cluster.go:2456).Run: full command output in run_071018.644515944_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 month ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 6154ebfa1482bcaecc1988a10f1f0f124b5c6b27:

(cluster.go:2456).Run: full command output in run_212001.538594652_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 month ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 59be0708627bb27f49d8976182062c6886d64282:

(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 month ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 59be0708627bb27f49d8976182062c6886d64282:

(cluster.go:2456).Run: full command output in run_072505.361096831_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 month ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 7a8ce2447eb023e855cb85b3ce65a07a70a39334:

(monitor.go:154).Wait: monitor failure: changefeed[default]: max latency was more than allowed: 5m0.67713304s vs 5m0s
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 month ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 7a8ce2447eb023e855cb85b3ce65a07a70a39334:

(cluster.go:2456).Run: full command output in run_070540.347040267_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 month ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 05052df0b4d89dd1147714431163cd8a9b63c589:

(cdc.go:3578).validateMessage: topic consumer for warehouse encountered validator error(s): topic warehouse partition 1: saw new row timestamp 1721544086420409658.0000000000 after 1721544089523320910.0000000000 was seen
(cluster.go:2456).Run: context canceled
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 month ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 05052df0b4d89dd1147714431163cd8a9b63c589:

(cluster.go:2456).Run: full command output in run_070540.248848618_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 month ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 05052df0b4d89dd1147714431163cd8a9b63c589:

(cdc.go:3578).validateMessage: topic consumer for warehouse encountered validator error(s): topic warehouse partition 0: saw new row timestamp 1721630760787794140.0000000000 after 1721631121585352911.0000000000 was seen
(cluster.go:2456).Run: context canceled
(cluster.go:2456).Run: context canceled
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 month ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 05052df0b4d89dd1147714431163cd8a9b63c589:

(cluster.go:2456).Run: full command output in run_070457.310124728_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 month ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 7c29b0c71f3ee8ccc436b5f039955bf6d2add914:

(monitor.go:154).Wait: monitor failure: changefeed[default]: max latency was more than allowed: 5m0.635719847s vs 5m0s
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 month ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 7c29b0c71f3ee8ccc436b5f039955bf6d2add914:

(cluster.go:2456).Run: full command output in run_070608.949893345_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 month ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 4af6b13bf95a52fe8f6857ffd32e8c1156c36950:

(cluster.go:2456).Run: full command output in run_070520.761192346_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 month ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ da85c982fa391ef34fd14c29006b1f629217ff42:

(cdc.go:3578).validateMessage: topic consumer for warehouse encountered validator error(s): topic warehouse partition 0: saw new row timestamp 1721888370170710395.0000000000 after 1721888601837299720.0000000000 was seen
(cluster.go:2456).Run: context canceled
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 month ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ da85c982fa391ef34fd14c29006b1f629217ff42:

(cluster.go:2456).Run: full command output in run_070641.672418411_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 month ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 7fb362dd5aa6e85d65c4c89f208c5bed51ab9692:

(cdc.go:3578).validateMessage: topic consumer for warehouse encountered validator error(s): topic warehouse partition 0: saw new row timestamp 1721974887322126368.0000000000 after 1721975094537863667.0000000000 was seen
(cluster.go:2456).Run: context canceled
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 month ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 7fb362dd5aa6e85d65c4c89f208c5bed51ab9692:

(cluster.go:2456).Run: full command output in run_071949.985897779_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 month ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 1893ac1d7188dc87dbb2b379b30172bf83ca4645:

(cdc.go:3569).validateMessage: topic consumer for warehouse encountered validator error(s): topic warehouse partition 1: saw new row timestamp 1722065972160087313.0000000000 after 1722065976248567451.0000000000 was seen
(cluster.go:2458).Run: context canceled
(cdc.go:379).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 month ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 1893ac1d7188dc87dbb2b379b30172bf83ca4645:

(cluster.go:2458).Run: full command output in run_071701.193307423_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:379).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 month ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ fb8032d12d2a787b54076812595e9d7fb22f925a:

(cdc.go:379).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 month ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ fb8032d12d2a787b54076812595e9d7fb22f925a:

(cluster.go:2458).Run: full command output in run_070419.350565489_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:379).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 month ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ fb8032d12d2a787b54076812595e9d7fb22f925a:

(cluster.go:2458).Run: full command output in run_061234.993048844_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:379).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 month ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ fb8032d12d2a787b54076812595e9d7fb22f925a:

(cdc.go:3569).validateMessage: topic consumer for warehouse encountered validator error(s): topic warehouse partition 1: saw new row timestamp 1722244690640641789.0000000000 after 1722244764350399369.0000000000 was seen
(cluster.go:2458).Run: context canceled
(cluster.go:2458).Run: context canceled
(cdc.go:379).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity commented 4 weeks ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 5d9405ff2e16622c055f94208992a5347c4c273e:

(cluster.go:2458).Run: full command output in run_060525.588567810_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:379).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 4 weeks ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 5d9405ff2e16622c055f94208992a5347c4c273e:

(cdc.go:3570).validateMessage: topic consumer for warehouse encountered validator error(s): topic warehouse partition 0: saw new row timestamp 1722330406608668057.0000000000 after 1722330410732668675.0000000000 was seen
(cluster.go:2458).Run: context canceled
(cdc.go:379).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity commented 4 weeks ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ c7d1ceed692d36e9d7c5a71e7122408e2e3e3b8b:

(cluster.go:2458).Run: full command output in run_055529.829901911_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:379).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 weeks ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 7a1bf52daa3f3dcaa434fd66d2b3c960a3c9c2a5:

(cluster.go:2458).Run: full command output in run_063239.485540933_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:379).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 weeks ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 7a1bf52daa3f3dcaa434fd66d2b3c960a3c9c2a5:

(cdc.go:379).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 weeks ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 78fa126dfc749e620c28531c1659e35bf98034ec:

(cluster.go:2458).Run: full command output in run_063006.616391805_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:379).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 weeks ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 78fa126dfc749e620c28531c1659e35bf98034ec:

(cdc.go:379).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 weeks ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 356e1cc24a67d7e9a1e637b98d1664794f70fa03:

(cluster.go:2473).Run: full command output in run_061429.248514341_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:379).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 weeks ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 356e1cc24a67d7e9a1e637b98d1664794f70fa03:

(cdc.go:379).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 weeks ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ a0a52309cbbe5cb68d576fb366411fa7d7cf3574:

(cluster.go:2473).Run: full command output in run_061932.147432267_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:379).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 weeks ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ a0a52309cbbe5cb68d576fb366411fa7d7cf3574:

(cdc.go:379).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 weeks ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 5f7709cf41a3996c4bfd7eae1e231e75b024db47:

(cluster.go:2473).Run: full command output in run_060946.753201613_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:379).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 weeks ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ dbc62db07a1f149d305cff463b350588086f1b08:

(cluster.go:2473).Run: full command output in run_061401.912003367_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:379).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 weeks ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 7917e91eadb2f622faadf635a3e13c384e42070e:

(cluster.go:2473).Run: full command output in run_060825.419715238_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:379).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 weeks ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 7917e91eadb2f622faadf635a3e13c384e42070e:

(monitor.go:154).Wait: monitor failure: changefeed[default]: max latency was more than allowed: 5m0.910602299s vs 5m0s
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 weeks ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 533174dc4d87c792722bae844642f42dcf149aa7:

(cluster.go:2473).Run: full command output in run_063222.455035055_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:379).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 weeks ago

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 533174dc4d87c792722bae844642f42dcf149aa7:

(cdc.go:379).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!