search

cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
https://www.cockroachlabs.com
Other
30.16k stars 3.82k forks source link

roachtest: cdc/pubsub-sink failed #129222

Open cockroach-teamcity opened 3 months ago

cockroach-teamcity commented 3 months ago

roachtest.cdc/pubsub-sink failed with artifacts on release-23.1 @ 45935614dbc275899a5868b454ed13ba552f56bb:

(latency_verifier.go:192).assertValid: latency never dropped to acceptable steady level: 1m0s
(monitor.go:153).Wait: monitor failure: monitor user task failed: t.Fatal() was called
test artifacts and logs in: /artifacts/cdc/pubsub-sink/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

- #128743 roachtest: cdc/pubsub-sink failed [A-cdc C-test-failure O-roachtest O-robot T-cdc branch-release-23.1.25-rc release-blocker] - #128273 roachtest: cdc/pubsub-sink failed [A-cdc C-test-failure O-roachtest O-robot T-cdc branch-release-23.2.9-rc release-blocker]

/cc @cockroachdb/cdc

This test on roachdash | Improve this report!

Jira issue: CRDB-41458

cockroach-teamcity commented 2 months ago

roachtest.cdc/pubsub-sink failed with artifacts on release-23.1 @ e5d5d380b5fba8e375e874c0bec1655f9e1750bc:

(latency_verifier.go:185).assertValid: initial scan did not complete
(monitor.go:153).Wait: monitor failure: monitor user task failed: t.Fatal() was called
test artifacts and logs in: /artifacts/cdc/pubsub-sink/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

- #128743 roachtest: cdc/pubsub-sink failed [A-cdc C-test-failure O-roachtest O-robot P-2 T-cdc branch-release-23.1.25-rc release-blocker] - #128273 roachtest: cdc/pubsub-sink failed [A-cdc C-test-failure O-roachtest O-robot P-2 T-cdc branch-release-23.2.9-rc release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 months ago

roachtest.cdc/pubsub-sink failed with artifacts on release-23.1 @ 28163220c479ea7999a671b5af133321b86148d9:

(latency_verifier.go:192).assertValid: latency never dropped to acceptable steady level: 1m0s
(monitor.go:153).Wait: monitor failure: monitor user task failed: t.Fatal() was called
test artifacts and logs in: /artifacts/cdc/pubsub-sink/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

- #128743 roachtest: cdc/pubsub-sink failed [A-cdc C-test-failure O-roachtest O-robot P-2 T-cdc branch-release-23.1.25-rc release-blocker] - #128273 roachtest: cdc/pubsub-sink failed [A-cdc C-test-failure O-roachtest O-robot P-2 T-cdc branch-release-23.2.9-rc release-blocker]

This test on roachdash | Improve this report!

wenyihu6 commented 1 month ago

Removing release blocker - long standing issue with slow pubsub performance https://github.com/cockroachdb/cockroach/issues/110424 and https://github.com/cockroachdb/cockroach/issues/111829.

cockroach-teamcity commented 3 weeks ago

roachtest.cdc/pubsub-sink failed with artifacts on release-23.1 @ a6e68054ec8a260b5fa4fde0bab38ffa64d4fd87:

(latency_verifier.go:187).assertValid: latency never dropped to acceptable steady level: 1m0s
(monitor.go:148).Wait: monitor failure: monitor user task failed: t.Fatal() was called
test artifacts and logs in: /artifacts/cdc/pubsub-sink/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

- #132975 roachtest: cdc/pubsub-sink failed [A-cdc C-test-failure O-roachtest O-robot P-3 T-cdc branch-release-23.2 release-blocker] - #132076 roachtest: cdc/pubsub-sink failed [A-cdc C-test-failure O-roachtest O-robot P-2 T-cdc branch-release-23.2.13-rc release-blocker] - #128743 roachtest: cdc/pubsub-sink failed [A-cdc C-test-failure O-roachtest O-robot P-2 T-cdc branch-release-23.1.25-rc release-blocker] - #128273 roachtest: cdc/pubsub-sink failed [A-cdc C-test-failure O-roachtest O-robot P-2 T-cdc branch-release-23.2.9-rc release-blocker]

This test on roachdash | Improve this report!