search

cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
https://www.cockroachlabs.com
Other
30.18k stars 3.82k forks source link

ccl/changefeedccl: TestParallelIOMetrics failed #133335

Open cockroach-teamcity opened 1 month ago

cockroach-teamcity commented 1 month ago

ccl/changefeedccl.TestParallelIOMetrics failed on release-24.1 @ a66eebcd4eecc3a95f5d7d3af39b370b702a64da:

=== RUN   TestParallelIOMetrics
    test_log_scope.go:165: test logs captured to: outputs.zip/logTestParallelIOMetrics4034577413
    test_log_scope.go:76: use -show-logs to present logs inline
    changefeed_test.go:9360: -- test log scope end --
test logs left over in: outputs.zip/logTestParallelIOMetrics4034577413
--- FAIL: TestParallelIOMetrics (54.74s)
=== RUN   TestParallelIOMetrics/pubsub
    helpers_test.go:872: making server as system tenant
    helpers_test.go:948: making pubsub feed factory
    changefeed_test.go:9332: condition failed to evaluate within 45s: from changefeed_test.go:9335: waiting for pending keys: 0
    --- FAIL: TestParallelIOMetrics/pubsub (54.73s)

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #130390 ccl/changefeedccl: TestParallelIOMetrics failed [A-cdc C-test-failure O-robot P-2 T-cdc X-duplicate branch-release-24.2.2-rc release-blocker] - #129917 ccl/changefeedccl: TestParallelIOMetrics failed [A-cdc C-test-failure O-robot P-2 T-cdc branch-release-24.2 release-blocker] - #125295 ccl/changefeedccl: TestParallelIOMetrics failed [A-cdc C-test-failure O-robot P-3 T-cdc branch-master]

/cc @cockroachdb/cdc

This test on roachdash | Improve this report!

Jira issue: CRDB-43545

cockroach-teamcity commented 4 weeks ago

ccl/changefeedccl.TestParallelIOMetrics failed on release-24.1 @ b20c617197fc13f08ae9be59ec40254c17c9e0f5:

=== RUN   TestParallelIOMetrics
    test_log_scope.go:165: test logs captured to: outputs.zip/logTestParallelIOMetrics39545899
    test_log_scope.go:76: use -show-logs to present logs inline
    changefeed_test.go:9360: -- test log scope end --
test logs left over in: outputs.zip/logTestParallelIOMetrics39545899
--- FAIL: TestParallelIOMetrics (148.93s)
=== RUN   TestParallelIOMetrics/pubsub
    helpers_test.go:869: making server as secondary tenant
    helpers_test.go:948: making pubsub feed factory
    changefeed_test.go:9356: 
            Error Trace:    github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl/changefeed_test.go:9356
                                        github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl/helpers_test.go:1120
                                        github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl/helpers_test.go:1155
            Error:          Received unexpected error:
                            context deadline exceeded
            Test:           TestParallelIOMetrics/pubsub
    --- FAIL: TestParallelIOMetrics/pubsub (148.92s)

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #130390 ccl/changefeedccl: TestParallelIOMetrics failed [A-cdc C-test-failure O-robot P-2 T-cdc X-duplicate branch-release-24.2.2-rc release-blocker] - #129917 ccl/changefeedccl: TestParallelIOMetrics failed [A-cdc C-test-failure O-robot P-2 T-cdc branch-release-24.2 release-blocker] - #125295 ccl/changefeedccl: TestParallelIOMetrics failed [A-cdc C-test-failure O-robot P-3 T-cdc branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 weeks ago

ccl/changefeedccl.TestParallelIOMetrics failed on release-24.1 @ 7a942858c76a501b2f6c211a62c8e46cac5d5c91:

      github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl/changefeed_test.go:9356 +0x68d
  github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl.cdcTestNamed.func1()
      github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl/helpers_test.go:1120 +0xaf
  github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl.cdcTestNamedWithSystem.func1()
      github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl/helpers_test.go:1155 +0x416
  testing.tRunner()
      GOROOT/src/testing/testing.go:1689 +0x21e
  testing.(*T).Run.gowrap1()
      GOROOT/src/testing/testing.go:1742 +0x44

Previous read at 0x000013c6aca8 by goroutine 98032:
  github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl.(*ParallelIO).processIO.func1()
      github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl/parallel_io.go:248 +0x64
  github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl.(*ParallelIO).processIO.func2()
      github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl/parallel_io.go:274 +0xf3
  github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl.(*ParallelIO).processIO.Group.GoCtx.func6()
      github.com/cockroachdb/cockroach/pkg/util/ctxgroup/ctxgroup.go:163 +0x46
  golang.org/x/sync/errgroup.(*Group).Go.func1()
      golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:78 +0x91

Goroutine 94711 (running) created at:
  testing.(*T).Run()
      GOROOT/src/testing/testing.go:1742 +0x825
  github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl.cdcTestNamedWithSystem()
      github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl/helpers_test.go:1145 +0x4f0
  github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl.cdcTestNamed()
      github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl/helpers_test.go:1122 +0xbd
  github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl.cdcTest()
      github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl/helpers_test.go:1115 +0x18e
  github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl.TestParallelIOMetrics()
      github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl/changefeed_test.go:9359 +0x111
  testing.tRunner()
      GOROOT/src/testing/testing.go:1689 +0x21e
  testing.(*T).Run.gowrap1()
      GOROOT/src/testing/testing.go:1742 +0x44

Goroutine 98032 (running) created at:
  golang.org/x/sync/errgroup.(*Group).Go()
      golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:75 +0x124
  github.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.GoCtx()
      github.com/cockroachdb/cockroach/pkg/util/ctxgroup/ctxgroup.go:162 +0x1be
  github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl.(*ParallelIO).processIO()
      github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl/parallel_io.go:272 +0x1dd
  github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl.NewParallelIO.func1()
      github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl/parallel_io.go:101 +0x4c
  github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl.NewParallelIO.Group.GoCtx.func2()
      github.com/cockroachdb/cockroach/pkg/util/ctxgroup/ctxgroup.go:163 +0x46
  golang.org/x/sync/errgroup.(*Group).Go.func1()
      golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:78 +0x91
==================

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #134188 ccl/changefeedccl: TestParallelIOMetrics failed [A-cdc C-test-failure O-robot T-cdc branch-release-24.3] - #133817 ccl/changefeedccl: TestParallelIOMetrics failed [A-cdc C-test-failure O-robot T-cdc branch-release-24.2.5-rc] - #130390 ccl/changefeedccl: TestParallelIOMetrics failed [A-cdc C-test-failure O-robot P-2 T-cdc X-duplicate branch-release-24.2.2-rc release-blocker] - #129917 ccl/changefeedccl: TestParallelIOMetrics failed [A-cdc C-test-failure O-robot P-2 T-cdc branch-release-24.2 release-blocker] - #125295 ccl/changefeedccl: TestParallelIOMetrics failed [A-cdc C-test-failure O-robot P-3 T-cdc branch-master]

This test on roachdash | Improve this report!