search

cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
https://www.cockroachlabs.com
Other
30.16k stars 3.82k forks source link

pkg/ccl/logictestccl/tests/5node/5node_test: TestCCLLogic_partitioning_hash_sharded_index failed #135815

Closed cockroach-teamcity closed 1 day ago

cockroach-teamcity commented 2 days ago

pkg/ccl/logictestccl/tests/5node/5node_test.TestCCLLogic_partitioning_hash_sharded_index failed on release-24.1.7-rc @ 3613a619e327fb412ac62036ce2c7060c25e48db:

=== RUN   TestCCLLogic_partitioning_hash_sharded_index
    test_log_scope.go:165: test logs captured to: outputs.zip/logTestCCLLogic_partitioning_hash_sharded_index1125688403
    test_log_scope.go:76: use -show-logs to present logs inline
[10:51:36] --- progress: /var/lib/engflow/worker/work/0/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/logictestccl/tests/5node/5node_test_/5node_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/logictestccl/testdata/logic_test/partitioning_hash_sharded_index: 7 statements
[10:51:39] --- progress: /var/lib/engflow/worker/work/0/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/logictestccl/tests/5node/5node_test_/5node_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/logictestccl/testdata/logic_test/partitioning_hash_sharded_index: 15 statements
[10:53:03] --- progress: /var/lib/engflow/worker/work/0/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/logictestccl/tests/5node/5node_test_/5node_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/logictestccl/testdata/logic_test/partitioning_hash_sharded_index: 16 statements
[10:58:27] --- progress: /var/lib/engflow/worker/work/0/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/logictestccl/tests/5node/5node_test_/5node_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/logictestccl/testdata/logic_test/partitioning_hash_sharded_index: 18 statements
[10:58:31] --- progress: /var/lib/engflow/worker/work/0/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/logictestccl/tests/5node/5node_test_/5node_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/logictestccl/testdata/logic_test/partitioning_hash_sharded_index: 19 statements
[11:43:38] --- done: /var/lib/engflow/worker/work/0/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/logictestccl/tests/5node/5node_test_/5node_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/logictestccl/testdata/logic_test/partitioning_hash_sharded_index with config 5node: 19 tests, 0 failures
    logic.go:4199: 
        /var/lib/engflow/worker/work/0/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/logictestccl/tests/5node/5node_test_/5node_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/logictestccl/testdata/logic_test/partitioning_hash_sharded_index:162: error while processing
    logic.go:4199: 
        /var/lib/engflow/worker/work/0/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/logictestccl/tests/5node/5node_test_/5node_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/logictestccl/testdata/logic_test/partitioning_hash_sharded_index:162: 
        expected success, but found
        (40003) polling for queued jobs to complete: poll-show-jobs: operation "intent_resolver_ir_batcher.sendBatch" timed out after 1m0.007s (given timeout 1m0s): aborted in DistSender: result is ambiguous: context deadline exceeded
        dist_sender.go:2287: in deduceRetryEarlyExitError()
    panic.go:626: -- test log scope end --
test logs left over in: outputs.zip/logTestCCLLogic_partitioning_hash_sharded_index1125688403
--- FAIL: TestCCLLogic_partitioning_hash_sharded_index (3165.47s)

Parameters:

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

Jira issue: CRDB-44734

yuzefovich commented 1 day ago

The error is usually indicative of the overloaded cluster, and this happened on a race build with 5 nodes, so seems somewhat expected. I didn't find any previous issues like this, so closing as an infra flake.