cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
https://www.cockroachlabs.com
Other
30.09k stars 3.8k forks source link

sql: unexpected error due to Query has no home region #102833

Closed cockroach-teamcity closed 1 year ago

cockroach-teamcity commented 1 year ago

pkg/ccl/logictestccl/tests/multiregion-9node-3region-3azs-vec-off/multiregion-9node-3region-3azs-vec-off_test.TestCCLLogic_multi_region_remote_access_error failed with artifacts on release-23.1.0 @ 29ed08a512389e42ccccdde0906e34a301c28b4a:

=== RUN   TestCCLLogic_multi_region_remote_access_error
    test_log_scope.go:161: test logs captured to: /artifacts/tmp/_tmp/875622737c3d90631dff1d5650587860/logTestCCLLogic_multi_region_remote_access_error1638275173
    test_log_scope.go:79: use -show-logs to present logs inline
*
* INFO: Running test with the default test tenant. If you are only seeing a test case failure when this message appears, there may be a problem with your test case running within tenants.
*
*
* INFO: Running test with the default test tenant. If you are only seeing a test case failure when this message appears, there may be a problem with your test case running within tenants.
*
*
* INFO: Running test with the default test tenant. If you are only seeing a test case failure when this message appears, there may be a problem with your test case running within tenants.
*
*
* INFO: Running test with the default test tenant. If you are only seeing a test case failure when this message appears, there may be a problem with your test case running within tenants.
*
*
* INFO: Running test with the default test tenant. If you are only seeing a test case failure when this message appears, there may be a problem with your test case running within tenants.
*
*
* INFO: Running test with the default test tenant. If you are only seeing a test case failure when this message appears, there may be a problem with your test case running within tenants.
*
*
* INFO: Running test with the default test tenant. If you are only seeing a test case failure when this message appears, there may be a problem with your test case running within tenants.
*
*
* INFO: Running test with the default test tenant. If you are only seeing a test case failure when this message appears, there may be a problem with your test case running within tenants.
*
*
* INFO: Running test with the default test tenant. If you are only seeing a test case failure when this message appears, there may be a problem with your test case running within tenants.
*
[06:49:44] --- progress: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/2908/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/logictestccl/tests/multiregion-9node-3region-3azs-vec-off/multiregion-9node-3region-3azs-vec-off_test_/multiregion-9node-3region-3azs-vec-off_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/logictestccl/testdata/logic_test/multi_region_remote_access_error: 17 statements
[06:49:46] --- progress: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/2908/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/logictestccl/tests/multiregion-9node-3region-3azs-vec-off/multiregion-9node-3region-3azs-vec-off_test_/multiregion-9node-3region-3azs-vec-off_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/logictestccl/testdata/logic_test/multi_region_remote_access_error: 38 statements
[06:49:51] --- progress: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/2908/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/logictestccl/tests/multiregion-9node-3region-3azs-vec-off/multiregion-9node-3region-3azs-vec-off_test_/multiregion-9node-3region-3azs-vec-off_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/logictestccl/testdata/logic_test/multi_region_remote_access_error: 40 statements
    logic.go:2871: 

        /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/2908/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/logictestccl/tests/multiregion-9node-3region-3azs-vec-off/multiregion-9node-3region-3azs-vec-off_test_/multiregion-9node-3region-3azs-vec-off_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/logictestccl/testdata/logic_test/multi_region_remote_access_error:343: WITH vtab AS (SELECT * FROM messages_rbt)
        SELECT vtab.account_id, vtab.message FROM vtab
          INNER LOOKUP JOIN messages_rbr rbr on vtab.account_id = rbr.account_id and rbr.crdb_region = 'ap-southeast-2'
        expected success, but found
        (XCHR2) Query has no home region. Try adding a LIMIT clause. For more information, see https://www.cockroachlabs.com/docs/stable/cost-based-optimizer.html#control-whether-queries-are-limited-to-a-single-region
        relational.go:2005: in buildDistribute()
[06:49:51] --- done: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/2908/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/logictestccl/tests/multiregion-9node-3region-3azs-vec-off/multiregion-9node-3region-3azs-vec-off_test_/multiregion-9node-3region-3azs-vec-off_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/logictestccl/testdata/logic_test/multi_region_remote_access_error with config multiregion-9node-3region-3azs-vec-off: 43 tests, 1 failures
    logic.go:3983: 
        /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/2908/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/logictestccl/tests/multiregion-9node-3region-3azs-vec-off/multiregion-9node-3region-3azs-vec-off_test_/multiregion-9node-3region-3azs-vec-off_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/logictestccl/testdata/logic_test/multi_region_remote_access_error:349: error while processing
    logic.go:3983: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/2908/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/logictestccl/tests/multiregion-9node-3region-3azs-vec-off/multiregion-9node-3region-3azs-vec-off_test_/multiregion-9node-3region-3azs-vec-off_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/logictestccl/testdata/logic_test/multi_region_remote_access_error:349: too many errors encountered, skipping the rest of the input
    panic.go:522: -- test log scope end --
test logs left over in: /artifacts/tmp/_tmp/875622737c3d90631dff1d5650587860/logTestCCLLogic_multi_region_remote_access_error1638275173
--- FAIL: TestCCLLogic_multi_region_remote_access_error (20.56s)

Parameters: TAGS=bazel,gss

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

/cc @cockroachdb/sql-queries

This test on roachdash | Improve this report!

Jira issue: CRDB-27673

cockroach-teamcity commented 1 year ago

pkg/ccl/logictestccl/tests/multiregion-9node-3region-3azs-vec-off/multiregion-9node-3region-3azs-vec-off_test.TestCCLLogic_multi_region_remote_access_error failed with artifacts on release-23.1.0 @ 29ed08a512389e42ccccdde0906e34a301c28b4a:

=== RUN   TestCCLLogic_multi_region_remote_access_error
    test_log_scope.go:161: test logs captured to: /artifacts/tmp/_tmp/875622737c3d90631dff1d5650587860/logTestCCLLogic_multi_region_remote_access_error419727166
    test_log_scope.go:79: use -show-logs to present logs inline
*
* INFO: Running test with the default test tenant. If you are only seeing a test case failure when this message appears, there may be a problem with your test case running within tenants.
*
*
* INFO: Running test with the default test tenant. If you are only seeing a test case failure when this message appears, there may be a problem with your test case running within tenants.
*
*
* INFO: Running test with the default test tenant. If you are only seeing a test case failure when this message appears, there may be a problem with your test case running within tenants.
*
*
* INFO: Running test with the default test tenant. If you are only seeing a test case failure when this message appears, there may be a problem with your test case running within tenants.
*
*
* INFO: Running test with the default test tenant. If you are only seeing a test case failure when this message appears, there may be a problem with your test case running within tenants.
*
*
* INFO: Running test with the default test tenant. If you are only seeing a test case failure when this message appears, there may be a problem with your test case running within tenants.
*
*
* INFO: Running test with the default test tenant. If you are only seeing a test case failure when this message appears, there may be a problem with your test case running within tenants.
*
*
* INFO: Running test with the default test tenant. If you are only seeing a test case failure when this message appears, there may be a problem with your test case running within tenants.
*
*
* INFO: Running test with the default test tenant. If you are only seeing a test case failure when this message appears, there may be a problem with your test case running within tenants.
*
[07:39:15] setting distsql_workmem='17830B';
[07:39:18] --- progress: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/2758/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/logictestccl/tests/multiregion-9node-3region-3azs-vec-off/multiregion-9node-3region-3azs-vec-off_test_/multiregion-9node-3region-3azs-vec-off_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/logictestccl/testdata/logic_test/multi_region_remote_access_error: 17 statements
[07:39:20] --- progress: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/2758/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/logictestccl/tests/multiregion-9node-3region-3azs-vec-off/multiregion-9node-3region-3azs-vec-off_test_/multiregion-9node-3region-3azs-vec-off_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/logictestccl/testdata/logic_test/multi_region_remote_access_error: 32 statements
[07:39:25] --- progress: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/2758/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/logictestccl/tests/multiregion-9node-3region-3azs-vec-off/multiregion-9node-3region-3azs-vec-off_test_/multiregion-9node-3region-3azs-vec-off_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/logictestccl/testdata/logic_test/multi_region_remote_access_error: 40 statements
    logic.go:2871: 

        /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/2758/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/logictestccl/tests/multiregion-9node-3region-3azs-vec-off/multiregion-9node-3region-3azs-vec-off_test_/multiregion-9node-3region-3azs-vec-off_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/logictestccl/testdata/logic_test/multi_region_remote_access_error:343: WITH vtab AS (SELECT * FROM messages_rbt)
        SELECT vtab.account_id, vtab.message FROM vtab
          INNER LOOKUP JOIN messages_rbr rbr on vtab.account_id = rbr.account_id and rbr.crdb_region = 'ap-southeast-2'
        expected success, but found
        (XCHR2) Query has no home region. Try adding a LIMIT clause. For more information, see https://www.cockroachlabs.com/docs/stable/cost-based-optimizer.html#control-whether-queries-are-limited-to-a-single-region
        relational.go:2005: in buildDistribute()
[07:39:25] --- done: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/2758/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/logictestccl/tests/multiregion-9node-3region-3azs-vec-off/multiregion-9node-3region-3azs-vec-off_test_/multiregion-9node-3region-3azs-vec-off_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/logictestccl/testdata/logic_test/multi_region_remote_access_error with config multiregion-9node-3region-3azs-vec-off: 43 tests, 1 failures
    logic.go:3983: 
        /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/2758/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/logictestccl/tests/multiregion-9node-3region-3azs-vec-off/multiregion-9node-3region-3azs-vec-off_test_/multiregion-9node-3region-3azs-vec-off_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/logictestccl/testdata/logic_test/multi_region_remote_access_error:349: error while processing
    logic.go:3983: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/2758/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/logictestccl/tests/multiregion-9node-3region-3azs-vec-off/multiregion-9node-3region-3azs-vec-off_test_/multiregion-9node-3region-3azs-vec-off_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/logictestccl/testdata/logic_test/multi_region_remote_access_error:349: too many errors encountered, skipping the rest of the input
    panic.go:522: -- test log scope end --
test logs left over in: /artifacts/tmp/_tmp/875622737c3d90631dff1d5650587860/logTestCCLLogic_multi_region_remote_access_error419727166
--- FAIL: TestCCLLogic_multi_region_remote_access_error (22.18s)

Parameters: TAGS=bazel,gss

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

pkg/ccl/logictestccl/tests/multiregion-9node-3region-3azs-vec-off/multiregion-9node-3region-3azs-vec-off_test.TestCCLLogic_multi_region_remote_access_error failed with artifacts on release-23.1.0 @ 358e0d87912365b8976c55ab9b3292e999cf720d:

=== RUN   TestCCLLogic_multi_region_remote_access_error
    test_log_scope.go:161: test logs captured to: /artifacts/tmp/_tmp/875622737c3d90631dff1d5650587860/logTestCCLLogic_multi_region_remote_access_error2148777635
    test_log_scope.go:79: use -show-logs to present logs inline
*
* INFO: Running test with the default test tenant. If you are only seeing a test case failure when this message appears, there may be a problem with your test case running within tenants.
*
*
* INFO: Running test with the default test tenant. If you are only seeing a test case failure when this message appears, there may be a problem with your test case running within tenants.
*
*
* INFO: Running test with the default test tenant. If you are only seeing a test case failure when this message appears, there may be a problem with your test case running within tenants.
*
*
* INFO: Running test with the default test tenant. If you are only seeing a test case failure when this message appears, there may be a problem with your test case running within tenants.
*
*
* INFO: Running test with the default test tenant. If you are only seeing a test case failure when this message appears, there may be a problem with your test case running within tenants.
*
*
* INFO: Running test with the default test tenant. If you are only seeing a test case failure when this message appears, there may be a problem with your test case running within tenants.
*
*
* INFO: Running test with the default test tenant. If you are only seeing a test case failure when this message appears, there may be a problem with your test case running within tenants.
*
*
* INFO: Running test with the default test tenant. If you are only seeing a test case failure when this message appears, there may be a problem with your test case running within tenants.
*
*
* INFO: Running test with the default test tenant. If you are only seeing a test case failure when this message appears, there may be a problem with your test case running within tenants.
*
[07:20:28] --- progress: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/18/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/logictestccl/tests/multiregion-9node-3region-3azs-vec-off/multiregion-9node-3region-3azs-vec-off_test_/multiregion-9node-3region-3azs-vec-off_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/logictestccl/testdata/logic_test/multi_region_remote_access_error: 17 statements
[07:20:30] --- progress: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/18/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/logictestccl/tests/multiregion-9node-3region-3azs-vec-off/multiregion-9node-3region-3azs-vec-off_test_/multiregion-9node-3region-3azs-vec-off_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/logictestccl/testdata/logic_test/multi_region_remote_access_error: 34 statements
[07:20:36] --- progress: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/18/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/logictestccl/tests/multiregion-9node-3region-3azs-vec-off/multiregion-9node-3region-3azs-vec-off_test_/multiregion-9node-3region-3azs-vec-off_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/logictestccl/testdata/logic_test/multi_region_remote_access_error: 40 statements
    logic.go:2871: 

        /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/18/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/logictestccl/tests/multiregion-9node-3region-3azs-vec-off/multiregion-9node-3region-3azs-vec-off_test_/multiregion-9node-3region-3azs-vec-off_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/logictestccl/testdata/logic_test/multi_region_remote_access_error:343: WITH vtab AS (SELECT * FROM messages_rbt)
        SELECT vtab.account_id, vtab.message FROM vtab
          INNER LOOKUP JOIN messages_rbr rbr on vtab.account_id = rbr.account_id and rbr.crdb_region = 'ap-southeast-2'
        expected success, but found
        (XCHR2) Query has no home region. Try adding a LIMIT clause. For more information, see https://www.cockroachlabs.com/docs/stable/cost-based-optimizer.html#control-whether-queries-are-limited-to-a-single-region
        relational.go:2005: in buildDistribute()
[07:20:36] --- done: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/18/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/logictestccl/tests/multiregion-9node-3region-3azs-vec-off/multiregion-9node-3region-3azs-vec-off_test_/multiregion-9node-3region-3azs-vec-off_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/logictestccl/testdata/logic_test/multi_region_remote_access_error with config multiregion-9node-3region-3azs-vec-off: 43 tests, 1 failures
    logic.go:3983: 
        /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/18/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/logictestccl/tests/multiregion-9node-3region-3azs-vec-off/multiregion-9node-3region-3azs-vec-off_test_/multiregion-9node-3region-3azs-vec-off_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/logictestccl/testdata/logic_test/multi_region_remote_access_error:349: error while processing
    logic.go:3983: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/18/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/logictestccl/tests/multiregion-9node-3region-3azs-vec-off/multiregion-9node-3region-3azs-vec-off_test_/multiregion-9node-3region-3azs-vec-off_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/logictestccl/testdata/logic_test/multi_region_remote_access_error:349: too many errors encountered, skipping the rest of the input
    panic.go:522: -- test log scope end --
test logs left over in: /artifacts/tmp/_tmp/875622737c3d90631dff1d5650587860/logTestCCLLogic_multi_region_remote_access_error2148777635
--- FAIL: TestCCLLogic_multi_region_remote_access_error (21.46s)

Parameters: TAGS=bazel,gss

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

This test on roachdash | Improve this report!

mgartner commented 1 year ago
SELECT vtab.account_id, vtab.message FROM vtab
          INNER LOOKUP JOIN messages_rbr rbr on vtab.account_id = rbr.account_id and rbr.crdb_region = 'ap-southeast-2'
        expected success, but found
        (XCHR2) Query has no home region. Try adding a LIMIT clause. For more information, see https://www.cockroachlabs.com/docs/stable/cost-based-optimizer.html#control-whether-queries-are-limited-to-a-single-region
        relational.go:2005: in buildDistribute()

@msirek I believe you added this errors. Do you mind taking a look?

msirek commented 1 year ago

Closing as a dup of https://github.com/cockroachdb/cockroach/pull/102484. We aren't backporting to 23.1.0 any more.