configprofiles: TestDataDriven failed

[cockroach-teamcity]

configprofiles.TestDataDriven failed with artifacts on master @ 5b44c4fd6d97dc3a75e786fed24f47ad8bcf9039:

Write at 0x00c0046c5458 by goroutine 14310:
  github.com/cockroachdb/cockroach/pkg/server.(*channelOrchestrator).startControlledServer.func5()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_channel_orchestrator.go:416 +0xa64
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:470 +0x1f6

Previous read at 0x00c0046c5458 by goroutine 16512:
  github.com/cockroachdb/cockroach/pkg/server.(*serverStateUsingChannels).getServer()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_channel_orchestrator.go:109 +0x4e
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).getServer()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_accessors.go:28 +0x138
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).sqlMux()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_sql.go:66 +0x2ac
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).sqlMux-fm()
      <autogenerated>:1 +0xc7
  github.com/cockroachdb/cockroach/pkg/server.startServeSQL.func1.1()
      github.com/cockroachdb/cockroach/pkg/server/server_sql.go:1755 +0x2eb
  github.com/cockroachdb/cockroach/pkg/util/netutil.(*TCPServer).ServeWith.func1()
      github.com/cockroachdb/cockroach/pkg/util/netutil/net.go:188 +0x111
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:470 +0x1f6

Goroutine 14310 (running) created at:
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:461 +0x619
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:332 +0xf4c
  github.com/cockroachdb/cockroach/pkg/server.(*channelOrchestrator).startControlledServer()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_channel_orchestrator.go:292 +0x29
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).createServerEntryLocked()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:168 +0x2b0
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).scanTenantsForRunnableServices()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:129 +0x53a
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).start.func1()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:60 +0x21a
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:470 +0x1f6

Goroutine 16512 (running) created at:
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:461 +0x619
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:332 +0x404
  github.com/cockroachdb/cockroach/pkg/util/netutil.(*TCPServer).ServeWith()
      github.com/cockroachdb/cockroach/pkg/util/netutil/net.go:185 +0x36
  github.com/cockroachdb/cockroach/pkg/server.startServeSQL.func1()
      github.com/cockroachdb/cockroach/pkg/server/server_sql.go:1745 +0x17b
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:470 +0x1f6
==================

Parameters: TAGS=bazel,gss,race

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #102055 configprofiles: TestDataDriven failed [C-test-failure O-robot branch-release-23.1.0]

/cc @cockroachdb/multi-tenant @cockroachdb/server

This test on roachdash | Improve this report!

Jira issue: CRDB-27428

[cockroach-teamcity]

configprofiles.TestDataDriven failed with artifacts on master @ 7d02e061759599a2b054ee06c71524443f77d20a:

  github.com/cockroachdb/datadriven.WalkAny()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:447 +0x585
  github.com/cockroachdb/datadriven.Walk()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:423 +0xc4
  github.com/cockroachdb/cockroach/pkg/configprofiles_test.TestDataDriven()
      github.com/cockroachdb/cockroach/pkg/configprofiles_test/pkg/configprofiles/datadriven_test.go:37 +0x1a4
  testing.tRunner()
      GOROOT/src/testing/testing.go:1446 +0x216
  testing.(*T).Run.func1()
      GOROOT/src/testing/testing.go:1493 +0x47

Goroutine 7136 (running) created at:
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:461 +0x619
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:332 +0xf4c
  github.com/cockroachdb/cockroach/pkg/server.(*channelOrchestrator).startControlledServer()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_channel_orchestrator.go:292 +0x29
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).createServerEntryLocked()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:168 +0x2b0
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).scanTenantsForRunnableServices()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:129 +0x53a
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).start.func1()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:60 +0x21a
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:470 +0x1f6
==================
=== RUN   TestDataDriven/example
    datadriven.go:143: 
        testdata/example:1:
        profile [0 args]
        example
        ----
        canonical profile name: example
        server started
    datadriven.go:143: 
        testdata/example:7:
        system-sql [0 args]
        SHOW DATABASES
        ----
        defaultdb root NULL NULL {} NULL
        example root NULL NULL {} NULL
        postgres root NULL NULL {} NULL
        system node NULL NULL {} NULL
    datadriven.go:143: 
        testdata/example:15:
        system-sql [0 args]
        SELECT * FROM example.data
        ----
        hello

Parameters: TAGS=bazel,gss,race

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #102055 configprofiles: TestDataDriven failed [C-test-failure O-robot branch-release-23.1.0]

This test on roachdash | Improve this report!

[cockroach-teamcity]

configprofiles.TestDataDriven failed with artifacts on master @ 5c9746012cb9a3244f47098254e603b7d924fdb2:

      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:143 +0x3d1
  github.com/cockroachdb/datadriven.RunTest()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:116 +0xc4
  github.com/cockroachdb/cockroach/pkg/configprofiles_test.TestDataDriven.func1()
      github.com/cockroachdb/cockroach/pkg/configprofiles_test/pkg/configprofiles/datadriven_test.go:49 +0x34e
  github.com/cockroachdb/datadriven.Walk.func1()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:424 +0x6e
  github.com/cockroachdb/datadriven.WalkAny()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:435 +0x2a5
  github.com/cockroachdb/datadriven.WalkAny.func1()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:448 +0xc7
  github.com/cockroachdb/datadriven.subTest.func1()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/test_interface.go:27 +0x41
  testing.tRunner()
      GOROOT/src/testing/testing.go:1446 +0x216
  testing.(*T).Run.func1()
      GOROOT/src/testing/testing.go:1493 +0x47

Goroutine 18557 (running) created at:
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:461 +0x619
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:332 +0xf4c
  github.com/cockroachdb/cockroach/pkg/server.(*channelOrchestrator).startControlledServer()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_channel_orchestrator.go:292 +0x29
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).createServerEntryLocked()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:168 +0x2b0
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).scanTenantsForRunnableServices()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:129 +0x53a
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).start.func1()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:60 +0x21a
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:470 +0x1f6

Goroutine 15318 (running) created at:
  testing.(*T).Run()
      GOROOT/src/testing/testing.go:1493 +0x75d
  github.com/cockroachdb/datadriven.subTest()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/test_interface.go:27 +0x10b
  github.com/cockroachdb/datadriven.WalkAny()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:447 +0x585
  github.com/cockroachdb/datadriven.Walk()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:423 +0xc4
  github.com/cockroachdb/cockroach/pkg/configprofiles_test.TestDataDriven()
      github.com/cockroachdb/cockroach/pkg/configprofiles_test/pkg/configprofiles/datadriven_test.go:37 +0x1a4
  testing.tRunner()
      GOROOT/src/testing/testing.go:1446 +0x216
  testing.(*T).Run.func1()
      GOROOT/src/testing/testing.go:1493 +0x47
==================

Parameters: TAGS=bazel,gss,race

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #102055 configprofiles: TestDataDriven failed [C-test-failure O-robot branch-release-23.1.0]

This test on roachdash | Improve this report!

[cockroach-teamcity]

configprofiles.TestDataDriven failed with artifacts on master @ 918923738a73c39986c163465edb70e9af2c49b8:

        'sql.scatter.allow_for_secondary_tenant.enabled',
        'sql.split_at.allow_for_secondary_tenant.enabled'
        )
        ORDER BY tenant_id, name
        ----
        2 sql.scatter.allow_for_secondary_tenant.enabled true
        2 sql.split_at.allow_for_secondary_tenant.enabled true
    datadriven.go:143: 
        testdata/multitenant-noapp:42:
        system-sql [0 args]
        SHOW TENANTS WITH CAPABILITIES
        ----
        1 system ready shared can_admin_relocate_range false
        1 system ready shared can_admin_scatter true
        1 system ready shared can_admin_split true
        1 system ready shared can_admin_unsplit false
        1 system ready shared can_check_consistency false
        1 system ready shared can_use_nodelocal_storage false
        1 system ready shared can_view_node_info false
        1 system ready shared can_view_tsdb_metrics false
        1 system ready shared exempt_from_rate_limiting false
        1 system ready shared span_config_bounds {}
        2 template ready none can_admin_relocate_range true
        2 template ready none can_admin_scatter true
        2 template ready none can_admin_split true
        2 template ready none can_admin_unsplit true
        2 template ready none can_check_consistency true
        2 template ready none can_use_nodelocal_storage true
        2 template ready none can_view_node_info true
        2 template ready none can_view_tsdb_metrics true
        2 template ready none exempt_from_rate_limiting true
        2 template ready none span_config_bounds {}
    datadriven.go:143: 
        testdata/multitenant-noapp:66:
        system-sql [0 args]
        CREATE TENANT application LIKE template
        ----
        <no rows>
    datadriven.go:143: 
        testdata/multitenant-noapp:71:
        system-sql [0 args]
        ALTER TENANT application START SERVICE SHARED
        ----
        <no rows>
    datadriven.go:143: 
        testdata/multitenant-noapp:76:
        connect-tenant [0 args]
        application
        ----
        ok

Parameters: TAGS=bazel,gss,race

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #102800 configprofiles: TestDataDriven failed [C-test-failure O-robot T-multitenant branch-release-23.1] - #102055 configprofiles: TestDataDriven failed [C-test-failure O-robot branch-release-23.1.0]

This test on roachdash | Improve this report!

[cockroach-teamcity]

configprofiles.TestDataDriven failed with artifacts on master @ adad57859a5281e2846082761c8232890b3d2a68:

        'sql.scatter.allow_for_secondary_tenant.enabled',
        'sql.split_at.allow_for_secondary_tenant.enabled'
        )
        ORDER BY tenant_id, name
        ----
        2 sql.scatter.allow_for_secondary_tenant.enabled true
        2 sql.split_at.allow_for_secondary_tenant.enabled true
    datadriven.go:143: 
        testdata/multitenant-noapp:42:
        system-sql [0 args]
        SHOW TENANTS WITH CAPABILITIES
        ----
        1 system ready shared can_admin_relocate_range false
        1 system ready shared can_admin_scatter true
        1 system ready shared can_admin_split true
        1 system ready shared can_admin_unsplit false
        1 system ready shared can_check_consistency false
        1 system ready shared can_use_nodelocal_storage false
        1 system ready shared can_view_node_info false
        1 system ready shared can_view_tsdb_metrics false
        1 system ready shared exempt_from_rate_limiting false
        1 system ready shared span_config_bounds {}
        2 template ready none can_admin_relocate_range true
        2 template ready none can_admin_scatter true
        2 template ready none can_admin_split true
        2 template ready none can_admin_unsplit true
        2 template ready none can_check_consistency true
        2 template ready none can_use_nodelocal_storage true
        2 template ready none can_view_node_info true
        2 template ready none can_view_tsdb_metrics true
        2 template ready none exempt_from_rate_limiting true
        2 template ready none span_config_bounds {}
    datadriven.go:143: 
        testdata/multitenant-noapp:66:
        system-sql [0 args]
        CREATE TENANT application LIKE template
        ----
        <no rows>
    datadriven.go:143: 
        testdata/multitenant-noapp:71:
        system-sql [0 args]
        ALTER TENANT application START SERVICE SHARED
        ----
        <no rows>
    datadriven.go:143: 
        testdata/multitenant-noapp:76:
        connect-tenant [0 args]
        application
        ----
        ok

Parameters: TAGS=bazel,gss,race

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #102800 configprofiles: TestDataDriven failed [C-test-failure O-robot T-multitenant branch-release-23.1] - #102055 configprofiles: TestDataDriven failed [C-test-failure O-robot branch-release-23.1.0]

This test on roachdash | Improve this report!

[cockroach-teamcity]

configprofiles.TestDataDriven failed with artifacts on master @ 439c515b2a0058648731da73993c409544404da1:

      GOROOT/src/testing/testing.go:1446 +0x216
  testing.(*T).Run.func1()
      GOROOT/src/testing/testing.go:1493 +0x47

Previous read at 0x00c001bd2198 by goroutine 18809:
  github.com/cockroachdb/cockroach/pkg/server.(*Server).makeSharedProcessTenantConfig()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_new_server.go:156 +0xbd
  github.com/cockroachdb/cockroach/pkg/server.(*Server).newTenantServer()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_new_server.go:78 +0x108
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).newServerForOrchestrator()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:257 +0x23c
  github.com/cockroachdb/cockroach/pkg/server.(*channelOrchestrator).startControlledServer.func5.2()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_channel_orchestrator.go:355 +0x12b
  github.com/cockroachdb/cockroach/pkg/server.(*channelOrchestrator).startControlledServer.func5()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_channel_orchestrator.go:379 +0x56a
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:470 +0x1f6

Goroutine 15474 (running) created at:
  testing.(*T).Run()
      GOROOT/src/testing/testing.go:1493 +0x75d
  github.com/cockroachdb/datadriven.subTest()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/test_interface.go:27 +0x10b
  github.com/cockroachdb/datadriven.WalkAny()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:447 +0x585
  github.com/cockroachdb/datadriven.Walk()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:423 +0xc4
  github.com/cockroachdb/cockroach/pkg/configprofiles_test.TestDataDriven()
      github.com/cockroachdb/cockroach/pkg/configprofiles_test/pkg/configprofiles/datadriven_test.go:37 +0x1a4
  testing.tRunner()
      GOROOT/src/testing/testing.go:1446 +0x216
  testing.(*T).Run.func1()
      GOROOT/src/testing/testing.go:1493 +0x47

Goroutine 18809 (running) created at:
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:461 +0x619
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:332 +0xf4c
  github.com/cockroachdb/cockroach/pkg/server.(*channelOrchestrator).startControlledServer()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_channel_orchestrator.go:292 +0x29
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).createServerEntryLocked()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:168 +0x2b0
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).scanTenantsForRunnableServices()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:129 +0x53a
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).start.func1()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:60 +0x21a
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:470 +0x1f6
==================

Parameters: TAGS=bazel,gss,race

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #102800 configprofiles: TestDataDriven failed [C-test-failure O-robot T-multitenant branch-release-23.1] - #102055 configprofiles: TestDataDriven failed [C-test-failure O-robot branch-release-23.1.0]

This test on roachdash | Improve this report!

[cockroach-teamcity]

configprofiles.TestDataDriven failed with artifacts on master @ 245c3b9db56567d9820babe460c5ed8a3786890e:

        sql.zone_configs.allow_for_secondary_tenant.enabled true
    datadriven.go:143: 
        testdata/multitenant-app:36:
        system-sql [0 args]
        SELECT tenant_id, name, value FROM system.tenant_settings
        WHERE name IN (
        'sql.scatter.allow_for_secondary_tenant.enabled',
        'sql.split_at.allow_for_secondary_tenant.enabled'
        )
        ORDER BY tenant_id, name
        ----
        2 sql.scatter.allow_for_secondary_tenant.enabled true
        2 sql.split_at.allow_for_secondary_tenant.enabled true
        3 sql.scatter.allow_for_secondary_tenant.enabled true
        3 sql.split_at.allow_for_secondary_tenant.enabled true
    datadriven.go:143: 
        testdata/multitenant-app:49:
        system-sql [0 args]
        SHOW TENANTS WITH CAPABILITIES
        ----
        1 system ready shared can_admin_relocate_range false
        1 system ready shared can_admin_scatter true
        1 system ready shared can_admin_split true
        1 system ready shared can_admin_unsplit false
        1 system ready shared can_check_consistency false
        1 system ready shared can_use_nodelocal_storage false
        1 system ready shared can_view_node_info false
        1 system ready shared can_view_tsdb_metrics false
        1 system ready shared exempt_from_rate_limiting false
        1 system ready shared span_config_bounds {}
        2 template ready none can_admin_relocate_range true
        2 template ready none can_admin_scatter true
        2 template ready none can_admin_split true
        2 template ready none can_admin_unsplit true
        2 template ready none can_check_consistency true
        2 template ready none can_use_nodelocal_storage true
        2 template ready none can_view_node_info true
        2 template ready none can_view_tsdb_metrics true
        2 template ready none exempt_from_rate_limiting true
        2 template ready none span_config_bounds {}
        3 application ready shared can_admin_relocate_range true
        3 application ready shared can_admin_scatter true
        3 application ready shared can_admin_split true
        3 application ready shared can_admin_unsplit true
        3 application ready shared can_check_consistency true
        3 application ready shared can_use_nodelocal_storage true
        3 application ready shared can_view_node_info true
        3 application ready shared can_view_tsdb_metrics true
        3 application ready shared exempt_from_rate_limiting true
        3 application ready shared span_config_bounds {}

Parameters: TAGS=bazel,gss,race

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #102800 configprofiles: TestDataDriven failed [C-test-failure O-robot T-multitenant branch-release-23.1] - #102055 configprofiles: TestDataDriven failed [C-test-failure O-robot branch-release-23.1.0]

This test on roachdash | Improve this report!

[cockroach-teamcity]

configprofiles.TestDataDriven failed with artifacts on master @ 63eb6b86c1518fbed9db10e7d2afa1446b2b3b82:

  github.com/cockroachdb/cockroach/pkg/server.(*channelOrchestrator).startControlledServer()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_channel_orchestrator.go:292 +0x29
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).createServerEntryLocked()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:168 +0x2b0
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).scanTenantsForRunnableServices()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:129 +0x53a
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).start.func1()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:60 +0x21a
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:470 +0x1f6

Goroutine 15345 (running) created at:
  testing.(*T).Run()
      GOROOT/src/testing/testing.go:1493 +0x75d
  github.com/cockroachdb/datadriven.subTest()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/test_interface.go:27 +0x10b
  github.com/cockroachdb/datadriven.WalkAny()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:447 +0x585
  github.com/cockroachdb/datadriven.Walk()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:423 +0xc4
  github.com/cockroachdb/cockroach/pkg/configprofiles_test.TestDataDriven()
      github.com/cockroachdb/cockroach/pkg/configprofiles_test/pkg/configprofiles/datadriven_test.go:37 +0x1a4
  testing.tRunner()
      GOROOT/src/testing/testing.go:1446 +0x216
  testing.(*T).Run.func1()
      GOROOT/src/testing/testing.go:1493 +0x47
==================
=== RUN   TestDataDriven/example
    datadriven.go:143: 
        testdata/example:1:
        profile [0 args]
        example
        ----
        canonical profile name: example
        server started
    datadriven.go:143: 
        testdata/example:7:
        system-sql [0 args]
        SHOW DATABASES
        ----
        defaultdb root NULL NULL {} NULL
        example root NULL NULL {} NULL
        postgres root NULL NULL {} NULL
        system node NULL NULL {} NULL
    datadriven.go:143: 
        testdata/example:15:
        system-sql [0 args]
        SELECT * FROM example.data
        ----
        hello

Parameters: TAGS=bazel,gss,race

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #102800 configprofiles: TestDataDriven failed [C-test-failure O-robot T-multitenant branch-release-23.1] - #102055 configprofiles: TestDataDriven failed [C-test-failure O-robot branch-release-23.1.0]

This test on roachdash | Improve this report!

[cockroach-teamcity]

configprofiles.TestDataDriven failed with artifacts on master @ 63eb6b86c1518fbed9db10e7d2afa1446b2b3b82:

      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:143 +0x3d1
  github.com/cockroachdb/datadriven.RunTest()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:116 +0xc4
  github.com/cockroachdb/cockroach/pkg/configprofiles_test.TestDataDriven.func1()
      github.com/cockroachdb/cockroach/pkg/configprofiles_test/pkg/configprofiles/datadriven_test.go:49 +0x34e
  github.com/cockroachdb/datadriven.Walk.func1()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:424 +0x6e
  github.com/cockroachdb/datadriven.WalkAny()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:435 +0x2a5
  github.com/cockroachdb/datadriven.WalkAny.func1()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:448 +0xc7
  github.com/cockroachdb/datadriven.subTest.func1()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/test_interface.go:27 +0x41
  testing.tRunner()
      GOROOT/src/testing/testing.go:1446 +0x216
  testing.(*T).Run.func1()
      GOROOT/src/testing/testing.go:1493 +0x47

Goroutine 6615 (running) created at:
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:461 +0x619
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:332 +0xf4c
  github.com/cockroachdb/cockroach/pkg/server.(*channelOrchestrator).startControlledServer()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_channel_orchestrator.go:292 +0x29
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).createServerEntryLocked()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:168 +0x2b0
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).scanTenantsForRunnableServices()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:129 +0x53a
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).start.func1()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:60 +0x21a
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:470 +0x1f6

Goroutine 3408 (running) created at:
  testing.(*T).Run()
      GOROOT/src/testing/testing.go:1493 +0x75d
  github.com/cockroachdb/datadriven.subTest()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/test_interface.go:27 +0x10b
  github.com/cockroachdb/datadriven.WalkAny()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:447 +0x585
  github.com/cockroachdb/datadriven.Walk()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:423 +0xc4
  github.com/cockroachdb/cockroach/pkg/configprofiles_test.TestDataDriven()
      github.com/cockroachdb/cockroach/pkg/configprofiles_test/pkg/configprofiles/datadriven_test.go:37 +0x1a4
  testing.tRunner()
      GOROOT/src/testing/testing.go:1446 +0x216
  testing.(*T).Run.func1()
      GOROOT/src/testing/testing.go:1493 +0x47
==================

Parameters: TAGS=bazel,gss,race

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #102800 configprofiles: TestDataDriven failed [C-test-failure O-robot T-multitenant branch-release-23.1] - #102055 configprofiles: TestDataDriven failed [C-test-failure O-robot branch-release-23.1.0]

This test on roachdash | Improve this report!

[cockroach-teamcity]

configprofiles.TestDataDriven failed with artifacts on master @ a65bca232dfde1862e5aff343e7b1f3a379d6cd6:

        sql.zone_configs.allow_for_secondary_tenant.enabled true
    datadriven.go:143: 
        testdata/multitenant-app:36:
        system-sql [0 args]
        SELECT tenant_id, name, value FROM system.tenant_settings
        WHERE name IN (
        'sql.scatter.allow_for_secondary_tenant.enabled',
        'sql.split_at.allow_for_secondary_tenant.enabled'
        )
        ORDER BY tenant_id, name
        ----
        2 sql.scatter.allow_for_secondary_tenant.enabled true
        2 sql.split_at.allow_for_secondary_tenant.enabled true
        3 sql.scatter.allow_for_secondary_tenant.enabled true
        3 sql.split_at.allow_for_secondary_tenant.enabled true
    datadriven.go:143: 
        testdata/multitenant-app:49:
        system-sql [0 args]
        SHOW TENANTS WITH CAPABILITIES
        ----
        1 system ready shared can_admin_relocate_range false
        1 system ready shared can_admin_scatter true
        1 system ready shared can_admin_split true
        1 system ready shared can_admin_unsplit false
        1 system ready shared can_check_consistency false
        1 system ready shared can_use_nodelocal_storage false
        1 system ready shared can_view_node_info false
        1 system ready shared can_view_tsdb_metrics false
        1 system ready shared exempt_from_rate_limiting false
        1 system ready shared span_config_bounds {}
        2 template ready none can_admin_relocate_range true
        2 template ready none can_admin_scatter true
        2 template ready none can_admin_split true
        2 template ready none can_admin_unsplit true
        2 template ready none can_check_consistency true
        2 template ready none can_use_nodelocal_storage true
        2 template ready none can_view_node_info true
        2 template ready none can_view_tsdb_metrics true
        2 template ready none exempt_from_rate_limiting true
        2 template ready none span_config_bounds {}
        3 application ready shared can_admin_relocate_range true
        3 application ready shared can_admin_scatter true
        3 application ready shared can_admin_split true
        3 application ready shared can_admin_unsplit true
        3 application ready shared can_check_consistency true
        3 application ready shared can_use_nodelocal_storage true
        3 application ready shared can_view_node_info true
        3 application ready shared can_view_tsdb_metrics true
        3 application ready shared exempt_from_rate_limiting true
        3 application ready shared span_config_bounds {}

Parameters: TAGS=bazel,gss,race

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #102800 configprofiles: TestDataDriven failed [C-test-failure O-robot T-multitenant branch-release-23.1] - #102055 configprofiles: TestDataDriven failed [C-test-failure O-robot branch-release-23.1.0]

This test on roachdash | Improve this report!

[knz]

found root cause: #104500