search

cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
https://www.cockroachlabs.com
Other
30.07k stars 3.8k forks source link

configprofiles: TestDataDriven failed #102055

Closed cockroach-teamcity closed 1 year ago

cockroach-teamcity commented 1 year ago

configprofiles.TestDataDriven failed with artifacts on release-23.1.0 @ ca2fae8b11a761af8ac7e5334aa5642c15dfb42f:

github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:582 stop.(*Stopper).Quiesce ???
github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:530 stop.(*Stopper).Stop ???
github.com/cockroachdb/cockroach/pkg/server/server_controller_channel_orchestrator.go:461 server.(*channelOrchestrator).propagateUngracefulStopAsync.func1 ???
github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:470 stop.(*Stopper).RunAsyncTaskEx.func2 ???

Here is what goroutine 3467443 doing now
goroutine 3467443 [IO wait, 5 minutes]:
internal/poll.runtime_pollWait(0x7f32e2e7c508, 0x72)
    GOROOT/src/runtime/netpoll.go:305 +0x89
internal/poll.(*pollDesc).wait(0xc005517600?, 0x45bfb9?, 0x0)
    GOROOT/src/internal/poll/fd_poll_runtime.go:84 +0x32
internal/poll.(*pollDesc).waitRead(...)
    GOROOT/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc005517600)
    GOROOT/src/internal/poll/fd_unix.go:614 +0x234
net.(*netFD).accept(0xc005517600)
    GOROOT/src/net/fd_unix.go:172 +0x35
net.(*TCPListener).accept(0xc00373ab70)
    GOROOT/src/net/tcpsock_posix.go:142 +0x28
net.(*TCPListener).Accept(0xc00373ab70)
    GOROOT/src/net/tcpsock.go:288 +0x3d
github.com/cockroachdb/cmux.(*cMux).Serve(0xc008032ec0)
    github.com/cockroachdb/cmux/external/com_github_cockroachdb_cmux/cmux.go:124 +0xa9
github.com/cockroachdb/cockroach/pkg/server.startListenRPCAndSQL.func5.1()
    github.com/cockroachdb/cockroach/pkg/server/start_listen.go:152 +0x22
sync.(*Once).doSlow(0xc011be72c0?, 0x32?)
    GOROOT/src/sync/once.go:74 +0xc2
sync.(*Once).Do(...)
    GOROOT/src/sync/once.go:65
github.com/cockroachdb/cockroach/pkg/server.startListenRPCAndSQL.func5()
    github.com/cockroachdb/cockroach/pkg/server/start_listen.go:148 +0x85
github.com/cockroachdb/cockroach/pkg/util/stop.CloserFn.Close(0xc00522e398?)
    github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:107 +0x1a
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).AddCloser(0xc00c8e1080, {0x7050f00?, 0xc00a54db30})
    github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:254 +0xe2
github.com/cockroachdb/cockroach/pkg/server.startListenRPCAndSQL({_, _}, {_, _}, {0xc004ab0000, 0xc00f537d40, 0xc00c9dbb00, 0xc0048ed770, 0xc000f25f80, 0xc0120a0810, ...}, ...)
    github.com/cockroachdb/cockroach/pkg/server/start_listen.go:163 +0xb0a
github.com/cockroachdb/cockroach/pkg/server.(*SQLServerWrapper).PreStart(0xc00266d2c0, {0x7087d48?, 0xc005585560})
    github.com/cockroachdb/cockroach/pkg/server/tenant.go:509 +0x259
github.com/cockroachdb/cockroach/pkg/server.(*tenantServerWrapper).preStart(0x0?, {0x7087d48?, 0xc005585560?})
    github.com/cockroachdb/cockroach/pkg/server/server_controller.go:159 +0x27
github.com/cockroachdb/cockroach/pkg/server.(*channelOrchestrator).startControlledServer.func5.2(0xc009b246d8, 0xc004964860, 0xc010735fc0?, 0xc000939cd8, {0x7087d48, 0xc0111f64b0}, 0x3fc3333333333333?, 0xc00a8729c0?)
    github.com/cockroachdb/cockroach/pkg/server/server_controller_channel_orchestrator.go:366 +0x11f
github.com/cockroachdb/cockroach/pkg/server.(*channelOrchestrator).startControlledServer.func5({0xc0061da800?, 0xc003d61fd0?})
    github.com/cockroachdb/cockroach/pkg/server/server_controller_channel_orchestrator.go:379 +0x3db
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
    github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:470 +0x146
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx
    github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:461 +0x43b

Parameters: TAGS=bazel,gss,deadlock

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

/cc @cockroachdb/multi-tenant @cockroachdb/server

This test on roachdash | Improve this report!

Jira issue: CRDB-27247

cockroach-teamcity commented 1 year ago

configprofiles.TestDataDriven failed with artifacts on release-23.1.0 @ 5efa6ff20f56d2ce8111b710190d1b378adb26d9:

      github.com/cockroachdb/cockroach/pkg/configprofiles_test/pkg/configprofiles/datadriven_test.go:64 +0xb92
  github.com/cockroachdb/datadriven.runDirective.func1()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:320 +0xd3
  github.com/cockroachdb/datadriven.runDirective()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:325 +0x84
  github.com/cockroachdb/datadriven.runDirectiveOrSubTest()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:194 +0x92
  github.com/cockroachdb/datadriven.runTestInternal()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:167 +0xc8
  github.com/cockroachdb/datadriven.RunTest()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:135 +0x2f4
  github.com/cockroachdb/cockroach/pkg/configprofiles_test.TestDataDriven.func1()
      github.com/cockroachdb/cockroach/pkg/configprofiles_test/pkg/configprofiles/datadriven_test.go:49 +0x34e
  github.com/cockroachdb/datadriven.Walk()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:412 +0x227
  github.com/cockroachdb/datadriven.Walk.func1()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:425 +0xb9
  testing.tRunner()
      GOROOT/src/testing/testing.go:1446 +0x216
  testing.(*T).Run.func1()
      GOROOT/src/testing/testing.go:1493 +0x47

Goroutine 5951 (running) created at:
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:461 +0x619
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:332 +0xf4c
  github.com/cockroachdb/cockroach/pkg/server.(*channelOrchestrator).startControlledServer()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_channel_orchestrator.go:292 +0x29
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).createServerEntryLocked()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:168 +0x2b0
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).scanTenantsForRunnableServices()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:129 +0x53a
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).start.func1()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:60 +0x21a
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:470 +0x1f6

Goroutine 3028 (running) created at:
  testing.(*T).Run()
      GOROOT/src/testing/testing.go:1493 +0x75d
  github.com/cockroachdb/datadriven.Walk()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:424 +0x4fd
  github.com/cockroachdb/cockroach/pkg/configprofiles_test.TestDataDriven()
      github.com/cockroachdb/cockroach/pkg/configprofiles_test/pkg/configprofiles/datadriven_test.go:37 +0x1a4
  testing.tRunner()
      GOROOT/src/testing/testing.go:1446 +0x216
  testing.(*T).Run.func1()
      GOROOT/src/testing/testing.go:1493 +0x47
==================

Parameters: TAGS=bazel,gss,race

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #102408 configprofiles: TestDataDriven failed [C-test-failure O-robot branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

configprofiles.TestDataDriven failed with artifacts on release-23.1.0 @ 5efa6ff20f56d2ce8111b710190d1b378adb26d9:

      github.com/cockroachdb/cockroach/pkg/configprofiles_test/pkg/configprofiles/datadriven_test.go:64 +0xb92
  github.com/cockroachdb/datadriven.runDirective.func1()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:320 +0xd3
  github.com/cockroachdb/datadriven.runDirective()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:325 +0x84
  github.com/cockroachdb/datadriven.runDirectiveOrSubTest()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:194 +0x92
  github.com/cockroachdb/datadriven.runTestInternal()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:167 +0xc8
  github.com/cockroachdb/datadriven.RunTest()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:135 +0x2f4
  github.com/cockroachdb/cockroach/pkg/configprofiles_test.TestDataDriven.func1()
      github.com/cockroachdb/cockroach/pkg/configprofiles_test/pkg/configprofiles/datadriven_test.go:49 +0x34e
  github.com/cockroachdb/datadriven.Walk()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:412 +0x227
  github.com/cockroachdb/datadriven.Walk.func1()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:425 +0xb9
  testing.tRunner()
      GOROOT/src/testing/testing.go:1446 +0x216
  testing.(*T).Run.func1()
      GOROOT/src/testing/testing.go:1493 +0x47

Goroutine 5915 (running) created at:
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:461 +0x619
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:332 +0xf4c
  github.com/cockroachdb/cockroach/pkg/server.(*channelOrchestrator).startControlledServer()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_channel_orchestrator.go:292 +0x29
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).createServerEntryLocked()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:168 +0x2b0
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).scanTenantsForRunnableServices()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:129 +0x53a
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).start.func1()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:60 +0x21a
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:470 +0x1f6

Goroutine 3029 (running) created at:
  testing.(*T).Run()
      GOROOT/src/testing/testing.go:1493 +0x75d
  github.com/cockroachdb/datadriven.Walk()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:424 +0x4fd
  github.com/cockroachdb/cockroach/pkg/configprofiles_test.TestDataDriven()
      github.com/cockroachdb/cockroach/pkg/configprofiles_test/pkg/configprofiles/datadriven_test.go:37 +0x1a4
  testing.tRunner()
      GOROOT/src/testing/testing.go:1446 +0x216
  testing.(*T).Run.func1()
      GOROOT/src/testing/testing.go:1493 +0x47
==================

Parameters: TAGS=bazel,gss,race

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #102800 configprofiles: TestDataDriven failed [C-test-failure O-robot T-multitenant branch-release-23.1] - #102408 configprofiles: TestDataDriven failed [C-test-failure O-robot branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

configprofiles.TestDataDriven failed with artifacts on release-23.1.0 @ 29ed08a512389e42ccccdde0906e34a301c28b4a:

      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:412 +0x227
  github.com/cockroachdb/datadriven.Walk.func1()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:425 +0xb9
  testing.tRunner()
      GOROOT/src/testing/testing.go:1446 +0x216
  testing.(*T).Run.func1()
      GOROOT/src/testing/testing.go:1493 +0x47

Previous read at 0x00c004142198 by goroutine 16387:
  github.com/cockroachdb/cockroach/pkg/server.(*Server).makeSharedProcessTenantConfig()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_new_server.go:156 +0xbd
  github.com/cockroachdb/cockroach/pkg/server.(*Server).newTenantServer()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_new_server.go:78 +0x108
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).newServerForOrchestrator()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:257 +0x23c
  github.com/cockroachdb/cockroach/pkg/server.(*channelOrchestrator).startControlledServer.func5.2()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_channel_orchestrator.go:355 +0x12b
  github.com/cockroachdb/cockroach/pkg/server.(*channelOrchestrator).startControlledServer.func5()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_channel_orchestrator.go:379 +0x56a
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:470 +0x1f6

Goroutine 13519 (running) created at:
  testing.(*T).Run()
      GOROOT/src/testing/testing.go:1493 +0x75d
  github.com/cockroachdb/datadriven.Walk()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:424 +0x4fd
  github.com/cockroachdb/cockroach/pkg/configprofiles_test.TestDataDriven()
      github.com/cockroachdb/cockroach/pkg/configprofiles_test/pkg/configprofiles/datadriven_test.go:37 +0x1a4
  testing.tRunner()
      GOROOT/src/testing/testing.go:1446 +0x216
  testing.(*T).Run.func1()
      GOROOT/src/testing/testing.go:1493 +0x47

Goroutine 16387 (running) created at:
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:461 +0x619
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:332 +0xf4c
  github.com/cockroachdb/cockroach/pkg/server.(*channelOrchestrator).startControlledServer()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_channel_orchestrator.go:292 +0x29
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).createServerEntryLocked()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:168 +0x2b0
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).scanTenantsForRunnableServices()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:129 +0x53a
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).start.func1()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:60 +0x21a
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:470 +0x1f6
==================

Parameters: TAGS=bazel,gss,race

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #102800 configprofiles: TestDataDriven failed [C-test-failure O-robot T-multitenant branch-release-23.1] - #102408 configprofiles: TestDataDriven failed [C-test-failure O-robot branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

configprofiles.TestDataDriven failed with artifacts on release-23.1.0 @ 29ed08a512389e42ccccdde0906e34a301c28b4a:

      github.com/cockroachdb/cockroach/pkg/configprofiles_test/pkg/configprofiles/datadriven_test.go:64 +0xb92
  github.com/cockroachdb/datadriven.runDirective.func1()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:320 +0xd3
  github.com/cockroachdb/datadriven.runDirective()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:325 +0x84
  github.com/cockroachdb/datadriven.runDirectiveOrSubTest()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:194 +0x92
  github.com/cockroachdb/datadriven.runTestInternal()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:167 +0xc8
  github.com/cockroachdb/datadriven.RunTest()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:135 +0x2f4
  github.com/cockroachdb/cockroach/pkg/configprofiles_test.TestDataDriven.func1()
      github.com/cockroachdb/cockroach/pkg/configprofiles_test/pkg/configprofiles/datadriven_test.go:49 +0x34e
  github.com/cockroachdb/datadriven.Walk()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:412 +0x227
  github.com/cockroachdb/datadriven.Walk.func1()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:425 +0xb9
  testing.tRunner()
      GOROOT/src/testing/testing.go:1446 +0x216
  testing.(*T).Run.func1()
      GOROOT/src/testing/testing.go:1493 +0x47

Goroutine 16937 (running) created at:
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:461 +0x619
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:332 +0xf4c
  github.com/cockroachdb/cockroach/pkg/server.(*channelOrchestrator).startControlledServer()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_channel_orchestrator.go:292 +0x29
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).createServerEntryLocked()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:168 +0x2b0
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).scanTenantsForRunnableServices()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:129 +0x53a
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).start.func1()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:60 +0x21a
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:470 +0x1f6

Goroutine 14074 (running) created at:
  testing.(*T).Run()
      GOROOT/src/testing/testing.go:1493 +0x75d
  github.com/cockroachdb/datadriven.Walk()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:424 +0x4fd
  github.com/cockroachdb/cockroach/pkg/configprofiles_test.TestDataDriven()
      github.com/cockroachdb/cockroach/pkg/configprofiles_test/pkg/configprofiles/datadriven_test.go:37 +0x1a4
  testing.tRunner()
      GOROOT/src/testing/testing.go:1446 +0x216
  testing.(*T).Run.func1()
      GOROOT/src/testing/testing.go:1493 +0x47
==================

Parameters: TAGS=bazel,gss,race

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #102800 configprofiles: TestDataDriven failed [C-test-failure O-robot T-multitenant branch-release-23.1] - #102408 configprofiles: TestDataDriven failed [C-test-failure O-robot branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

configprofiles.TestDataDriven failed with artifacts on release-23.1.0 @ 358e0d87912365b8976c55ab9b3292e999cf720d:

        sql.zone_configs.allow_for_secondary_tenant.enabled true
    datadriven_test.go:49: 
        testdata/multitenant-app:36:
        system-sql [0 args]
        SELECT tenant_id, name, value FROM system.tenant_settings
        WHERE name IN (
        'sql.scatter.allow_for_secondary_tenant.enabled',
        'sql.split_at.allow_for_secondary_tenant.enabled'
        )
        ORDER BY tenant_id, name
        ----
        2 sql.scatter.allow_for_secondary_tenant.enabled true
        2 sql.split_at.allow_for_secondary_tenant.enabled true
        3 sql.scatter.allow_for_secondary_tenant.enabled true
        3 sql.split_at.allow_for_secondary_tenant.enabled true
    datadriven_test.go:49: 
        testdata/multitenant-app:49:
        system-sql [0 args]
        SHOW TENANTS WITH CAPABILITIES
        ----
        1 system ready shared can_admin_relocate_range false
        1 system ready shared can_admin_scatter true
        1 system ready shared can_admin_split true
        1 system ready shared can_admin_unsplit false
        1 system ready shared can_check_consistency false
        1 system ready shared can_use_nodelocal_storage false
        1 system ready shared can_view_node_info false
        1 system ready shared can_view_tsdb_metrics false
        1 system ready shared exempt_from_rate_limiting false
        1 system ready shared span_config_bounds {}
        2 template ready none can_admin_relocate_range true
        2 template ready none can_admin_scatter true
        2 template ready none can_admin_split true
        2 template ready none can_admin_unsplit true
        2 template ready none can_check_consistency true
        2 template ready none can_use_nodelocal_storage true
        2 template ready none can_view_node_info true
        2 template ready none can_view_tsdb_metrics true
        2 template ready none exempt_from_rate_limiting true
        2 template ready none span_config_bounds {}
        3 application ready shared can_admin_relocate_range true
        3 application ready shared can_admin_scatter true
        3 application ready shared can_admin_split true
        3 application ready shared can_admin_unsplit true
        3 application ready shared can_check_consistency true
        3 application ready shared can_use_nodelocal_storage true
        3 application ready shared can_view_node_info true
        3 application ready shared can_view_tsdb_metrics true
        3 application ready shared exempt_from_rate_limiting true
        3 application ready shared span_config_bounds {}

Parameters: TAGS=bazel,gss,race

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #102800 configprofiles: TestDataDriven failed [C-test-failure O-robot T-multitenant branch-release-23.1] - #102408 configprofiles: TestDataDriven failed [C-test-failure O-robot branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

configprofiles.TestDataDriven failed with artifacts on release-23.1.0 @ 358e0d87912365b8976c55ab9b3292e999cf720d:

  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:461 +0x619
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:332 +0xf4c
  github.com/cockroachdb/cockroach/pkg/server.(*channelOrchestrator).startControlledServer()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_channel_orchestrator.go:292 +0x29
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).createServerEntryLocked()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:168 +0x2b0
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).scanTenantsForRunnableServices()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:129 +0x53a
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).start.func1()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:60 +0x21a
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:470 +0x1f6

Goroutine 11654 (running) created at:
  testing.(*T).Run()
      GOROOT/src/testing/testing.go:1493 +0x75d
  github.com/cockroachdb/datadriven.Walk()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:424 +0x4fd
  github.com/cockroachdb/cockroach/pkg/configprofiles_test.TestDataDriven()
      github.com/cockroachdb/cockroach/pkg/configprofiles_test/pkg/configprofiles/datadriven_test.go:37 +0x1a4
  testing.tRunner()
      GOROOT/src/testing/testing.go:1446 +0x216
  testing.(*T).Run.func1()
      GOROOT/src/testing/testing.go:1493 +0x47
==================
=== RUN   TestDataDriven/example
    datadriven_test.go:49: 
        testdata/example:1:
        profile [0 args]
        example
        ----
        canonical profile name: example
        server started
    datadriven_test.go:49: 
        testdata/example:7:
        system-sql [0 args]
        SHOW DATABASES
        ----
        defaultdb root NULL NULL {} NULL
        example root NULL NULL {} NULL
        postgres root NULL NULL {} NULL
        system node NULL NULL {} NULL
    datadriven_test.go:49: 
        testdata/example:15:
        system-sql [0 args]
        SELECT * FROM example.data
        ----
        hello

Parameters: TAGS=bazel,gss,race

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #102800 configprofiles: TestDataDriven failed [C-test-failure O-robot T-multitenant branch-release-23.1] - #102408 configprofiles: TestDataDriven failed [C-test-failure O-robot branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

configprofiles.TestDataDriven failed with artifacts on release-23.1.0 @ 358e0d87912365b8976c55ab9b3292e999cf720d:

      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:412 +0x227
  github.com/cockroachdb/datadriven.Walk.func1()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:425 +0xb9
  testing.tRunner()
      GOROOT/src/testing/testing.go:1446 +0x216
  testing.(*T).Run.func1()
      GOROOT/src/testing/testing.go:1493 +0x47

Previous read at 0x00c001f5a198 by goroutine 14555:
  github.com/cockroachdb/cockroach/pkg/server.(*Server).makeSharedProcessTenantConfig()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_new_server.go:156 +0xbd
  github.com/cockroachdb/cockroach/pkg/server.(*Server).newTenantServer()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_new_server.go:78 +0x108
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).newServerForOrchestrator()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:257 +0x23c
  github.com/cockroachdb/cockroach/pkg/server.(*channelOrchestrator).startControlledServer.func5.2()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_channel_orchestrator.go:355 +0x12b
  github.com/cockroachdb/cockroach/pkg/server.(*channelOrchestrator).startControlledServer.func5()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_channel_orchestrator.go:379 +0x56a
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:470 +0x1f6

Goroutine 11672 (running) created at:
  testing.(*T).Run()
      GOROOT/src/testing/testing.go:1493 +0x75d
  github.com/cockroachdb/datadriven.Walk()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:424 +0x4fd
  github.com/cockroachdb/cockroach/pkg/configprofiles_test.TestDataDriven()
      github.com/cockroachdb/cockroach/pkg/configprofiles_test/pkg/configprofiles/datadriven_test.go:37 +0x1a4
  testing.tRunner()
      GOROOT/src/testing/testing.go:1446 +0x216
  testing.(*T).Run.func1()
      GOROOT/src/testing/testing.go:1493 +0x47

Goroutine 14555 (running) created at:
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:461 +0x619
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:332 +0xf4c
  github.com/cockroachdb/cockroach/pkg/server.(*channelOrchestrator).startControlledServer()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_channel_orchestrator.go:292 +0x29
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).createServerEntryLocked()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:168 +0x2b0
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).scanTenantsForRunnableServices()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:129 +0x53a
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).start.func1()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:60 +0x21a
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:470 +0x1f6
==================

Parameters: TAGS=bazel,gss,race

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #102800 configprofiles: TestDataDriven failed [C-test-failure O-robot T-multitenant branch-release-23.1] - #102408 configprofiles: TestDataDriven failed [C-test-failure O-robot branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

configprofiles.TestDataDriven failed with artifacts on release-23.1.0 @ 358e0d87912365b8976c55ab9b3292e999cf720d:

      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:412 +0x227
  github.com/cockroachdb/datadriven.Walk.func1()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:425 +0xb9
  testing.tRunner()
      GOROOT/src/testing/testing.go:1446 +0x216
  testing.(*T).Run.func1()
      GOROOT/src/testing/testing.go:1493 +0x47

Previous read at 0x00c002df1698 by goroutine 5990:
  github.com/cockroachdb/cockroach/pkg/server.(*Server).makeSharedProcessTenantConfig()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_new_server.go:156 +0xbd
  github.com/cockroachdb/cockroach/pkg/server.(*Server).newTenantServer()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_new_server.go:78 +0x108
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).newServerForOrchestrator()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:257 +0x23c
  github.com/cockroachdb/cockroach/pkg/server.(*channelOrchestrator).startControlledServer.func5.2()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_channel_orchestrator.go:355 +0x12b
  github.com/cockroachdb/cockroach/pkg/server.(*channelOrchestrator).startControlledServer.func5()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_channel_orchestrator.go:379 +0x56a
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:470 +0x1f6

Goroutine 3104 (running) created at:
  testing.(*T).Run()
      GOROOT/src/testing/testing.go:1493 +0x75d
  github.com/cockroachdb/datadriven.Walk()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:424 +0x4fd
  github.com/cockroachdb/cockroach/pkg/configprofiles_test.TestDataDriven()
      github.com/cockroachdb/cockroach/pkg/configprofiles_test/pkg/configprofiles/datadriven_test.go:37 +0x1a4
  testing.tRunner()
      GOROOT/src/testing/testing.go:1446 +0x216
  testing.(*T).Run.func1()
      GOROOT/src/testing/testing.go:1493 +0x47

Goroutine 5990 (running) created at:
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:461 +0x619
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:332 +0xf4c
  github.com/cockroachdb/cockroach/pkg/server.(*channelOrchestrator).startControlledServer()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_channel_orchestrator.go:292 +0x29
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).createServerEntryLocked()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:168 +0x2b0
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).scanTenantsForRunnableServices()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:129 +0x53a
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).start.func1()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:60 +0x21a
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:470 +0x1f6
==================

Parameters: TAGS=bazel,gss,race

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #102800 configprofiles: TestDataDriven failed [C-test-failure O-robot T-multitenant branch-release-23.1] - #102408 configprofiles: TestDataDriven failed [C-test-failure O-robot branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

configprofiles.TestDataDriven failed with artifacts on release-23.1.0 @ 358e0d87912365b8976c55ab9b3292e999cf720d:

      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:412 +0x227
  github.com/cockroachdb/datadriven.Walk.func1()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:425 +0xb9
  testing.tRunner()
      GOROOT/src/testing/testing.go:1446 +0x216
  testing.(*T).Run.func1()
      GOROOT/src/testing/testing.go:1493 +0x47

Previous read at 0x00c001ba2198 by goroutine 5970:
  github.com/cockroachdb/cockroach/pkg/server.(*Server).makeSharedProcessTenantConfig()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_new_server.go:156 +0xbd
  github.com/cockroachdb/cockroach/pkg/server.(*Server).newTenantServer()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_new_server.go:78 +0x108
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).newServerForOrchestrator()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:257 +0x23c
  github.com/cockroachdb/cockroach/pkg/server.(*channelOrchestrator).startControlledServer.func5.2()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_channel_orchestrator.go:355 +0x12b
  github.com/cockroachdb/cockroach/pkg/server.(*channelOrchestrator).startControlledServer.func5()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_channel_orchestrator.go:379 +0x56a
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:470 +0x1f6

Goroutine 3065 (running) created at:
  testing.(*T).Run()
      GOROOT/src/testing/testing.go:1493 +0x75d
  github.com/cockroachdb/datadriven.Walk()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:424 +0x4fd
  github.com/cockroachdb/cockroach/pkg/configprofiles_test.TestDataDriven()
      github.com/cockroachdb/cockroach/pkg/configprofiles_test/pkg/configprofiles/datadriven_test.go:37 +0x1a4
  testing.tRunner()
      GOROOT/src/testing/testing.go:1446 +0x216
  testing.(*T).Run.func1()
      GOROOT/src/testing/testing.go:1493 +0x47

Goroutine 5970 (running) created at:
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:461 +0x619
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:332 +0xf4c
  github.com/cockroachdb/cockroach/pkg/server.(*channelOrchestrator).startControlledServer()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_channel_orchestrator.go:292 +0x29
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).createServerEntryLocked()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:168 +0x2b0
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).scanTenantsForRunnableServices()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:129 +0x53a
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).start.func1()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:60 +0x21a
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:470 +0x1f6
==================

Parameters: TAGS=bazel,gss,race

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #102800 configprofiles: TestDataDriven failed [C-test-failure O-robot T-multitenant branch-release-23.1] - #102408 configprofiles: TestDataDriven failed [C-test-failure O-robot branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

configprofiles.TestDataDriven failed with artifacts on release-23.1.0 @ 358e0d87912365b8976c55ab9b3292e999cf720d:

      github.com/cockroachdb/cockroach/pkg/configprofiles_test/pkg/configprofiles/datadriven_test.go:64 +0xb92
  github.com/cockroachdb/datadriven.runDirective.func1()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:320 +0xd3
  github.com/cockroachdb/datadriven.runDirective()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:325 +0x84
  github.com/cockroachdb/datadriven.runDirectiveOrSubTest()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:194 +0x92
  github.com/cockroachdb/datadriven.runTestInternal()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:167 +0xc8
  github.com/cockroachdb/datadriven.RunTest()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:135 +0x2f4
  github.com/cockroachdb/cockroach/pkg/configprofiles_test.TestDataDriven.func1()
      github.com/cockroachdb/cockroach/pkg/configprofiles_test/pkg/configprofiles/datadriven_test.go:49 +0x34e
  github.com/cockroachdb/datadriven.Walk()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:412 +0x227
  github.com/cockroachdb/datadriven.Walk.func1()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:425 +0xb9
  testing.tRunner()
      GOROOT/src/testing/testing.go:1446 +0x216
  testing.(*T).Run.func1()
      GOROOT/src/testing/testing.go:1493 +0x47

Goroutine 5967 (running) created at:
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:461 +0x619
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:332 +0xf4c
  github.com/cockroachdb/cockroach/pkg/server.(*channelOrchestrator).startControlledServer()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_channel_orchestrator.go:292 +0x29
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).createServerEntryLocked()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:168 +0x2b0
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).scanTenantsForRunnableServices()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:129 +0x53a
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).start.func1()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:60 +0x21a
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:470 +0x1f6

Goroutine 3077 (running) created at:
  testing.(*T).Run()
      GOROOT/src/testing/testing.go:1493 +0x75d
  github.com/cockroachdb/datadriven.Walk()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:424 +0x4fd
  github.com/cockroachdb/cockroach/pkg/configprofiles_test.TestDataDriven()
      github.com/cockroachdb/cockroach/pkg/configprofiles_test/pkg/configprofiles/datadriven_test.go:37 +0x1a4
  testing.tRunner()
      GOROOT/src/testing/testing.go:1446 +0x216
  testing.(*T).Run.func1()
      GOROOT/src/testing/testing.go:1493 +0x47
==================

Parameters: TAGS=bazel,gss,race

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #102800 configprofiles: TestDataDriven failed [C-test-failure O-robot T-multitenant branch-release-23.1] - #102408 configprofiles: TestDataDriven failed [C-test-failure O-robot branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

configprofiles.TestDataDriven failed with artifacts on release-23.1.0 @ 358e0d87912365b8976c55ab9b3292e999cf720d:

      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:412 +0x227
  github.com/cockroachdb/datadriven.Walk.func1()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:425 +0xb9
  testing.tRunner()
      GOROOT/src/testing/testing.go:1446 +0x216
  testing.(*T).Run.func1()
      GOROOT/src/testing/testing.go:1493 +0x47

Previous read at 0x00c0024bec18 by goroutine 5994:
  github.com/cockroachdb/cockroach/pkg/server.(*Server).makeSharedProcessTenantConfig()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_new_server.go:156 +0xbd
  github.com/cockroachdb/cockroach/pkg/server.(*Server).newTenantServer()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_new_server.go:78 +0x108
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).newServerForOrchestrator()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:257 +0x23c
  github.com/cockroachdb/cockroach/pkg/server.(*channelOrchestrator).startControlledServer.func5.2()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_channel_orchestrator.go:355 +0x12b
  github.com/cockroachdb/cockroach/pkg/server.(*channelOrchestrator).startControlledServer.func5()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_channel_orchestrator.go:379 +0x56a
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:470 +0x1f6

Goroutine 3073 (running) created at:
  testing.(*T).Run()
      GOROOT/src/testing/testing.go:1493 +0x75d
  github.com/cockroachdb/datadriven.Walk()
      github.com/cockroachdb/datadriven/external/com_github_cockroachdb_datadriven/datadriven.go:424 +0x4fd
  github.com/cockroachdb/cockroach/pkg/configprofiles_test.TestDataDriven()
      github.com/cockroachdb/cockroach/pkg/configprofiles_test/pkg/configprofiles/datadriven_test.go:37 +0x1a4
  testing.tRunner()
      GOROOT/src/testing/testing.go:1446 +0x216
  testing.(*T).Run.func1()
      GOROOT/src/testing/testing.go:1493 +0x47

Goroutine 5994 (running) created at:
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:461 +0x619
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:332 +0xf4c
  github.com/cockroachdb/cockroach/pkg/server.(*channelOrchestrator).startControlledServer()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_channel_orchestrator.go:292 +0x29
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).createServerEntryLocked()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:168 +0x2b0
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).scanTenantsForRunnableServices()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:129 +0x53a
  github.com/cockroachdb/cockroach/pkg/server.(*serverController).start.func1()
      github.com/cockroachdb/cockroach/pkg/server/server_controller_orchestration.go:60 +0x21a
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:470 +0x1f6
==================

Parameters: TAGS=bazel,gss,race

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #102800 configprofiles: TestDataDriven failed [C-test-failure O-robot T-multitenant branch-release-23.1] - #102408 configprofiles: TestDataDriven failed [C-test-failure O-robot branch-master]

This test on roachdash | Improve this report!

knz commented 1 year ago

Hasn't failed since May on release-23.1 or master. The test is not disabled. Closing.