configprofiles: TestProfilesValidSQL failed

cockroach-teamcity commented 6 days ago

configprofiles.TestProfilesValidSQL failed with artifacts on release-23.2 @ a1a1bf97dd897f3f93b08ac8382bca2af2fd04d7:

    github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:475 +0x415
Other goroutines holding locks:
goroutine 72 lock 0xc0040e65c0
github.com/cockroachdb/cockroach/pkg/util/admission/grant_coordinator.go:739 admission.(*GrantCoordinator).CPULoad ??? <<<<<
github.com/cockroachdb/cockroach/pkg/util/admission/grant_coordinator.go:738 admission.(*GrantCoordinator).CPULoad ???
github.com/cockroachdb/cockroach/pkg/util/goschedstats/runnable.go:241 goschedstats.(*schedStatsTicker).getStatsOnTick ???
github.com/cockroachdb/cockroach/pkg/util/goschedstats/runnable.go:171 goschedstats.init.0.func1 ???

=== RUN   TestProfilesValidSQL/virtual+app+sharedservice/4/create_an_application_virtual_cluster
    profiles_test.go:61: txn statement: CREATE VIRTUAL CLUSTER application
    profiles_test.go:61: txn statement: ALTER VIRTUAL CLUSTER application START SERVICE SHARED
=== RUN   TestProfilesValidSQL/virtual+app+sharedservice/5/activate_application_virtual_cluster
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING server.controller.default_target_cluster = 'application'
=== RUN   TestProfilesValidSQL/virtual+app+sharedservice+repl/3/use_the_application_virtual_cluster_template_by_default_in_CREATE_VIRTUAL_CLUSTER
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.create_virtual_cluster.default_template = 'template'
=== RUN   TestProfilesValidSQL/virtual+app+sharedservice+repl/5/activate_application_virtual_cluster
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING server.controller.default_target_cluster = 'application'
=== RUN   TestProfilesValidSQL/virtual+app+sharedservice/1/initial_cluster_config
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING trace.redact_at_virtual_cluster_boundary.enabled = false
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs.enabled = true
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs_unrestricted.enabled = true
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.virtual_cluster.feature_access.multiregion.enabled = true
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING spanconfig.range_coalescing.system.enabled = false
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING spanconfig.range_coalescing.application.enabled = false
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.drop_virtual_cluster.enabled = false
=== RUN   TestProfilesValidSQL/virtual+app+sharedservice
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f07519a9a253a7694f6e67cf7554fe40/logTestProfilesValidSQL_virtual+app+sharedservice2531869698
    test_log_scope.go:81: use -show-logs to present logs inline
    profiles_test.go:71: -- test log scope end --
=== RUN   TestProfilesValidSQL/virtual+app+sharedservice+repl/4/create_an_application_virtual_cluster
    profiles_test.go:61: txn statement: CREATE VIRTUAL CLUSTER application
    profiles_test.go:61: txn statement: ALTER VIRTUAL CLUSTER application START SERVICE SHARED
=== RUN   TestProfilesValidSQL/virtual+app+sharedservice+repl/2/create_virtual_cluster_template
    profiles_test.go:61: txn statement: CREATE VIRTUAL CLUSTER template
    profiles_test.go:61: txn statement: ALTER VIRTUAL CLUSTER template GRANT ALL CAPABILITIES
    profiles_test.go:61: txn statement: ALTER VIRTUAL CLUSTER template SET CLUSTER SETTING sql.virtual_cluster.feature_access.manual_range_scatter.enabled = true
    profiles_test.go:61: txn statement: ALTER VIRTUAL CLUSTER template SET CLUSTER SETTING sql.virtual_cluster.feature_access.manual_range_split.enabled = true
=== RUN   TestProfilesValidSQL/virtual+app+sharedservice+repl
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f07519a9a253a7694f6e67cf7554fe40/logTestProfilesValidSQL_virtual+app+sharedservice+repl2787538810
    test_log_scope.go:81: use -show-logs to present logs inline
=== RUN   TestProfilesValidSQL/virtual+app+sharedservice+repl/1/initial_cluster_config
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING trace.redact_at_virtual_cluster_boundary.enabled = false
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs.enabled = true
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs_unrestricted.enabled = true
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.virtual_cluster.feature_access.multiregion.enabled = true
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING spanconfig.range_coalescing.system.enabled = false
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING spanconfig.range_coalescing.application.enabled = false
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.drop_virtual_cluster.enabled = false

Parameters:

TAGS=bazel,gss,deadlock
stress=true
Help

/cc @cockroachdb/server _{This test on roachdash | Improve this report!

Jira issue: CRDB-42170}

rimadeodhar commented 2 days ago

This test has been deleted on master. @stevendanna, is there any value in continuing to maintain this test on 23.2?

cthumuluru-crdb commented 2 days ago

Thanks, @rimadeodhar. Looks like we previously determined it's not a release blocker. Should we consider removing release blocker for this one too?

cockroach-teamcity commented 2 days ago

configprofiles.TestProfilesValidSQL failed with artifacts on release-23.2 @ e1a7cbe2adde82bdbe67c46237f005158c5ecf82:

F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !    github.com/cockroachdb/pebble/external/com_github_cockroachdb_pebble/table_cache.go:383 +0x92
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !created by github.com/cockroachdb/pebble.(*tableCacheShard).init in goroutine 32913
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !    github.com/cockroachdb/pebble/external/com_github_cockroachdb_pebble/table_cache.go:375 +0x19d
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !goroutine 33087 [select]:
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !github.com/cockroachdb/cockroach/pkg/util/admission.(*WorkQueue).startClosingEpochs.func1()
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !    github.com/cockroachdb/cockroach/pkg/util/admission/work_queue.go:502 +0x1cd
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !created by github.com/cockroachdb/cockroach/pkg/util/admission.(*WorkQueue).startClosingEpochs in goroutine 32913
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !    github.com/cockroachdb/cockroach/pkg/util/admission/work_queue.go:473 +0x8e
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !goroutine 33045 [select]:
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !github.com/cockroachdb/cockroach/pkg/util/log.(*fileSink).gcDaemon(0xc0055347e0, {0xd343718, 0xc009210910})
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !    github.com/cockroachdb/cockroach/pkg/util/log/file_log_gc.go:25 +0xd3
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !created by github.com/cockroachdb/cockroach/pkg/util/log.ApplyConfig in goroutine 32913
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !    github.com/cockroachdb/cockroach/pkg/util/log/flags.go:319 +0x1c1a
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !goroutine 33046 [select]:
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !github.com/cockroachdb/pebble/vfs.(*diskHealthCheckingFS).startTickerLocked.func1()
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !    github.com/cockroachdb/pebble/vfs/external/com_github_cockroachdb_pebble/vfs/disk_health.go:566 +0x19e
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !created by github.com/cockroachdb/pebble/vfs.(*diskHealthCheckingFS).startTickerLocked in goroutine 32913
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !    github.com/cockroachdb/pebble/vfs/external/com_github_cockroachdb_pebble/vfs/disk_health.go:555 +0x111
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !goroutine 33047 [select]:
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !github.com/cockroachdb/pebble/vfs.(*diskHealthCheckingFile).startTicker.func1()
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !    github.com/cockroachdb/pebble/vfs/external/com_github_cockroachdb_pebble/vfs/disk_health.go:171 +0x192
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !created by github.com/cockroachdb/pebble/vfs.(*diskHealthCheckingFile).startTicker in goroutine 32913
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !    github.com/cockroachdb/pebble/vfs/external/com_github_cockroachdb_pebble/vfs/disk_health.go:166 +0xad
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !For more context, check log files in: /artifacts/tmp/_tmp/f07519a9a253a7694f6e67cf7554fe40/logTestProfilesValidSQL_virtual+app+sharedservice748731872
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !****************************************************************************
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !This node experienced a fatal error (printed above), and as a result the
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !process is terminating.
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !Fatal errors can occur due to faulty hardware (disks, memory, clocks) or a
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !problem in CockroachDB. With your help, the support team at Cockroach Labs
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !will try to determine the root cause, recommend next steps, and we can
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !improve CockroachDB based on your report.
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !Please submit a crash report by following the instructions here:
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !    https://github.com/cockroachdb/cockroach/issues/new/choose
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !If you would rather not post publicly, please contact us directly at:
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !    support@cockroachlabs.com
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !
F240917 10:09:06.705596 36211 util/cidr/cidr.go:142  [T3,n1] 1 !The Cockroach Labs team appreciates your feedback.

Parameters:

TAGS=bazel,gss
stress=true
Help

_{This test on roachdash | Improve this report!}

cockroach-teamcity commented 2 days ago

configprofiles.TestProfilesValidSQL failed with artifacts on release-23.2 @ e1a7cbe2adde82bdbe67c46237f005158c5ecf82:

F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !goroutine 8427568 [runnable]:
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !github.com/sasha-s/go-deadlock.lock.func1()
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !  github.com/sasha-s/go-deadlock/external/com_github_sasha_s_go_deadlock/deadlock.go:182
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !created by github.com/sasha-s/go-deadlock.lock in goroutine 8427084
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !  github.com/sasha-s/go-deadlock/external/com_github_sasha_s_go_deadlock/deadlock.go:182 +0x154
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !goroutine 7806097 [chan receive]:
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !github.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop.func1({0x7b6a6b0, 0xc010df6c90})
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !  github.com/cockroachdb/pebble/external/com_github_cockroachdb_pebble/table_cache.go:385 +0x94
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !runtime/pprof.Do({0x7b6a528?, 0xbb42be0?}, {{0xc00166b4c0?, 0x0?, 0xc004cb8fd0?}}, 0xc004cb8fa8)
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !  GOROOT/src/runtime/pprof/runtime.go:51 +0x9d
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !github.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop(0xc01b2635e0?)
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !  github.com/cockroachdb/pebble/external/com_github_cockroachdb_pebble/table_cache.go:383 +0x52
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !created by github.com/cockroachdb/pebble.(*tableCacheShard).init in goroutine 7804707
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !  github.com/cockroachdb/pebble/external/com_github_cockroachdb_pebble/table_cache.go:375 +0xe5
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !goroutine 7807514 [chan receive]:
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !github.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop.func1({0x7b6a6b0, 0xc0117e6ea0})
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !  github.com/cockroachdb/pebble/external/com_github_cockroachdb_pebble/table_cache.go:385 +0x94
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !runtime/pprof.Do({0x7b6a528?, 0xbb42be0?}, {{0xc00166b4c0?, 0x12e70e0?, 0xc0033e1fd0?}}, 0xc0033e1fa8)
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !  GOROOT/src/runtime/pprof/runtime.go:51 +0x9d
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !github.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop(0xc0033e1f98?)
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !  github.com/cockroachdb/pebble/external/com_github_cockroachdb_pebble/table_cache.go:383 +0x52
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !created by github.com/cockroachdb/pebble.(*tableCacheShard).init in goroutine 7804707
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !  github.com/cockroachdb/pebble/external/com_github_cockroachdb_pebble/table_cache.go:375 +0xe5
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !For more context, check log files in: /artifacts/tmp/_tmp/f07519a9a253a7694f6e67cf7554fe40/logTestProfilesValidSQL_virtual+app+sharedservice2987099589
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !****************************************************************************
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !This node experienced a fatal error (printed above), and as a result the
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !process is terminating.
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !Fatal errors can occur due to faulty hardware (disks, memory, clocks) or a
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !problem in CockroachDB. With your help, the support team at Cockroach Labs
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !will try to determine the root cause, recommend next steps, and we can
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !improve CockroachDB based on your report.
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !Please submit a crash report by following the instructions here:
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !    https://github.com/cockroachdb/cockroach/issues/new/choose
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !If you would rather not post publicly, please contact us directly at:
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !    support@cockroachlabs.com
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !
F240917 10:10:00.685973 8420251 util/cidr/cidr.go:142  [T3,n1] 1 !The Cockroach Labs team appreciates your feedback.
=== RUN   TestProfilesValidSQL/virtual+noapp+repl/3/use_the_application_virtual_cluster_template_by_default_in_CREATE_VIRTUAL_CLUSTER
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.create_virtual_cluster.default_template = 'template'

Parameters:

TAGS=bazel,gss,deadlock
stress=true
Help

Same failure on other branches

- #130863 configprofiles: TestProfilesValidSQL failed [C-test-failure O-robot T-server-and-security branch-release-23.2.12-rc release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 days ago

configprofiles.TestProfilesValidSQL failed with artifacts on release-23.2 @ e1a7cbe2adde82bdbe67c46237f005158c5ecf82:

F240917 10:10:12.123158 38306 util/cidr/cidr.go:142  [T3,n1] 1 !    github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:484 +0x13a
F240917 10:10:12.123158 38306 util/cidr/cidr.go:142  [T3,n1] 1 !created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 36809
F240917 10:10:12.123158 38306 util/cidr/cidr.go:142  [T3,n1] 1 !    github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:475 +0x415
F240917 10:10:12.123158 38306 util/cidr/cidr.go:142  [T3,n1] 1 !
F240917 10:10:12.123158 38306 util/cidr/cidr.go:142  [T3,n1] 1 !For more context, check log files in: /artifacts/tmp/_tmp/f07519a9a253a7694f6e67cf7554fe40/logTestProfilesValidSQL_virtual+app+sharedservice926614256
F240917 10:10:12.123158 38306 util/cidr/cidr.go:142  [T3,n1] 1 !
F240917 10:10:12.123158 38306 util/cidr/cidr.go:142  [T3,n1] 1 !
F240917 10:10:12.123158 38306 util/cidr/cidr.go:142  [T3,n1] 1 !****************************************************************************
F240917 10:10:12.123158 38306 util/cidr/cidr.go:142  [T3,n1] 1 !
F240917 10:10:12.123158 38306 util/cidr/cidr.go:142  [T3,n1] 1 !This node experienced a fatal error (printed above), and as a result the
F240917 10:10:12.123158 38306 util/cidr/cidr.go:142  [T3,n1] 1 !process is terminating.
F240917 10:10:12.123158 38306 util/cidr/cidr.go:142  [T3,n1] 1 !
F240917 10:10:12.123158 38306 util/cidr/cidr.go:142  [T3,n1] 1 !Fatal errors can occur due to faulty hardware (disks, memory, clocks) or a
F240917 10:10:12.123158 38306 util/cidr/cidr.go:142  [T3,n1] 1 !problem in CockroachDB. With your help, the support team at Cockroach Labs
F240917 10:10:12.123158 38306 util/cidr/cidr.go:142  [T3,n1] 1 !will try to determine the root cause, recommend next steps, and we can
F240917 10:10:12.123158 38306 util/cidr/cidr.go:142  [T3,n1] 1 !improve CockroachDB based on your report.
F240917 10:10:12.123158 38306 util/cidr/cidr.go:142  [T3,n1] 1 !
F240917 10:10:12.123158 38306 util/cidr/cidr.go:142  [T3,n1] 1 !Please submit a crash report by following the instructions here:
F240917 10:10:12.123158 38306 util/cidr/cidr.go:142  [T3,n1] 1 !
F240917 10:10:12.123158 38306 util/cidr/cidr.go:142  [T3,n1] 1 !    https://github.com/cockroachdb/cockroach/issues/new/choose
F240917 10:10:12.123158 38306 util/cidr/cidr.go:142  [T3,n1] 1 !
F240917 10:10:12.123158 38306 util/cidr/cidr.go:142  [T3,n1] 1 !If you would rather not post publicly, please contact us directly at:
F240917 10:10:12.123158 38306 util/cidr/cidr.go:142  [T3,n1] 1 !
F240917 10:10:12.123158 38306 util/cidr/cidr.go:142  [T3,n1] 1 !    support@cockroachlabs.com
F240917 10:10:12.123158 38306 util/cidr/cidr.go:142  [T3,n1] 1 !
F240917 10:10:12.123158 38306 util/cidr/cidr.go:142  [T3,n1] 1 !The Cockroach Labs team appreciates your feedback.
=== RUN   TestProfilesValidSQL/virtual+noapp/1/initial_cluster_config
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING trace.redact_at_virtual_cluster_boundary.enabled = false
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs.enabled = true
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs_unrestricted.enabled = true
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.virtual_cluster.feature_access.multiregion.enabled = true
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING spanconfig.range_coalescing.system.enabled = false
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING spanconfig.range_coalescing.application.enabled = false
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.drop_virtual_cluster.enabled = false
=== RUN   TestProfilesValidSQL/example/1/create_an_example_database
    profiles_test.go:61: txn statement: CREATE DATABASE IF NOT EXISTS example
    profiles_test.go:61: txn statement: CREATE TABLE IF NOT EXISTS example.data AS SELECT 'hello' AS value
=== RUN   TestProfilesValidSQL/virtual+noapp+repl/1/initial_cluster_config
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING trace.redact_at_virtual_cluster_boundary.enabled = false
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs.enabled = true
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs_unrestricted.enabled = true
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.virtual_cluster.feature_access.multiregion.enabled = true
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING spanconfig.range_coalescing.system.enabled = false
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING spanconfig.range_coalescing.application.enabled = false
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.drop_virtual_cluster.enabled = false
=== RUN   TestProfilesValidSQL/virtual+noapp+repl/2/create_virtual_cluster_template
    profiles_test.go:61: txn statement: CREATE VIRTUAL CLUSTER template
    profiles_test.go:61: txn statement: ALTER VIRTUAL CLUSTER template GRANT ALL CAPABILITIES
    profiles_test.go:61: txn statement: ALTER VIRTUAL CLUSTER template SET CLUSTER SETTING sql.virtual_cluster.feature_access.manual_range_scatter.enabled = true
    profiles_test.go:61: txn statement: ALTER VIRTUAL CLUSTER template SET CLUSTER SETTING sql.virtual_cluster.feature_access.manual_range_split.enabled = true

Parameters:

TAGS=bazel,gss
stress=true
Help

Same failure on other branches

- #130863 configprofiles: TestProfilesValidSQL failed [C-test-failure O-robot T-server-and-security branch-release-23.2.12-rc release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 day ago

configprofiles.TestProfilesValidSQL failed with artifacts on release-23.2 @ 5fbe8f17051cfe89d38bfab3e370e0e89919e34a:

F240918 10:12:11.535407 43409 util/cidr/cidr.go:142  [T3,n1] 1 !process is terminating.
F240918 10:12:11.535407 43409 util/cidr/cidr.go:142  [T3,n1] 1 !
F240918 10:12:11.535407 43409 util/cidr/cidr.go:142  [T3,n1] 1 !Fatal errors can occur due to faulty hardware (disks, memory, clocks) or a
F240918 10:12:11.535407 43409 util/cidr/cidr.go:142  [T3,n1] 1 !problem in CockroachDB. With your help, the support team at Cockroach Labs
F240918 10:12:11.535407 43409 util/cidr/cidr.go:142  [T3,n1] 1 !will try to determine the root cause, recommend next steps, and we can
F240918 10:12:11.535407 43409 util/cidr/cidr.go:142  [T3,n1] 1 !improve CockroachDB based on your report.
F240918 10:12:11.535407 43409 util/cidr/cidr.go:142  [T3,n1] 1 !
F240918 10:12:11.535407 43409 util/cidr/cidr.go:142  [T3,n1] 1 !Please submit a crash report by following the instructions here:
F240918 10:12:11.535407 43409 util/cidr/cidr.go:142  [T3,n1] 1 !
F240918 10:12:11.535407 43409 util/cidr/cidr.go:142  [T3,n1] 1 !    https://github.com/cockroachdb/cockroach/issues/new/choose
F240918 10:12:11.535407 43409 util/cidr/cidr.go:142  [T3,n1] 1 !
F240918 10:12:11.535407 43409 util/cidr/cidr.go:142  [T3,n1] 1 !If you would rather not post publicly, please contact us directly at:
F240918 10:12:11.535407 43409 util/cidr/cidr.go:142  [T3,n1] 1 !
F240918 10:12:11.535407 43409 util/cidr/cidr.go:142  [T3,n1] 1 !    support@cockroachlabs.com
F240918 10:12:11.535407 43409 util/cidr/cidr.go:142  [T3,n1] 1 !
F240918 10:12:11.535407 43409 util/cidr/cidr.go:142  [T3,n1] 1 !The Cockroach Labs team appreciates your feedback.
=== RUN   TestProfilesValidSQL/virtual+noapp
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f07519a9a253a7694f6e67cf7554fe40/logTestProfilesValidSQL_virtual+noapp3758301336
    test_log_scope.go:81: use -show-logs to present logs inline
    profiles_test.go:71: -- test log scope end --
=== RUN   TestProfilesValidSQL/virtual+noapp/1/initial_cluster_config
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING trace.redact_at_virtual_cluster_boundary.enabled = false
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs.enabled = true
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs_unrestricted.enabled = true
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.virtual_cluster.feature_access.multiregion.enabled = true
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING spanconfig.range_coalescing.system.enabled = false
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING spanconfig.range_coalescing.application.enabled = false
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.drop_virtual_cluster.enabled = false
=== RUN   TestProfilesValidSQL/virtual+app+sharedservice+repl/5/activate_application_virtual_cluster
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING server.controller.default_target_cluster = 'application'
=== RUN   TestProfilesValidSQL/virtual+app+sharedservice/2/create_virtual_cluster_template
    profiles_test.go:61: txn statement: CREATE VIRTUAL CLUSTER template
    profiles_test.go:61: txn statement: ALTER VIRTUAL CLUSTER template GRANT ALL CAPABILITIES
    profiles_test.go:61: txn statement: ALTER VIRTUAL CLUSTER template SET CLUSTER SETTING sql.virtual_cluster.feature_access.manual_range_scatter.enabled = true
    profiles_test.go:61: txn statement: ALTER VIRTUAL CLUSTER template SET CLUSTER SETTING sql.virtual_cluster.feature_access.manual_range_split.enabled = true
=== RUN   TestProfilesValidSQL/virtual+app+sharedservice/3/use_the_application_virtual_cluster_template_by_default_in_CREATE_VIRTUAL_CLUSTER
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.create_virtual_cluster.default_template = 'template'
=== RUN   TestProfilesValidSQL/virtual+app+sharedservice+repl
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f07519a9a253a7694f6e67cf7554fe40/logTestProfilesValidSQL_virtual+app+sharedservice+repl1625695627
    test_log_scope.go:81: use -show-logs to present logs inline
    profiles_test.go:71: -- test log scope end --
=== RUN   TestProfilesValidSQL/virtual+noapp+repl/3/use_the_application_virtual_cluster_template_by_default_in_CREATE_VIRTUAL_CLUSTER
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.create_virtual_cluster.default_template = 'template'
=== RUN   TestProfilesValidSQL/virtual+app+sharedservice+repl/6/enable_rangefeeds_and_replication
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING kv.rangefeed.enabled = true
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING physical_replication.enabled = true
=== RUN   TestProfilesValidSQL/virtual+noapp+repl
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f07519a9a253a7694f6e67cf7554fe40/logTestProfilesValidSQL_virtual+noapp+repl3971390751
    test_log_scope.go:81: use -show-logs to present logs inline
    profiles_test.go:71: -- test log scope end --

Parameters:

TAGS=bazel,gss
stress=true
Help

Same failure on other branches

- #130863 configprofiles: TestProfilesValidSQL failed [C-test-failure O-robot T-server-and-security branch-release-23.2.12-rc release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 day ago

configprofiles.TestProfilesValidSQL failed with artifacts on release-23.2 @ 5fbe8f17051cfe89d38bfab3e370e0e89919e34a:

F240918 10:18:33.092993 47697 util/cidr/cidr.go:142  [T3,n1] 1 !The Cockroach Labs team appreciates your feedback.
=== RUN   TestProfilesValidSQL/virtual+noapp
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f07519a9a253a7694f6e67cf7554fe40/logTestProfilesValidSQL_virtual+noapp990543095
    test_log_scope.go:81: use -show-logs to present logs inline
    profiles_test.go:71: -- test log scope end --
=== RUN   TestProfilesValidSQL/virtual+noapp+repl/1/initial_cluster_config
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING trace.redact_at_virtual_cluster_boundary.enabled = false
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs.enabled = true
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs_unrestricted.enabled = true
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.virtual_cluster.feature_access.multiregion.enabled = true
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING spanconfig.range_coalescing.system.enabled = false
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING spanconfig.range_coalescing.application.enabled = false
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.drop_virtual_cluster.enabled = false
=== RUN   TestProfilesValidSQL/virtual+noapp+repl/3/use_the_application_virtual_cluster_template_by_default_in_CREATE_VIRTUAL_CLUSTER
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.create_virtual_cluster.default_template = 'template'
=== RUN   TestProfilesValidSQL/virtual+noapp+repl/4/enable_rangefeeds_and_replication
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING kv.rangefeed.enabled = true
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING physical_replication.enabled = true
=== RUN   TestProfilesValidSQL/virtual+noapp/1/initial_cluster_config
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING trace.redact_at_virtual_cluster_boundary.enabled = false
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs.enabled = true
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs_unrestricted.enabled = true
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.virtual_cluster.feature_access.multiregion.enabled = true
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING spanconfig.range_coalescing.system.enabled = false
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING spanconfig.range_coalescing.application.enabled = false
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.drop_virtual_cluster.enabled = false
=== RUN   TestProfilesValidSQL/virtual+noapp/2/create_virtual_cluster_template
    profiles_test.go:61: txn statement: CREATE VIRTUAL CLUSTER template
    profiles_test.go:61: txn statement: ALTER VIRTUAL CLUSTER template GRANT ALL CAPABILITIES
    profiles_test.go:61: txn statement: ALTER VIRTUAL CLUSTER template SET CLUSTER SETTING sql.virtual_cluster.feature_access.manual_range_scatter.enabled = true
    profiles_test.go:61: txn statement: ALTER VIRTUAL CLUSTER template SET CLUSTER SETTING sql.virtual_cluster.feature_access.manual_range_split.enabled = true
=== RUN   TestProfilesValidSQL/virtual+noapp/3/use_the_application_virtual_cluster_template_by_default_in_CREATE_VIRTUAL_CLUSTER
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.create_virtual_cluster.default_template = 'template'
=== RUN   TestProfilesValidSQL/virtual+app+sharedservice/3/use_the_application_virtual_cluster_template_by_default_in_CREATE_VIRTUAL_CLUSTER
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.create_virtual_cluster.default_template = 'template'
=== RUN   TestProfilesValidSQL/virtual+noapp+repl
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f07519a9a253a7694f6e67cf7554fe40/logTestProfilesValidSQL_virtual+noapp+repl748000069
    test_log_scope.go:81: use -show-logs to present logs inline
    profiles_test.go:71: -- test log scope end --
=== RUN   TestProfilesValidSQL/example/1/create_an_example_database
    profiles_test.go:61: txn statement: CREATE DATABASE IF NOT EXISTS example
    profiles_test.go:61: txn statement: CREATE TABLE IF NOT EXISTS example.data AS SELECT 'hello' AS value
=== RUN   TestProfilesValidSQL/virtual+noapp+repl/2/create_virtual_cluster_template
    profiles_test.go:61: txn statement: CREATE VIRTUAL CLUSTER template
    profiles_test.go:61: txn statement: ALTER VIRTUAL CLUSTER template GRANT ALL CAPABILITIES
    profiles_test.go:61: txn statement: ALTER VIRTUAL CLUSTER template SET CLUSTER SETTING sql.virtual_cluster.feature_access.manual_range_scatter.enabled = true
    profiles_test.go:61: txn statement: ALTER VIRTUAL CLUSTER template SET CLUSTER SETTING sql.virtual_cluster.feature_access.manual_range_split.enabled = true
=== RUN   TestProfilesValidSQL/virtual+app+sharedservice/4/create_an_application_virtual_cluster
    profiles_test.go:61: txn statement: CREATE VIRTUAL CLUSTER application
    profiles_test.go:61: txn statement: ALTER VIRTUAL CLUSTER application START SERVICE SHARED

Parameters:

TAGS=bazel,gss
stress=true
Help

Same failure on other branches

- #130863 configprofiles: TestProfilesValidSQL failed [C-test-failure O-robot T-server-and-security branch-release-23.2.12-rc release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 5 hours ago

configprofiles.TestProfilesValidSQL failed with artifacts on release-23.2 @ 5ae18a722f6efad6b8943d2514aed72a6b2e920a:

F240919 10:10:04.510856 40525 util/cidr/cidr.go:142  [T3,n1] 1 !
F240919 10:10:04.510856 40525 util/cidr/cidr.go:142  [T3,n1] 1 !This node experienced a fatal error (printed above), and as a result the
F240919 10:10:04.510856 40525 util/cidr/cidr.go:142  [T3,n1] 1 !process is terminating.
F240919 10:10:04.510856 40525 util/cidr/cidr.go:142  [T3,n1] 1 !
F240919 10:10:04.510856 40525 util/cidr/cidr.go:142  [T3,n1] 1 !Fatal errors can occur due to faulty hardware (disks, memory, clocks) or a
F240919 10:10:04.510856 40525 util/cidr/cidr.go:142  [T3,n1] 1 !problem in CockroachDB. With your help, the support team at Cockroach Labs
F240919 10:10:04.510856 40525 util/cidr/cidr.go:142  [T3,n1] 1 !will try to determine the root cause, recommend next steps, and we can
F240919 10:10:04.510856 40525 util/cidr/cidr.go:142  [T3,n1] 1 !improve CockroachDB based on your report.
F240919 10:10:04.510856 40525 util/cidr/cidr.go:142  [T3,n1] 1 !
F240919 10:10:04.510856 40525 util/cidr/cidr.go:142  [T3,n1] 1 !Please submit a crash report by following the instructions here:
F240919 10:10:04.510856 40525 util/cidr/cidr.go:142  [T3,n1] 1 !
F240919 10:10:04.510856 40525 util/cidr/cidr.go:142  [T3,n1] 1 !    https://github.com/cockroachdb/cockroach/issues/new/choose
F240919 10:10:04.510856 40525 util/cidr/cidr.go:142  [T3,n1] 1 !
F240919 10:10:04.510856 40525 util/cidr/cidr.go:142  [T3,n1] 1 !If you would rather not post publicly, please contact us directly at:
F240919 10:10:04.510856 40525 util/cidr/cidr.go:142  [T3,n1] 1 !
F240919 10:10:04.510856 40525 util/cidr/cidr.go:142  [T3,n1] 1 !    support@cockroachlabs.com
F240919 10:10:04.510856 40525 util/cidr/cidr.go:142  [T3,n1] 1 !
F240919 10:10:04.510856 40525 util/cidr/cidr.go:142  [T3,n1] 1 !The Cockroach Labs team appreciates your feedback.
=== RUN   TestProfilesValidSQL/virtual+app+sharedservice/3/use_the_application_virtual_cluster_template_by_default_in_CREATE_VIRTUAL_CLUSTER
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.create_virtual_cluster.default_template = 'template'
=== RUN   TestProfilesValidSQL/virtual+noapp+repl
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f07519a9a253a7694f6e67cf7554fe40/logTestProfilesValidSQL_virtual+noapp+repl335353025
    test_log_scope.go:81: use -show-logs to present logs inline
    profiles_test.go:71: -- test log scope end --
=== RUN   TestProfilesValidSQL/virtual+noapp/3/use_the_application_virtual_cluster_template_by_default_in_CREATE_VIRTUAL_CLUSTER
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.create_virtual_cluster.default_template = 'template'
=== RUN   TestProfilesValidSQL/virtual+noapp
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f07519a9a253a7694f6e67cf7554fe40/logTestProfilesValidSQL_virtual+noapp687677979
    test_log_scope.go:81: use -show-logs to present logs inline
    profiles_test.go:71: -- test log scope end --
=== RUN   TestProfilesValidSQL/virtual+noapp+repl/2/create_virtual_cluster_template
    profiles_test.go:61: txn statement: CREATE VIRTUAL CLUSTER template
    profiles_test.go:61: txn statement: ALTER VIRTUAL CLUSTER template GRANT ALL CAPABILITIES
    profiles_test.go:61: txn statement: ALTER VIRTUAL CLUSTER template SET CLUSTER SETTING sql.virtual_cluster.feature_access.manual_range_scatter.enabled = true
    profiles_test.go:61: txn statement: ALTER VIRTUAL CLUSTER template SET CLUSTER SETTING sql.virtual_cluster.feature_access.manual_range_split.enabled = true
=== RUN   TestProfilesValidSQL/virtual+noapp+repl/4/enable_rangefeeds_and_replication
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING kv.rangefeed.enabled = true
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING physical_replication.enabled = true
=== RUN   TestProfilesValidSQL/example
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f07519a9a253a7694f6e67cf7554fe40/logTestProfilesValidSQL_example792365853
    test_log_scope.go:81: use -show-logs to present logs inline
    profiles_test.go:71: -- test log scope end --
=== RUN   TestProfilesValidSQL/example/1/create_an_example_database
    profiles_test.go:61: txn statement: CREATE DATABASE IF NOT EXISTS example
    profiles_test.go:61: txn statement: CREATE TABLE IF NOT EXISTS example.data AS SELECT 'hello' AS value
=== RUN   TestProfilesValidSQL/virtual+app+sharedservice/2/create_virtual_cluster_template
    profiles_test.go:61: txn statement: CREATE VIRTUAL CLUSTER template
    profiles_test.go:61: txn statement: ALTER VIRTUAL CLUSTER template GRANT ALL CAPABILITIES
    profiles_test.go:61: txn statement: ALTER VIRTUAL CLUSTER template SET CLUSTER SETTING sql.virtual_cluster.feature_access.manual_range_scatter.enabled = true
    profiles_test.go:61: txn statement: ALTER VIRTUAL CLUSTER template SET CLUSTER SETTING sql.virtual_cluster.feature_access.manual_range_split.enabled = true

Parameters:

TAGS=bazel,gss
stress=true
Help

Same failure on other branches

- #130863 configprofiles: TestProfilesValidSQL failed [C-test-failure O-robot T-server-and-security branch-release-23.2.12-rc release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 5 hours ago

configprofiles.TestProfilesValidSQL failed with artifacts on release-23.2 @ 5ae18a722f6efad6b8943d2514aed72a6b2e920a:

F240919 10:14:07.041060 43420 util/cidr/cidr.go:142  [T3,n1] 1 !
F240919 10:14:07.041060 43420 util/cidr/cidr.go:142  [T3,n1] 1 !Fatal errors can occur due to faulty hardware (disks, memory, clocks) or a
F240919 10:14:07.041060 43420 util/cidr/cidr.go:142  [T3,n1] 1 !problem in CockroachDB. With your help, the support team at Cockroach Labs
F240919 10:14:07.041060 43420 util/cidr/cidr.go:142  [T3,n1] 1 !will try to determine the root cause, recommend next steps, and we can
F240919 10:14:07.041060 43420 util/cidr/cidr.go:142  [T3,n1] 1 !improve CockroachDB based on your report.
F240919 10:14:07.041060 43420 util/cidr/cidr.go:142  [T3,n1] 1 !
F240919 10:14:07.041060 43420 util/cidr/cidr.go:142  [T3,n1] 1 !Please submit a crash report by following the instructions here:
F240919 10:14:07.041060 43420 util/cidr/cidr.go:142  [T3,n1] 1 !
F240919 10:14:07.041060 43420 util/cidr/cidr.go:142  [T3,n1] 1 !    https://github.com/cockroachdb/cockroach/issues/new/choose
F240919 10:14:07.041060 43420 util/cidr/cidr.go:142  [T3,n1] 1 !
F240919 10:14:07.041060 43420 util/cidr/cidr.go:142  [T3,n1] 1 !If you would rather not post publicly, please contact us directly at:
F240919 10:14:07.041060 43420 util/cidr/cidr.go:142  [T3,n1] 1 !
F240919 10:14:07.041060 43420 util/cidr/cidr.go:142  [T3,n1] 1 !    support@cockroachlabs.com
F240919 10:14:07.041060 43420 util/cidr/cidr.go:142  [T3,n1] 1 !
F240919 10:14:07.041060 43420 util/cidr/cidr.go:142  [T3,n1] 1 !The Cockroach Labs team appreciates your feedback.
=== RUN   TestProfilesValidSQL/virtual+noapp+repl
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f07519a9a253a7694f6e67cf7554fe40/logTestProfilesValidSQL_virtual+noapp+repl3786250512
    test_log_scope.go:81: use -show-logs to present logs inline
    profiles_test.go:71: -- test log scope end --
=== RUN   TestProfilesValidSQL/virtual+noapp+repl/3/use_the_application_virtual_cluster_template_by_default_in_CREATE_VIRTUAL_CLUSTER
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.create_virtual_cluster.default_template = 'template'
=== RUN   TestProfilesValidSQL/virtual+noapp/1/initial_cluster_config
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING trace.redact_at_virtual_cluster_boundary.enabled = false
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs.enabled = true
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs_unrestricted.enabled = true
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.virtual_cluster.feature_access.multiregion.enabled = true
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING spanconfig.range_coalescing.system.enabled = false
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING spanconfig.range_coalescing.application.enabled = false
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.drop_virtual_cluster.enabled = false
=== RUN   TestProfilesValidSQL/virtual+app+sharedservice/3/use_the_application_virtual_cluster_template_by_default_in_CREATE_VIRTUAL_CLUSTER
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.create_virtual_cluster.default_template = 'template'
=== RUN   TestProfilesValidSQL/virtual+app+sharedservice/4/create_an_application_virtual_cluster
    profiles_test.go:61: txn statement: CREATE VIRTUAL CLUSTER application
    profiles_test.go:61: txn statement: ALTER VIRTUAL CLUSTER application START SERVICE SHARED
=== RUN   TestProfilesValidSQL/virtual+noapp+repl/4/enable_rangefeeds_and_replication
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING kv.rangefeed.enabled = true
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING physical_replication.enabled = true
=== RUN   TestProfilesValidSQL/virtual+noapp/3/use_the_application_virtual_cluster_template_by_default_in_CREATE_VIRTUAL_CLUSTER
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.create_virtual_cluster.default_template = 'template'
=== RUN   TestProfilesValidSQL/virtual+app+sharedservice
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f07519a9a253a7694f6e67cf7554fe40/logTestProfilesValidSQL_virtual+app+sharedservice1203311379
    test_log_scope.go:81: use -show-logs to present logs inline
=== RUN   TestProfilesValidSQL/virtual+noapp+repl/1/initial_cluster_config
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING trace.redact_at_virtual_cluster_boundary.enabled = false
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs.enabled = true
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs_unrestricted.enabled = true
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.virtual_cluster.feature_access.multiregion.enabled = true
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING spanconfig.range_coalescing.system.enabled = false
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING spanconfig.range_coalescing.application.enabled = false
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.drop_virtual_cluster.enabled = false

Parameters:

TAGS=bazel,gss
stress=true
Help

Same failure on other branches

- #130863 configprofiles: TestProfilesValidSQL failed [C-test-failure O-robot T-server-and-security branch-release-23.2.12-rc release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 5 hours ago

configprofiles.TestProfilesValidSQL failed with artifacts on release-23.2 @ 5ae18a722f6efad6b8943d2514aed72a6b2e920a:

F240919 10:36:47.873629 10744439 util/cidr/cidr.go:142  [T3,n1] 1 ! github.com/cockroachdb/pebble/external/com_github_cockroachdb_pebble/cleaner.go:85 +0x56
F240919 10:36:47.873629 10744439 util/cidr/cidr.go:142  [T3,n1] 1 !created by github.com/cockroachdb/pebble.openCleanupManager in goroutine 10131754
F240919 10:36:47.873629 10744439 util/cidr/cidr.go:142  [T3,n1] 1 ! github.com/cockroachdb/pebble/external/com_github_cockroachdb_pebble/cleaner.go:84 +0x298
F240919 10:36:47.873629 10744439 util/cidr/cidr.go:142  [T3,n1] 1 !
F240919 10:36:47.873629 10744439 util/cidr/cidr.go:142  [T3,n1] 1 !goroutine 10133152 [chan receive]:
F240919 10:36:47.873629 10744439 util/cidr/cidr.go:142  [T3,n1] 1 !github.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop.func1({0x7b6b510, 0xc010637560})
F240919 10:36:47.873629 10744439 util/cidr/cidr.go:142  [T3,n1] 1 ! github.com/cockroachdb/pebble/external/com_github_cockroachdb_pebble/table_cache.go:385 +0x94
F240919 10:36:47.873629 10744439 util/cidr/cidr.go:142  [T3,n1] 1 !runtime/pprof.Do({0x7b6b388?, 0xbb44be0?}, {{0xc0000fad00?, 0x12e70e0?, 0xc0043cefd0?}}, 0xc0043cefa8)
F240919 10:36:47.873629 10744439 util/cidr/cidr.go:142  [T3,n1] 1 ! GOROOT/src/runtime/pprof/runtime.go:51 +0x9d
F240919 10:36:47.873629 10744439 util/cidr/cidr.go:142  [T3,n1] 1 !github.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop(0xc0043cef70?)
F240919 10:36:47.873629 10744439 util/cidr/cidr.go:142  [T3,n1] 1 ! github.com/cockroachdb/pebble/external/com_github_cockroachdb_pebble/table_cache.go:383 +0x52
F240919 10:36:47.873629 10744439 util/cidr/cidr.go:142  [T3,n1] 1 !created by github.com/cockroachdb/pebble.(*tableCacheShard).init in goroutine 10131754
F240919 10:36:47.873629 10744439 util/cidr/cidr.go:142  [T3,n1] 1 ! github.com/cockroachdb/pebble/external/com_github_cockroachdb_pebble/table_cache.go:375 +0xe5
F240919 10:36:47.873629 10744439 util/cidr/cidr.go:142  [T3,n1] 1 !
F240919 10:36:47.873629 10744439 util/cidr/cidr.go:142  [T3,n1] 1 !For more context, check log files in: /artifacts/tmp/_tmp/f07519a9a253a7694f6e67cf7554fe40/logTestProfilesValidSQL_virtual+app+sharedservice3660573321
F240919 10:36:47.873629 10744439 util/cidr/cidr.go:142  [T3,n1] 1 !
F240919 10:36:47.873629 10744439 util/cidr/cidr.go:142  [T3,n1] 1 !
F240919 10:36:47.873629 10744439 util/cidr/cidr.go:142  [T3,n1] 1 !****************************************************************************
F240919 10:36:47.873629 10744439 util/cidr/cidr.go:142  [T3,n1] 1 !
F240919 10:36:47.873629 10744439 util/cidr/cidr.go:142  [T3,n1] 1 !This node experienced a fatal error (printed above), and as a result the
F240919 10:36:47.873629 10744439 util/cidr/cidr.go:142  [T3,n1] 1 !process is terminating.
F240919 10:36:47.873629 10744439 util/cidr/cidr.go:142  [T3,n1] 1 !
F240919 10:36:47.873629 10744439 util/cidr/cidr.go:142  [T3,n1] 1 !Fatal errors can occur due to faulty hardware (disks, memory, clocks) or a
F240919 10:36:47.873629 10744439 util/cidr/cidr.go:142  [T3,n1] 1 !problem in CockroachDB. With your help, the support team at Cockroach Labs
F240919 10:36:47.873629 10744439 util/cidr/cidr.go:142  [T3,n1] 1 !will try to determine the root cause, recommend next steps, and we can
F240919 10:36:47.873629 10744439 util/cidr/cidr.go:142  [T3,n1] 1 !improve CockroachDB based on your report.
F240919 10:36:47.873629 10744439 util/cidr/cidr.go:142  [T3,n1] 1 !
F240919 10:36:47.873629 10744439 util/cidr/cidr.go:142  [T3,n1] 1 !Please submit a crash report by following the instructions here:
F240919 10:36:47.873629 10744439 util/cidr/cidr.go:142  [T3,n1] 1 !
F240919 10:36:47.873629 10744439 util/cidr/cidr.go:142  [T3,n1] 1 !    https://github.com/cockroachdb/cockroach/issues/new/choose
F240919 10:36:47.873629 10744439 util/cidr/cidr.go:142  [T3,n1] 1 !
F240919 10:36:47.873629 10744439 util/cidr/cidr.go:142  [T3,n1] 1 !If you would rather not post publicly, please contact us directly at:
F240919 10:36:47.873629 10744439 util/cidr/cidr.go:142  [T3,n1] 1 !
F240919 10:36:47.873629 10744439 util/cidr/cidr.go:142  [T3,n1] 1 !    support@cockroachlabs.com
F240919 10:36:47.873629 10744439 util/cidr/cidr.go:142  [T3,n1] 1 !
F240919 10:36:47.873629 10744439 util/cidr/cidr.go:142  [T3,n1] 1 !The Cockroach Labs team appreciates your feedback.
=== RUN   TestProfilesValidSQL/virtual+noapp+repl/3/use_the_application_virtual_cluster_template_by_default_in_CREATE_VIRTUAL_CLUSTER
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.create_virtual_cluster.default_template = 'template'
=== RUN   TestProfilesValidSQL/virtual+app+sharedservice+repl/1/initial_cluster_config
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING trace.redact_at_virtual_cluster_boundary.enabled = false
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs.enabled = true
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs_unrestricted.enabled = true
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.virtual_cluster.feature_access.multiregion.enabled = true
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING spanconfig.range_coalescing.system.enabled = false
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING spanconfig.range_coalescing.application.enabled = false
    profiles_test.go:52: non-txn statement: SET CLUSTER SETTING sql.drop_virtual_cluster.enabled = false
=== RUN   TestProfilesValidSQL/virtual+noapp
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f07519a9a253a7694f6e67cf7554fe40/logTestProfilesValidSQL_virtual+noapp2504201909
    test_log_scope.go:81: use -show-logs to present logs inline
    profiles_test.go:71: -- test log scope end --

Parameters:

TAGS=bazel,gss,deadlock
stress=true
Help

Same failure on other branches

- #130863 configprofiles: TestProfilesValidSQL failed [C-test-failure O-robot T-server-and-security branch-release-23.2.12-rc release-blocker]

This test on roachdash | Improve this report!

cockroachdb / cockroach

configprofiles: TestProfilesValidSQL failed #130659