blathers-crl[bot]
commented
10 months ago cc @cockroachdb/disaster-recovery
Open cockroach-teamcity opened 10 months ago
blathers-crl[bot]
commented
10 months ago cc @cockroachdb/disaster-recovery
cockroach-teamcity
commented
10 months ago ccl/backupccl.TestDataDriven_restore_on_fail_or_cancel_fast_drop failed on master @ 097880977a1f5bfb8377afd2a407cdf7ca4fe377:
Fatal error:
panic: test timed out after 14m57s
running tests:
TestDataDriven_restore_on_fail_or_cancel_fast_drop (14m0s)
TestDataDriven_restore_on_fail_or_cancel_fast_drop/restore-cleanup-with-range-tombstones (13m59s)
Stack:
goroutine 814941 [running]:
testing.(*M).startAlarm.func1()
GOROOT/src/testing/testing.go:2259 +0x3b9
created by time.goFunc
GOROOT/src/time/sleep.go:176 +0x2d
```
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:32:
exec-sql [1 args]
SET CLUSTER SETTING sql.gc_job.wait_for_gc.interval = '250ms';
----
datadriven.go:259:
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:36:
exec-sql [1 args]
SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs.enabled = true;
----
datadriven.go:259:
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:40:
exec-sql [1 args]
SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs_unrestricted.enabled = true;
----
datadriven.go:259:
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:48:
exec-sql [1 args]
SET CLUSTER SETTING kv.protectedts.poll_interval = '250ms';
----
datadriven.go:259:
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:52:
exec-sql [0 args]
SET CLUSTER SETTING jobs.debug.pausepoints = 'restore.after_publishing_descriptors';
----
datadriven.go:259:
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:56:
restore [2 args]
RESTORE FROM LATEST IN 'nodelocal://1/cluster_backup';
----
job paused at pausepoint
datadriven.go:259:
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:61:
exec-sql [0 args]
SET CLUSTER SETTING jobs.debug.pausepoints = '';
----
datadriven.go:259:
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:66:
job [1 args]
Parameters:
attempt=1run=30shard=41
stevendanna
commented
10 months ago I recently change this. I probably broke it. I'll look into it.
stevendanna
commented
10 months ago The PR likely at fault here https://github.com/cockroachdb/cockroach/pull/116555 hasn't been backported yet so this likely doesn't need to be a release blocker.
cockroach-teamcity
commented
10 months ago ccl/backupccl.TestDataDriven_restore_on_fail_or_cancel_fast_drop failed on master @ ff291e3ee70eedac50b985860502d2f0b0867003:
Fatal error:
panic: test timed out after 14m57s
running tests:
TestDataDriven_restore_on_fail_or_cancel_fast_drop (14m10s)
TestDataDriven_restore_on_fail_or_cancel_fast_drop/restore-cleanup-with-range-tombstones (14m9s)
Stack:
goroutine 1530045 [running]:
testing.(*M).startAlarm.func1()
GOROOT/src/testing/testing.go:2259 +0x3b9
created by time.goFunc
GOROOT/src/time/sleep.go:176 +0x2d
```
/var/lib/engflow/worker/work/3/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:32:
exec-sql [1 args]
SET CLUSTER SETTING sql.gc_job.wait_for_gc.interval = '250ms';
----
datadriven.go:259:
/var/lib/engflow/worker/work/3/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:36:
exec-sql [1 args]
SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs.enabled = true;
----
datadriven.go:259:
/var/lib/engflow/worker/work/3/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:40:
exec-sql [1 args]
SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs_unrestricted.enabled = true;
----
datadriven.go:259:
/var/lib/engflow/worker/work/3/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:48:
exec-sql [1 args]
SET CLUSTER SETTING kv.protectedts.poll_interval = '250ms';
----
datadriven.go:259:
/var/lib/engflow/worker/work/3/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:52:
exec-sql [0 args]
SET CLUSTER SETTING jobs.debug.pausepoints = 'restore.after_publishing_descriptors';
----
datadriven.go:259:
/var/lib/engflow/worker/work/3/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:56:
restore [2 args]
RESTORE FROM LATEST IN 'nodelocal://1/cluster_backup';
----
job paused at pausepoint
datadriven.go:259:
/var/lib/engflow/worker/work/3/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:61:
exec-sql [0 args]
SET CLUSTER SETTING jobs.debug.pausepoints = '';
----
datadriven.go:259:
/var/lib/engflow/worker/work/3/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:66:
job [1 args]
Parameters:
attempt=1run=4shard=41
cockroach-teamcity
commented
10 months ago ccl/backupccl.TestDataDriven_restore_on_fail_or_cancel_fast_drop failed on master @ d2d974202781321ddb4fb1115c68fe7566ab9d06:
Fatal error:
panic: test timed out after 14m57s
running tests:
TestDataDriven_restore_on_fail_or_cancel_fast_drop (14m12s)
TestDataDriven_restore_on_fail_or_cancel_fast_drop/restore-cleanup-with-range-tombstones (14m12s)
Stack:
goroutine 1575116 [running]:
testing.(*M).startAlarm.func1()
GOROOT/src/testing/testing.go:2259 +0x3b9
created by time.goFunc
GOROOT/src/time/sleep.go:176 +0x2d
```
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:32:
exec-sql [1 args]
SET CLUSTER SETTING sql.gc_job.wait_for_gc.interval = '250ms';
----
datadriven.go:259:
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:36:
exec-sql [1 args]
SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs.enabled = true;
----
datadriven.go:259:
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:40:
exec-sql [1 args]
SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs_unrestricted.enabled = true;
----
datadriven.go:259:
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:48:
exec-sql [1 args]
SET CLUSTER SETTING kv.protectedts.poll_interval = '250ms';
----
datadriven.go:259:
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:52:
exec-sql [0 args]
SET CLUSTER SETTING jobs.debug.pausepoints = 'restore.after_publishing_descriptors';
----
datadriven.go:259:
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:56:
restore [2 args]
RESTORE FROM LATEST IN 'nodelocal://1/cluster_backup';
----
job paused at pausepoint
datadriven.go:259:
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:61:
exec-sql [0 args]
SET CLUSTER SETTING jobs.debug.pausepoints = '';
----
datadriven.go:259:
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:66:
job [1 args]
Parameters:
attempt=1run=1shard=42
cockroach-teamcity
commented
10 months ago ccl/backupccl.TestDataDriven_restore_on_fail_or_cancel_fast_drop failed on master @ 53e4efd389167110d687e5dea8bf915fe2582a25:
Fatal error:
panic: test timed out after 14m57s
running tests:
TestDataDriven_restore_on_fail_or_cancel_fast_drop (14m9s)
TestDataDriven_restore_on_fail_or_cancel_fast_drop/restore-cleanup-with-range-tombstones (14m9s)
Stack:
goroutine 1577006 [running]:
testing.(*M).startAlarm.func1()
GOROOT/src/testing/testing.go:2259 +0x3b9
created by time.goFunc
GOROOT/src/time/sleep.go:176 +0x2d
```
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:32:
exec-sql [1 args]
SET CLUSTER SETTING sql.gc_job.wait_for_gc.interval = '250ms';
----
datadriven.go:259:
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:36:
exec-sql [1 args]
SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs.enabled = true;
----
datadriven.go:259:
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:40:
exec-sql [1 args]
SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs_unrestricted.enabled = true;
----
datadriven.go:259:
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:48:
exec-sql [1 args]
SET CLUSTER SETTING kv.protectedts.poll_interval = '250ms';
----
datadriven.go:259:
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:52:
exec-sql [0 args]
SET CLUSTER SETTING jobs.debug.pausepoints = 'restore.after_publishing_descriptors';
----
datadriven.go:259:
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:56:
restore [2 args]
RESTORE FROM LATEST IN 'nodelocal://1/cluster_backup';
----
job paused at pausepoint
datadriven.go:259:
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:61:
exec-sql [0 args]
SET CLUSTER SETTING jobs.debug.pausepoints = '';
----
datadriven.go:259:
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:66:
job [1 args]
Parameters:
attempt=1run=30shard=42
cockroach-teamcity
commented
10 months ago ccl/backupccl.TestDataDriven_restore_on_fail_or_cancel_fast_drop failed on master @ 53e4efd389167110d687e5dea8bf915fe2582a25:
Fatal error:
panic: test timed out after 14m57s
running tests:
TestDataDriven_restore_on_fail_or_cancel_fast_drop (14m8s)
TestDataDriven_restore_on_fail_or_cancel_fast_drop/restore-cleanup-with-range-tombstones (14m7s)
Stack:
goroutine 2226917 [running]:
testing.(*M).startAlarm.func1()
GOROOT/src/testing/testing.go:2259 +0x3b9
created by time.goFunc
GOROOT/src/time/sleep.go:176 +0x2d
```
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:32:
exec-sql [1 args]
SET CLUSTER SETTING sql.gc_job.wait_for_gc.interval = '250ms';
----
datadriven.go:259:
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:36:
exec-sql [1 args]
SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs.enabled = true;
----
datadriven.go:259:
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:40:
exec-sql [1 args]
SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs_unrestricted.enabled = true;
----
datadriven.go:259:
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:48:
exec-sql [1 args]
SET CLUSTER SETTING kv.protectedts.poll_interval = '250ms';
----
datadriven.go:259:
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:52:
exec-sql [0 args]
SET CLUSTER SETTING jobs.debug.pausepoints = 'restore.after_publishing_descriptors';
----
datadriven.go:259:
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:56:
restore [2 args]
RESTORE FROM LATEST IN 'nodelocal://1/cluster_backup';
----
job paused at pausepoint
datadriven.go:259:
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:61:
exec-sql [0 args]
SET CLUSTER SETTING jobs.debug.pausepoints = '';
----
datadriven.go:259:
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:66:
job [1 args]
Parameters:
attempt=1run=8shard=42
cockroach-teamcity
commented
10 months ago ccl/backupccl.TestDataDriven_restore_on_fail_or_cancel_fast_drop failed on master @ 53e4efd389167110d687e5dea8bf915fe2582a25:
Fatal error:
panic: test timed out after 14m57s
running tests:
TestDataDriven_restore_on_fail_or_cancel_fast_drop (14m12s)
TestDataDriven_restore_on_fail_or_cancel_fast_drop/restore-cleanup-with-range-tombstones (14m11s)
Stack:
goroutine 2366160 [running]:
testing.(*M).startAlarm.func1()
GOROOT/src/testing/testing.go:2259 +0x3b9
created by time.goFunc
GOROOT/src/time/sleep.go:176 +0x2d
```
/var/lib/engflow/worker/work/3/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:32:
exec-sql [1 args]
SET CLUSTER SETTING sql.gc_job.wait_for_gc.interval = '250ms';
----
datadriven.go:259:
/var/lib/engflow/worker/work/3/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:36:
exec-sql [1 args]
SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs.enabled = true;
----
datadriven.go:259:
/var/lib/engflow/worker/work/3/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:40:
exec-sql [1 args]
SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs_unrestricted.enabled = true;
----
datadriven.go:259:
/var/lib/engflow/worker/work/3/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:48:
exec-sql [1 args]
SET CLUSTER SETTING kv.protectedts.poll_interval = '250ms';
----
datadriven.go:259:
/var/lib/engflow/worker/work/3/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:52:
exec-sql [0 args]
SET CLUSTER SETTING jobs.debug.pausepoints = 'restore.after_publishing_descriptors';
----
datadriven.go:259:
/var/lib/engflow/worker/work/3/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:56:
restore [2 args]
RESTORE FROM LATEST IN 'nodelocal://1/cluster_backup';
----
job paused at pausepoint
datadriven.go:259:
/var/lib/engflow/worker/work/3/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:61:
exec-sql [0 args]
SET CLUSTER SETTING jobs.debug.pausepoints = '';
----
datadriven.go:259:
/var/lib/engflow/worker/work/3/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:66:
job [1 args]
Parameters:
attempt=1run=14shard=42
cockroach-teamcity
commented
10 months ago ccl/backupccl.TestDataDriven_restore_on_fail_or_cancel_fast_drop failed on master @ 53e4efd389167110d687e5dea8bf915fe2582a25:
Fatal error:
panic: test timed out after 14m57s
running tests:
TestDataDriven_restore_on_fail_or_cancel_fast_drop (14m0s)
TestDataDriven_restore_on_fail_or_cancel_fast_drop/restore-cleanup-with-range-tombstones (14m0s)
Stack:
goroutine 1192379 [running]:
testing.(*M).startAlarm.func1()
GOROOT/src/testing/testing.go:2259 +0x3b9
created by time.goFunc
GOROOT/src/time/sleep.go:176 +0x2d
```
/var/lib/engflow/worker/work/3/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:32:
exec-sql [1 args]
SET CLUSTER SETTING sql.gc_job.wait_for_gc.interval = '250ms';
----
datadriven.go:259:
/var/lib/engflow/worker/work/3/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:36:
exec-sql [1 args]
SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs.enabled = true;
----
datadriven.go:259:
/var/lib/engflow/worker/work/3/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:40:
exec-sql [1 args]
SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs_unrestricted.enabled = true;
----
datadriven.go:259:
/var/lib/engflow/worker/work/3/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:48:
exec-sql [1 args]
SET CLUSTER SETTING kv.protectedts.poll_interval = '250ms';
----
datadriven.go:259:
/var/lib/engflow/worker/work/3/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:52:
exec-sql [0 args]
SET CLUSTER SETTING jobs.debug.pausepoints = 'restore.after_publishing_descriptors';
----
datadriven.go:259:
/var/lib/engflow/worker/work/3/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:56:
restore [2 args]
RESTORE FROM LATEST IN 'nodelocal://1/cluster_backup';
----
job paused at pausepoint
datadriven.go:259:
/var/lib/engflow/worker/work/3/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:61:
exec-sql [0 args]
SET CLUSTER SETTING jobs.debug.pausepoints = '';
----
datadriven.go:259:
/var/lib/engflow/worker/work/3/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:66:
job [1 args]
Parameters:
attempt=1run=29shard=42
cockroach-teamcity
commented
9 months ago ccl/backupccl.TestDataDriven_restore_on_fail_or_cancel_fast_drop failed on master @ 4f31fbae529e459c00ef2490e193c0c246e8d0f9:
Fatal error:
panic: test timed out after 14m57s
running tests:
TestDataDriven_restore_on_fail_or_cancel_fast_drop (14m9s)
TestDataDriven_restore_on_fail_or_cancel_fast_drop/restore-cleanup-with-range-tombstones (14m8s)
Stack:
goroutine 809232 [running]:
testing.(*M).startAlarm.func1()
GOROOT/src/testing/testing.go:2259 +0x3b9
created by time.goFunc
GOROOT/src/time/sleep.go:176 +0x2d
```
/var/lib/engflow/worker/work/1/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:32:
exec-sql [1 args]
SET CLUSTER SETTING sql.gc_job.wait_for_gc.interval = '250ms';
----
datadriven.go:259:
/var/lib/engflow/worker/work/1/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:36:
exec-sql [1 args]
SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs.enabled = true;
----
datadriven.go:259:
/var/lib/engflow/worker/work/1/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:40:
exec-sql [1 args]
SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs_unrestricted.enabled = true;
----
datadriven.go:259:
/var/lib/engflow/worker/work/1/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:48:
exec-sql [1 args]
SET CLUSTER SETTING kv.protectedts.poll_interval = '250ms';
----
datadriven.go:259:
/var/lib/engflow/worker/work/1/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:52:
exec-sql [0 args]
SET CLUSTER SETTING jobs.debug.pausepoints = 'restore.after_publishing_descriptors';
----
datadriven.go:259:
/var/lib/engflow/worker/work/1/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:56:
restore [2 args]
RESTORE FROM LATEST IN 'nodelocal://1/cluster_backup';
----
job paused at pausepoint
datadriven.go:259:
/var/lib/engflow/worker/work/1/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:61:
exec-sql [0 args]
SET CLUSTER SETTING jobs.debug.pausepoints = '';
----
datadriven.go:259:
/var/lib/engflow/worker/work/1/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:66:
job [1 args]
Parameters:
attempt=1run=10shard=42
cockroach-teamcity
commented
9 months ago ccl/backupccl.TestDataDriven_restore_on_fail_or_cancel_fast_drop failed on master @ 57bd0a92676b1c58ee7e29979ce3dceb5837abdb:
Fatal error:
panic: test timed out after 14m57s
running tests:
TestDataDriven_restore_on_fail_or_cancel_fast_drop (14m10s)
TestDataDriven_restore_on_fail_or_cancel_fast_drop/restore-cleanup-with-range-tombstones (14m9s)
Stack:
goroutine 765564 [running]:
testing.(*M).startAlarm.func1()
GOROOT/src/testing/testing.go:2259 +0x3b9
created by time.goFunc
GOROOT/src/time/sleep.go:176 +0x2d
```
/var/lib/engflow/worker/work/3/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:32:
exec-sql [1 args]
SET CLUSTER SETTING sql.gc_job.wait_for_gc.interval = '250ms';
----
datadriven.go:259:
/var/lib/engflow/worker/work/3/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:36:
exec-sql [1 args]
SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs.enabled = true;
----
datadriven.go:259:
/var/lib/engflow/worker/work/3/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:40:
exec-sql [1 args]
SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs_unrestricted.enabled = true;
----
datadriven.go:259:
/var/lib/engflow/worker/work/3/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:48:
exec-sql [1 args]
SET CLUSTER SETTING kv.protectedts.poll_interval = '250ms';
----
datadriven.go:259:
/var/lib/engflow/worker/work/3/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:52:
exec-sql [0 args]
SET CLUSTER SETTING jobs.debug.pausepoints = 'restore.after_publishing_descriptors';
----
datadriven.go:259:
/var/lib/engflow/worker/work/3/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:56:
restore [2 args]
RESTORE FROM LATEST IN 'nodelocal://1/cluster_backup';
----
job paused at pausepoint
datadriven.go:259:
/var/lib/engflow/worker/work/3/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:61:
exec-sql [0 args]
SET CLUSTER SETTING jobs.debug.pausepoints = '';
----
datadriven.go:259:
/var/lib/engflow/worker/work/3/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:66:
job [1 args]
Parameters:
attempt=1run=21shard=42
cockroach-teamcity
commented
9 months ago ccl/backupccl.TestDataDriven_restore_on_fail_or_cancel_fast_drop failed on master @ c316d6a615fa02a05357a20bf03b8a197ab27810:
Fatal error:
panic: test timed out after 14m57s
running tests:
TestDataDriven_restore_on_fail_or_cancel_fast_drop (14m10s)
TestDataDriven_restore_on_fail_or_cancel_fast_drop/restore-cleanup-with-range-tombstones (14m9s)
Stack:
goroutine 1503747 [running]:
testing.(*M).startAlarm.func1()
GOROOT/src/testing/testing.go:2259 +0x3b9
created by time.goFunc
GOROOT/src/time/sleep.go:176 +0x2d
```
/var/lib/engflow/worker/work/1/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:32:
exec-sql [1 args]
SET CLUSTER SETTING sql.gc_job.wait_for_gc.interval = '250ms';
----
datadriven.go:259:
/var/lib/engflow/worker/work/1/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:36:
exec-sql [1 args]
SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs.enabled = true;
----
datadriven.go:259:
/var/lib/engflow/worker/work/1/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:40:
exec-sql [1 args]
SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs_unrestricted.enabled = true;
----
datadriven.go:259:
/var/lib/engflow/worker/work/1/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:48:
exec-sql [1 args]
SET CLUSTER SETTING kv.protectedts.poll_interval = '250ms';
----
datadriven.go:259:
/var/lib/engflow/worker/work/1/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:52:
exec-sql [0 args]
SET CLUSTER SETTING jobs.debug.pausepoints = 'restore.after_publishing_descriptors';
----
datadriven.go:259:
/var/lib/engflow/worker/work/1/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:56:
restore [2 args]
RESTORE FROM LATEST IN 'nodelocal://1/cluster_backup';
----
job paused at pausepoint
datadriven.go:259:
/var/lib/engflow/worker/work/1/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:61:
exec-sql [0 args]
SET CLUSTER SETTING jobs.debug.pausepoints = '';
----
datadriven.go:259:
/var/lib/engflow/worker/work/1/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:66:
job [1 args]
Parameters:
attempt=1run=25shard=42
cockroach-teamcity
commented
9 months ago ccl/backupccl.TestDataDriven_restore_on_fail_or_cancel_fast_drop failed on master @ c316d6a615fa02a05357a20bf03b8a197ab27810:
Fatal error:
panic: test timed out after 14m57s
running tests:
TestDataDriven_restore_on_fail_or_cancel_fast_drop (14m9s)
TestDataDriven_restore_on_fail_or_cancel_fast_drop/restore-cleanup-with-range-tombstones (14m8s)
Stack:
goroutine 1104491 [running]:
testing.(*M).startAlarm.func1()
GOROOT/src/testing/testing.go:2259 +0x3b9
created by time.goFunc
GOROOT/src/time/sleep.go:176 +0x2d
```
/var/lib/engflow/worker/work/3/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:32:
exec-sql [1 args]
SET CLUSTER SETTING sql.gc_job.wait_for_gc.interval = '250ms';
----
datadriven.go:259:
/var/lib/engflow/worker/work/3/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:36:
exec-sql [1 args]
SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs.enabled = true;
----
datadriven.go:259:
/var/lib/engflow/worker/work/3/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:40:
exec-sql [1 args]
SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs_unrestricted.enabled = true;
----
datadriven.go:259:
/var/lib/engflow/worker/work/3/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:48:
exec-sql [1 args]
SET CLUSTER SETTING kv.protectedts.poll_interval = '250ms';
----
datadriven.go:259:
/var/lib/engflow/worker/work/3/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:52:
exec-sql [0 args]
SET CLUSTER SETTING jobs.debug.pausepoints = 'restore.after_publishing_descriptors';
----
datadriven.go:259:
/var/lib/engflow/worker/work/3/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:56:
restore [2 args]
RESTORE FROM LATEST IN 'nodelocal://1/cluster_backup';
----
job paused at pausepoint
datadriven.go:259:
/var/lib/engflow/worker/work/3/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:61:
exec-sql [0 args]
SET CLUSTER SETTING jobs.debug.pausepoints = '';
----
datadriven.go:259:
/var/lib/engflow/worker/work/3/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:66:
job [1 args]
Parameters:
attempt=1run=18shard=42
cockroach-teamcity
commented
9 months ago ccl/backupccl.TestDataDriven_restore_on_fail_or_cancel_fast_drop failed on master @ c316d6a615fa02a05357a20bf03b8a197ab27810:
Fatal error:
panic: test timed out after 14m57s
running tests:
TestDataDriven_restore_on_fail_or_cancel_fast_drop (14m8s)
TestDataDriven_restore_on_fail_or_cancel_fast_drop/restore-cleanup-with-range-tombstones (14m7s)
Stack:
goroutine 2174414 [running]:
testing.(*M).startAlarm.func1()
GOROOT/src/testing/testing.go:2259 +0x3b9
created by time.goFunc
GOROOT/src/time/sleep.go:176 +0x2d
```
/var/lib/engflow/worker/work/0/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:32:
exec-sql [1 args]
SET CLUSTER SETTING sql.gc_job.wait_for_gc.interval = '250ms';
----
datadriven.go:259:
/var/lib/engflow/worker/work/0/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:36:
exec-sql [1 args]
SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs.enabled = true;
----
datadriven.go:259:
/var/lib/engflow/worker/work/0/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:40:
exec-sql [1 args]
SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs_unrestricted.enabled = true;
----
datadriven.go:259:
/var/lib/engflow/worker/work/0/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:48:
exec-sql [1 args]
SET CLUSTER SETTING kv.protectedts.poll_interval = '250ms';
----
datadriven.go:259:
/var/lib/engflow/worker/work/0/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:52:
exec-sql [0 args]
SET CLUSTER SETTING jobs.debug.pausepoints = 'restore.after_publishing_descriptors';
----
datadriven.go:259:
/var/lib/engflow/worker/work/0/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:56:
restore [2 args]
RESTORE FROM LATEST IN 'nodelocal://1/cluster_backup';
----
job paused at pausepoint
datadriven.go:259:
/var/lib/engflow/worker/work/0/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:61:
exec-sql [0 args]
SET CLUSTER SETTING jobs.debug.pausepoints = '';
----
datadriven.go:259:
/var/lib/engflow/worker/work/0/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:66:
job [1 args]
Parameters:
attempt=1run=20shard=42
cockroach-teamcity
commented
9 months ago ccl/backupccl.TestDataDriven_restore_on_fail_or_cancel_fast_drop failed on master @ c316d6a615fa02a05357a20bf03b8a197ab27810:
Fatal error:
panic: test timed out after 14m57s
running tests:
TestDataDriven_restore_on_fail_or_cancel_fast_drop (14m15s)
TestDataDriven_restore_on_fail_or_cancel_fast_drop/restore-cleanup-with-range-tombstones (14m14s)
Stack:
goroutine 1120816 [running]:
testing.(*M).startAlarm.func1()
GOROOT/src/testing/testing.go:2259 +0x3b9
created by time.goFunc
GOROOT/src/time/sleep.go:176 +0x2d
```
/var/lib/engflow/worker/work/1/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:32:
exec-sql [1 args]
SET CLUSTER SETTING sql.gc_job.wait_for_gc.interval = '250ms';
----
datadriven.go:259:
/var/lib/engflow/worker/work/1/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:36:
exec-sql [1 args]
SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs.enabled = true;
----
datadriven.go:259:
/var/lib/engflow/worker/work/1/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:40:
exec-sql [1 args]
SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs_unrestricted.enabled = true;
----
datadriven.go:259:
/var/lib/engflow/worker/work/1/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:48:
exec-sql [1 args]
SET CLUSTER SETTING kv.protectedts.poll_interval = '250ms';
----
datadriven.go:259:
/var/lib/engflow/worker/work/1/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:52:
exec-sql [0 args]
SET CLUSTER SETTING jobs.debug.pausepoints = 'restore.after_publishing_descriptors';
----
datadriven.go:259:
/var/lib/engflow/worker/work/1/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:56:
restore [2 args]
RESTORE FROM LATEST IN 'nodelocal://1/cluster_backup';
----
job paused at pausepoint
datadriven.go:259:
/var/lib/engflow/worker/work/1/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:61:
exec-sql [0 args]
SET CLUSTER SETTING jobs.debug.pausepoints = '';
----
datadriven.go:259:
/var/lib/engflow/worker/work/1/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:66:
job [1 args]
Parameters:
attempt=1run=2shard=42
cockroach-teamcity
commented
9 months ago ccl/backupccl.TestDataDriven_restore_on_fail_or_cancel_fast_drop failed on master @ c316d6a615fa02a05357a20bf03b8a197ab27810:
Fatal error:
panic: test timed out after 14m57s
running tests:
TestDataDriven_restore_on_fail_or_cancel_fast_drop (14m18s)
TestDataDriven_restore_on_fail_or_cancel_fast_drop/restore-cleanup-with-range-tombstones (14m17s)
Stack:
goroutine 843859 [running]:
testing.(*M).startAlarm.func1()
GOROOT/src/testing/testing.go:2259 +0x3b9
created by time.goFunc
GOROOT/src/time/sleep.go:176 +0x2d
```
/var/lib/engflow/worker/work/0/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:32:
exec-sql [1 args]
SET CLUSTER SETTING sql.gc_job.wait_for_gc.interval = '250ms';
----
datadriven.go:259:
/var/lib/engflow/worker/work/0/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:36:
exec-sql [1 args]
SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs.enabled = true;
----
datadriven.go:259:
/var/lib/engflow/worker/work/0/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:40:
exec-sql [1 args]
SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs_unrestricted.enabled = true;
----
datadriven.go:259:
/var/lib/engflow/worker/work/0/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:48:
exec-sql [1 args]
SET CLUSTER SETTING kv.protectedts.poll_interval = '250ms';
----
datadriven.go:259:
/var/lib/engflow/worker/work/0/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:52:
exec-sql [0 args]
SET CLUSTER SETTING jobs.debug.pausepoints = 'restore.after_publishing_descriptors';
----
datadriven.go:259:
/var/lib/engflow/worker/work/0/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:56:
restore [2 args]
RESTORE FROM LATEST IN 'nodelocal://1/cluster_backup';
----
job paused at pausepoint
datadriven.go:259:
/var/lib/engflow/worker/work/0/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:61:
exec-sql [0 args]
SET CLUSTER SETTING jobs.debug.pausepoints = '';
----
datadriven.go:259:
/var/lib/engflow/worker/work/0/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:66:
job [1 args]
Parameters:
attempt=1run=22shard=42
cockroach-teamcity
commented
9 months ago ccl/backupccl.TestDataDriven_restore_on_fail_or_cancel_fast_drop failed with artifacts on master @ a8d806658ae8118e7aca4cd5d1810b5fdc45b15c:
Fatal error:
panic: test timed out after 14m57s
running tests:
TestDataDriven_restore_on_fail_or_cancel_fast_drop (13m56s)
TestDataDriven_restore_on_fail_or_cancel_fast_drop/restore-cleanup-with-range-tombstones (13m54s)
Stack:
goroutine 4063118 [running]:
testing.(*M).startAlarm.func1()
GOROOT/src/testing/testing.go:2259 +0x3b9
created by time.goFunc
GOROOT/src/time/sleep.go:176 +0x2d
```
/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/5389/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:32:
exec-sql [1 args]
SET CLUSTER SETTING sql.gc_job.wait_for_gc.interval = '250ms';
----
datadriven.go:259:
/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/5389/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:36:
exec-sql [1 args]
SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs.enabled = true;
----
datadriven.go:259:
/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/5389/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:40:
exec-sql [1 args]
SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs_unrestricted.enabled = true;
----
datadriven.go:259:
/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/5389/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:48:
exec-sql [1 args]
SET CLUSTER SETTING kv.protectedts.poll_interval = '250ms';
----
datadriven.go:259:
/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/5389/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:52:
exec-sql [0 args]
SET CLUSTER SETTING jobs.debug.pausepoints = 'restore.after_publishing_descriptors';
----
datadriven.go:259:
/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/5389/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:56:
restore [2 args]
RESTORE FROM LATEST IN 'nodelocal://1/cluster_backup';
----
job paused at pausepoint
datadriven.go:259:
/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/5389/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:61:
exec-sql [0 args]
SET CLUSTER SETTING jobs.debug.pausepoints = '';
----
datadriven.go:259:
/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/5389/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:66:
job [1 args]
See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)
cockroach-teamcity
commented
9 months ago ccl/backupccl.TestDataDriven_restore_on_fail_or_cancel_fast_drop failed on master @ a8d806658ae8118e7aca4cd5d1810b5fdc45b15c:
Fatal error:
panic: test timed out after 14m57s
running tests:
TestDataDriven_restore_on_fail_or_cancel_fast_drop (14m19s)
TestDataDriven_restore_on_fail_or_cancel_fast_drop/restore-cleanup-with-range-tombstones (14m18s)
Stack:
goroutine 730808 [running]:
testing.(*M).startAlarm.func1()
GOROOT/src/testing/testing.go:2259 +0x3b9
created by time.goFunc
GOROOT/src/time/sleep.go:176 +0x2d
```
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:32:
exec-sql [1 args]
SET CLUSTER SETTING sql.gc_job.wait_for_gc.interval = '250ms';
----
datadriven.go:259:
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:36:
exec-sql [1 args]
SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs.enabled = true;
----
datadriven.go:259:
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:40:
exec-sql [1 args]
SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs_unrestricted.enabled = true;
----
datadriven.go:259:
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:48:
exec-sql [1 args]
SET CLUSTER SETTING kv.protectedts.poll_interval = '250ms';
----
datadriven.go:259:
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:52:
exec-sql [0 args]
SET CLUSTER SETTING jobs.debug.pausepoints = 'restore.after_publishing_descriptors';
----
datadriven.go:259:
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:56:
restore [2 args]
RESTORE FROM LATEST IN 'nodelocal://1/cluster_backup';
----
job paused at pausepoint
datadriven.go:259:
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:61:
exec-sql [0 args]
SET CLUSTER SETTING jobs.debug.pausepoints = '';
----
datadriven.go:259:
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:66:
job [1 args]
Parameters:
attempt=1run=12shard=42
cockroach-teamcity
commented
9 months ago ccl/backupccl.TestDataDriven_restore_on_fail_or_cancel_fast_drop failed with artifacts on master @ f2917d82b235db6fda145a932050e5a58f957b9f:
Fatal error:
panic: test timed out after 14m57s
running tests:
TestDataDriven_restore_on_fail_or_cancel_fast_drop (13m56s)
TestDataDriven_restore_on_fail_or_cancel_fast_drop/restore-cleanup-with-range-tombstones (13m54s)
Stack:
goroutine 4055793 [running]:
testing.(*M).startAlarm.func1()
GOROOT/src/testing/testing.go:2259 +0x3b9
created by time.goFunc
GOROOT/src/time/sleep.go:176 +0x2d
```
/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/5410/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:32:
exec-sql [1 args]
SET CLUSTER SETTING sql.gc_job.wait_for_gc.interval = '250ms';
----
datadriven.go:259:
/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/5410/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:36:
exec-sql [1 args]
SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs.enabled = true;
----
datadriven.go:259:
/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/5410/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:40:
exec-sql [1 args]
SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs_unrestricted.enabled = true;
----
datadriven.go:259:
/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/5410/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:48:
exec-sql [1 args]
SET CLUSTER SETTING kv.protectedts.poll_interval = '250ms';
----
datadriven.go:259:
/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/5410/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:52:
exec-sql [0 args]
SET CLUSTER SETTING jobs.debug.pausepoints = 'restore.after_publishing_descriptors';
----
datadriven.go:259:
/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/5410/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:56:
restore [2 args]
RESTORE FROM LATEST IN 'nodelocal://1/cluster_backup';
----
job paused at pausepoint
datadriven.go:259:
/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/5410/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:61:
exec-sql [0 args]
SET CLUSTER SETTING jobs.debug.pausepoints = '';
----
datadriven.go:259:
/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/5410/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:66:
job [1 args]
See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)
cockroach-teamcity
commented
9 months ago ccl/backupccl.TestDataDriven_restore_on_fail_or_cancel_fast_drop failed on master @ f2917d82b235db6fda145a932050e5a58f957b9f:
Fatal error:
panic: test timed out after 14m57s
running tests:
TestDataDriven_restore_on_fail_or_cancel_fast_drop (14m7s)
TestDataDriven_restore_on_fail_or_cancel_fast_drop/restore-cleanup-with-range-tombstones (14m6s)
Stack:
goroutine 843370 [running]:
testing.(*M).startAlarm.func1()
GOROOT/src/testing/testing.go:2259 +0x3b9
created by time.goFunc
GOROOT/src/time/sleep.go:176 +0x2d
```
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:32:
exec-sql [1 args]
SET CLUSTER SETTING sql.gc_job.wait_for_gc.interval = '250ms';
----
datadriven.go:259:
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:36:
exec-sql [1 args]
SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs.enabled = true;
----
datadriven.go:259:
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:40:
exec-sql [1 args]
SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs_unrestricted.enabled = true;
----
datadriven.go:259:
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:48:
exec-sql [1 args]
SET CLUSTER SETTING kv.protectedts.poll_interval = '250ms';
----
datadriven.go:259:
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:52:
exec-sql [0 args]
SET CLUSTER SETTING jobs.debug.pausepoints = 'restore.after_publishing_descriptors';
----
datadriven.go:259:
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:56:
restore [2 args]
RESTORE FROM LATEST IN 'nodelocal://1/cluster_backup';
----
job paused at pausepoint
datadriven.go:259:
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:61:
exec-sql [0 args]
SET CLUSTER SETTING jobs.debug.pausepoints = '';
----
datadriven.go:259:
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:66:
job [1 args]
Parameters:
attempt=1run=1shard=42
stevendanna
commented
9 months ago Moved to P-1 as we've skipped it under tenants where it seems to be timing out.
msbutler
commented
7 months ago @stevendanna a heads up that we're out of sla.
cockroach-teamcity
commented
4 months ago ccl/backupccl.TestDataDriven_restore_on_fail_or_cancel_fast_drop failed with artifacts on master @ 4a708c864424fd0163738869ab2602a958ad2c09:
----
datadriven.go:259:
/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/16219/execroot/com_github_cockroachdb_cockroach/bazel-out/aarch64-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:27:
exec-sql [0 args]
SET CLUSTER SETTING sql.catalog.descriptor_lease_duration = '1s';
----
datadriven.go:259:
/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/16219/execroot/com_github_cockroachdb_cockroach/bazel-out/aarch64-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:33:
exec-sql [1 args]
SET CLUSTER SETTING sql.gc_job.wait_for_gc.interval = '250ms';
----
datadriven.go:259:
/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/16219/execroot/com_github_cockroachdb_cockroach/bazel-out/aarch64-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:41:
exec-sql [1 args]
SET CLUSTER SETTING kv.protectedts.poll_interval = '250ms';
----
datadriven.go:259:
/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/16219/execroot/com_github_cockroachdb_cockroach/bazel-out/aarch64-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:45:
exec-sql [0 args]
SET CLUSTER SETTING jobs.debug.pausepoints = 'restore.after_publishing_descriptors';
----
datadriven.go:259:
/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/16219/execroot/com_github_cockroachdb_cockroach/bazel-out/aarch64-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:49:
restore [2 args]
RESTORE FROM LATEST IN 'nodelocal://1/cluster_backup';
----
job paused at pausepoint
datadriven.go:259:
/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/16219/execroot/com_github_cockroachdb_cockroach/bazel-out/aarch64-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:54:
exec-sql [0 args]
SET CLUSTER SETTING jobs.debug.pausepoints = '';
----
datadriven.go:259:
/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/16219/execroot/com_github_cockroachdb_cockroach/bazel-out/aarch64-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:59:
job [1 args]
<no input to command>
----
datadriven.go:259:
/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/16219/execroot/com_github_cockroachdb_cockroach/bazel-out/aarch64-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:68:
sleep [1 args]
<no input to command>
----
datadriven.go:259:
/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/16219/execroot/com_github_cockroachdb_cockroach/bazel-out/aarch64-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:71:
SELECT crdb_internal.kv_enqueue_replica(range_id, 'mvccGC', true) FROM (SELECT range_id FROM crdb_internal.ranges);
expected:
found:
pq: resolved public to 120 but found no descriptor with id 120: referenced descriptor ID 120: looking up ID 120: descriptor not found
--- FAIL: TestDataDriven_restore_on_fail_or_cancel_fast_drop/restore-cleanup-with-range-tombstones (4.69s)See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)
cockroach-teamcity
commented
1 month ago ccl/backupccl.TestDataDriven_restore_on_fail_or_cancel_fast_drop failed with artifacts on master @ 50cc596574ae4f78ac0374264412ac6272a63dbd:
----
datadriven.go:259:
/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/14800/execroot/com_github_cockroachdb_cockroach/bazel-out/aarch64-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:27:
exec-sql [0 args]
SET CLUSTER SETTING sql.catalog.descriptor_lease_duration = '1s';
----
datadriven.go:259:
/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/14800/execroot/com_github_cockroachdb_cockroach/bazel-out/aarch64-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:33:
exec-sql [1 args]
SET CLUSTER SETTING sql.gc_job.wait_for_gc.interval = '250ms';
----
datadriven.go:259:
/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/14800/execroot/com_github_cockroachdb_cockroach/bazel-out/aarch64-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:41:
exec-sql [1 args]
SET CLUSTER SETTING kv.protectedts.poll_interval = '250ms';
----
datadriven.go:259:
/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/14800/execroot/com_github_cockroachdb_cockroach/bazel-out/aarch64-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:45:
exec-sql [0 args]
SET CLUSTER SETTING jobs.debug.pausepoints = 'restore.after_publishing_descriptors';
----
datadriven.go:259:
/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/14800/execroot/com_github_cockroachdb_cockroach/bazel-out/aarch64-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:49:
restore [2 args]
RESTORE FROM LATEST IN 'nodelocal://1/cluster_backup';
----
job paused at pausepoint
datadriven.go:259:
/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/14800/execroot/com_github_cockroachdb_cockroach/bazel-out/aarch64-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:54:
exec-sql [0 args]
SET CLUSTER SETTING jobs.debug.pausepoints = '';
----
datadriven.go:259:
/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/14800/execroot/com_github_cockroachdb_cockroach/bazel-out/aarch64-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:59:
job [1 args]
<no input to command>
----
datadriven.go:259:
/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/14800/execroot/com_github_cockroachdb_cockroach/bazel-out/aarch64-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:68:
sleep [1 args]
<no input to command>
----
datadriven.go:259:
/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/14800/execroot/com_github_cockroachdb_cockroach/bazel-out/aarch64-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:71:
SELECT crdb_internal.kv_enqueue_replica(range_id, 'mvccGC', true) FROM (SELECT range_id FROM crdb_internal.ranges);
expected:
found:
pq: resolved public to 120 but found no descriptor with id 120: referenced descriptor ID 120: looking up ID 120: descriptor not found
--- FAIL: TestDataDriven_restore_on_fail_or_cancel_fast_drop/restore-cleanup-with-range-tombstones (5.93s)See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)
ccl/backupccl.TestDataDriven_restore_on_fail_or_cancel_fast_drop failed on master @ 5f76d93b2ad8d29c14c9b176753ec33cbf81e3fe:
Fatal error:
Stack:
Log preceding fatal error
``` /var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:32: exec-sql [1 args] SET CLUSTER SETTING sql.gc_job.wait_for_gc.interval = '250ms'; ---- datadriven.go:259: /var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:36: exec-sql [1 args] SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs.enabled = true; ---- datadriven.go:259: /var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:40: exec-sql [1 args] SET CLUSTER SETTING sql.virtual_cluster.feature_access.zone_configs_unrestricted.enabled = true; ---- datadriven.go:259: /var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:48: exec-sql [1 args] SET CLUSTER SETTING kv.protectedts.poll_interval = '250ms'; ---- datadriven.go:259: /var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:52: exec-sql [0 args] SET CLUSTER SETTING jobs.debug.pausepoints = 'restore.after_publishing_descriptors'; ---- datadriven.go:259: /var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:56: restore [2 args] RESTORE FROM LATEST IN 'nodelocal://1/cluster_backup'; ---- job paused at pausepoint datadriven.go:259: /var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:61: exec-sql [0 args] SET CLUSTER SETTING jobs.debug.pausepoints = ''; ---- datadriven.go:259: /var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:66: job [1 args]
----
datadriven.go:259:
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:75:
sleep [1 args]
----
datadriven.go:259:
/var/lib/engflow/worker/work/2/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/backupccl/backupccl_test_/backupccl_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/backupccl/testdata/backup-restore/restore-on-fail-or-cancel-fast-drop:78:
exec-sql [1 args]
SELECT crdb_internal.kv_enqueue_replica(range_id, 'mvccGC', true) FROM (SELECT range_id FROM crdb_internal.ranges);
----
```
Parameters:
attempt=1run=17shard=41Help
See also: How To Investigate a Go Test Failure (internal)
/cc @cockroachdb/test-engThis test on roachdash | Improve this report!
Jira issue: CRDB-34742