Open cockroach-teamcity opened 6 days ago
pkg/server/storage_api/storage_api_test.TestAdminDecommissionedOperations failed with artifacts on release-23.2.11-rc @ c70f43425e66787952e3252f84bc6340c128709d:
=== RUN TestAdminDecommissionedOperations
test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/800529510c8a77f305555fe4848c57f0/logTestAdminDecommissionedOperations2377586895
test_log_scope.go:81: use -show-logs to present logs inline
test_server_shim.go:93: cluster virtualization disabled due to issue: #81590 (expected label: C-bug)
pkg/server/storage_api/storage_api_test_test/pkg/server/storage_api/decommission_test.go:819: (TestAdminDecommissionedOperations)
NOTICE: .NodeID() called via implicit interface StorageLayerInterface;
HINT: consider using .StorageLayer().NodeID() instead.
pkg/server/storage_api/storage_api_test_test/pkg/server/storage_api/decommission_test.go:827: (TestAdminDecommissionedOperations)
NOTICE: .NodeID() called via implicit interface StorageLayerInterface;
HINT: consider using .StorageLayer().NodeID() instead.
pkg/server/storage_api/storage_api_test_test/pkg/server/storage_api/decommission_test.go:833: (TestAdminDecommissionedOperations.func1)
NOTICE: .DB() called via implicit interface ApplicationLayerInterface;
HINT: consider using .ApplicationLayer().DB() instead.
TIP: consider replacing the test server initialization from:
ts, ... := serverutils.StartServer(t, ...)
defer ts.Stopper().Stop(...)
to:
srv, ... := serverutils.StartServer(t, ...)
defer srv.Stopper().Stop(...)
ts := srv.ApplicationLayer()
See also: https://go.crdb.dev/p/testserver-and-cluster-virtualization
decommission_test.go:977: -- test log scope end --
test logs left over in: /artifacts/tmp/_tmp/800529510c8a77f305555fe4848c57f0/logTestAdminDecommissionedOperations2377586895
--- FAIL: TestAdminDecommissionedOperations (8.28s)
=== RUN TestAdminDecommissionedOperations/Events
decommission_test.go:972:
Error Trace: pkg/server/storage_api/storage_api_test_test/pkg/server/storage_api/decommission_test.go:972
github.com/cockroachdb/cockroach/pkg/testutils/soon.go:75
github.com/cockroachdb/cockroach/pkg/util/retry/retry.go:213
github.com/cockroachdb/cockroach/pkg/testutils/soon.go:81
github.com/cockroachdb/cockroach/pkg/testutils/soon.go:60
github.com/cockroachdb/cockroach/pkg/testutils/soon.go:42
pkg/server/storage_api/storage_api_test_test/pkg/server/storage_api/decommission_test.go:954
Error: Not equal:
expected: 0xd
actual : 0x7
Test: TestAdminDecommissionedOperations/Events
Messages: rpc error: code = PermissionDenied desc = admin-events: RangeIterator failed to seek to /Table/12/2: failed to connect to n1 at 127.0.0.1:36493: initial connection heartbeat failed: grpc: n2 was permanently removed from the cluster at 2024-09-11 16:27:28.300698611 +0000 UTC; it is not allowed to rejoin the cluster [code 7/PermissionDenied], node is decommissioned
--- FAIL: TestAdminDecommissionedOperations/Events (0.01s)
Parameters:
TAGS=bazel,gss,deadlock
stress=true
See also: How To Investigate a Go Test Failure (internal)
- #130388 pkg/server/storage_api/storage_api_test: TestAdminDecommissionedOperations failed [C-test-failure O-robot branch-release-24.1.5-rc release-blocker] - #130160 pkg/server/storage_api/storage_api_test: TestAdminDecommissionedOperations failed [C-test-failure O-robot branch-release-23.2 release-blocker] - #130135 pkg/server/storage_api/storage_api_test: TestAdminDecommissionedOperations failed [C-test-failure O-robot branch-release-24.1 release-blocker]
pkg/server/storage_api/storage_api_test.TestAdminDecommissionedOperations failed with artifacts on release-23.2.11-rc @ 701e687d9491360b9f080c07bcb70e463184d2e4:
=== RUN TestAdminDecommissionedOperations
test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/800529510c8a77f305555fe4848c57f0/logTestAdminDecommissionedOperations3037517741
test_log_scope.go:81: use -show-logs to present logs inline
test_server_shim.go:93: cluster virtualization disabled due to issue: #81590 (expected label: C-bug)
pkg/server/storage_api/storage_api_test_test/pkg/server/storage_api/decommission_test.go:819: (TestAdminDecommissionedOperations)
NOTICE: .NodeID() called via implicit interface StorageLayerInterface;
HINT: consider using .StorageLayer().NodeID() instead.
pkg/server/storage_api/storage_api_test_test/pkg/server/storage_api/decommission_test.go:827: (TestAdminDecommissionedOperations)
NOTICE: .NodeID() called via implicit interface StorageLayerInterface;
HINT: consider using .StorageLayer().NodeID() instead.
pkg/server/storage_api/storage_api_test_test/pkg/server/storage_api/decommission_test.go:833: (TestAdminDecommissionedOperations.func1)
NOTICE: .DB() called via implicit interface ApplicationLayerInterface;
HINT: consider using .ApplicationLayer().DB() instead.
TIP: consider replacing the test server initialization from:
ts, ... := serverutils.StartServer(t, ...)
defer ts.Stopper().Stop(...)
to:
srv, ... := serverutils.StartServer(t, ...)
defer srv.Stopper().Stop(...)
ts := srv.ApplicationLayer()
See also: https://go.crdb.dev/p/testserver-and-cluster-virtualization
decommission_test.go:977: -- test log scope end --
--- FAIL: TestAdminDecommissionedOperations (8.31s)
=== RUN TestAdminDecommissionedOperations/Events
decommission_test.go:972:
Error Trace: pkg/server/storage_api/storage_api_test_test/pkg/server/storage_api/decommission_test.go:972
github.com/cockroachdb/cockroach/pkg/testutils/soon.go:75
github.com/cockroachdb/cockroach/pkg/util/retry/retry.go:213
github.com/cockroachdb/cockroach/pkg/testutils/soon.go:81
github.com/cockroachdb/cockroach/pkg/testutils/soon.go:60
github.com/cockroachdb/cockroach/pkg/testutils/soon.go:42
pkg/server/storage_api/storage_api_test_test/pkg/server/storage_api/decommission_test.go:954
Error: Not equal:
expected: 0xd
actual : 0x7
Test: TestAdminDecommissionedOperations/Events
Messages: rpc error: code = PermissionDenied desc = admin-events: RangeIterator failed to seek to /Table/12/2: failed to connect to n1 at 127.0.0.1:42643: initial connection heartbeat failed: grpc: n2 was permanently removed from the cluster at 2024-09-12 16:19:22.075455738 +0000 UTC; it is not allowed to rejoin the cluster [code 7/PermissionDenied], node is decommissioned
--- FAIL: TestAdminDecommissionedOperations/Events (0.01s)
Parameters:
TAGS=bazel,gss,deadlock
stress=true
See also: How To Investigate a Go Test Failure (internal)
- #130388 pkg/server/storage_api/storage_api_test: TestAdminDecommissionedOperations failed [C-test-failure O-robot branch-release-24.1.5-rc release-blocker] - #130160 pkg/server/storage_api/storage_api_test: TestAdminDecommissionedOperations failed [C-test-failure O-robot branch-release-23.2 release-blocker] - #130135 pkg/server/storage_api/storage_api_test: TestAdminDecommissionedOperations failed [C-test-failure O-robot branch-release-24.1 release-blocker]
pkg/server/storage_api/storage_api_test.TestAdminDecommissionedOperations failed with artifacts on release-23.2.11-rc @ c70f43425e66787952e3252f84bc6340c128709d:
Parameters:
TAGS=bazel,gss
stress=true
Help
See also: How To Investigate a Go Test Failure (internal)
Same failure on other branches
- #130388 pkg/server/storage_api/storage_api_test: TestAdminDecommissionedOperations failed [C-test-failure O-robot branch-release-24.1.5-rc release-blocker] - #130160 pkg/server/storage_api/storage_api_test: TestAdminDecommissionedOperations failed [C-test-failure O-robot branch-release-23.2 release-blocker] - #130135 pkg/server/storage_api/storage_api_test: TestAdminDecommissionedOperations failed [C-test-failure O-robot branch-release-24.1 release-blocker]
/cc @cockroachdb/unowned
This test on roachdash | Improve this report!
Jira issue: CRDB-42101