: failed

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ 2bd61ba8700c0ada35d8d6dd24546e2a36999900:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-disk:fakedist-disk_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-disk:fakedist-disk_test (300 packages loaded, 12223 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-disk:fakedist-disk_test (457 packages loaded, 14034 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-disk:fakedist-disk_test (621 packages loaded, 15441 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-disk:fakedist-disk_test (717 packages loaded, 17137 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-disk:fakedist-disk_test (789 packages loaded, 17875 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-disk:fakedist-disk_test (829 packages loaded, 18458 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-disk:fakedist-disk_test (987 packages loaded, 21755 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-disk:fakedist-disk_test (1115 packages loaded, 25435 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-disk:fakedist-disk_test (1223 packages loaded, 28914 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-disk:fakedist-disk_test (1227 packages loaded, 31236 targets configured)
INFO: Analyzed target //pkg/sql/sqlitelogictest/tests/fakedist-disk:fakedist-disk_test (1283 packages loaded, 31967 targets configured).
INFO: Found 1 test target...
[0 / 3] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[226 / 1,183] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 0s processwrapper-sandbox ... (8 actions, 7 running)
[358 / 1,703] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (8 actions running)
[358 / 1,703] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (8 actions running)
[360 / 1,703] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 23s processwrapper-sandbox ... (7 actions, 6 running)
[654 / 2,744] Generating Descriptor Set proto_library //pkg/repstream/streampb:streampb_proto; 0s processwrapper-sandbox ... (4 actions, 3 running)
[831 / 3,816] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 0s processwrapper-sandbox ... (4 actions, 3 running)
[831 / 3,816] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 2s processwrapper-sandbox ... (6 actions running)
[831 / 3,816] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 10s processwrapper-sandbox ... (6 actions running)
[831 / 3,816] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 40s processwrapper-sandbox ... (6 actions running)
[832 / 3,816] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 49s processwrapper-sandbox ... (6 actions, 5 running)
[845 / 3,816] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 50s processwrapper-sandbox ... (8 actions, 7 running)
[861 / 3,816] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 51s processwrapper-sandbox ... (8 actions, 7 running)
[876 / 3,816] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 52s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-a32faae95f26/bin/external/go_sdk/builder_reset/builder link -sdk exte

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #120986 : failed [C-test-failure O-robot T-testeng branch-release-23.1 release-blocker] - #120985 : failed [C-test-failure O-robot T-testeng branch-release-23.2.4-rc release-blocker]

/cc @cockroachdb/test-eng

This test on roachdash | Improve this report!

Jira issue: CRDB-37044

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ 2bd61ba8700c0ada35d8d6dd24546e2a36999900:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-vec-off:fakedist-vec-off_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-vec-off:fakedist-vec-off_test (283 packages loaded, 11620 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-vec-off:fakedist-vec-off_test (356 packages loaded, 13147 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-vec-off:fakedist-vec-off_test (394 packages loaded, 14009 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-vec-off:fakedist-vec-off_test (563 packages loaded, 14693 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-vec-off:fakedist-vec-off_test (673 packages loaded, 17182 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-vec-off:fakedist-vec-off_test (763 packages loaded, 19484 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-vec-off:fakedist-vec-off_test (890 packages loaded, 21843 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-vec-off:fakedist-vec-off_test (1025 packages loaded, 24260 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-vec-off:fakedist-vec-off_test (1115 packages loaded, 27074 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-vec-off:fakedist-vec-off_test (1232 packages loaded, 30068 targets configured)
INFO: Analyzed target //pkg/sql/sqlitelogictest/tests/fakedist-vec-off:fakedist-vec-off_test (1283 packages loaded, 31967 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[130 / 498] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (3 actions running)
[346 / 1,260] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (8 actions, 7 running)
[476 / 1,829] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 4s processwrapper-sandbox ... (8 actions running)
[476 / 1,829] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 13s processwrapper-sandbox ... (8 actions running)
[477 / 1,829] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 22s processwrapper-sandbox ... (8 actions, 7 running)
[537 / 1,940] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 21s processwrapper-sandbox ... (8 actions, 7 running)
[663 / 2,379] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 22s processwrapper-sandbox ... (5 actions, 4 running)
[731 / 2,539] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 3s processwrapper-sandbox ... (8 actions, 7 running)
[784 / 2,965] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 4s processwrapper-sandbox ... (7 actions, 6 running)
[824 / 3,520] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 5s processwrapper-sandbox ... (6 actions running)
[831 / 3,816] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 17s processwrapper-sandbox ... (6 actions running)
[832 / 3,816] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 44s processwrapper-sandbox ... (6 actions, 5 running)
[838 / 3,816] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 45s processwrapper-sandbox ... (8 actions, 7 running)
[845 / 3,816] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 46s processwrapper-sandbox ... (8 actions, 7 running)
[847 / 3,816] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 48s processwrapper-sandbox ... (8 actions, 7 running)
[850 / 3,816] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 49s processwrapper-sandbox ... (8 actions running)
[854 / 3,816] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 50s

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #120986 : failed [C-test-failure O-robot T-testeng branch-release-23.1 release-blocker] - #120985 : failed [C-test-failure O-robot T-testeng branch-release-23.2.4-rc release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ 2bd61ba8700c0ada35d8d6dd24546e2a36999900:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/sqlitelogictest/tests/local:local_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local:local_test (15 packages loaded, 334 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local:local_test (15 packages loaded, 334 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local:local_test (15 packages loaded, 334 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local:local_test (295 packages loaded, 12719 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local:local_test (375 packages loaded, 13243 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local:local_test (491 packages loaded, 13758 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local:local_test (627 packages loaded, 15611 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local:local_test (731 packages loaded, 18006 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local:local_test (853 packages loaded, 20019 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local:local_test (911 packages loaded, 21933 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local:local_test (1037 packages loaded, 24951 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local:local_test (1197 packages loaded, 28824 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local:local_test (1239 packages loaded, 31094 targets configured)
INFO: Analyzed target //pkg/sql/sqlitelogictest/tests/local:local_test (1283 packages loaded, 31967 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 5] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[344 / 1,231] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 0s processwrapper-sandbox ... (8 actions, 7 running)
[353 / 1,328] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (8 actions running)
[353 / 1,328] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (8 actions running)
[354 / 1,328] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 22s processwrapper-sandbox ... (8 actions, 7 running)
[534 / 1,863] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 23s processwrapper-sandbox ... (7 actions, 5 running)
[583 / 2,115] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 24s processwrapper-sandbox ... (7 actions, 6 running)
[674 / 2,752] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 2s processwrapper-sandbox ... (7 actions, 5 running)
[831 / 3,816] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 3s processwrapper-sandbox ... (6 actions, 5 running)
[831 / 3,816] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 4s processwrapper-sandbox ... (6 actions running)
[831 / 3,816] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 14s processwrapper-sandbox ... (6 actions running)
[831 / 3,816] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 44s processwrapper-sandbox ... (6 actions running)
[832 / 3,816] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 48s processwrapper-sandbox ... (6 actions, 5 running)
[835 / 3,816] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 49s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #120986 : failed [C-test-failure O-robot T-testeng branch-release-23.1 release-blocker] - #120985 : failed [C-test-failure O-robot T-testeng branch-release-23.2.4-rc release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ 2bd61ba8700c0ada35d8d6dd24546e2a36999900:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-legacy-schema-changer:local-legacy-schema-changer_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-legacy-schema-changer:local-legacy-schema-changer_test (283 packages loaded, 11688 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-legacy-schema-changer:local-legacy-schema-changer_test (363 packages loaded, 12600 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-legacy-schema-changer:local-legacy-schema-changer_test (577 packages loaded, 14179 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-legacy-schema-changer:local-legacy-schema-changer_test (631 packages loaded, 15490 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-legacy-schema-changer:local-legacy-schema-changer_test (746 packages loaded, 17678 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-legacy-schema-changer:local-legacy-schema-changer_test (865 packages loaded, 19776 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-legacy-schema-changer:local-legacy-schema-changer_test (930 packages loaded, 22044 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-legacy-schema-changer:local-legacy-schema-changer_test (1069 packages loaded, 25132 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-legacy-schema-changer:local-legacy-schema-changer_test (1220 packages loaded, 28940 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-legacy-schema-changer:local-legacy-schema-changer_test (1239 packages loaded, 31101 targets configured)
INFO: Analyzed target //pkg/sql/sqlitelogictest/tests/local-legacy-schema-changer:local-legacy-schema-changer_test (1283 packages loaded, 31967 targets configured).
INFO: Found 1 test target...
[0 / 5] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[349 / 1,171] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 0s processwrapper-sandbox ... (8 actions running)
[479 / 1,742] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (8 actions running)
[479 / 1,742] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (8 actions running)
[480 / 1,742] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 25s processwrapper-sandbox ... (8 actions, 7 running)
[677 / 2,710] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 25s processwrapper-sandbox ... (5 actions running)
[735 / 3,127] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 1s processwrapper-sandbox ... (7 actions, 3 running)
[821 / 3,536] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 2s processwrapper-sandbox ... (8 actions, 7 running)
[830 / 3,816] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 3s processwrapper-sandbox ... (5 actions running)
[831 / 3,816] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 4s processwrapper-sandbox ... (6 actions, 5 running)
[831 / 3,816] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 6s processwrapper-sandbox ... (6 actions running)
[831 / 3,816] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 15s processwrapper-sandbox ... (6 actions running)
[831 / 3,816] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 45s processwrapper-sandbox ... (6 actions running)
[832 / 3,816] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 51s processwrapper-sandbox ... (6 actions, 5 running)
[840 / 3,816] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 52s processwrapper-sandbox ... (8 actions, 7 running)
[849 / 3,816] GoStdlib external

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #120986 : failed [C-test-failure O-robot T-testeng branch-release-23.1 release-blocker] - #120985 : failed [C-test-failure O-robot T-testeng branch-release-23.2.4-rc release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ 2bd61ba8700c0ada35d8d6dd24546e2a36999900:

stdout: 
, stderr: 

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker] - #120986 : failed [C-test-failure O-robot T-testeng branch-release-23.1 release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ 2bd61ba8700c0ada35d8d6dd24546e2a36999900:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/sqlliveness/slstorage:slstorage_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/sqlliveness/slstorage:slstorage_test (439 packages loaded, 12346 targets configured)
Analyzing: target //pkg/sql/sqlliveness/slstorage:slstorage_test (568 packages loaded, 15199 targets configured)
Analyzing: target //pkg/sql/sqlliveness/slstorage:slstorage_test (702 packages loaded, 18048 targets configured)
Analyzing: target //pkg/sql/sqlliveness/slstorage:slstorage_test (753 packages loaded, 21932 targets configured)
Analyzing: target //pkg/sql/sqlliveness/slstorage:slstorage_test (801 packages loaded, 25843 targets configured)
Analyzing: target //pkg/sql/sqlliveness/slstorage:slstorage_test (1062 packages loaded, 29872 targets configured)
INFO: Analyzed target //pkg/sql/sqlliveness/slstorage:slstorage_test (1062 packages loaded, 29872 targets configured).
INFO: Found 1 test target...
[0 / 5] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[240 / 941] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (8 actions, 7 running)
[241 / 946] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (8 actions running)
[241 / 946] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (8 actions running)
[243 / 946] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 22s processwrapper-sandbox ... (7 actions, 6 running)
[616 / 2,218] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 0s processwrapper-sandbox ... (6 actions, 4 running)
[702 / 3,115] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 1s processwrapper-sandbox ... (6 actions, 5 running)
[831 / 3,594] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 2s processwrapper-sandbox ... (6 actions running)
[831 / 3,594] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 12s processwrapper-sandbox ... (6 actions running)
[831 / 3,594] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 42s processwrapper-sandbox ... (6 actions running)
[832 / 3,594] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 45s processwrapper-sandbox ... (5 actions running)
[837 / 3,594] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 46s processwrapper-sandbox ... (8 actions running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocat

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker] - #120986 : failed [C-test-failure O-robot T-testeng branch-release-23.1 release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ 2bd61ba8700c0ada35d8d6dd24546e2a36999900:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-vec-off:local-vec-off_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-vec-off:local-vec-off_test (15 packages loaded, 334 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-vec-off:local-vec-off_test (15 packages loaded, 334 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-vec-off:local-vec-off_test (305 packages loaded, 13554 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-vec-off:local-vec-off_test (374 packages loaded, 14019 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-vec-off:local-vec-off_test (560 packages loaded, 14361 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-vec-off:local-vec-off_test (612 packages loaded, 15962 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-vec-off:local-vec-off_test (653 packages loaded, 16804 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-vec-off:local-vec-off_test (822 packages loaded, 19798 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-vec-off:local-vec-off_test (938 packages loaded, 21890 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-vec-off:local-vec-off_test (1061 packages loaded, 24877 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-vec-off:local-vec-off_test (1227 packages loaded, 29876 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-vec-off:local-vec-off_test (1242 packages loaded, 31372 targets configured)
INFO: Analyzed target //pkg/sql/sqlitelogictest/tests/local-vec-off:local-vec-off_test (1283 packages loaded, 31967 targets configured).
INFO: Found 1 test target...
[0 / 5] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[3 / 24] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[366 / 1,387] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (8 actions running)
[366 / 1,387] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 13s processwrapper-sandbox ... (8 actions running)
[367 / 1,387] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 21s processwrapper-sandbox ... (8 actions, 7 running)
[370 / 1,387] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 22s processwrapper-sandbox ... (8 actions running)
[374 / 1,388] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 21s processwrapper-sandbox ... (8 actions, 7 running)
[635 / 2,191] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 22s processwrapper-sandbox ... (8 actions, 7 running)
[692 / 2,484] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 23s processwrapper-sandbox ... (6 actions, 5 running)
[762 / 2,789] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 4s processwrapper-sandbox ... (8 actions, 7 running)
[787 / 3,131] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 5s processwrapper-sandbox ... (8 actions, 7 running)
[831 / 3,816] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 7s processwrapper-sandbox ... (6 actions, 5 running)
[831 / 3,816] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 8s processwrapper-sandbox ... (6 actions running)
[831 / 3,816] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 17s processwrapper-sandbox ... (6 actions running)
[832 / 3,816] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 41s processwrapper-sandbox ... (6 actions, 5 running)
[837 / 3,816] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 42s processwrapper-sandbox ... (8 actions, 7 running)
[84

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker] - #120986 : failed [C-test-failure O-robot T-testeng branch-release-23.1 release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ 2bd61ba8700c0ada35d8d6dd24546e2a36999900:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/sqlliveness/slinstance:slinstance_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/sqlliveness/slinstance:slinstance_test (107 packages loaded, 13732 targets configured)
Analyzing: target //pkg/sql/sqlliveness/slinstance:slinstance_test (217 packages loaded, 15569 targets configured)
Analyzing: target //pkg/sql/sqlliveness/slinstance:slinstance_test (319 packages loaded, 18518 targets configured)
Analyzing: target //pkg/sql/sqlliveness/slinstance:slinstance_test (458 packages loaded, 21562 targets configured)
Analyzing: target //pkg/sql/sqlliveness/slinstance:slinstance_test (501 packages loaded, 24817 targets configured)
INFO: Analyzed target //pkg/sql/sqlliveness/slinstance:slinstance_test (509 packages loaded, 25285 targets configured).
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[353 / 1,350] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 0s processwrapper-sandbox ... (8 actions, 7 running)
[353 / 1,350] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (8 actions running)
[353 / 1,350] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (8 actions running)
[354 / 1,350] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 22s processwrapper-sandbox ... (8 actions, 7 running)
[625 / 2,315] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 22s processwrapper-sandbox ... (6 actions, 5 running)
[781 / 2,761] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 1s processwrapper-sandbox ... (6 actions, 5 running)
[781 / 2,761] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 2s processwrapper-sandbox ... (6 actions running)
[781 / 2,761] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 10s processwrapper-sandbox ... (6 actions running)
[781 / 2,761] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 40s processwrapper-sandbox ... (6 actions running)
[782 / 2,761] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 48s processwrapper-sandbox ... (6 actions, 5 running)
[794 / 2,761] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 49s processwrapper-sandbox ... (7 actions running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-a32faae95f26/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsa

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker] - #120986 : failed [C-test-failure O-robot T-testeng branch-release-23.1 release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ 2bd61ba8700c0ada35d8d6dd24546e2a36999900:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/sqlstats/insights/integration:integration_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/sqlstats/insights/integration:integration_test (367 packages loaded, 11205 targets configured)
Analyzing: target //pkg/sql/sqlstats/insights/integration:integration_test (410 packages loaded, 11950 targets configured)
Analyzing: target //pkg/sql/sqlstats/insights/integration:integration_test (422 packages loaded, 12587 targets configured)
Analyzing: target //pkg/sql/sqlstats/insights/integration:integration_test (638 packages loaded, 15327 targets configured)
Analyzing: target //pkg/sql/sqlstats/insights/integration:integration_test (785 packages loaded, 20041 targets configured)
Analyzing: target //pkg/sql/sqlstats/insights/integration:integration_test (880 packages loaded, 22752 targets configured)
Analyzing: target //pkg/sql/sqlstats/insights/integration:integration_test (928 packages loaded, 25955 targets configured)
Analyzing: target //pkg/sql/sqlstats/insights/integration:integration_test (999 packages loaded, 28550 targets configured)
Analyzing: target //pkg/sql/sqlstats/insights/integration:integration_test (1014 packages loaded, 29110 targets configured)
INFO: Analyzed target //pkg/sql/sqlstats/insights/integration:integration_test (1062 packages loaded, 29866 targets configured).
INFO: Found 1 test target...
[0 / 3] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[649 / 2,303] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 0s processwrapper-sandbox ... (7 actions, 6 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker] - #120986 : failed [C-test-failure O-robot T-testeng branch-release-23.1 release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ 2bd61ba8700c0ada35d8d6dd24546e2a36999900:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/sqlstats/persistedsqlstats:persistedsqlstats_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/sqlstats/persistedsqlstats:persistedsqlstats_test (248 packages loaded, 10978 targets configured)
Analyzing: target //pkg/sql/sqlstats/persistedsqlstats:persistedsqlstats_test (547 packages loaded, 12216 targets configured)
Analyzing: target //pkg/sql/sqlstats/persistedsqlstats:persistedsqlstats_test (583 packages loaded, 14434 targets configured)
Analyzing: target //pkg/sql/sqlstats/persistedsqlstats:persistedsqlstats_test (630 packages loaded, 16092 targets configured)
Analyzing: target //pkg/sql/sqlstats/persistedsqlstats:persistedsqlstats_test (798 packages loaded, 19768 targets configured)
Analyzing: target //pkg/sql/sqlstats/persistedsqlstats:persistedsqlstats_test (876 packages loaded, 22906 targets configured)
Analyzing: target //pkg/sql/sqlstats/persistedsqlstats:persistedsqlstats_test (992 packages loaded, 25948 targets configured)
Analyzing: target //pkg/sql/sqlstats/persistedsqlstats:persistedsqlstats_test (1009 packages loaded, 29162 targets configured)
INFO: Analyzed target //pkg/sql/sqlstats/persistedsqlstats:persistedsqlstats_test (1065 packages loaded, 29892 targets configured).
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[225 / 855] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (8 actions, 7 running)
[358 / 1,417] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (8 actions running)
[358 / 1,417] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (8 actions running)
[360 / 1,417] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 22s processwrapper-sandbox ... (7 actions, 6 running)
[647 / 2,638] Generating Descriptor Set proto_library //pkg/sql/execinfrapb:execinfrapb_proto; 0s processwrapper-sandbox ... (4 actions, 3 running)
[831 / 3,598] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 1s processwrapper-sandbox ... (5 actions, 4 running)
[831 / 3,598] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 2s processwrapper-sandbox ... (6 actions running)
[831 / 3,598] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 12s processwrapper-sandbox ... (6 actions running)
[831 / 3,598] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 42s processwrapper-sandbox ... (6 actions running)
[832 / 3,598] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 48s processwrapper-sandbox ... (6 actions, 5 running)
[846 / 3,598] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 49s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-a32faae95f26/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_g

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker] - #120986 : failed [C-test-failure O-robot T-testeng branch-release-23.1 release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ 2bd61ba8700c0ada35d8d6dd24546e2a36999900:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/sqlstats/persistedsqlstats/sqlstatsutil:sqlstatsutil_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/sqlstats/persistedsqlstats/sqlstatsutil:sqlstatsutil_test (90 packages loaded, 14088 targets configured)
Analyzing: target //pkg/sql/sqlstats/persistedsqlstats/sqlstatsutil:sqlstatsutil_test (202 packages loaded, 17624 targets configured)
INFO: Analyzed target //pkg/sql/sqlstats/persistedsqlstats/sqlstatsutil:sqlstatsutil_test (213 packages loaded, 22394 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 3] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[312 / 1,264] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (8 actions running)
[312 / 1,264] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (8 actions running)
[313 / 1,264] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 23s processwrapper-sandbox ... (8 actions, 7 running)
[625 / 2,190] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 0s processwrapper-sandbox ... (4 actions, 3 running)
[627 / 2,190] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 1s processwrapper-sandbox ... (6 actions running)
[627 / 2,190] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 10s processwrapper-sandbox ... (6 actions running)
[627 / 2,190] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 40s processwrapper-sandbox ... (6 actions running)
[628 / 2,190] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 50s processwrapper-sandbox ... (6 actions, 5 running)
[641 / 2,190] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 51s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-a32faae95f26/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.r

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ 2bd61ba8700c0ada35d8d6dd24546e2a36999900:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/sqltestutils:sqltestutils_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/sqltestutils:sqltestutils_test (32 packages loaded, 11511 targets configured)
Analyzing: target //pkg/sql/sqltestutils:sqltestutils_test (289 packages loaded, 13842 targets configured)
Analyzing: target //pkg/sql/sqltestutils:sqltestutils_test (590 packages loaded, 16082 targets configured)
Analyzing: target //pkg/sql/sqltestutils:sqltestutils_test (704 packages loaded, 18649 targets configured)
Analyzing: target //pkg/sql/sqltestutils:sqltestutils_test (763 packages loaded, 19960 targets configured)
Analyzing: target //pkg/sql/sqltestutils:sqltestutils_test (787 packages loaded, 20914 targets configured)
Analyzing: target //pkg/sql/sqltestutils:sqltestutils_test (818 packages loaded, 22028 targets configured)
Analyzing: target //pkg/sql/sqltestutils:sqltestutils_test (899 packages loaded, 25595 targets configured)
Analyzing: target //pkg/sql/sqltestutils:sqltestutils_test (905 packages loaded, 28146 targets configured)
Analyzing: target //pkg/sql/sqltestutils:sqltestutils_test (1007 packages loaded, 29142 targets configured)
Analyzing: target //pkg/sql/sqltestutils:sqltestutils_test (1062 packages loaded, 29835 targets configured)
INFO: Analyzed target //pkg/sql/sqltestutils:sqltestutils_test (1063 packages loaded, 29872 targets configured).
INFO: Found 1 test target...
[0 / 5] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[239 / 831] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 0s processwrapper-sandbox ... (7 actions, 6 running)
[240 / 836] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (8 actions running)
[240 / 836] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (8 actions running)
[241 / 836] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 24s processwrapper-sandbox ... (8 actions, 7 running)
[562 / 1,915] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 24s processwrapper-sandbox ... (7 actions, 6 running)
[632 / 2,206] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 1s processwrapper-sandbox ... (6 actions, 5 running)
[696 / 2,968] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 2s processwrapper-sandbox ... (8 actions, 7 running)
[831 / 3,595] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 4s processwrapper-sandbox ... (6 actions running)
[831 / 3,595] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 15s processwrapper-sandbox ... (6 actions running)
[831 / 3,595] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 45s processwrapper-sandbox ... (6 actions running)
[832 / 3,595] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 50s processwrapper-sandbox ... (6 actions, 5 running)
[835 / 3,595] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 51s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: re

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ 2bd61ba8700c0ada35d8d6dd24546e2a36999900:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/sqlstats/sslocal:sslocal_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/sqlstats/sslocal:sslocal_test (335 packages loaded, 10986 targets configured)
Analyzing: target //pkg/sql/sqlstats/sslocal:sslocal_test (453 packages loaded, 12367 targets configured)
Analyzing: target //pkg/sql/sqlstats/sslocal:sslocal_test (598 packages loaded, 13951 targets configured)
Analyzing: target //pkg/sql/sqlstats/sslocal:sslocal_test (701 packages loaded, 15916 targets configured)
Analyzing: target //pkg/sql/sqlstats/sslocal:sslocal_test (780 packages loaded, 17732 targets configured)
Analyzing: target //pkg/sql/sqlstats/sslocal:sslocal_test (879 packages loaded, 20366 targets configured)
Analyzing: target //pkg/sql/sqlstats/sslocal:sslocal_test (920 packages loaded, 23561 targets configured)
Analyzing: target //pkg/sql/sqlstats/sslocal:sslocal_test (978 packages loaded, 27094 targets configured)
Analyzing: target //pkg/sql/sqlstats/sslocal:sslocal_test (1006 packages loaded, 29023 targets configured)
INFO: Analyzed target //pkg/sql/sqlstats/sslocal:sslocal_test (1062 packages loaded, 29872 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 5] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[356 / 1,307] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 0s processwrapper-sandbox ... (8 actions, 7 running)
[489 / 1,861] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (8 actions, 7 running)
[489 / 1,861] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 3s processwrapper-sandbox ... (8 actions running)
[489 / 1,861] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (8 actions running)
[490 / 1,861] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 24s processwrapper-sandbox ... (8 actions, 7 running)
[635 / 2,075] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 24s processwrapper-sandbox ... (4 actions running)
[733 / 2,554] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (8 actions, 7 running)
[816 / 3,349] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 3s processwrapper-sandbox ... (8 actions, 7 running)
[831 / 3,595] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 4s processwrapper-sandbox ... (6 actions, 5 running)
[831 / 3,595] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 5s processwrapper-sandbox ... (6 actions running)
[831 / 3,595] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 15s processwrapper-sandbox ... (6 actions running)
[831 / 3,595] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 45s processwrapper-sandbox ... (6 actions running)
[833 / 3,595] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 57s processwrapper-sandbox ... (5 actions, 4 running)
[845 / 3,595] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 58s processwrapper-sandbox ... (8 actions, 7 running)
[860 / 3,595] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 59s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).s

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ 73cbe7cb5c80599e9218d48479e88b6fefe43bee:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/stats:stats_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/stats:stats_test (489 packages loaded, 11523 targets configured)
Analyzing: target //pkg/sql/stats:stats_test (518 packages loaded, 12404 targets configured)
Analyzing: target //pkg/sql/stats:stats_test (663 packages loaded, 14765 targets configured)
Analyzing: target //pkg/sql/stats:stats_test (805 packages loaded, 17233 targets configured)
Analyzing: target //pkg/sql/stats:stats_test (852 packages loaded, 18483 targets configured)
Analyzing: target //pkg/sql/stats:stats_test (901 packages loaded, 21364 targets configured)
Analyzing: target //pkg/sql/stats:stats_test (913 packages loaded, 22223 targets configured)
Analyzing: target //pkg/sql/stats:stats_test (931 packages loaded, 26002 targets configured)
Analyzing: target //pkg/sql/stats:stats_test (967 packages loaded, 28325 targets configured)
Analyzing: target //pkg/sql/stats:stats_test (1007 packages loaded, 29154 targets configured)
INFO: Analyzed target //pkg/sql/stats:stats_test (1063 packages loaded, 29884 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[284 / 1,059] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 0s processwrapper-sandbox ... (8 actions, 7 running)
[293 / 1,093] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (8 actions, 7 running)
[293 / 1,093] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 3s processwrapper-sandbox ... (8 actions running)
[293 / 1,093] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 13s processwrapper-sandbox ... (8 actions running)
[294 / 1,093] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 24s processwrapper-sandbox ... (8 actions, 7 running)
[647 / 2,420] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 24s processwrapper-sandbox ... (4 actions, 3 running)
[704 / 3,145] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (5 actions, 3 running)
[830 / 3,595] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox ... (6 actions, 5 running)
[830 / 3,595] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 4s processwrapper-sandbox ... (6 actions running)
[830 / 3,595] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 12s processwrapper-sandbox ... (6 actions running)
[830 / 3,595] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 42s processwrapper-sandbox ... (6 actions running)
[831 / 3,595] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 52s processwrapper-sandbox ... (6 actions, 5 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-23b4ae28a647/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
ru

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ 73cbe7cb5c80599e9218d48479e88b6fefe43bee:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/stmtdiagnostics:stmtdiagnostics_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/stmtdiagnostics:stmtdiagnostics_test (413 packages loaded, 11279 targets configured)
Analyzing: target //pkg/sql/stmtdiagnostics:stmtdiagnostics_test (534 packages loaded, 12602 targets configured)
Analyzing: target //pkg/sql/stmtdiagnostics:stmtdiagnostics_test (653 packages loaded, 13920 targets configured)
Analyzing: target //pkg/sql/stmtdiagnostics:stmtdiagnostics_test (750 packages loaded, 16897 targets configured)
Analyzing: target //pkg/sql/stmtdiagnostics:stmtdiagnostics_test (854 packages loaded, 19975 targets configured)
Analyzing: target //pkg/sql/stmtdiagnostics:stmtdiagnostics_test (929 packages loaded, 24607 targets configured)
Analyzing: target //pkg/sql/stmtdiagnostics:stmtdiagnostics_test (974 packages loaded, 27195 targets configured)
Analyzing: target //pkg/sql/stmtdiagnostics:stmtdiagnostics_test (1005 packages loaded, 29138 targets configured)
INFO: Analyzed target //pkg/sql/stmtdiagnostics:stmtdiagnostics_test (1061 packages loaded, 29868 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 5] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[246 / 952] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (8 actions, 7 running)
[384 / 1,447] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (8 actions, 7 running)
[433 / 1,612] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 3s processwrapper-sandbox ... (8 actions, 7 running)
[443 / 1,721] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 4s processwrapper-sandbox ... (8 actions running)
[443 / 1,721] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 13s processwrapper-sandbox ... (8 actions running)
[444 / 1,721] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 22s processwrapper-sandbox ... (8 actions, 7 running)
[449 / 1,721] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 23s processwrapper-sandbox ... (8 actions, 7 running)
[653 / 2,756] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 21s processwrapper-sandbox ... (7 actions, 6 running)
[690 / 2,970] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 22s processwrapper-sandbox ... (7 actions, 6 running)
[831 / 3,593] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 4s processwrapper-sandbox ... (6 actions, 5 running)
[831 / 3,593] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 5s processwrapper-sandbox ... (6 actions running)
[831 / 3,593] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 15s processwrapper-sandbox ... (6 actions running)
[831 / 3,593] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 45s processwrapper-sandbox ... (6 actions running)
[832 / 3,593] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 54s processwrapper-sandbox ... (6 actions, 5 running)
[843 / 3,593] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 55s processwrapper-sandbox ... (7 actions, 6 running)
[855 / 3,593] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 56s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-23b4ae28a647/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ 73cbe7cb5c80599e9218d48479e88b6fefe43bee:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/syntheticprivilege:syntheticprivilege_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/syntheticprivilege:syntheticprivilege_test (128 packages loaded, 13779 targets configured)
Analyzing: target //pkg/sql/syntheticprivilege:syntheticprivilege_test (211 packages loaded, 16505 targets configured)
Analyzing: target //pkg/sql/syntheticprivilege:syntheticprivilege_test (311 packages loaded, 19431 targets configured)
Analyzing: target //pkg/sql/syntheticprivilege:syntheticprivilege_test (339 packages loaded, 23472 targets configured)
INFO: Analyzed target //pkg/sql/syntheticprivilege:syntheticprivilege_test (346 packages loaded, 24261 targets configured).
INFO: Found 1 test target...
[0 / 3] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[220 / 746] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (8 actions running)
[220 / 746] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (8 actions running)
[221 / 746] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 23s processwrapper-sandbox ... (8 actions, 7 running)
[655 / 2,163] [Prepa] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool] ... (4 actions, 1 running)
[690 / 2,427] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 1s processwrapper-sandbox ... (6 actions running)
[690 / 2,427] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 10s processwrapper-sandbox ... (6 actions running)
[690 / 2,427] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 40s processwrapper-sandbox ... (6 actions running)
[691 / 2,427] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 49s processwrapper-sandbox ... (6 actions, 5 running)
[701 / 2,427] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 50s processwrapper-sandbox ... (8 actions, 7 running)
[711 / 2,427] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 51s processwrapper-sandbox ... (8 actions, 7 running)
[723 / 2,427] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 52s processwrapper-sandbox ... (8 actions, 7 running)
[745 / 2,427] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 54s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: reloc

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ 73cbe7cb5c80599e9218d48479e88b6fefe43bee:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/tests:tests_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/tests:tests_test (546 packages loaded, 11364 targets configured)
Analyzing: target //pkg/sql/tests:tests_test (678 packages loaded, 12533 targets configured)
Analyzing: target //pkg/sql/tests:tests_test (773 packages loaded, 15101 targets configured)
Analyzing: target //pkg/sql/tests:tests_test (964 packages loaded, 18331 targets configured)
Analyzing: target //pkg/sql/tests:tests_test (1124 packages loaded, 21677 targets configured)
Analyzing: target //pkg/sql/tests:tests_test (1208 packages loaded, 24675 targets configured)
Analyzing: target //pkg/sql/tests:tests_test (1247 packages loaded, 26619 targets configured)
Analyzing: target //pkg/sql/tests:tests_test (1423 packages loaded, 29297 targets configured)
Analyzing: target //pkg/sql/tests:tests_test (1548 packages loaded, 32088 targets configured)
Analyzing: target //pkg/sql/tests:tests_test (1557 packages loaded, 33288 targets configured)
INFO: Analyzed target //pkg/sql/tests:tests_test (1573 packages loaded, 33449 targets configured).
INFO: Found 1 test target...
[0 / 5] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[324 / 1,369] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 0s processwrapper-sandbox ... (8 actions, 7 running)
[332 / 1,645] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (8 actions running)
[332 / 1,645] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (8 actions running)
[333 / 1,645] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 22s processwrapper-sandbox ... (8 actions, 7 running)
[572 / 2,358] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 23s processwrapper-sandbox ... (6 actions, 5 running)
[639 / 3,038] [Prepa] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool] ... (5 actions, 2 running)
[844 / 4,130] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 1s processwrapper-sandbox ... (5 actions, 4 running)
[845 / 4,130] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 3s processwrapper-sandbox ... (6 actions running)
[845 / 4,130] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 13s processwrapper-sandbox ... (6 actions running)
[845 / 4,130] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 43s processwrapper-sandbox ... (6 actions running)
[846 / 4,130] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 49s processwrapper-sandbox ... (6 actions, 5 running)
[854 / 4,130] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 50s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-a32faae95f26/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ 73cbe7cb5c80599e9218d48479e88b6fefe43bee:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/ttl/ttljob:ttljob_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/ttl/ttljob:ttljob_test (466 packages loaded, 10996 targets configured)
Analyzing: target //pkg/sql/ttl/ttljob:ttljob_test (530 packages loaded, 12267 targets configured)
Analyzing: target //pkg/sql/ttl/ttljob:ttljob_test (630 packages loaded, 15017 targets configured)
Analyzing: target //pkg/sql/ttl/ttljob:ttljob_test (728 packages loaded, 17830 targets configured)
Analyzing: target //pkg/sql/ttl/ttljob:ttljob_test (867 packages loaded, 21515 targets configured)
Analyzing: target //pkg/sql/ttl/ttljob:ttljob_test (920 packages loaded, 24901 targets configured)
Analyzing: target //pkg/sql/ttl/ttljob:ttljob_test (984 packages loaded, 26954 targets configured)
Analyzing: target //pkg/sql/ttl/ttljob:ttljob_test (1008 packages loaded, 29011 targets configured)
INFO: Analyzed target //pkg/sql/ttl/ttljob:ttljob_test (1071 packages loaded, 29903 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[579 / 2,023] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (7 actions, 6 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
Target //pkg/sql/ttl/ttljob:ttljob_test failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/sql/ttl/ttljob/BUILD.bazel:58:8 GoCompilePkg pkg/sql/ttl/ttljob/ttljob_test~testm

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ 73cbe7cb5c80599e9218d48479e88b6fefe43bee:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/ttl/ttlbase:ttlbase_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/ttl/ttlbase:ttlbase_test (164 packages loaded, 13835 targets configured)
Analyzing: target //pkg/sql/ttl/ttlbase:ttlbase_test (261 packages loaded, 16670 targets configured)
Analyzing: target //pkg/sql/ttl/ttlbase:ttlbase_test (401 packages loaded, 20634 targets configured)
Analyzing: target //pkg/sql/ttl/ttlbase:ttlbase_test (424 packages loaded, 24175 targets configured)
INFO: Analyzed target //pkg/sql/ttl/ttlbase:ttlbase_test (425 packages loaded, 24753 targets configured).
INFO: Found 1 test target...
[0 / 5] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[221 / 624] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 0s processwrapper-sandbox ... (7 actions running)
[352 / 1,202] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (8 actions, 7 running)
[352 / 1,202] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 3s processwrapper-sandbox ... (8 actions running)
[352 / 1,202] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (8 actions running)
[353 / 1,202] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 23s processwrapper-sandbox ... (8 actions, 7 running)
[569 / 2,010] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (5 actions, 3 running)
[720 / 2,553] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (6 actions, 5 running)
[720 / 2,553] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 3s processwrapper-sandbox ... (6 actions running)
[720 / 2,553] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 11s processwrapper-sandbox ... (6 actions running)
[720 / 2,553] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 41s processwrapper-sandbox ... (6 actions running)
[721 / 2,553] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 48s processwrapper-sandbox ... (6 actions, 5 running)
[733 / 2,553] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 50s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-a32faae95f26/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ 73cbe7cb5c80599e9218d48479e88b6fefe43bee:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/types:types_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/types:types_test (101 packages loaded, 12803 targets configured)
Analyzing: target //pkg/sql/types:types_test (138 packages loaded, 15304 targets configured)
Analyzing: target //pkg/sql/types:types_test (226 packages loaded, 19186 targets configured)
Analyzing: target //pkg/sql/types:types_test (267 packages loaded, 21641 targets configured)
INFO: Analyzed target //pkg/sql/types:types_test (272 packages loaded, 23665 targets configured).
INFO: Found 1 test target...
[0 / 5] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[447 / 1,556] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (8 actions running)
[447 / 1,556] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (8 actions running)
[448 / 1,556] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 24s processwrapper-sandbox ... (8 actions, 7 running)
[671 / 2,318] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 24s processwrapper-sandbox ... (5 actions, 3 running)
[689 / 2,351] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (6 actions, 5 running)
[689 / 2,351] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 3s processwrapper-sandbox ... (6 actions running)
[689 / 2,351] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 11s processwrapper-sandbox ... (6 actions running)
[689 / 2,351] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 41s processwrapper-sandbox ... (6 actions running)
[690 / 2,351] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 52s processwrapper-sandbox ... (6 actions, 5 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acqui

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ 2aa3bd10be16f221fe3bdbda5b117ecc6bb412fa:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/storage:storage_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/storage:storage_test (209 packages loaded, 12085 targets configured)
Analyzing: target //pkg/storage:storage_test (313 packages loaded, 14786 targets configured)
Analyzing: target //pkg/storage:storage_test (467 packages loaded, 19728 targets configured)
Analyzing: target //pkg/storage:storage_test (488 packages loaded, 22674 targets configured)
INFO: Analyzed target //pkg/storage:storage_test (498 packages loaded, 25391 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[376 / 1,274] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (8 actions, 7 running)
[376 / 1,274] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (8 actions running)
[376 / 1,274] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (8 actions running)
[377 / 1,274] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 22s processwrapper-sandbox ... (8 actions, 7 running)
[507 / 1,430] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 22s processwrapper-sandbox ... (4 actions, 3 running)
[753 / 2,704] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (7 actions, 6 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
[785 / 2,704] 1 / 1 tests, 1 failed; checking cached actions
Target

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ 2aa3bd10be16f221fe3bdbda5b117ecc6bb412fa:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/storage/enginepb:enginepb_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/storage/enginepb:enginepb_test (174 packages loaded, 14547 targets configured)
Analyzing: target //pkg/storage/enginepb:enginepb_test (396 packages loaded, 19342 targets configured)
Analyzing: target //pkg/storage/enginepb:enginepb_test (439 packages loaded, 24870 targets configured)
INFO: Analyzed target //pkg/storage/enginepb:enginepb_test (439 packages loaded, 24878 targets configured).
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[335 / 1,096] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (8 actions, 7 running)
[472 / 1,667] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (8 actions running)
[472 / 1,667] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (8 actions running)
[473 / 1,667] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 21s processwrapper-sandbox ... (8 actions, 7 running)
[680 / 2,359] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 22s processwrapper-sandbox ... (7 actions running)
[724 / 2,506] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 1s processwrapper-sandbox ... (6 actions, 4 running)
[745 / 2,638] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 2s processwrapper-sandbox ... (6 actions running)
[745 / 2,638] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 12s processwrapper-sandbox ... (6 actions running)
[745 / 2,638] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 42s processwrapper-sandbox ... (6 actions running)
[746 / 2,638] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 46s processwrapper-sandbox ... (6 actions, 5 running)
[756 / 2,638] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 47s processwrapper-sandbox ... (8 actions, 7 running)
[762 / 2,638] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 48s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_ma

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ 2aa3bd10be16f221fe3bdbda5b117ecc6bb412fa:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/storage/fs:fs_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/storage/fs:fs_test (124 packages loaded, 12277 targets configured)
Analyzing: target //pkg/storage/fs:fs_test (268 packages loaded, 15504 targets configured)
Analyzing: target //pkg/storage/fs:fs_test (402 packages loaded, 19762 targets configured)
Analyzing: target //pkg/storage/fs:fs_test (421 packages loaded, 23004 targets configured)
INFO: Analyzed target //pkg/storage/fs:fs_test (440 packages loaded, 24886 targets configured).
INFO: Found 1 test target...
[0 / 5] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[358 / 1,301] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 0s processwrapper-sandbox ... (8 actions, 7 running)
[488 / 1,847] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (8 actions running)
[488 / 1,847] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (8 actions running)
[489 / 1,847] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 22s processwrapper-sandbox ... (8 actions, 7 running)
[498 / 1,847] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 22s processwrapper-sandbox ... (6 actions, 5 running)
[640 / 2,154] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (6 actions, 5 running)
[730 / 2,610] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox ... (8 actions, 7 running)
[746 / 2,639] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 4s processwrapper-sandbox ... (6 actions running)
[746 / 2,639] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 15s processwrapper-sandbox ... (6 actions running)
[746 / 2,639] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 45s processwrapper-sandbox ... (6 actions running)
[747 / 2,639] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 49s processwrapper-sandbox ... (6 actions, 5 running)
[761 / 2,639] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 50s processwrapper-sandbox ... (8 actions, 7 running)
[780 / 2,639] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 51s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runt

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ 2aa3bd10be16f221fe3bdbda5b117ecc6bb412fa:

[57 / 227] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 13s processwrapper-sandbox ... (8 actions running)
[60 / 227] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 14s processwrapper-sandbox ... (8 actions, 7 running)
[68 / 227] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 15s processwrapper-sandbox ... (8 actions, 7 running)
[73 / 227] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 17s processwrapper-sandbox ... (8 actions, 7 running)
[78 / 227] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 18s processwrapper-sandbox ... (8 actions running)
[83 / 227] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 19s processwrapper-sandbox ... (8 actions, 7 running)
[86 / 227] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 21s processwrapper-sandbox ... (8 actions, 7 running)
[97 / 227] Compiling src/google/protobuf/text_format.cc [for tool]; 5s processwrapper-sandbox ... (8 actions running)
[100 / 227] Compiling src/google/protobuf/compiler/command_line_interface.cc [for tool]; 3s processwrapper-sandbox ... (8 actions, 7 running)
[102 / 227] Compiling src/google/protobuf/compiler/command_line_interface.cc [for tool]; 5s processwrapper-sandbox ... (8 actions, 7 running)
[105 / 227] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 4s processwrapper-sandbox ... (8 actions, 7 running)
[108 / 227] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 5s processwrapper-sandbox ... (8 actions, 7 running)
[122 / 302] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 6s processwrapper-sandbox ... (8 actions running)
[171 / 958] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 8s processwrapper-sandbox ... (8 actions, 7 running)
[174 / 958] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 9s processwrapper-sandbox ... (8 actions, 7 running)
[175 / 958] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 10s processwrapper-sandbox ... (8 actions running)
[176 / 958] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 12s processwrapper-sandbox ... (8 actions, 7 running)
[179 / 958] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 13s processwrapper-sandbox ... (8 actions, 7 running)
[179 / 958] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 14s processwrapper-sandbox ... (8 actions running)
[181 / 958] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 15s processwrapper-sandbox ... (8 actions running)
[182 / 958] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 17s processwrapper-sandbox ... (8 actions running)
[183 / 958] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 18s processwrapper-sandbox ... (8 actions running)
[185 / 958] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 20s processwrapper-sandbox ... (8 actions, 7 running)
[195 / 958] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 21s processwrapper-sandbox ... (8 actions, 7 running)
[214 / 958] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 22s processwrapper-sandbox ... (8 actions, 7 running)
[223 / 958] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 23s processwrapper-sandbox ... (8 actions, 7 running)
[224 / 958] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 24s processwrapper-sandbox ... (8 actions running)
[225 / 958] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 25s processwrapper-sandbox ... (8 actions running)
[227 / 958] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 26s processwrapper-sandbox ... (8 actions, 7 running)
[228 / 958] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 28s processwrapper-sandbox ... (8 actions, 7 running)
[228 / 958] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 29s processwrapper-sandbox ... (8 actions running)
[232 / 958] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 24s processwrapper-sandbox ... (8 actions, 7 running)
[236 / 958] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 25s processwrapper-sandbox ... (8 actions, 7 running)
[239 / 958] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 27s processwrapper-sandbox ... (8 actions running)
[241 / 958] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 28s processwrapper-sandbox ... (8 actions running)
[247 / 958] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 29s processwrapper-sandbox ... (8 actions, 7 running)
[251 / 958] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 31s processwrapper-sandbox ... (8 actions, 7 running)
[259 / 958] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 32s processwrapper-sandbox ... (8 actions, 7 running)
[264 / 958] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 33s processwrapper-sandbox ... (8 actions, 7 running)
[270 / 958] Compiling src/google/protobuf/wire_format.cc [for tool]; 2s processwrapper-sandbox ... (8 actions, 7 running)
[273 / 958] Compiling src/google/protobuf/wire_format.cc [for tool]; 3s processwrapper-sandbox ... (8 actions running)
[275 / 958] Compiling src/google/protobuf/util/message_differencer.cc [for tool]; 3s processwrapper-sandbox ... (8 actions, 7 running)
[281 / 958] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 4s processwrapper-sandbox ... (8 actions, 7 running)
[287 / 958] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 5s processwrapper-sandbox ... (8 actions, 7 running)
[293 / 958] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 6s processwrapper-sandbox ... (8 actions, 7 running)
[297 / 958] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 7s processwrapper-sandbox ... (8 actions, 7 running)
[303 / 958] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 8s processwrapper-sandbox ... (8 actions, 7 running)
[305 / 958] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 9s processwrapper-sandbox ... (8 actions, 7 running)
[305 / 958] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 10s processwrapper-sandbox ... (8 actions running)
[306 /

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ 2aa3bd10be16f221fe3bdbda5b117ecc6bb412fa:

[54 / 181] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 19s processwrapper-sandbox ... (8 actions, 7 running)
[57 / 181] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 21s processwrapper-sandbox ... (8 actions, 7 running)
[69 / 181] Compiling src/google/protobuf/compiler/command_line_interface.cc [for tool]; 3s processwrapper-sandbox ... (8 actions, 7 running)
[73 / 181] Compiling src/google/protobuf/compiler/command_line_interface.cc [for tool]; 4s processwrapper-sandbox ... (8 actions running)
[79 / 181] Compiling src/google/protobuf/compiler/js/js_generator.cc [for tool]; 2s processwrapper-sandbox ... (8 actions, 7 running)
[84 / 181] Compiling src/google/protobuf/compiler/js/js_generator.cc [for tool]; 4s processwrapper-sandbox ... (8 actions, 7 running)
[89 / 181] Compiling src/google/protobuf/compiler/js/js_generator.cc [for tool]; 5s processwrapper-sandbox ... (8 actions, 7 running)
[96 / 181] Compiling src/google/protobuf/compiler/js/js_generator.cc [for tool]; 6s processwrapper-sandbox ... (8 actions, 7 running)
[105 / 181] Compiling src/google/protobuf/compiler/js/js_generator.cc [for tool]; 7s processwrapper-sandbox ... (8 actions running)
[110 / 181] Compiling src/google/protobuf/generated_message_util.cc [for tool]; 1s processwrapper-sandbox ... (8 actions, 7 running)
[114 / 212] Compiling src/google/protobuf/compiler/parser.cc [for tool]; 3s processwrapper-sandbox ... (8 actions, 7 running)
[132 / 568] Compiling src/google/protobuf/generated_message_table_driven_lite.cc [for tool]; 4s processwrapper-sandbox ... (8 actions, 7 running)
[143 / 568] Compiling src/google/protobuf/generated_message_reflection.cc [for tool]; 3s processwrapper-sandbox ... (8 actions, 7 running)
[150 / 568] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 3s processwrapper-sandbox ... (8 actions, 7 running)
[163 / 568] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 4s processwrapper-sandbox ... (8 actions, 7 running)
[169 / 568] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 5s processwrapper-sandbox ... (8 actions running)
[176 / 568] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 6s processwrapper-sandbox ... (8 actions running)
[181 / 568] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 7s processwrapper-sandbox ... (8 actions running)
[182 / 568] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 8s processwrapper-sandbox ... (8 actions running)
[183 / 568] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 9s processwrapper-sandbox ... (8 actions, 7 running)
[187 / 568] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 11s processwrapper-sandbox ... (8 actions, 7 running)
[189 / 568] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 12s processwrapper-sandbox ... (8 actions, 7 running)
[189 / 568] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 13s processwrapper-sandbox ... (8 actions running)
[193 / 568] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 14s processwrapper-sandbox ... (8 actions, 7 running)
[196 / 568] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 15s processwrapper-sandbox ... (8 actions, 7 running)
[199 / 568] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 17s processwrapper-sandbox ... (8 actions running)
[203 / 568] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 18s processwrapper-sandbox ... (8 actions, 7 running)
[207 / 568] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 19s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
r

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ 2aa3bd10be16f221fe3bdbda5b117ecc6bb412fa:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/testutils:testutils_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/testutils:testutils_test (70 packages loaded, 14187 targets configured)
Analyzing: target //pkg/testutils:testutils_test (180 packages loaded, 17400 targets configured)
Analyzing: target //pkg/testutils:testutils_test (241 packages loaded, 20661 targets configured)
Analyzing: target //pkg/testutils:testutils_test (271 packages loaded, 22713 targets configured)
INFO: Analyzed target //pkg/testutils:testutils_test (278 packages loaded, 22947 targets configured).
INFO: Found 1 test target...
[0 / 5] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[237 / 1,272] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 0s processwrapper-sandbox ... (8 actions, 7 running)
[237 / 1,272] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (8 actions running)
[237 / 1,272] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (8 actions running)
[238 / 1,272] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 22s processwrapper-sandbox ... (8 actions, 7 running)
[650 / 2,300] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 22s processwrapper-sandbox ... (5 actions, 4 running)
[663 / 2,300] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 2s processwrapper-sandbox ... (6 actions running)
[663 / 2,300] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 11s processwrapper-sandbox ... (6 actions running)
[663 / 2,300] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 41s processwrapper-sandbox ... (6 actions running)
[664 / 2,300] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 46s processwrapper-sandbox ... (6 actions, 5 running)
[673 / 2,300] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 47s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not define

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ 2aa3bd10be16f221fe3bdbda5b117ecc6bb412fa:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/testutils/echotest:echotest_test (0 packages loaded, 0 targets configured)
INFO: Analyzed target //pkg/testutils/echotest:echotest_test (13 packages loaded, 14695 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 5] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[252 / 739] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[252 / 739] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[254 / 739] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 15s processwrapper-sandbox ... (4 actions, 3 running)
[280 / 739] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (8 actions, 7 running)
[311 / 739] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (8 actions running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
[331 / 739] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox
Target //pkg/testutils/echotest:echotest_test failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/testutils/echotest/BUILD.bazel:16:8 GoCompilePkg pkg/testutils/echotest/echotest_test~testmain.a failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builde

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ 2aa3bd10be16f221fe3bdbda5b117ecc6bb412fa:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/testutils/fingerprintutils:fingerprintutils_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/testutils/fingerprintutils:fingerprintutils_test (227 packages loaded, 10899 targets configured)
Analyzing: target //pkg/testutils/fingerprintutils:fingerprintutils_test (337 packages loaded, 12373 targets configured)
Analyzing: target //pkg/testutils/fingerprintutils:fingerprintutils_test (536 packages loaded, 15429 targets configured)
Analyzing: target //pkg/testutils/fingerprintutils:fingerprintutils_test (638 packages loaded, 16705 targets configured)
Analyzing: target //pkg/testutils/fingerprintutils:fingerprintutils_test (707 packages loaded, 20018 targets configured)
Analyzing: target //pkg/testutils/fingerprintutils:fingerprintutils_test (743 packages loaded, 21694 targets configured)
Analyzing: target //pkg/testutils/fingerprintutils:fingerprintutils_test (761 packages loaded, 26323 targets configured)
Analyzing: target //pkg/testutils/fingerprintutils:fingerprintutils_test (998 packages loaded, 28871 targets configured)
Analyzing: target //pkg/testutils/fingerprintutils:fingerprintutils_test (1012 packages loaded, 29097 targets configured)
INFO: Analyzed target //pkg/testutils/fingerprintutils:fingerprintutils_test (1063 packages loaded, 29871 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 5] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[575 / 1,931] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 0s processwrapper-sandbox ... (7 actions, 6 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many err

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ 2aa3bd10be16f221fe3bdbda5b117ecc6bb412fa:

stdout: 
, stderr: 

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ 2aa3bd10be16f221fe3bdbda5b117ecc6bb412fa:

[251 / 1,085] Compiling src/google/protobuf/generated_message_reflection.cc [for tool]; 1s processwrapper-sandbox ... (7 actions, 6 running)
[256 / 1,085] Compiling src/google/protobuf/generated_message_reflection.cc [for tool]; 2s processwrapper-sandbox ... (8 actions, 7 running)
[258 / 1,085] Compiling src/google/protobuf/generated_message_reflection.cc [for tool]; 3s processwrapper-sandbox ... (8 actions, 7 running)
[260 / 1,085] Compiling src/google/protobuf/generated_message_reflection.cc [for tool]; 4s processwrapper-sandbox ... (8 actions, 7 running)
[261 / 1,085] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 5s processwrapper-sandbox ... (8 actions running)
[262 / 1,085] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 6s processwrapper-sandbox ... (8 actions, 7 running)
[266 / 1,085] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 8s processwrapper-sandbox ... (8 actions, 7 running)
[267 / 1,085] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 9s processwrapper-sandbox ... (8 actions running)
[268 / 1,085] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 11s processwrapper-sandbox ... (8 actions, 7 running)
[268 / 1,085] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 12s processwrapper-sandbox ... (8 actions running)
[269 / 1,085] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 13s processwrapper-sandbox ... (8 actions, 7 running)
[271 / 1,085] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 15s processwrapper-sandbox ... (8 actions, 7 running)
[272 / 1,085] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 16s processwrapper-sandbox ... (8 actions running)
[273 / 1,085] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 23s processwrapper-sandbox ... (8 actions, 7 running)
[273 / 1,085] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 24s processwrapper-sandbox ... (8 actions running)
[274 / 1,085] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 26s processwrapper-sandbox ... (8 actions, 7 running)
[274 / 1,085] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 27s processwrapper-sandbox ... (8 actions running)
[275 / 1,085] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 28s processwrapper-sandbox ... (8 actions, 7 running)
[276 / 1,085] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 30s processwrapper-sandbox ... (8 actions running)
[277 / 1,085] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 33s processwrapper-sandbox ... (8 actions, 7 running)
[278 / 1,085] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 34s processwrapper-sandbox ... (8 actions running)
[279 / 1,085] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 34s processwrapper-sandbox ... (8 actions running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/BUILD.bazel:42:7: Error while validating output TreeArtifact File:[[<execution_root>]bazel-out/k8-opt-exec-2B5CBBC6-ST-d79bb2715aa5/bin]external/io_bazel_rules_go/stdlib_/pkg : java.lang.InterruptedException
[288 / 1,08

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ 2aa3bd10be16f221fe3bdbda5b117ecc6bb412fa:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/testutils/lint/passes/errcmp:errcmp_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/testutils/lint/passes/errcmp:errcmp_test (22 packages loaded, 13333 targets configured)
INFO: Analyzed target //pkg/testutils/lint/passes/errcmp:errcmp_test (24 packages loaded, 14759 targets configured).
INFO: Found 1 test target...
[0 / 5] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[251 / 774] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 0s processwrapper-sandbox ... (5 actions running)
[252 / 774] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[252 / 774] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[253 / 774] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 15s processwrapper-sandbox ... (5 actions, 3 running)
[263 / 774] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 1s processwrapper-sandbox ... (3 actions running)
[263 / 774] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 11s processwrapper-sandbox ... (3 actions running)
[264 / 774] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 23s processwrapper-sandbox ... (3 actions, 2 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
[286 / 774] 1 / 1 tests, 1 failed; checking cached actions
Target //pkg/testutils/lint/passes/errcmp:errcmp_test failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: 

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ 2aa3bd10be16f221fe3bdbda5b117ecc6bb412fa:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/testutils/lint/passes/errwrap:errwrap_test (0 packages loaded, 0 targets configured)
INFO: Analyzed target //pkg/testutils/lint/passes/errwrap:errwrap_test (24 packages loaded, 14763 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 3] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[17 / 440] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (8 actions, 7 running)
[28 / 440] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (8 actions, 7 running)
[32 / 440] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 3s processwrapper-sandbox ... (8 actions running)
[37 / 440] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 4s processwrapper-sandbox ... (8 actions, 7 running)
[44 / 440] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 5s processwrapper-sandbox ... (8 actions, 7 running)
[49 / 440] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 6s processwrapper-sandbox ... (8 actions, 7 running)
[54 / 440] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 8s processwrapper-sandbox ... (8 actions, 7 running)
[57 / 440] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 9s processwrapper-sandbox ... (8 actions running)
[62 / 440] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 10s processwrapper-sandbox ... (8 actions, 7 running)
[65 / 440] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (8 actions, 7 running)
[67 / 440] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 13s processwrapper-sandbox ... (8 actions running)
[71 / 440] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 14s processwrapper-sandbox ... (8 actions, 7 running)
[76 / 440] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 16s processwrapper-sandbox ... (8 actions, 7 running)
[78 / 440] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 17s processwrapper-sandbox ... (8 actions running)
[85 / 440] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 18s processwrapper-sandbox ... (8 actions running)
[89 / 440] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 19s processwrapper-sandbox ... (8 actions, 7 running)
[92 / 440] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 21s processwrapper-sandbox ... (8 actions, 7 running)
[103 / 440] Compiling src/google/protobuf/text_format.cc [for tool]; 3s processwrapper-sandbox ... (8 actions, 7 running)
[104 / 440] Compiling src/google/protobuf/text_format.cc [for tool]; 4s processwrapper-sandbox ... (8 actions running)
[111 / 440] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 3s processwrapper-sandbox ... (8 actions, 7 running)
[115 / 440] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 4s processwrapper-sandbox ... (8 actions, 7 running)
[117 / 440] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 6s processwrapper-sandbox ... (8 actions, 7 running)
[120 / 440] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 7s processwrapper-sandbox ... (8 actions running)
[124 / 440] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 9s processwrapper-sandbox ... (8 actions running)
[135 / 526] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 10s processwrapper-sandbox ... (8 actions running)
[136 / 526] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 11s processwrapper-sandbox ... (8 actions, 7 running)
[139 / 526] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 12s processwrapper-sandbox ... (8 actions, 7 running)
[139 / 526] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 14s processwrapper-sandbox ... (8 actions running)
[1

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ c5d1b23ded9be10271b5398242b4b622b08c8f7f:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/testutils/lint/passes/hash:hash_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/testutils/lint/passes/hash:hash_test (22 packages loaded, 13319 targets configured)
INFO: Analyzed target //pkg/testutils/lint/passes/hash:hash_test (24 packages loaded, 14756 targets configured).
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[266 / 772] Creating runfiles tree bazel-out/k8-fastbuild/bin/pkg/testutils/lint/passes/hash/hash_test_/hash_test.runfiles; 0s local ... (8 actions, 6 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
Target //pkg/testutils/lint/passes/hash:hash_test failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/testutils/lint/passes/hash/BUILD.bazel:14:8 GoCompilePkg pkg/testutils/lint/passes/hash/hash_test~testmain.a failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
INFO: Elapsed time: 4.056s, Critical Path: 1.59s
INFO: 18 processes: 13 internal, 5 processwrapper-sandbox.
FAILED: Build did NOT complete successf

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ c5d1b23ded9be10271b5398242b4b622b08c8f7f:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/testutils/lint/passes/forbiddenmethod:forbiddenmethod_test (0 packages loaded, 0 targets configured)
INFO: Analyzed target //pkg/testutils/lint/passes/forbiddenmethod:forbiddenmethod_test (24 packages loaded, 14768 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 5] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[251 / 774] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (5 actions running)
[252 / 774] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (4 actions running)
[252 / 774] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[253 / 774] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 15s processwrapper-sandbox ... (5 actions, 3 running)
[263 / 774] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 1s processwrapper-sandbox ... (3 actions running)
[263 / 774] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 10s processwrapper-sandbox ... (3 actions running)
[264 / 774] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 22s processwrapper-sandbox ... (3 actions, 2 running)
[273 / 774] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 23s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
[290 / 774] 1 / 1 tests, 1 failed; checking cached actions
Target //pkg/testutils/lint/passes/forbiddenmethod:forbiddenmethod_test failed to bu

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ c5d1b23ded9be10271b5398242b4b622b08c8f7f:

[85 / 259] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 1s processwrapper-sandbox ... (8 actions, 7 running)
[91 / 259] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 3s processwrapper-sandbox ... (8 actions, 7 running)
[94 / 259] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 4s processwrapper-sandbox ... (8 actions running)
[99 / 259] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 5s processwrapper-sandbox ... (8 actions, 7 running)
[103 / 259] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 7s processwrapper-sandbox ... (8 actions, 7 running)
[106 / 259] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 8s processwrapper-sandbox ... (8 actions running)
[107 / 259] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 9s processwrapper-sandbox ... (8 actions running)
[110 / 259] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 10s processwrapper-sandbox ... (8 actions, 7 running)
[116 / 288] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 11s processwrapper-sandbox ... (8 actions, 7 running)
[128 / 457] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 12s processwrapper-sandbox ... (8 actions, 7 running)
[136 / 572] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 13s processwrapper-sandbox ... (8 actions, 7 running)
[138 / 572] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 14s processwrapper-sandbox ... (8 actions, 7 running)
[142 / 572] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 16s processwrapper-sandbox ... (8 actions, 7 running)
[147 / 572] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 17s processwrapper-sandbox ... (8 actions running)
[151 / 572] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 18s processwrapper-sandbox ... (8 actions running)
[154 / 572] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 19s processwrapper-sandbox ... (8 actions, 7 running)
[161 / 572] Compiling src/google/protobuf/compiler/js/js_generator.cc [for tool]; 9s processwrapper-sandbox ... (8 actions, 7 running)
[183 / 572] Compiling src/google/protobuf/compiler/js/js_generator.cc [for tool]; 10s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
Target //pkg/testutils/lint/passes/fmtsafe:fmtsafe_test failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/util/log/logpb/BUILD.bazel:5:11 GoCompilePkg pkg/util/log/logpb/logpb.a [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
INFO: Elapsed time: 

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ c5d1b23ded9be10271b5398242b4b622b08c8f7f:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/testutils/lint/passes/leaktestcall:leaktestcall_test (0 packages loaded, 0 targets configured)
INFO: Analyzed target //pkg/testutils/lint/passes/leaktestcall:leaktestcall_test (24 packages loaded, 14757 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[251 / 772] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 0s processwrapper-sandbox ... (5 actions running)
[252 / 772] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[252 / 772] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[253 / 772] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 16s processwrapper-sandbox ... (5 actions, 3 running)
[262 / 772] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (4 actions, 3 running)
[263 / 772] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (3 actions running)
[263 / 772] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 10s processwrapper-sandbox ... (3 actions running)
[264 / 772] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 24s processwrapper-sandbox ... (3 actions, 2 running)
[274 / 772] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 25s processwrapper-sandbox ... (8 actions running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
Target //pkg/testutils/lint/passes/leaktestcall:leaktestcall_test 

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ c5d1b23ded9be10271b5398242b4b622b08c8f7f:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/testutils/lint/passes/loopvarcapture:loopvarcapture_test (0 packages loaded, 0 targets configured)
INFO: Analyzed target //pkg/testutils/lint/passes/loopvarcapture:loopvarcapture_test (24 packages loaded, 14761 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 5] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[251 / 775] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (5 actions running)
[252 / 775] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (4 actions running)
[252 / 775] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 13s processwrapper-sandbox ... (4 actions running)
[253 / 775] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 15s processwrapper-sandbox ... (4 actions, 3 running)
[263 / 775] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (3 actions running)
[263 / 775] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 11s processwrapper-sandbox ... (3 actions running)
[264 / 775] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 23s processwrapper-sandbox ... (3 actions, 2 running)
[283 / 775] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 24s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
Target //pkg/testutils/lint/passes/loopvarcapture:loopvarcapture_test failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /go/s

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ c5d1b23ded9be10271b5398242b4b622b08c8f7f:

[84 / 248] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 21s processwrapper-sandbox ... (8 actions, 7 running)
[89 / 248] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 22s processwrapper-sandbox ... (8 actions running)
[96 / 248] Compiling src/google/protobuf/text_format.cc [for tool]; 4s processwrapper-sandbox ... (8 actions running)
[104 / 248] Compiling src/google/protobuf/generated_message_reflection.cc [for tool]; 2s processwrapper-sandbox ... (8 actions, 7 running)
[109 / 248] Compiling src/google/protobuf/generated_message_reflection.cc [for tool]; 3s processwrapper-sandbox ... (8 actions, 7 running)
[122 / 491] Compiling src/google/protobuf/compiler/command_line_interface.cc [for tool]; 1s processwrapper-sandbox ... (8 actions, 7 running)
[124 / 491] Compiling src/google/protobuf/compiler/command_line_interface.cc [for tool]; 2s processwrapper-sandbox ... (8 actions, 7 running)
[125 / 491] Compiling src/google/protobuf/compiler/command_line_interface.cc [for tool]; 4s processwrapper-sandbox ... (8 actions running)
[130 / 491] Compiling src/google/protobuf/descriptor.cc [for tool]; 5s processwrapper-sandbox ... (8 actions, 7 running)
[136 / 491] Compiling src/google/protobuf/descriptor.cc [for tool]; 6s processwrapper-sandbox ... (8 actions running)
[139 / 491] Compiling src/google/protobuf/descriptor.cc [for tool]; 8s processwrapper-sandbox ... (8 actions running)
[144 / 491] Compiling src/google/protobuf/descriptor.cc [for tool]; 10s processwrapper-sandbox ... (8 actions, 7 running)
[148 / 491] Compiling src/google/protobuf/descriptor.cc [for tool]; 11s processwrapper-sandbox ... (8 actions, 7 running)
[150 / 491] Compiling src/google/protobuf/descriptor.cc [for tool]; 12s processwrapper-sandbox ... (8 actions, 7 running)
[153 / 491] Compiling src/google/protobuf/descriptor.cc [for tool]; 13s processwrapper-sandbox ... (8 actions running)
[155 / 491] Compiling src/google/protobuf/descriptor.cc [for tool]; 15s processwrapper-sandbox ... (8 actions, 7 running)
[161 / 491] Compiling src/google/protobuf/descriptor.cc [for tool]; 16s processwrapper-sandbox ... (8 actions, 7 running)
[169 / 491] Compiling src/google/protobuf/descriptor.cc [for tool]; 17s processwrapper-sandbox ... (8 actions, 7 running)
[180 / 491] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 17s processwrapper-sandbox ... (8 actions, 7 running)
[184 / 491] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 18s processwrapper-sandbox ... (8 actions, 7 running)
[187 / 491] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 19s processwrapper-sandbox ... (8 actions running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
Target //pkg/testutils/lint/passes/nilness:nilness_test failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/util/log/logpb/BUILD.bazel:5:11 GoCompilePkg pkg/util/log/logpb/logpb.a [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk ex

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ c5d1b23ded9be10271b5398242b4b622b08c8f7f:

[79 / 392] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 18s processwrapper-sandbox ... (8 actions, 7 running)
[83 / 392] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 19s processwrapper-sandbox ... (8 actions, 7 running)
[90 / 392] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 21s processwrapper-sandbox ... (8 actions, 7 running)
[97 / 392] Compiling src/google/protobuf/generated_message_table_driven.cc [for tool]; 1s processwrapper-sandbox ... (8 actions running)
[100 / 392] Compiling src/google/protobuf/generated_message_table_driven.cc [for tool]; 2s processwrapper-sandbox ... (8 actions, 7 running)
[104 / 392] Compiling src/google/protobuf/generated_message_reflection.cc [for tool]; 4s processwrapper-sandbox ... (8 actions, 7 running)
[110 / 392] Compiling src/google/protobuf/descriptor.cc [for tool]; 4s processwrapper-sandbox ... (8 actions, 7 running)
[129 / 683] Compiling src/google/protobuf/descriptor.cc [for tool]; 6s processwrapper-sandbox ... (8 actions, 7 running)
[130 / 683] Compiling src/google/protobuf/descriptor.cc [for tool]; 7s processwrapper-sandbox ... (8 actions running)
[132 / 683] Compiling src/google/protobuf/descriptor.cc [for tool]; 8s processwrapper-sandbox ... (8 actions running)
[134 / 683] Compiling src/google/protobuf/descriptor.cc [for tool]; 9s processwrapper-sandbox ... (8 actions, 7 running)
[137 / 683] Compiling src/google/protobuf/descriptor.cc [for tool]; 10s processwrapper-sandbox ... (8 actions, 7 running)
[140 / 683] Compiling src/google/protobuf/descriptor.cc [for tool]; 12s processwrapper-sandbox ... (8 actions running)
[142 / 683] Compiling src/google/protobuf/descriptor.cc [for tool]; 13s processwrapper-sandbox ... (7 actions, 6 running)
[145 / 683] Compiling src/google/protobuf/descriptor.cc [for tool]; 15s processwrapper-sandbox ... (8 actions running)
[148 / 683] Compiling src/google/protobuf/descriptor.cc [for tool]; 16s processwrapper-sandbox ... (8 actions running)
[152 / 683] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 16s processwrapper-sandbox ... (8 actions, 7 running)
[165 / 683] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 17s processwrapper-sandbox ... (8 actions, 7 running)
[167 / 683] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 19s processwrapper-sandbox ... (8 actions, 7 running)
[173 / 683] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 20s processwrapper-sandbox ... (8 actions, 7 running)
[194 / 683] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 16s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
Target //pkg/testutils/lint/passes/passesutil:passesutil_test failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/com_github_cockroachdb_errors/errorspb/BUILD.bazel:30:11 GoCompilePkg external/com_github_cockroachdb_errors/errorspb/errorspb.a [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a9

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ c5d1b23ded9be10271b5398242b4b622b08c8f7f:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/testutils/lint/passes/timer:timer_test (0 packages loaded, 0 targets configured)
INFO: Analyzed target //pkg/testutils/lint/passes/timer:timer_test (24 packages loaded, 14757 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[251 / 772] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (5 actions running)
[252 / 772] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (4 actions running)
[252 / 772] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[253 / 772] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 15s processwrapper-sandbox ... (4 actions, 3 running)
[263 / 772] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (3 actions running)
[263 / 772] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 10s processwrapper-sandbox ... (3 actions running)
[264 / 772] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 22s processwrapper-sandbox ... (3 actions, 2 running)
[280 / 772] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 23s processwrapper-sandbox ... (8 actions, 6 running)
[308 / 772] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 24s processwrapper-sandbox ... (8 actions running)
[339 / 772] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 25s processwrapper-sandbox ... (8 actions, 7 running)
[369 / 772] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 26s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/g

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ c5d1b23ded9be10271b5398242b4b622b08c8f7f:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/testutils/lint/passes/returnerrcheck:returnerrcheck_test (0 packages loaded, 0 targets configured)
INFO: Analyzed target //pkg/testutils/lint/passes/returnerrcheck:returnerrcheck_test (24 packages loaded, 14758 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[251 / 774] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (5 actions running)
[252 / 774] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (4 actions running)
[252 / 774] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[254 / 774] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 15s processwrapper-sandbox ... (3 actions, 2 running)
[263 / 774] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (3 actions running)
[263 / 774] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 11s processwrapper-sandbox ... (3 actions running)
[264 / 774] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 23s processwrapper-sandbox ... (3 actions, 2 running)
[279 / 774] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 24s processwrapper-sandbox ... (8 actions, 7 running)
[291 / 774] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 25s processwrapper-sandbox ... (8 actions, 7 running)
[320 / 774] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 26s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcomm

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ c5d1b23ded9be10271b5398242b4b622b08c8f7f:

[101 / 418] Compiling src/google/protobuf/struct.pb.cc [for tool]; 3s processwrapper-sandbox ... (8 actions, 7 running)
[104 / 418] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 3s processwrapper-sandbox ... (8 actions running)
[106 / 418] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 5s processwrapper-sandbox ... (8 actions, 7 running)
[108 / 418] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 6s processwrapper-sandbox ... (8 actions running)
[110 / 418] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 7s processwrapper-sandbox ... (8 actions running)
[113 / 418] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 8s processwrapper-sandbox ... (8 actions, 7 running)
[114 / 418] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 10s processwrapper-sandbox ... (8 actions, 7 running)
[130 / 671] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 11s processwrapper-sandbox ... (8 actions running)
[131 / 671] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 12s processwrapper-sandbox ... (8 actions, 7 running)
[131 / 671] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 14s processwrapper-sandbox ... (8 actions running)
[132 / 671] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 15s processwrapper-sandbox ... (8 actions, 7 running)
[133 / 671] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 16s processwrapper-sandbox ... (8 actions, 7 running)
[133 / 671] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 18s processwrapper-sandbox ... (8 actions running)
[135 / 671] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 19s processwrapper-sandbox ... (8 actions running)
[136 / 671] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 20s processwrapper-sandbox ... (8 actions, 7 running)
[137 / 671] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 21s processwrapper-sandbox ... (8 actions, 7 running)
[139 / 671] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 23s processwrapper-sandbox ... (8 actions running)
[142 / 671] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 24s processwrapper-sandbox ... (8 actions, 7 running)
[150 / 671] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 25s processwrapper-sandbox ... (8 actions, 7 running)
[172 / 671] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 26s processwrapper-sandbox ... (8 actions, 7 running)
[200 / 671] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 27s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
Target //pkg/testutils/lint/passes/nocopy:nocopy_test failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/util/log/logpb/BUILD.bazel:5:11 GoCompilePkg pkg/util/log/logpb/logpb.a [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90e

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ c5d1b23ded9be10271b5398242b4b622b08c8f7f:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/testutils/lint/passes/unconvert:unconvert_test (0 packages loaded, 0 targets configured)
INFO: Analyzed target //pkg/testutils/lint/passes/unconvert:unconvert_test (24 packages loaded, 14759 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 5] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[251 / 774] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (5 actions running)
[252 / 774] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (4 actions running)
[252 / 774] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[253 / 774] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 15s processwrapper-sandbox ... (5 actions, 3 running)
[263 / 774] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (3 actions running)
[263 / 774] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 10s processwrapper-sandbox ... (3 actions running)
[264 / 774] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 23s processwrapper-sandbox ... (3 actions, 2 running)
[273 / 774] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 24s processwrapper-sandbox ... (7 actions running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
Target //pkg/testutils/lint/passes/unconvert:unconvert_test failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /go/src/github.com/cockroachdb/cockroa

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ c5d1b23ded9be10271b5398242b4b622b08c8f7f:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/testutils/listenerutil:listenerutil_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/testutils/listenerutil:listenerutil_test (80 packages loaded, 13824 targets configured)
Analyzing: target //pkg/testutils/listenerutil:listenerutil_test (154 packages loaded, 18617 targets configured)
INFO: Analyzed target //pkg/testutils/listenerutil:listenerutil_test (175 packages loaded, 22072 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[330 / 1,144] [Prepa] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool] ... (8 actions, 5 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
[333 / 1,144] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (6 actions running)
Target //pkg/testutils/listenerutil:listenerutil_test failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/testutils/listenerutil/BUILD.bazel:15:8 GoCompilePkg pkg/testutils/listenerutil/listenerutil_test~testmain.a failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see ver

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ c5d1b23ded9be10271b5398242b4b622b08c8f7f:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/testutils/release:release_test (0 packages loaded, 0 targets configured)
INFO: Analyzed target //pkg/testutils/release:release_test (4 packages loaded, 14565 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 6] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[249 / 718] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[249 / 718] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[251 / 718] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 15s processwrapper-sandbox ... (3 actions, 2 running)
[260 / 718] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (3 actions running)
[260 / 718] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 11s processwrapper-sandbox ... (3 actions running)
[261 / 718] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 24s processwrapper-sandbox ... (3 actions, 2 running)
[289 / 718] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 25s processwrapper-sandbox ... (8 actions running)
[316 / 718] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 26s processwrapper-sandbox ... (7 actions, 6 running)
[336 / 718] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 27s processwrapper-sandbox ... (7 actions, 6 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
[360 / 718] 1 / 1 tests, 1 failed; checking cached actions
Target //pkg/testutils/release:release_test failed to bui

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

[rickystewart]

Branch deletion problem for "Fake release branch" release-23.1.17-custom. Will leave this open for now to collect failures.

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ c5d1b23ded9be10271b5398242b4b622b08c8f7f:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/testutils/sqlutils:sqlutils_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/testutils/sqlutils:sqlutils_test (232 packages loaded, 10968 targets configured)
Analyzing: target //pkg/testutils/sqlutils:sqlutils_test (321 packages loaded, 12147 targets configured)
Analyzing: target //pkg/testutils/sqlutils:sqlutils_test (353 packages loaded, 13187 targets configured)
Analyzing: target //pkg/testutils/sqlutils:sqlutils_test (386 packages loaded, 13642 targets configured)
Analyzing: target //pkg/testutils/sqlutils:sqlutils_test (555 packages loaded, 15443 targets configured)
Analyzing: target //pkg/testutils/sqlutils:sqlutils_test (696 packages loaded, 19469 targets configured)
Analyzing: target //pkg/testutils/sqlutils:sqlutils_test (739 packages loaded, 21985 targets configured)
Analyzing: target //pkg/testutils/sqlutils:sqlutils_test (856 packages loaded, 25609 targets configured)
Analyzing: target //pkg/testutils/sqlutils:sqlutils_test (985 packages loaded, 28033 targets configured)
Analyzing: target //pkg/testutils/sqlutils:sqlutils_test (998 packages loaded, 28980 targets configured)
Analyzing: target //pkg/testutils/sqlutils:sqlutils_test (1051 packages loaded, 29718 targets configured)
INFO: Analyzed target //pkg/testutils/sqlutils:sqlutils_test (1061 packages loaded, 29869 targets configured).
INFO: Found 1 test target...
[0 / 5] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[354 / 1,287] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 0s processwrapper-sandbox ... (8 actions, 7 running)
[354 / 1,287] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (8 actions running)
[354 / 1,287] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (8 actions running)
[355 / 1,287] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 22s processwrapper-sandbox ... (8 actions, 7 running)
[698 / 2,721] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 22s processwrapper-sandbox ... (5 actions, 4 running)
[786 / 3,416] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (8 actions, 7 running)
[831 / 3,593] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox ... (6 actions running)
[831 / 3,593] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 12s processwrapper-sandbox ... (6 actions running)
[831 / 3,593] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 42s processwrapper-sandbox ... (6 actions running)
[832 / 3,593] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 47s processwrapper-sandbox ... (6 actions, 5 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-23b4ae28a647/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: r

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ c5d1b23ded9be10271b5398242b4b622b08c8f7f:

stdout: 
, stderr: 

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ c5d1b23ded9be10271b5398242b4b622b08c8f7f:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/testutils/testcluster:testcluster_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/testutils/testcluster:testcluster_test (307 packages loaded, 12010 targets configured)
Analyzing: target //pkg/testutils/testcluster:testcluster_test (376 packages loaded, 13274 targets configured)
Analyzing: target //pkg/testutils/testcluster:testcluster_test (554 packages loaded, 15403 targets configured)
Analyzing: target //pkg/testutils/testcluster:testcluster_test (591 packages loaded, 17439 targets configured)
Analyzing: target //pkg/testutils/testcluster:testcluster_test (712 packages loaded, 20349 targets configured)
Analyzing: target //pkg/testutils/testcluster:testcluster_test (758 packages loaded, 24463 targets configured)
Analyzing: target //pkg/testutils/testcluster:testcluster_test (926 packages loaded, 27077 targets configured)
Analyzing: target //pkg/testutils/testcluster:testcluster_test (999 packages loaded, 28980 targets configured)
INFO: Analyzed target //pkg/testutils/testcluster:testcluster_test (1062 packages loaded, 29869 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[216 / 832] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (8 actions running)
[216 / 832] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (8 actions running)
[217 / 832] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 22s processwrapper-sandbox ... (8 actions, 7 running)
[569 / 2,056] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 22s processwrapper-sandbox ... (5 actions, 4 running)
[642 / 2,673] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 0s processwrapper-sandbox ... (6 actions, 4 running)
[831 / 3,594] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 1s processwrapper-sandbox ... (5 actions, 4 running)
[831 / 3,594] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 3s processwrapper-sandbox ... (6 actions running)
[831 / 3,594] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 12s processwrapper-sandbox ... (6 actions running)
[831 / 3,594] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 42s processwrapper-sandbox ... (6 actions running)
[832 / 3,594] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 45s processwrapper-sandbox ... (6 actions, 5 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not def

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ c5d1b23ded9be10271b5398242b4b622b08c8f7f:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/ts:ts_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/ts:ts_test (221 packages loaded, 11010 targets configured)
Analyzing: target //pkg/ts:ts_test (363 packages loaded, 11760 targets configured)
Analyzing: target //pkg/ts:ts_test (435 packages loaded, 12165 targets configured)
Analyzing: target //pkg/ts:ts_test (567 packages loaded, 14870 targets configured)
Analyzing: target //pkg/ts:ts_test (683 packages loaded, 18280 targets configured)
Analyzing: target //pkg/ts:ts_test (726 packages loaded, 20154 targets configured)
Analyzing: target //pkg/ts:ts_test (838 packages loaded, 23396 targets configured)
Analyzing: target //pkg/ts:ts_test (979 packages loaded, 26658 targets configured)
Analyzing: target //pkg/ts:ts_test (991 packages loaded, 28489 targets configured)
Analyzing: target //pkg/ts:ts_test (1055 packages loaded, 29684 targets configured)
INFO: Analyzed target //pkg/ts:ts_test (1063 packages loaded, 29883 targets configured).
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[355 / 1,225] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 0s processwrapper-sandbox ... (8 actions, 7 running)
[493 / 1,802] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (8 actions running)
[493 / 1,802] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (8 actions running)
[494 / 1,802] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 24s processwrapper-sandbox ... (8 actions, 7 running)
[681 / 2,381] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 25s processwrapper-sandbox ... (8 actions, 7 running)
[746 / 2,688] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (6 actions, 5 running)
[816 / 3,522] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox ... (7 actions running)
[831 / 3,595] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 3s processwrapper-sandbox ... (6 actions running)
[831 / 3,595] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 14s processwrapper-sandbox ... (6 actions running)
[831 / 3,595] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 44s processwrapper-sandbox ... (6 actions running)
[832 / 3,595] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 55s processwrapper-sandbox ... (6 actions, 5 running)
[841 / 3,595] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 56s processwrapper-sandbox ... (8 actions, 7 running)
[857 / 3,595] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 57s processwrapper-sandbox ... (8 actions, 7 running)
[869 / 3,595] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 58s processwrapper-sandbox ... (8 actions, 7 running)
[882 / 3,595] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 59s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

[cockroach-teamcity]

. failed with artifacts on release-23.1.17-custom @ 4cc2bbd87f8273c4165fc88732e34c007de44dd2:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/ts/testmodel:testmodel_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/ts/testmodel:testmodel_test (63 packages loaded, 14812 targets configured)
Analyzing: target //pkg/ts/testmodel:testmodel_test (115 packages loaded, 17092 targets configured)
INFO: Analyzed target //pkg/ts/testmodel:testmodel_test (152 packages loaded, 17333 targets configured).
INFO: Found 1 test target...
[0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[382 / 1,194] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 0s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
[421 / 1,194] 1 / 1 tests, 1 failed; checking cached actions
Target //pkg/ts/testmodel:testmodel_test failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/ts/testmodel/BUILD.bazel:15:8 GoCompilePkg pkg/ts/testmodel/testmodel_test~testmain.a failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
INFO: Elapsed time: 5.697s, Critical Path: 2.27s
INFO: 66 processes: 23 inter

Parameters:

• TAGS=bazel,gss,race
• stress=true
  Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!