cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
https://www.cockroachlabs.com
Other
30.21k stars 3.82k forks source link

: failed #121043

Closed cockroach-teamcity closed 8 months ago

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ 2bd61ba8700c0ada35d8d6dd24546e2a36999900:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-disk:fakedist-disk_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-disk:fakedist-disk_test (300 packages loaded, 12223 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-disk:fakedist-disk_test (457 packages loaded, 14034 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-disk:fakedist-disk_test (621 packages loaded, 15441 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-disk:fakedist-disk_test (717 packages loaded, 17137 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-disk:fakedist-disk_test (789 packages loaded, 17875 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-disk:fakedist-disk_test (829 packages loaded, 18458 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-disk:fakedist-disk_test (987 packages loaded, 21755 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-disk:fakedist-disk_test (1115 packages loaded, 25435 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-disk:fakedist-disk_test (1223 packages loaded, 28914 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-disk:fakedist-disk_test (1227 packages loaded, 31236 targets configured)
INFO: Analyzed target //pkg/sql/sqlitelogictest/tests/fakedist-disk:fakedist-disk_test (1283 packages loaded, 31967 targets configured).
INFO: Found 1 test target...
[0 / 3] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[226 / 1,183] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 0s processwrapper-sandbox ... (8 actions, 7 running)
[358 / 1,703] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (8 actions running)
[358 / 1,703] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (8 actions running)
[360 / 1,703] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 23s processwrapper-sandbox ... (7 actions, 6 running)
[654 / 2,744] Generating Descriptor Set proto_library //pkg/repstream/streampb:streampb_proto; 0s processwrapper-sandbox ... (4 actions, 3 running)
[831 / 3,816] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 0s processwrapper-sandbox ... (4 actions, 3 running)
[831 / 3,816] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 2s processwrapper-sandbox ... (6 actions running)
[831 / 3,816] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 10s processwrapper-sandbox ... (6 actions running)
[831 / 3,816] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 40s processwrapper-sandbox ... (6 actions running)
[832 / 3,816] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 49s processwrapper-sandbox ... (6 actions, 5 running)
[845 / 3,816] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 50s processwrapper-sandbox ... (8 actions, 7 running)
[861 / 3,816] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 51s processwrapper-sandbox ... (8 actions, 7 running)
[876 / 3,816] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 52s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-a32faae95f26/bin/external/go_sdk/builder_reset/builder link -sdk exte

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #120986 : failed [C-test-failure O-robot T-testeng branch-release-23.1 release-blocker] - #120985 : failed [C-test-failure O-robot T-testeng branch-release-23.2.4-rc release-blocker]

/cc @cockroachdb/test-eng

This test on roachdash | Improve this report!

Jira issue: CRDB-37044

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ 4cc2bbd87f8273c4165fc88732e34c007de44dd2:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/ui:ui_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/ui:ui_test (125 packages loaded, 13913 targets configured)
Analyzing: target //pkg/ui:ui_test (321 packages loaded, 16072 targets configured)
Analyzing: target //pkg/ui:ui_test (447 packages loaded, 20813 targets configured)
Analyzing: target //pkg/ui:ui_test (472 packages loaded, 25075 targets configured)
INFO: Analyzed target //pkg/ui:ui_test (472 packages loaded, 25075 targets configured).
INFO: Found 1 test target...
[0 / 5] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[282 / 953] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 0s processwrapper-sandbox ... (8 actions, 7 running)
[297 / 1,017] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (8 actions running)
[297 / 1,017] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (8 actions running)
[298 / 1,017] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 22s processwrapper-sandbox ... (8 actions, 7 running)
[619 / 2,306] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 22s processwrapper-sandbox ... (7 actions, 6 running)
[780 / 2,717] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[790 / 2,717] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 2s processwrapper-sandbox ... (8 actions, 7 running)
[809 / 2,717] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 3s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ 4cc2bbd87f8273c4165fc88732e34c007de44dd2:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/upgrade/upgrademanager:upgrademanager_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/upgrade/upgrademanager:upgrademanager_test (416 packages loaded, 12294 targets configured)
Analyzing: target //pkg/upgrade/upgrademanager:upgrademanager_test (609 packages loaded, 14791 targets configured)
Analyzing: target //pkg/upgrade/upgrademanager:upgrademanager_test (726 packages loaded, 16874 targets configured)
Analyzing: target //pkg/upgrade/upgrademanager:upgrademanager_test (874 packages loaded, 21387 targets configured)
Analyzing: target //pkg/upgrade/upgrademanager:upgrademanager_test (914 packages loaded, 24148 targets configured)
Analyzing: target //pkg/upgrade/upgrademanager:upgrademanager_test (967 packages loaded, 26830 targets configured)
Analyzing: target //pkg/upgrade/upgrademanager:upgrademanager_test (1062 packages loaded, 29870 targets configured)
INFO: Analyzed target //pkg/upgrade/upgrademanager:upgrademanager_test (1062 packages loaded, 29870 targets configured).
INFO: Found 1 test target...
[0 / 6] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[699 / 3,021] [Prepa] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool] ... (3 actions, 0 running)
[725 / 3,021] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 0s processwrapper-sandbox ... (8 actions, 7 running)
[747 / 3,021] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 1s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-a32faae95f26/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit sta

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ 4cc2bbd87f8273c4165fc88732e34c007de44dd2:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/upgrade/upgradecluster:upgradecluster_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/upgrade/upgradecluster:upgradecluster_test (489 packages loaded, 13148 targets configured)
Analyzing: target //pkg/upgrade/upgradecluster:upgradecluster_test (693 packages loaded, 15685 targets configured)
Analyzing: target //pkg/upgrade/upgradecluster:upgradecluster_test (863 packages loaded, 20990 targets configured)
Analyzing: target //pkg/upgrade/upgradecluster:upgradecluster_test (936 packages loaded, 23980 targets configured)
Analyzing: target //pkg/upgrade/upgradecluster:upgradecluster_test (997 packages loaded, 27460 targets configured)
INFO: Analyzed target //pkg/upgrade/upgradecluster:upgradecluster_test (1061 packages loaded, 29869 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 5] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[337 / 1,097] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 0s processwrapper-sandbox ... (8 actions, 7 running)
[467 / 1,645] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (8 actions running)
[467 / 1,645] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (8 actions running)
[468 / 1,645] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 23s processwrapper-sandbox ... (8 actions, 7 running)
[614 / 1,956] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 24s processwrapper-sandbox ... (8 actions, 7 running)
[722 / 2,418] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (8 actions, 6 running)
[792 / 3,154] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox ... (8 actions, 7 running)
[831 / 3,593] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 4s processwrapper-sandbox ... (6 actions running)
[831 / 3,593] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 15s processwrapper-sandbox ... (6 actions running)
[831 / 3,593] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 45s processwrapper-sandbox ... (6 actions running)
[832 / 3,593] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 48s processwrapper-sandbox ... (5 actions running)
[837 / 3,593] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 49s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __t

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ 4cc2bbd87f8273c4165fc88732e34c007de44dd2:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/upgrade/upgrades:upgrades_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/upgrade/upgrades:upgrades_test (512 packages loaded, 12500 targets configured)
Analyzing: target //pkg/upgrade/upgrades:upgrades_test (620 packages loaded, 13490 targets configured)
Analyzing: target //pkg/upgrade/upgrades:upgrades_test (737 packages loaded, 14909 targets configured)
Analyzing: target //pkg/upgrade/upgrades:upgrades_test (1022 packages loaded, 19287 targets configured)
Analyzing: target //pkg/upgrade/upgrades:upgrades_test (1090 packages loaded, 21082 targets configured)
Analyzing: target //pkg/upgrade/upgrades:upgrades_test (1156 packages loaded, 22617 targets configured)
Analyzing: target //pkg/upgrade/upgrades:upgrades_test (1243 packages loaded, 25590 targets configured)
Analyzing: target //pkg/upgrade/upgrades:upgrades_test (1358 packages loaded, 27690 targets configured)
Analyzing: target //pkg/upgrade/upgrades:upgrades_test (1488 packages loaded, 29974 targets configured)
Analyzing: target //pkg/upgrade/upgrades:upgrades_test (1545 packages loaded, 32446 targets configured)
Analyzing: target //pkg/upgrade/upgrades:upgrades_test (1550 packages loaded, 32786 targets configured)
INFO: Analyzed target //pkg/upgrade/upgrades:upgrades_test (1563 packages loaded, 32917 targets configured).
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[376 / 1,300] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (8 actions running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running 

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ 4cc2bbd87f8273c4165fc88732e34c007de44dd2:

[90 / 265] Compiling src/google/protobuf/descriptor.cc [for tool]; 2s processwrapper-sandbox ... (8 actions, 7 running)
[107 / 265] Compiling src/google/protobuf/descriptor.cc [for tool]; 3s processwrapper-sandbox ... (8 actions, 7 running)
[131 / 669] Compiling src/google/protobuf/descriptor.cc [for tool]; 4s processwrapper-sandbox ... (8 actions, 7 running)
[137 / 669] Compiling src/google/protobuf/descriptor.cc [for tool]; 5s processwrapper-sandbox ... (8 actions, 7 running)
[142 / 669] Compiling src/google/protobuf/descriptor.cc [for tool]; 6s processwrapper-sandbox ... (8 actions running)
[143 / 669] Compiling src/google/protobuf/descriptor.cc [for tool]; 7s processwrapper-sandbox ... (8 actions running)
[148 / 669] Compiling src/google/protobuf/descriptor.cc [for tool]; 8s processwrapper-sandbox ... (8 actions, 7 running)
[152 / 669] Compiling src/google/protobuf/descriptor.cc [for tool]; 9s processwrapper-sandbox ... (8 actions, 7 running)
[159 / 669] Compiling src/google/protobuf/descriptor.cc [for tool]; 10s processwrapper-sandbox ... (8 actions, 7 running)
[159 / 669] Compiling src/google/protobuf/descriptor.cc [for tool]; 12s processwrapper-sandbox ... (8 actions running)
[162 / 669] Compiling src/google/protobuf/descriptor.cc [for tool]; 13s processwrapper-sandbox ... (8 actions running)
[163 / 669] Compiling src/google/protobuf/descriptor.cc [for tool]; 14s processwrapper-sandbox ... (8 actions, 7 running)
[173 / 669] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 12s processwrapper-sandbox ... (8 actions, 7 running)
[174 / 669] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 13s processwrapper-sandbox ... (8 actions, 7 running)
[176 / 669] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 15s processwrapper-sandbox ... (8 actions running)
[178 / 669] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 16s processwrapper-sandbox ... (8 actions running)
[181 / 669] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 17s processwrapper-sandbox ... (8 actions, 7 running)
[184 / 669] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 18s processwrapper-sandbox ... (8 actions, 7 running)
[186 / 669] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 20s processwrapper-sandbox ... (8 actions running)
[198 / 669] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 20s processwrapper-sandbox ... (8 actions running)
[231 / 669] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 21s processwrapper-sandbox ... (8 actions running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
Target //pkg/util:util_test failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/util/log/logpb/BUILD.bazel:5:11 GoCompilePkg pkg/util/log/logpb/logpb.a [for tool] failed: (Exit 1): builder failed: error executing command (from targ

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ 4cc2bbd87f8273c4165fc88732e34c007de44dd2:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/admission:admission_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/util/admission:admission_test (91 packages loaded, 11330 targets configured)
Analyzing: target //pkg/util/admission:admission_test (207 packages loaded, 15519 targets configured)
Analyzing: target //pkg/util/admission:admission_test (274 packages loaded, 20285 targets configured)
INFO: Analyzed target //pkg/util/admission:admission_test (280 packages loaded, 22987 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[225 / 822] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 0s processwrapper-sandbox ... (8 actions, 7 running)
[353 / 1,356] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (8 actions running)
[353 / 1,356] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (8 actions running)
[354 / 1,356] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 22s processwrapper-sandbox ... (8 actions, 7 running)
[662 / 2,302] [Prepa] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool] ... (4 actions, 3 running)
[663 / 2,302] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (6 actions running)
[663 / 2,302] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 10s processwrapper-sandbox ... (6 actions running)
[663 / 2,302] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 40s processwrapper-sandbox ... (6 actions running)
[664 / 2,302] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 47s processwrapper-sandbox ... (6 actions, 5 running)
[675 / 2,302] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 49s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_relea

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ 4cc2bbd87f8273c4165fc88732e34c007de44dd2:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/bitarray:bitarray_test (0 packages loaded, 0 targets configured)
INFO: Analyzed target //pkg/util/bitarray:bitarray_test (11 packages loaded, 14648 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 7] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[254 / 735] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[254 / 735] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[255 / 735] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 14s processwrapper-sandbox ... (4 actions, 3 running)
[284 / 735] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
Target //pkg/util/bitarray:bitarray_test failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/util/bitarray/BUILD.bazel:15:8 GoCompilePkg pkg/util/bitarray/bitarray_test_test.external.a failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox 

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ 4cc2bbd87f8273c4165fc88732e34c007de44dd2:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/binfetcher:binfetcher_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/util/binfetcher:binfetcher_test (93 packages loaded, 14531 targets configured)
Analyzing: target //pkg/util/binfetcher:binfetcher_test (153 packages loaded, 18686 targets configured)
INFO: Analyzed target //pkg/util/binfetcher:binfetcher_test (170 packages loaded, 22070 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[341 / 1,186] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 0s processwrapper-sandbox ... (8 actions running)
[467 / 1,678] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (8 actions running)
[467 / 1,678] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (8 actions running)
[469 / 1,678] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 23s processwrapper-sandbox ... (7 actions, 6 running)
[642 / 2,166] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 24s processwrapper-sandbox ... (5 actions, 4 running)
[650 / 2,175] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox ... (6 actions running)
[650 / 2,175] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 13s processwrapper-sandbox ... (6 actions running)
[650 / 2,175] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 43s processwrapper-sandbox ... (6 actions running)
[651 / 2,175] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 48s processwrapper-sandbox ... (6 actions, 5 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pk

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ 4cc2bbd87f8273c4165fc88732e34c007de44dd2:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/bitmap:bitmap_test (0 packages loaded, 0 targets configured)
INFO: Analyzed target //pkg/util/bitmap:bitmap_test (5 packages loaded, 14630 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[249 / 724] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[249 / 724] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[250 / 724] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 14s processwrapper-sandbox ... (4 actions, 3 running)
[260 / 724] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (3 actions running)
[260 / 724] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 10s processwrapper-sandbox ... (3 actions running)
[261 / 724] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 23s processwrapper-sandbox ... (3 actions, 2 running)
[281 / 724] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 24s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
Target //pkg/util/bitmap:bitmap_test failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/util/log/logpb/BUILD.bazel:5:11 GoCompilePkg pkg/util/log/logpb/logpb.a [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tool

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ 4cc2bbd87f8273c4165fc88732e34c007de44dd2:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/buildutil:buildutil_test (0 packages loaded, 0 targets configured)
INFO: Analyzed target //pkg/util/buildutil:buildutil_test (4 packages loaded, 13739 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 5] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[157 / 514] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (8 actions, 7 running)
[184 / 514] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (8 actions, 7 running)
[220 / 514] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
Target //pkg/util/buildutil:buildutil_test failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/com_github_cockroachdb_errors/errorspb/BUILD.bazel:30:11 GoCompilePkg external/com_github_cockroachdb_errors/errorspb/errorspb.a [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
INFO

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ 4cc2bbd87f8273c4165fc88732e34c007de44dd2:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/cache:cache_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/util/cache:cache_test (34 packages loaded, 14498 targets configured)
INFO: Analyzed target //pkg/util/cache:cache_test (102 packages loaded, 16997 targets configured).
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[284 / 1,036] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[284 / 1,036] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[285 / 1,036] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 14s processwrapper-sandbox ... (4 actions, 3 running)
[305 / 1,036] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
Target //pkg/util/cache:cache_test failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/util/sysutil/BUILD.bazel:3:11 GoCompilePkg pkg/util/sysutil/sysutil.a failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to s

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ 4cc2bbd87f8273c4165fc88732e34c007de44dd2:

[427 / 1,385] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 11s processwrapper-sandbox ... (8 actions running)
[428 / 1,385] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 12s processwrapper-sandbox ... (8 actions running)
[429 / 1,385] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 16s processwrapper-sandbox ... (8 actions, 7 running)
[429 / 1,385] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 17s processwrapper-sandbox ... (8 actions running)
[430 / 1,385] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 22s processwrapper-sandbox ... (8 actions, 7 running)
[431 / 1,385] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 23s processwrapper-sandbox ... (8 actions running)
[432 / 1,385] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 29s processwrapper-sandbox ... (8 actions, 7 running)
[432 / 1,385] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 30s processwrapper-sandbox ... (8 actions running)
[433 / 1,385] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 35s processwrapper-sandbox ... (8 actions, 7 running)
[433 / 1,385] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 37s processwrapper-sandbox ... (8 actions running)
[434 / 1,385] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 39s processwrapper-sandbox ... (8 actions, 7 running)
[434 / 1,385] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 40s processwrapper-sandbox ... (8 actions running)
[435 / 1,385] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 41s processwrapper-sandbox ... (8 actions, 7 running)
[436 / 1,385] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 43s processwrapper-sandbox ... (8 actions, 7 running)
[436 / 1,385] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 44s processwrapper-sandbox ... (8 actions running)
[444 / 1,385] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 45s processwrapper-sandbox ... (8 actions, 7 running)
[452 / 1,385] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 46s processwrapper-sandbox ... (8 actions, 7 running)
[473 / 1,385] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 47s processwrapper-sandbox ... (7 actions, 6 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
Target //pkg/util/bulk:bulk_test failed to build
Use --verbose_failures to see the command lines of failed build steps.
INFO: Elapsed time: 77.514s, Critical Path: 71.76s
INFO: 207 processes: 76 internal, 131 processwrapper-sandbox.
FAILED: Build did NOT complete successfully
FAILED: Build did N

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ 4cc2bbd87f8273c4165fc88732e34c007de44dd2:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/caller:caller_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/util/caller:caller_test (46 packages loaded, 14519 targets configured)
INFO: Analyzed target //pkg/util/caller:caller_test (99 packages loaded, 17029 targets configured).
INFO: Found 1 test target...
[0 / 3] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[284 / 1,037] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[284 / 1,037] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[285 / 1,037] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 15s processwrapper-sandbox ... (4 actions, 3 running)
[301 / 1,037] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (8 actions, 7 running)
[330 / 1,037] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (7 actions, 6 running)
[362 / 1,037] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox ... (7 actions, 6 running)
[384 / 1,037] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 3s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
[396 / 1,037] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 4s processwrapper-sandbox ... (3 actions running)
Target //pkg/util/caller:caller_test failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /go/src/github.com/cockro

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ 4cc2bbd87f8273c4165fc88732e34c007de44dd2:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/cgroups:cgroups_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/util/cgroups:cgroups_test (66 packages loaded, 14627 targets configured)
Analyzing: target //pkg/util/cgroups:cgroups_test (146 packages loaded, 18352 targets configured)
INFO: Analyzed target //pkg/util/cgroups:cgroups_test (171 packages loaded, 22071 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 5] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[652 / 2,176] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 0s processwrapper-sandbox ... (6 actions, 5 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
[656 / 2,176] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 1s processwrapper-sandbox ... (5 actions running)
[660 / 2,176] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox
[660 / 2,176] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 12s processwrapper-sandbox
[661 / 2,176] 1 / 1 tests, 1 failed; checking cached actions
Target //pkg/util/cgroups:cgroups_test failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/util/cgroups/BUILD.bazel:16:8 GoCompilePkg pkg/util/cgroups/cgroups_test.internal.a failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk e

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ 4cc2bbd87f8273c4165fc88732e34c007de44dd2:

stdout: 
, stderr: 

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ 4cc2bbd87f8273c4165fc88732e34c007de44dd2:

stdout: 
, stderr: 

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ 4cc2bbd87f8273c4165fc88732e34c007de44dd2:

stdout: 
, stderr: 

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ 4cc2bbd87f8273c4165fc88732e34c007de44dd2:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/cloudinfo:cloudinfo_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/util/cloudinfo:cloudinfo_test (23 packages loaded, 14507 targets configured)
INFO: Analyzed target //pkg/util/cloudinfo:cloudinfo_test (39 packages loaded, 16046 targets configured).
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[263 / 873] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[263 / 873] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[264 / 873] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 15s processwrapper-sandbox ... (4 actions, 3 running)
[274 / 873] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[274 / 873] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[275 / 873] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 28s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
[286 / 873] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 29s processwrapper-sandbox ... (3 actions running)
Target //pkg/util/cloudinfo:cloudinfo_test failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/util/cloudinfo/BUILD.bazel:11:8 GoCompilePkg pkg/util/cloudinfo/clo

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ 4cc2bbd87f8273c4165fc88732e34c007de44dd2:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/circuit:circuit_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/util/circuit:circuit_test (131 packages loaded, 14822 targets configured)
Analyzing: target //pkg/util/circuit:circuit_test (179 packages loaded, 21982 targets configured)
INFO: Analyzed target //pkg/util/circuit:circuit_test (179 packages loaded, 22101 targets configured).
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[325 / 1,119] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 0s processwrapper-sandbox ... (8 actions, 7 running)
[325 / 1,119] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (8 actions running)
[325 / 1,119] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (8 actions running)
[326 / 1,119] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 22s processwrapper-sandbox ... (8 actions, 7 running)
[650 / 2,184] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 0s processwrapper-sandbox
[650 / 2,184] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 1s processwrapper-sandbox ... (6 actions running)
[650 / 2,184] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 10s processwrapper-sandbox ... (6 actions running)
[650 / 2,184] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 40s processwrapper-sandbox ... (6 actions running)
[651 / 2,184] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 46s processwrapper-sandbox ... (6 actions, 5 running)
[662 / 2,184] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 47s processwrapper-sandbox ... (8 actions, 7 running)
[672 / 2,184] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 48s processwrapper-sandbox ... (8 actions, 7 running)
[682 / 2,184] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 49s processwrapper-sandbox ... (8 actions, 7 running)
[691 / 2,184] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 51s processwrapper-sandbox ... (8 actions, 7 running)
[707 / 2,184] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 52s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-a32faae95f26/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation targ

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ 4cc2bbd87f8273c4165fc88732e34c007de44dd2:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/ctxutil:ctxutil_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/util/ctxutil:ctxutil_test (30 packages loaded, 14150 targets configured)
INFO: Analyzed target //pkg/util/ctxutil:ctxutil_test (101 packages loaded, 17035 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[284 / 1,039] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[284 / 1,039] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[285 / 1,039] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 14s processwrapper-sandbox ... (4 actions, 3 running)
[295 / 1,039] [Prepa] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool] ... (3 actions, 2 running)
[295 / 1,039] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (4 actions running)
[295 / 1,039] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 10s processwrapper-sandbox ... (4 actions running)
[296 / 1,039] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 30s processwrapper-sandbox ... (6 actions, 3 running)
[307 / 1,039] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 31s processwrapper-sandbox ... (8 actions, 7 running)
[321 / 1,039] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 32s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
Target //pkg/ut

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ 4cc2bbd87f8273c4165fc88732e34c007de44dd2:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/ctxgroup:ctxgroup_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/util/ctxgroup:ctxgroup_test (83 packages loaded, 14075 targets configured)
Analyzing: target //pkg/util/ctxgroup:ctxgroup_test (165 packages loaded, 18766 targets configured)
INFO: Analyzed target //pkg/util/ctxgroup:ctxgroup_test (172 packages loaded, 22075 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 5] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[218 / 998] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 0s processwrapper-sandbox ... (8 actions, 7 running)
[348 / 1,541] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (8 actions running)
[348 / 1,541] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (8 actions running)
[350 / 1,541] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 22s processwrapper-sandbox ... (7 actions, 6 running)
[643 / 2,177] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 23s processwrapper-sandbox ... (6 actions, 5 running)
[650 / 2,177] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 1s processwrapper-sandbox ... (6 actions, 5 running)
[650 / 2,177] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 2s processwrapper-sandbox ... (6 actions running)
[650 / 2,177] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 11s processwrapper-sandbox ... (6 actions running)
[650 / 2,177] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 41s processwrapper-sandbox ... (6 actions running)
[651 / 2,177] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 47s processwrapper-sandbox ... (6 actions, 5 running)
[667 / 2,177] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 48s processwrapper-sandbox ... (8 actions, 7 running)
[678 / 2,177] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 49s processwrapper-sandbox ... (8 actions running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-23b4ae28a647/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not de

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ 4cc2bbd87f8273c4165fc88732e34c007de44dd2:

stdout: 
, stderr: 

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ 4cc2bbd87f8273c4165fc88732e34c007de44dd2:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/encoding:encoding_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/util/encoding:encoding_test (88 packages loaded, 13658 targets configured)
Analyzing: target //pkg/util/encoding:encoding_test (156 packages loaded, 17231 targets configured)
INFO: Analyzed target //pkg/util/encoding:encoding_test (157 packages loaded, 17415 targets configured).
INFO: Found 1 test target...
[0 / 3] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[331 / 1,160] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[331 / 1,160] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[333 / 1,160] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 15s processwrapper-sandbox ... (3 actions, 2 running)
[341 / 1,160] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (4 actions running)
[341 / 1,160] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 11s processwrapper-sandbox ... (4 actions running)
[342 / 1,160] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 31s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
[355 / 1,160] 1 / 1 tests, 1 failed; checking cached actions
Target //pkg/util/encoding:encoding_test failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/util/log/logpb/BUILD.bazel:5:11 GoC

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ 4cc2bbd87f8273c4165fc88732e34c007de44dd2:

stdout: 
, stderr: 

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ 4cc2bbd87f8273c4165fc88732e34c007de44dd2:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/envutil:envutil_test (0 packages loaded, 0 targets configured)
INFO: Analyzed target //pkg/util/envutil:envutil_test (4 packages loaded, 14626 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[249 / 722] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[249 / 722] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[250 / 722] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 15s processwrapper-sandbox ... (4 actions, 3 running)
[265 / 722] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (8 actions, 7 running)
[307 / 722] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (8 actions running)
[329 / 722] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox ... (8 actions, 7 running)
[357 / 722] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 3s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
Target //pkg/util/envutil:envutil_test failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/util/envutil/BUILD.bazel:15:8 GoCompilePkg pkg/util/envutil/envutil_test~testmain.a failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ 4cc2bbd87f8273c4165fc88732e34c007de44dd2:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/errorutil/unimplemented:unimplemented_test (0 packages loaded, 0 targets configured)
INFO: Analyzed target //pkg/util/errorutil/unimplemented:unimplemented_test (10 packages loaded, 14646 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[254 / 734] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[254 / 734] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[256 / 734] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 14s processwrapper-sandbox ... (3 actions, 2 running)
[265 / 734] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (3 actions running)
[265 / 734] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 10s processwrapper-sandbox ... (3 actions running)
[266 / 734] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 22s processwrapper-sandbox ... (4 actions, 2 running)
[279 / 734] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 23s processwrapper-sandbox ... (8 actions, 7 running)
[297 / 734] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 24s processwrapper-sandbox ... (8 actions, 7 running)
[330 / 734] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 25s processwrapper-sandbox ... (8 actions, 7 running)
[354 / 734] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 26s processwrapper-sandbox ... (7 actions, 6 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ 4cc2bbd87f8273c4165fc88732e34c007de44dd2:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/encoding/csv:csv_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/util/encoding/csv:csv_test (43 packages loaded, 13811 targets configured)
INFO: Analyzed target //pkg/util/encoding/csv:csv_test (100 packages loaded, 16992 targets configured).
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[284 / 1,034] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[284 / 1,034] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[285 / 1,034] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 15s processwrapper-sandbox ... (4 actions, 3 running)
[295 / 1,034] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[295 / 1,034] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[296 / 1,034] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 30s processwrapper-sandbox ... (4 actions, 3 running)
[309 / 1,034] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 32s processwrapper-sandbox ... (8 actions, 7 running)
[322 / 1,034] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 33s processwrapper-sandbox ... (8 actions, 7 running)
[333 / 1,034] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 34s processwrapper-sandbox ... (8 actions, 7 running)
[357 / 1,034] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 35s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ e354a4d94b0fb94f0b709d3e06ef6c3b7022caee:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/flagutil:flagutil_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/util/flagutil:flagutil_test (30 packages loaded, 14140 targets configured)
Analyzing: target //pkg/util/flagutil:flagutil_test (99 packages loaded, 16602 targets configured)
INFO: Analyzed target //pkg/util/flagutil:flagutil_test (100 packages loaded, 16989 targets configured).
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[284 / 1,034] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 0s processwrapper-sandbox ... (4 actions running)
[284 / 1,034] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[285 / 1,034] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 15s processwrapper-sandbox ... (4 actions, 3 running)
[295 / 1,034] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (4 actions running)
[295 / 1,034] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 11s processwrapper-sandbox ... (4 actions running)
[296 / 1,034] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 31s processwrapper-sandbox ... (4 actions, 3 running)
[306 / 1,034] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 32s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
[318 / 1,034] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 33s processwrapper-sandbox ... (3 actions running)
Target //pkg/util/flagutil:flagutil_test faile

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ e354a4d94b0fb94f0b709d3e06ef6c3b7022caee:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/fsm:fsm_test (0 packages loaded, 0 targets configured)
INFO: Analyzed target //pkg/util/fsm:fsm_test (4 packages loaded, 13734 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 3] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[166 / 511] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 0s processwrapper-sandbox ... (8 actions, 7 running)
[192 / 511] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (8 actions, 7 running)
[226 / 511] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (8 actions, 7 running)
[247 / 511] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 3s processwrapper-sandbox ... (8 actions, 7 running)
[276 / 511] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 5s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
Target //pkg/util/fsm:fsm_test failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/util/log/logpb/BUILD.bazel:5:11 GoCompilePkg pkg/util/log/logpb/logpb.a [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list .

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ e354a4d94b0fb94f0b709d3e06ef6c3b7022caee:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/fuzzystrmatch:fuzzystrmatch_test (0 packages loaded, 0 targets configured)
INFO: Analyzed target //pkg/util/fuzzystrmatch:fuzzystrmatch_test (4 packages loaded, 13690 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 5] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[131 / 506] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (3 actions running)
[131 / 506] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (3 actions running)
[133 / 506] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 14s processwrapper-sandbox ... (3 actions, 1 running)
[140 / 506] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (3 actions running)
[140 / 506] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 11s processwrapper-sandbox ... (3 actions running)
[141 / 506] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 23s processwrapper-sandbox ... (3 actions, 2 running)
[159 / 506] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 24s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
[188 / 506] 1 / 1 tests, 1 failed; checking cached actions
Target //pkg/util/fuzzystrmatch:fuzzystrmatch_test failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/util/log/logpb/BUILD.bazel:5:11 GoCompilePkg pkg/util/log/logpb/logpb.a [for too

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ e354a4d94b0fb94f0b709d3e06ef6c3b7022caee:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/future:future_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/util/future:future_test (58 packages loaded, 14392 targets configured)
Analyzing: target //pkg/util/future:future_test (163 packages loaded, 18669 targets configured)
INFO: Analyzed target //pkg/util/future:future_test (173 packages loaded, 22077 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[223 / 932] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (8 actions running)
[223 / 932] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (8 actions running)
[225 / 932] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 23s processwrapper-sandbox ... (7 actions, 6 running)
[650 / 2,179] [Prepa] GoStdlib external/io_bazel_rules_go/stdlib_/pkg ... (2 actions, 0 running)
[650 / 2,179] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 1s processwrapper-sandbox ... (6 actions running)
[650 / 2,179] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 10s processwrapper-sandbox ... (6 actions running)
[650 / 2,179] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 40s processwrapper-sandbox ... (6 actions running)
[651 / 2,179] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 47s processwrapper-sandbox ... (6 actions, 5 running)
[664 / 2,179] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 48s processwrapper-sandbox ... (7 actions, 6 running)
[678 / 2,179] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 49s processwrapper-sandbox ... (7 actions running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire no

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ e354a4d94b0fb94f0b709d3e06ef6c3b7022caee:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/goschedstats:goschedstats_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/util/goschedstats:goschedstats_test (82 packages loaded, 13766 targets configured)
Analyzing: target //pkg/util/goschedstats:goschedstats_test (161 packages loaded, 17633 targets configured)
INFO: Analyzed target //pkg/util/goschedstats:goschedstats_test (170 packages loaded, 22071 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[221 / 578] [Prepa] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool] ... (7 actions, 6 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
[224 / 578] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (6 actions running)
Target //pkg/util/goschedstats:goschedstats_test failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/util/goschedstats/BUILD.bazel:19:8 GoCompilePkg pkg/util/goschedstats/goschedstats_test~testmain.a failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and reta

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ e354a4d94b0fb94f0b709d3e06ef6c3b7022caee:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/grpcutil:grpcutil_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/util/grpcutil:grpcutil_test (284 packages loaded, 12114 targets configured)
Analyzing: target //pkg/util/grpcutil:grpcutil_test (316 packages loaded, 13676 targets configured)
Analyzing: target //pkg/util/grpcutil:grpcutil_test (395 packages loaded, 16132 targets configured)
Analyzing: target //pkg/util/grpcutil:grpcutil_test (473 packages loaded, 19476 targets configured)
Analyzing: target //pkg/util/grpcutil:grpcutil_test (491 packages loaded, 22178 targets configured)
Analyzing: target //pkg/util/grpcutil:grpcutil_test (807 packages loaded, 25088 targets configured)
Analyzing: target //pkg/util/grpcutil:grpcutil_test (1058 packages loaded, 29857 targets configured)
INFO: Analyzed target //pkg/util/grpcutil:grpcutil_test (1058 packages loaded, 29857 targets configured).
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[782 / 3,034] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 0s processwrapper-sandbox ... (7 actions, 6 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
Target //pkg/util/grpcutil:grpcutil_test failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/util/leaktest/BUILD.bazel:3:11 GoCompilePkg pkg/util/leaktest/leaktest.a failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ e354a4d94b0fb94f0b709d3e06ef6c3b7022caee:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/grunning:grunning_test (0 packages loaded, 0 targets configured)
INFO: Analyzed target //pkg/util/grunning:grunning_test (11 packages loaded, 14745 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[252 / 738] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[252 / 738] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[253 / 738] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 15s processwrapper-sandbox ... (4 actions, 3 running)
[271 / 738] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
Target //pkg/util/grunning:grunning_test failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/util/grunning/BUILD.bazel:14:8 GoCompilePkg pkg/util/grunning/grunning_test.internal.a failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and r

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ e354a4d94b0fb94f0b709d3e06ef6c3b7022caee:

stdout: 
, stderr: 

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ e354a4d94b0fb94f0b709d3e06ef6c3b7022caee:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/httputil:httputil_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/util/httputil:httputil_test (21 packages loaded, 13866 targets configured)
INFO: Analyzed target //pkg/util/httputil:httputil_test (43 packages loaded, 16119 targets configured).
INFO: Found 1 test target...
[0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[263 / 882] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[263 / 882] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[264 / 882] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 15s processwrapper-sandbox ... (4 actions, 3 running)
[280 / 882] [Prepa] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool] ... (8 actions, 6 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
Target //pkg/util/httputil:httputil_test failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/util/uuid/BUILD.bazel:3:11 GoCompilePkg pkg/util/uuid/uuid.a failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ e354a4d94b0fb94f0b709d3e06ef6c3b7022caee:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/humanizeutil:humanizeutil_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/util/humanizeutil:humanizeutil_test (19 packages loaded, 15125 targets configured)
INFO: Analyzed target //pkg/util/humanizeutil:humanizeutil_test (26 packages loaded, 15802 targets configured).
INFO: Found 1 test target...
[1 / 14] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[260 / 810] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[260 / 810] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[261 / 810] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 14s processwrapper-sandbox ... (4 actions, 3 running)
[271 / 810] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (4 actions, 3 running)
[271 / 810] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (4 actions running)
[271 / 810] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 11s processwrapper-sandbox ... (4 actions running)
[272 / 810] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 31s processwrapper-sandbox ... (4 actions, 3 running)
[290 / 810] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 32s processwrapper-sandbox ... (8 actions, 7 running)
[309 / 810] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 33s processwrapper-sandbox ... (8 actions, 7 running)
[326 / 810] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 34s processwrapper-sandbox ... (7 actions, 6 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many 

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ e354a4d94b0fb94f0b709d3e06ef6c3b7022caee:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/interval:interval_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/util/interval:interval_test (53 packages loaded, 14604 targets configured)
Analyzing: target //pkg/util/interval:interval_test (101 packages loaded, 16973 targets configured)
INFO: Analyzed target //pkg/util/interval:interval_test (102 packages loaded, 17000 targets configured).
INFO: Found 1 test target...
[0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[284 / 1,036] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[284 / 1,036] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[285 / 1,036] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 14s processwrapper-sandbox ... (4 actions, 3 running)
[295 / 1,036] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[295 / 1,036] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[296 / 1,036] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 29s processwrapper-sandbox ... (4 actions, 3 running)
[305 / 1,036] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 30s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
Target //pkg/util/interval:interval_test failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /g

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ e354a4d94b0fb94f0b709d3e06ef6c3b7022caee:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/interval/generic:generic_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/util/interval/generic:generic_test (85 packages loaded, 14126 targets configured)
Analyzing: target //pkg/util/interval/generic:generic_test (158 packages loaded, 18459 targets configured)
INFO: Analyzed target //pkg/util/interval/generic:generic_test (171 packages loaded, 22076 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 3] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[476 / 1,731] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (8 actions, 7 running)
[476 / 1,731] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (8 actions running)
[476 / 1,731] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (8 actions running)
[477 / 1,731] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 22s processwrapper-sandbox ... (8 actions, 7 running)
[624 / 2,035] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 22s processwrapper-sandbox ... (5 actions, 3 running)
[651 / 2,180] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox ... (6 actions running)
[651 / 2,180] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 10s processwrapper-sandbox ... (6 actions running)
[651 / 2,180] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 40s processwrapper-sandbox ... (6 actions running)
[652 / 2,180] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 47s processwrapper-sandbox ... (6 actions, 5 running)
[661 / 2,180] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 48s processwrapper-sandbox ... (7 actions, 6 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ e354a4d94b0fb94f0b709d3e06ef6c3b7022caee:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/intsets:intsets_test (0 packages loaded, 0 targets configured)
INFO: Analyzed target //pkg/util/intsets:intsets_test (5 packages loaded, 14595 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[249 / 719] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[249 / 719] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[251 / 719] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 14s processwrapper-sandbox ... (4 actions, 2 running)
[260 / 719] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (3 actions running)
[260 / 719] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 10s processwrapper-sandbox ... (3 actions running)
[261 / 719] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 22s processwrapper-sandbox ... (3 actions, 2 running)
[273 / 719] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 23s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
[297 / 719] 1 / 1 tests, 1 failed; checking cached actions
Target //pkg/util/intsets:intsets_test failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/util/intsets/BUILD.bazel:20:8 GoCompilePkg pkg/util/intsets/intsets_test~testmain.a failed: (Exit 1): builder failed

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ e354a4d94b0fb94f0b709d3e06ef6c3b7022caee:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/ipaddr:ipaddr_test (0 packages loaded, 0 targets configured)
INFO: Analyzed target //pkg/util/ipaddr:ipaddr_test (11 packages loaded, 14649 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[254 / 735] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[254 / 735] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[257 / 735] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 15s processwrapper-sandbox ... (4 actions, 1 running)
[265 / 735] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (3 actions running)
[265 / 735] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 11s processwrapper-sandbox ... (3 actions running)
[266 / 735] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 24s processwrapper-sandbox ... (3 actions, 2 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
[291 / 735] checking cached actions
Target //pkg/util/ipaddr:ipaddr_test failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/util/ipaddr/BUILD.bazel:19:8 GoCompilePkg pkg/util/ipaddr/ipaddr_test~testmain.a failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/ext

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ e354a4d94b0fb94f0b709d3e06ef6c3b7022caee:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/json:json_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/util/json:json_test (60 packages loaded, 14915 targets configured)
INFO: Analyzed target //pkg/util/json:json_test (72 packages loaded, 16543 targets configured).
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[284 / 952] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[284 / 952] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[285 / 952] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 15s processwrapper-sandbox ... (5 actions, 3 running)
[295 / 952] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (4 actions, 3 running)
[295 / 952] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox ... (4 actions running)
[295 / 952] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 11s processwrapper-sandbox ... (4 actions running)
[296 / 952] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 30s processwrapper-sandbox ... (4 actions, 3 running)
[311 / 952] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 31s processwrapper-sandbox ... (8 actions, 7 running)
[323 / 952] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 32s processwrapper-sandbox ... (8 actions, 7 running)
[337 / 952] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 33s processwrapper-sandbox ... (8 actions running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sd

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ e354a4d94b0fb94f0b709d3e06ef6c3b7022caee:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/json/tokenizer:tokenizer_test (0 packages loaded, 0 targets configured)
INFO: Analyzed target //pkg/util/json/tokenizer:tokenizer_test (4 packages loaded, 13739 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 3] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[131 / 511] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (3 actions running)
[131 / 511] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (3 actions running)
[133 / 511] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 14s processwrapper-sandbox ... (2 actions, 1 running)
[161 / 511] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (8 actions, 7 running)
[193 / 511] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
Target //pkg/util/json/tokenizer:tokenizer_test failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/com_github_cockroachdb_errors/errorspb/BUILD.bazel:30:11 GoCompilePkg external/com_github_cockroachdb_errors/errorspb/errorspb.a [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ e354a4d94b0fb94f0b709d3e06ef6c3b7022caee:

stdout: 
, stderr: 

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ e354a4d94b0fb94f0b709d3e06ef6c3b7022caee:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/log:log_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/util/log:log_test (89 packages loaded, 13625 targets configured)
Analyzing: target //pkg/util/log:log_test (161 packages loaded, 16421 targets configured)
INFO: Analyzed target //pkg/util/log:log_test (183 packages loaded, 17930 targets configured).
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[357 / 1,428] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[357 / 1,428] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[359 / 1,428] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 15s processwrapper-sandbox ... (3 actions, 2 running)
[381 / 1,428] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
Target //pkg/util/log:log_test failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/util/log/BUILD.bazel:132:8 GoCompilePkg pkg/util/log/log_test_test.external.a failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ e354a4d94b0fb94f0b709d3e06ef6c3b7022caee:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/log/eventpb:eventpb_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/util/log/eventpb:eventpb_test (115 packages loaded, 14851 targets configured)
Analyzing: target //pkg/util/log/eventpb:eventpb_test (221 packages loaded, 18179 targets configured)
Analyzing: target //pkg/util/log/eventpb:eventpb_test (270 packages loaded, 21843 targets configured)
INFO: Analyzed target //pkg/util/log/eventpb:eventpb_test (274 packages loaded, 23691 targets configured).
INFO: Found 1 test target...
[0 / 3] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[347 / 1,182] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (8 actions, 7 running)
[476 / 1,740] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (8 actions running)
[476 / 1,740] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (8 actions running)
[478 / 1,740] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 22s processwrapper-sandbox ... (7 actions, 6 running)
[633 / 2,143] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 23s processwrapper-sandbox ... (7 actions, 6 running)
[705 / 2,374] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (6 actions, 5 running)
[706 / 2,374] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 3s processwrapper-sandbox ... (6 actions running)
[706 / 2,374] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 12s processwrapper-sandbox ... (6 actions running)
[706 / 2,374] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 42s processwrapper-sandbox ... (6 actions running)
[707 / 2,374] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 48s processwrapper-sandbox ... (6 actions, 5 running)
[721 / 2,374] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 49s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ e354a4d94b0fb94f0b709d3e06ef6c3b7022caee:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/log/logconfig:logconfig_test (0 packages loaded, 0 targets configured)
INFO: Analyzed target //pkg/util/log/logconfig:logconfig_test (5 packages loaded, 15727 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[262 / 795] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[262 / 795] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[263 / 795] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 15s processwrapper-sandbox ... (4 actions, 3 running)
[273 / 795] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[273 / 795] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[274 / 795] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 28s processwrapper-sandbox ... (4 actions, 3 running)
[283 / 795] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 29s processwrapper-sandbox ... (8 actions running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
[293 / 795] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 30s processwrapper-sandbox ... (7 actions running)
Target //pkg/util/log/logconfig:logconfig_test failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/util/log/logpb/BUILD

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ e354a4d94b0fb94f0b709d3e06ef6c3b7022caee:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/log/logcrash:logcrash_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/util/log/logcrash:logcrash_test (288 packages loaded, 11395 targets configured)
Analyzing: target //pkg/util/log/logcrash:logcrash_test (293 packages loaded, 11470 targets configured)
Analyzing: target //pkg/util/log/logcrash:logcrash_test (319 packages loaded, 12253 targets configured)
Analyzing: target //pkg/util/log/logcrash:logcrash_test (502 packages loaded, 16102 targets configured)
Analyzing: target //pkg/util/log/logcrash:logcrash_test (569 packages loaded, 18245 targets configured)
Analyzing: target //pkg/util/log/logcrash:logcrash_test (835 packages loaded, 21421 targets configured)
Analyzing: target //pkg/util/log/logcrash:logcrash_test (961 packages loaded, 24858 targets configured)
Analyzing: target //pkg/util/log/logcrash:logcrash_test (1014 packages loaded, 28170 targets configured)
INFO: Analyzed target //pkg/util/log/logcrash:logcrash_test (1058 packages loaded, 29874 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 5] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[344 / 1,220] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (8 actions, 7 running)
[345 / 1,225] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (8 actions running)
[345 / 1,225] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (8 actions running)
[346 / 1,225] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 22s processwrapper-sandbox ... (8 actions, 7 running)
[645 / 2,178] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 23s processwrapper-sandbox ... (5 actions, 4 running)
[680 / 2,680] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (7 actions, 4 running)
[736 / 2,834] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox ... (7 actions, 6 running)
[780 / 3,411] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 3s processwrapper-sandbox ... (8 actions, 7 running)
[831 / 3,590] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 5s processwrapper-sandbox ... (6 actions running)
[831 / 3,590] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 14s processwrapper-sandbox ... (6 actions running)
[831 / 3,590] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 44s processwrapper-sandbox ... (6 actions running)
[832 / 3,590] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 49s processwrapper-sandbox ... (6 actions, 5 running)
[845 / 3,590] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 50s processwrapper-sandbox ... (8 actions, 7 running)
[858 / 3,590] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 51s processwrapper-sandbox ... (8 actions, 7 running)
[882 / 3,590] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 52s processwrapper-sandbox ... (7 actions, 6 running)
[901 / 3,590] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 53s processwrapper-sandbox ... (7 actions, 6 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChun

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ e354a4d94b0fb94f0b709d3e06ef6c3b7022caee:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/log/testshout:testshout_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/util/log/testshout:testshout_test (33 packages loaded, 14296 targets configured)
Analyzing: target //pkg/util/log/testshout:testshout_test (99 packages loaded, 16881 targets configured)
INFO: Analyzed target //pkg/util/log/testshout:testshout_test (100 packages loaded, 16987 targets configured).
INFO: Found 1 test target...
[0 / 3] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[362 / 1,034] [Prepa] GoStdlib external/io_bazel_rules_go/stdlib_/pkg ... (8 actions, 6 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
Target //pkg/util/log/testshout:testshout_test failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/com_github_cockroachdb_errors/errorspb/BUILD.bazel:30:11 GoCompilePkg external/com_github_cockroachdb_errors/errorspb/errorspb.a [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
INFO: Elapsed time: 4.718s, Critical Path: 1.78s
I

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

. failed with artifacts on release-23.1.17-custom @ e354a4d94b0fb94f0b709d3e06ef6c3b7022caee:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/metric:metric_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/util/metric:metric_test (52 packages loaded, 13987 targets configured)
Analyzing: target //pkg/util/metric:metric_test (134 packages loaded, 17182 targets configured)
INFO: Analyzed target //pkg/util/metric:metric_test (136 packages loaded, 17363 targets configured).
INFO: Found 1 test target...
[0 / 3] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[287 / 1,077] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[287 / 1,077] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[289 / 1,077] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 15s processwrapper-sandbox ... (2 actions running)
[297 / 1,077] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (4 actions running)
[297 / 1,077] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 11s processwrapper-sandbox ... (4 actions running)
[298 / 1,077] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 30s processwrapper-sandbox ... (4 actions, 3 running)
[313 / 1,077] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 31s processwrapper-sandbox ... (8 actions, 7 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:148:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
Target //pkg/util/metric:metric_test failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/ut

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #121046 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-rc release-blocker] - #121045 : failed [C-test-failure O-robot T-testeng branch-release-23.1.17-custom-v2 release-blocker]

This test on roachdash | Improve this report!