cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
https://www.cockroachlabs.com
Other
30.21k stars 3.82k forks source link

: failed #113235

Closed cockroach-teamcity closed 1 year ago

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 16298b03de240235bd406b874845e735b241c3fb:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/querycache:querycache_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/querycache:querycache_test (132 packages loaded, 12634 targets configured)
Analyzing: target //pkg/sql/querycache:querycache_test (336 packages loaded, 16524 targets configured)
Analyzing: target //pkg/sql/querycache:querycache_test (490 packages loaded, 20398 targets configured)
Analyzing: target //pkg/sql/querycache:querycache_test (526 packages loaded, 22795 targets configured)
INFO: Analyzed target //pkg/sql/querycache:querycache_test (529 packages loaded, 24231 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[342 / 1,050] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 0s processwrapper-sandbox ... (4 actions, 3 running)
[353 / 1,050] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:143:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
Target //pkg/sql/querycache:querycache_test failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/util/log/logpb/BUILD.bazel:5:11 GoCompilePkg pkg/util/log/logpb/logpb.a [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

/cc @cockroachdb/test-eng

This test on roachdash | Improve this report!

Jira issue: CRDB-32822

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 16298b03de240235bd406b874845e735b241c3fb:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/regions:regions_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/regions:regions_test (155 packages loaded, 11399 targets configured)
Analyzing: target //pkg/sql/regions:regions_test (273 packages loaded, 13732 targets configured)
Analyzing: target //pkg/sql/regions:regions_test (395 packages loaded, 16801 targets configured)
Analyzing: target //pkg/sql/regions:regions_test (474 packages loaded, 19532 targets configured)
Analyzing: target //pkg/sql/regions:regions_test (487 packages loaded, 21622 targets configured)
Analyzing: target //pkg/sql/regions:regions_test (510 packages loaded, 23991 targets configured)
INFO: Analyzed target //pkg/sql/regions:regions_test (510 packages loaded, 24038 targets configured).
INFO: Found 1 test target...
[0 / 8] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[4 / 56] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[4 / 56] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[5 / 56] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 18s processwrapper-sandbox ... (4 actions, 3 running)
[232 / 601] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (4 actions, 3 running)
[245 / 703] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (4 actions running)
[245 / 703] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 12s processwrapper-sandbox ... (4 actions running)
[246 / 703] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 29s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:143:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relo

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 16298b03de240235bd406b874845e735b241c3fb:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/randgen:randgen_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/randgen:randgen_test (216 packages loaded, 3902 targets configured)
Analyzing: target //pkg/sql/randgen:randgen_test (358 packages loaded, 10872 targets configured)
Analyzing: target //pkg/sql/randgen:randgen_test (439 packages loaded, 11910 targets configured)
Analyzing: target //pkg/sql/randgen:randgen_test (481 packages loaded, 12652 targets configured)
Analyzing: target //pkg/sql/randgen:randgen_test (742 packages loaded, 14506 targets configured)
Analyzing: target //pkg/sql/randgen:randgen_test (936 packages loaded, 17077 targets configured)
Analyzing: target //pkg/sql/randgen:randgen_test (1182 packages loaded, 19500 targets configured)
Analyzing: target //pkg/sql/randgen:randgen_test (1293 packages loaded, 22477 targets configured)
Analyzing: target //pkg/sql/randgen:randgen_test (1435 packages loaded, 25917 targets configured)
Analyzing: target //pkg/sql/randgen:randgen_test (1496 packages loaded, 28638 targets configured)
Analyzing: target //pkg/sql/randgen:randgen_test (1506 packages loaded, 31049 targets configured)
INFO: Analyzed target //pkg/sql/randgen:randgen_test (1506 packages loaded, 31184 targets configured).
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[364 / 1,177] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (3 actions, 2 running)
[364 / 1,177] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (4 actions running)
[364 / 1,177] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 11s processwrapper-sandbox ... (4 actions running)
[365 / 1,177] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 35s processwrapper-sandbox ... (4 actions, 3 running)
[367 / 1,177] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 36s processwrapper-sandbox ... (4 actions, 3 running)
[370 / 1,177] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 37s processwrapper-sandbox ... (4 actions, 3 running)
[373 / 1,177] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 38s processwrapper-sandbox ... (4 actions running)
[374 / 1,177] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 39s processwrapper-sandbox ... (4 actions running)
[375 / 1,177] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 41s processwrapper-sandbox ... (4 actions, 3 running)
[379 / 1,177] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 42s processwrapper-sandbox ... (4 actions, 3 running)
[385 / 1,177] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 43s processwrapper-sandbox ... (4 actions, 3 running)
[389 / 1,177] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 44s processwrapper-sandbox ... (4 actions running)
[393 / 1,177] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 45s processwrapper-sandbox ... (3 actions running)
[395 / 1,177] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 46s processwrapper-sandbox ... (4 actions running)
[406 / 1,177] GoCompilePkg external/com_github_gogo_protobuf/plugin/populate/populate.a [for tool]; 0s processwrapper-sandbox ... (3 actions, 2 running)
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/cmd/protoc-gen-gogoroach/BUILD.bazel:16:10: GoLink pkg/cmd/protoc-gen-gogoroach/protoc-gen-gogoroach_/protoc-gen-gogoroach [for tool] failed: (Exit 1): builder failed: error executing command (from target //pkg/cmd/protoc-gen-gogoroach:protoc-gen-gogoroach) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -arc ... (remaining 65 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserA

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 16298b03de240235bd406b874845e735b241c3fb:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/row:row_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/row:row_test (530 packages loaded, 11505 targets configured)
Analyzing: target //pkg/sql/row:row_test (643 packages loaded, 13575 targets configured)
Analyzing: target //pkg/sql/row:row_test (728 packages loaded, 16039 targets configured)
Analyzing: target //pkg/sql/row:row_test (884 packages loaded, 19960 targets configured)
Analyzing: target //pkg/sql/row:row_test (909 packages loaded, 22845 targets configured)
Analyzing: target //pkg/sql/row:row_test (925 packages loaded, 24742 targets configured)
Analyzing: target //pkg/sql/row:row_test (1027 packages loaded, 27448 targets configured)
INFO: Analyzed target //pkg/sql/row:row_test (1036 packages loaded, 28441 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 3] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[131 / 540] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[131 / 540] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[132 / 540] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 18s processwrapper-sandbox ... (4 actions, 3 running)
[292 / 1,028] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (4 actions, 2 running)
[364 / 1,354] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox ... (4 actions running)
[364 / 1,354] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 13s processwrapper-sandbox ... (4 actions running)
[365 / 1,354] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 30s processwrapper-sandbox ... (4 actions, 3 running)
[371 / 1,354] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 31s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:143:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not de

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 16298b03de240235bd406b874845e735b241c3fb:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/rowcontainer:rowcontainer_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/rowcontainer:rowcontainer_test (180 packages loaded, 10773 targets configured)
Analyzing: target //pkg/sql/rowcontainer:rowcontainer_test (302 packages loaded, 14230 targets configured)
Analyzing: target //pkg/sql/rowcontainer:rowcontainer_test (395 packages loaded, 16823 targets configured)
Analyzing: target //pkg/sql/rowcontainer:rowcontainer_test (489 packages loaded, 19299 targets configured)
Analyzing: target //pkg/sql/rowcontainer:rowcontainer_test (519 packages loaded, 22130 targets configured)
INFO: Analyzed target //pkg/sql/rowcontainer:rowcontainer_test (520 packages loaded, 24094 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 8] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[131 / 515] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[131 / 515] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[133 / 515] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 19s processwrapper-sandbox ... (3 actions, 2 running)
[320 / 991] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (3 actions, 2 running)
[370 / 1,173] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox ... (4 actions running)
[370 / 1,173] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 13s processwrapper-sandbox ... (4 actions running)
[371 / 1,173] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 30s processwrapper-sandbox ... (4 actions, 3 running)
[375 / 1,173] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 31s processwrapper-sandbox ... (4 actions, 3 running)
[381 / 1,173] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 32s processwrapper-sandbox ... (4 actions, 3 running)
[387 / 1,173] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 33s processwrapper-sandbox ... (4 actions, 3 running)
[396 / 1,173] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 35s processwrapper-sandbox ... (4 actions, 3 running)
[407 / 1,173] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 36s processwrapper-sandbox ... (4 actions running)
[408 / 1,173] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 37s processwrapper-sandbox ... (4 actions running)
[409 / 1,173] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 38s processwrapper-sandbox ... (4 actions running)
[414 / 1,173] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 39s processwrapper-sandbox ... (4 actions, 3 running)
[423 / 1,173] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 38s processwrapper-sandbox ... (4 actions, 3 running)
[434 / 1,173] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 40s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/cmd/protoc-gen-gogoroach/BUILD.bazel:16:10: GoLink pkg/cmd/protoc-gen-gogoroach/protoc-gen-gogoroach_/protoc-gen-gogoroach [for tool] failed: (Exit 1): builder failed: error executing command (from target //pkg/cmd/protoc-gen-gogoroach:protoc-gen-gogoroach) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -arc ... (remaining 65 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_fr

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 16298b03de240235bd406b874845e735b241c3fb:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/rowenc/keyside:keyside_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/rowenc/keyside:keyside_test (178 packages loaded, 11864 targets configured)
Analyzing: target //pkg/sql/rowenc/keyside:keyside_test (368 packages loaded, 15813 targets configured)
Analyzing: target //pkg/sql/rowenc/keyside:keyside_test (483 packages loaded, 19077 targets configured)
Analyzing: target //pkg/sql/rowenc/keyside:keyside_test (514 packages loaded, 21681 targets configured)
Analyzing: target //pkg/sql/rowenc/keyside:keyside_test (517 packages loaded, 24095 targets configured)
INFO: Analyzed target //pkg/sql/rowenc/keyside:keyside_test (517 packages loaded, 24095 targets configured).
INFO: Found 1 test target...
[0 / 7] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[319 / 1,048] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (3 actions, 2 running)
[319 / 1,048] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox ... (4 actions running)
[319 / 1,048] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 11s processwrapper-sandbox ... (4 actions running)
[320 / 1,048] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 36s processwrapper-sandbox ... (4 actions, 3 running)
[323 / 1,048] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 38s processwrapper-sandbox ... (4 actions, 3 running)
[327 / 1,048] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 39s processwrapper-sandbox ... (4 actions, 3 running)
[328 / 1,048] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 40s processwrapper-sandbox ... (4 actions running)
[329 / 1,048] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 41s processwrapper-sandbox ... (3 actions running)
[332 / 1,048] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 42s processwrapper-sandbox ... (4 actions running)
[339 / 1,048] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 43s processwrapper-sandbox ... (4 actions running)
[340 / 1,048] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 44s processwrapper-sandbox ... (4 actions, 3 running)
[347 / 1,048] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 45s processwrapper-sandbox ... (4 actions, 3 running)
[352 / 1,048] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 46s processwrapper-sandbox ... (4 actions, 3 running)
[359 / 1,048] GoCompilePkg external/com_github_gogo_protobuf/types/types.a [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[381 / 1,048] GoCompilePkg external/com_github_cockroachdb_redact/internal/markers/markers.a [for tool]; 0s processwrapper-sandbox ... (3 actions, 2 running)
[394 / 1,048] GoCompilePkg external/com_github_gogo_protobuf/plugin/marshalto/marshalto.a [for tool]; 0s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/cmd/protoc-gen-gogoroach/BUILD.bazel:16:10: GoLink pkg/cmd/protoc-gen-gogoroach/protoc-gen-gogoroach_/protoc-gen-gogoroach [for tool] failed: (Exit 1): builder failed: error executing command (from target //pkg/cmd/protoc-gen-gogoroach:protoc-gen-gogoroach) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -arc ... (remaining 65 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocati

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 16298b03de240235bd406b874845e735b241c3fb:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/rowenc:rowenc_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/rowenc:rowenc_test (298 packages loaded, 10992 targets configured)
Analyzing: target //pkg/sql/rowenc:rowenc_test (395 packages loaded, 12768 targets configured)
Analyzing: target //pkg/sql/rowenc:rowenc_test (482 packages loaded, 14435 targets configured)
Analyzing: target //pkg/sql/rowenc:rowenc_test (490 packages loaded, 14496 targets configured)
Analyzing: target //pkg/sql/rowenc:rowenc_test (553 packages loaded, 15642 targets configured)
Analyzing: target //pkg/sql/rowenc:rowenc_test (601 packages loaded, 16930 targets configured)
Analyzing: target //pkg/sql/rowenc:rowenc_test (634 packages loaded, 17749 targets configured)
Analyzing: target //pkg/sql/rowenc:rowenc_test (681 packages loaded, 20726 targets configured)
Analyzing: target //pkg/sql/rowenc:rowenc_test (693 packages loaded, 24100 targets configured)
Analyzing: target //pkg/sql/rowenc:rowenc_test (870 packages loaded, 25437 targets configured)
Analyzing: target //pkg/sql/rowenc:rowenc_test (961 packages loaded, 27366 targets configured)
Analyzing: target //pkg/sql/rowenc:rowenc_test (996 packages loaded, 27844 targets configured)
INFO: Analyzed target //pkg/sql/rowenc:rowenc_test (1040 packages loaded, 28461 targets configured).
INFO: Found 1 test target...
[0 / 8] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[131 / 517] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 0s processwrapper-sandbox ... (4 actions running)
[131 / 517] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[132 / 517] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 19s processwrapper-sandbox ... (4 actions, 3 running)
[343 / 1,215] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (4 actions, 2 running)
[393 / 1,366] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox ... (4 actions running)
[393 / 1,366] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 13s processwrapper-sandbox ... (4 actions running)
[394 / 1,366] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 30s processwrapper-sandbox ... (4 actions, 3 running)
[398 / 1,366] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 31s processwrapper-sandbox ... (4 actions, 3 running)
[403 / 1,366] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 32s processwrapper-sandbox ... (4 actions running)
[409 / 1,366] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 33s processwrapper-sandbox ... (4 actions, 3 running)
[411 / 1,366] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 35s processwrapper-sandbox ... (4 actions, 3 running)
[421 / 1,366] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 36s processwrapper-sandbox ... (4 actions, 3 running)
[433 / 1,366] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 37s processwrapper-sandbox ... (4 actions, 3 running)
[440 / 1,366] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 37s processwrapper-sandbox ... (4 actions, 3 running)
[451 / 1,366] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 37s processwrapper-sandbox ... (4 actions, 3 running)
[459 / 1,366] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 38s processwrapper-sandbox ... (4 actions, 3 running)
[474 / 1,366] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 39s processwrapper-sandbox ... (4 actions, 3 running)
[480 / 1,366] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 40s processwrapper-sandbox ... (4 actions running)
[492 / 1,366] GoCompilePkg external/com_github_gogo_protobuf/types/types.a [for tool]; 0s processwrapper-sandbox ... (4 actions running)
[510 / 1,366] GoCompilePkg external/com_github_gogo_protobuf/protoc-gen

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 9b7662ecca3809ad9acae9b0d7604d2c3596e7d4:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/rowenc/valueside:valueside_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/rowenc/valueside:valueside_test (86 packages loaded, 3605 targets configured)
Analyzing: target //pkg/sql/rowenc/valueside:valueside_test (246 packages loaded, 14200 targets configured)
Analyzing: target //pkg/sql/rowenc/valueside:valueside_test (392 packages loaded, 16453 targets configured)
Analyzing: target //pkg/sql/rowenc/valueside:valueside_test (493 packages loaded, 19396 targets configured)
Analyzing: target //pkg/sql/rowenc/valueside:valueside_test (517 packages loaded, 22735 targets configured)
INFO: Analyzed target //pkg/sql/rowenc/valueside:valueside_test (517 packages loaded, 24096 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 5] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[131 / 543] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[131 / 543] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[132 / 543] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 19s processwrapper-sandbox ... (4 actions, 3 running)
[369 / 1,359] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 0s processwrapper-sandbox ... (4 actions, 3 running)
[369 / 1,359] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[369 / 1,359] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[370 / 1,359] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 24s processwrapper-sandbox ... (4 actions, 3 running)
[376 / 1,359] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 25s processwrapper-sandbox ... (4 actions, 3 running)
[383 / 1,359] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 26s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:143:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
ru

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 9b7662ecca3809ad9acae9b0d7604d2c3596e7d4:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/schemachanger:schemachanger_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/schemachanger:schemachanger_test (393 packages loaded, 11549 targets configured)
Analyzing: target //pkg/sql/schemachanger:schemachanger_test (526 packages loaded, 13374 targets configured)
Analyzing: target //pkg/sql/schemachanger:schemachanger_test (676 packages loaded, 16275 targets configured)
Analyzing: target //pkg/sql/schemachanger:schemachanger_test (809 packages loaded, 19052 targets configured)
Analyzing: target //pkg/sql/schemachanger:schemachanger_test (898 packages loaded, 21874 targets configured)
Analyzing: target //pkg/sql/schemachanger:schemachanger_test (922 packages loaded, 24290 targets configured)
Analyzing: target //pkg/sql/schemachanger:schemachanger_test (1002 packages loaded, 26823 targets configured)
INFO: Analyzed target //pkg/sql/schemachanger:schemachanger_test (1048 packages loaded, 28952 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 7] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[294 / 1,048] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (3 actions, 1 running)
[306 / 1,048] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (4 actions, 3 running)
[319 / 1,048] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox ... (4 actions, 3 running)
[323 / 1,048] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 3s processwrapper-sandbox ... (4 actions, 3 running)
[329 / 1,048] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 4s processwrapper-sandbox ... (4 actions, 3 running)
[338 / 1,048] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 6s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/cmd/protoc-gen-gogoroach/BUILD.bazel:16:10: GoLink pkg/cmd/protoc-gen-gogoroach/protoc-gen-gogoroach_/protoc-gen-gogoroach [for tool] failed: (Exit 1): builder failed: error executing command (from target //pkg/cmd/protoc-gen-gogoroach:protoc-gen-gogoroach) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -arc ... (remaining 65 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 9b7662ecca3809ad9acae9b0d7604d2c3596e7d4:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/scheduledlogging:scheduledlogging_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/scheduledlogging:scheduledlogging_test (336 packages loaded, 11328 targets configured)
Analyzing: target //pkg/sql/scheduledlogging:scheduledlogging_test (489 packages loaded, 12777 targets configured)
Analyzing: target //pkg/sql/scheduledlogging:scheduledlogging_test (530 packages loaded, 13325 targets configured)
Analyzing: target //pkg/sql/scheduledlogging:scheduledlogging_test (657 packages loaded, 15593 targets configured)
Analyzing: target //pkg/sql/scheduledlogging:scheduledlogging_test (736 packages loaded, 18040 targets configured)
Analyzing: target //pkg/sql/scheduledlogging:scheduledlogging_test (744 packages loaded, 19041 targets configured)
Analyzing: target //pkg/sql/scheduledlogging:scheduledlogging_test (754 packages loaded, 21666 targets configured)
Analyzing: target //pkg/sql/scheduledlogging:scheduledlogging_test (761 packages loaded, 24778 targets configured)
Analyzing: target //pkg/sql/scheduledlogging:scheduledlogging_test (949 packages loaded, 27099 targets configured)
Analyzing: target //pkg/sql/scheduledlogging:scheduledlogging_test (968 packages loaded, 27560 targets configured)
INFO: Analyzed target //pkg/sql/scheduledlogging:scheduledlogging_test (1039 packages loaded, 28452 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 7] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[131 / 612] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[131 / 612] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[132 / 612] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 17s processwrapper-sandbox ... (4 actions, 3 running)
[369 / 1,134] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (4 actions, 3 running)
[398 / 1,227] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (4 actions, 3 running)
[401 / 1,263] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox ... (4 actions running)
[401 / 1,263] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 13s processwrapper-sandbox ... (4 actions running)
[402 / 1,263] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 27s processwrapper-sandbox ... (4 actions, 3 running)
[406 / 1,263] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 28s processwrapper-sandbox ... (4 actions running)
[413 / 1,263] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 30s processwrapper-sandbox ... (4 actions running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:143:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 9b7662ecca3809ad9acae9b0d7604d2c3596e7d4:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/rowexec:rowexec_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/rowexec:rowexec_test (146 packages loaded, 9365 targets configured)
Analyzing: target //pkg/sql/rowexec:rowexec_test (314 packages loaded, 10956 targets configured)
Analyzing: target //pkg/sql/rowexec:rowexec_test (523 packages loaded, 11690 targets configured)
Analyzing: target //pkg/sql/rowexec:rowexec_test (634 packages loaded, 14441 targets configured)
Analyzing: target //pkg/sql/rowexec:rowexec_test (662 packages loaded, 14679 targets configured)
Analyzing: target //pkg/sql/rowexec:rowexec_test (746 packages loaded, 16408 targets configured)
Analyzing: target //pkg/sql/rowexec:rowexec_test (858 packages loaded, 18476 targets configured)
Analyzing: target //pkg/sql/rowexec:rowexec_test (901 packages loaded, 21113 targets configured)
Analyzing: target //pkg/sql/rowexec:rowexec_test (913 packages loaded, 24943 targets configured)
Analyzing: target //pkg/sql/rowexec:rowexec_test (965 packages loaded, 26393 targets configured)
Analyzing: target //pkg/sql/rowexec:rowexec_test (969 packages loaded, 27586 targets configured)
Analyzing: target //pkg/sql/rowexec:rowexec_test (1029 packages loaded, 28313 targets configured)
INFO: Analyzed target //pkg/sql/rowexec:rowexec_test (1040 packages loaded, 28478 targets configured).
INFO: Found 1 test target...
[0 / 5] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[299 / 888] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (3 actions, 2 running)
[299 / 888] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (4 actions running)
[299 / 888] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 11s processwrapper-sandbox ... (4 actions running)
[300 / 888] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 35s processwrapper-sandbox ... (4 actions, 3 running)
[303 / 888] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 36s processwrapper-sandbox ... (4 actions, 3 running)
[306 / 888] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 37s processwrapper-sandbox ... (4 actions, 3 running)
[309 / 888] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 38s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:143:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.rac

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 9b7662ecca3809ad9acae9b0d7604d2c3596e7d4:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/rowflow:rowflow_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/rowflow:rowflow_test (251 packages loaded, 11848 targets configured)
Analyzing: target //pkg/sql/rowflow:rowflow_test (447 packages loaded, 15163 targets configured)
Analyzing: target //pkg/sql/rowflow:rowflow_test (537 packages loaded, 18769 targets configured)
Analyzing: target //pkg/sql/rowflow:rowflow_test (593 packages loaded, 21429 targets configured)
Analyzing: target //pkg/sql/rowflow:rowflow_test (608 packages loaded, 24568 targets configured)
INFO: Analyzed target //pkg/sql/rowflow:rowflow_test (608 packages loaded, 24743 targets configured).
INFO: Found 1 test target...
[0 / 3] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[131 / 524] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[131 / 524] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[132 / 524] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 18s processwrapper-sandbox ... (4 actions, 3 running)
[336 / 1,067] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (4 actions, 3 running)
[348 / 1,138] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox ... (4 actions running)
[348 / 1,138] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 11s processwrapper-sandbox ... (4 actions running)
[349 / 1,138] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 28s processwrapper-sandbox ... (4 actions, 3 running)
[352 / 1,138] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 29s processwrapper-sandbox ... (4 actions running)
[358 / 1,138] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 30s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:143:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocat

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 9b7662ecca3809ad9acae9b0d7604d2c3596e7d4:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/schemachange:schemachange_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/schemachange:schemachange_test (330 packages loaded, 10880 targets configured)
Analyzing: target //pkg/sql/schemachange:schemachange_test (413 packages loaded, 12466 targets configured)
Analyzing: target //pkg/sql/schemachange:schemachange_test (451 packages loaded, 13482 targets configured)
Analyzing: target //pkg/sql/schemachange:schemachange_test (521 packages loaded, 14522 targets configured)
Analyzing: target //pkg/sql/schemachange:schemachange_test (560 packages loaded, 15181 targets configured)
Analyzing: target //pkg/sql/schemachange:schemachange_test (697 packages loaded, 18581 targets configured)
Analyzing: target //pkg/sql/schemachange:schemachange_test (728 packages loaded, 21519 targets configured)
Analyzing: target //pkg/sql/schemachange:schemachange_test (759 packages loaded, 23569 targets configured)
Analyzing: target //pkg/sql/schemachange:schemachange_test (915 packages loaded, 25773 targets configured)
Analyzing: target //pkg/sql/schemachange:schemachange_test (967 packages loaded, 27454 targets configured)
Analyzing: target //pkg/sql/schemachange:schemachange_test (1017 packages loaded, 27872 targets configured)
INFO: Analyzed target //pkg/sql/schemachange:schemachange_test (1038 packages loaded, 28449 targets configured).
INFO: Found 1 test target...
[0 / 8] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[370 / 1,317] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (3 actions, 2 running)
[370 / 1,317] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox ... (4 actions running)
[370 / 1,317] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 11s processwrapper-sandbox ... (4 actions running)
[371 / 1,317] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 35s processwrapper-sandbox ... (4 actions, 3 running)
[374 / 1,317] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 36s processwrapper-sandbox ... (4 actions, 3 running)
[377 / 1,317] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 38s processwrapper-sandbox ... (4 actions, 3 running)
[380 / 1,317] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 39s processwrapper-sandbox ... (4 actions running)
[381 / 1,317] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 41s processwrapper-sandbox ... (4 actions, 3 running)
[385 / 1,317] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 42s processwrapper-sandbox ... (4 actions, 3 running)
[390 / 1,317] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 43s processwrapper-sandbox ... (4 actions, 3 running)
[397 / 1,317] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 44s processwrapper-sandbox ... (4 actions, 3 running)
[400 / 1,317] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 45s processwrapper-sandbox ... (4 actions running)
[401 / 1,317] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 46s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:143:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 9b7662ecca3809ad9acae9b0d7604d2c3596e7d4:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/scanner:scanner_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/scanner:scanner_test (14 packages loaded, 13728 targets configured)
INFO: Analyzed target //pkg/sql/scanner:scanner_test (14 packages loaded, 14149 targets configured).
INFO: Found 1 test target...
[0 / 8] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[142 / 538] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (3 actions running)
[142 / 538] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (3 actions running)
[143 / 538] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 19s processwrapper-sandbox ... (3 actions, 2 running)
[150 / 538] [Prepa] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool] ... (4 actions, 3 running)
[150 / 538] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (4 actions running)
[150 / 538] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 10s processwrapper-sandbox ... (4 actions running)
[151 / 538] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 36s processwrapper-sandbox ... (4 actions, 3 running)
[154 / 538] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 37s processwrapper-sandbox ... (4 actions, 3 running)
[157 / 538] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 38s processwrapper-sandbox ... (4 actions, 3 running)
[160 / 538] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 39s processwrapper-sandbox ... (4 actions, 3 running)
[161 / 538] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 40s processwrapper-sandbox ... (4 actions running)
[164 / 538] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 41s processwrapper-sandbox ... (4 actions running)
[167 / 538] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 43s processwrapper-sandbox ... (4 actions running)
[173 / 538] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 44s processwrapper-sandbox ... (4 actions running)
[181 / 538] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 45s processwrapper-sandbox ... (4 actions running)
[191 / 538] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 46s processwrapper-sandbox ... (4 actions running)
[199 / 538] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 47s processwrapper-sandbox ... (4 actions running)
[207 / 538] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 48s processwrapper-sandbox ... (4 actions running)
[221 / 538] GoCompilePkg external/org_golang_x_tools/go/analysis/passes/stringintconv/stringintconv.a [for tool]; 0s processwrapper-sandbox ... (4 actions running)
[244 / 538] GoCompilePkg external/co_honnef_go_tools/go/ir/ir.a [for tool]; 0s processwrapper-sandbox ... (4 actions, 3 running)
[254 / 538] GoCompilePkg external/co_honnef_go_tools/go/ir/ir.a [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[276 / 538] GoCompilePkg external/com_github_gogo_protobuf/types/types.a [for tool]; 0s processwrapper-sandbox ... (4 actions, 3 running)
[298 / 538] GoCompilePkg external/com_github_gogo_protobuf/plugin/marshalto/marshalto.a [for tool]; 0s processwrapper-sandbox ... (4 actions, 3 running)
[309 / 538] GoCompilePkg external/com_github_gogo_protobuf/plugin/stringer/stringer.a [for tool]; 0s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:143:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linu

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 9b7662ecca3809ad9acae9b0d7604d2c3596e7d4:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/schemachanger/corpus:corpus_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/schemachanger/corpus:corpus_test (93 packages loaded, 11258 targets configured)
Analyzing: target //pkg/sql/schemachanger/corpus:corpus_test (219 packages loaded, 14560 targets configured)
Analyzing: target //pkg/sql/schemachanger/corpus:corpus_test (339 packages loaded, 17789 targets configured)
Analyzing: target //pkg/sql/schemachanger/corpus:corpus_test (389 packages loaded, 20097 targets configured)
Analyzing: target //pkg/sql/schemachanger/corpus:corpus_test (409 packages loaded, 22036 targets configured)
INFO: Analyzed target //pkg/sql/schemachanger/corpus:corpus_test (416 packages loaded, 23557 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[312 / 915] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (3 actions, 2 running)
[319 / 952] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox ... (4 actions running)
[319 / 952] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 11s processwrapper-sandbox ... (4 actions running)
[320 / 952] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 33s processwrapper-sandbox ... (3 actions running)
[322 / 952] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 34s processwrapper-sandbox ... (4 actions running)
[327 / 952] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 35s processwrapper-sandbox ... (4 actions, 3 running)
[328 / 952] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 37s processwrapper-sandbox ... (4 actions running)
[329 / 952] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 39s processwrapper-sandbox ... (4 actions, 3 running)
[332 / 952] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 40s processwrapper-sandbox ... (4 actions running)
[335 / 952] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 41s processwrapper-sandbox ... (4 actions, 3 running)
[338 / 952] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 42s processwrapper-sandbox ... (4 actions, 3 running)
[342 / 952] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 43s processwrapper-sandbox ... (4 actions, 3 running)
[347 / 952] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 45s processwrapper-sandbox ... (4 actions, 3 running)
[358 / 952] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 44s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:143:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not de

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 9b7662ecca3809ad9acae9b0d7604d2c3596e7d4:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/schemachanger/scbuild:scbuild_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/schemachanger/scbuild:scbuild_test (332 packages loaded, 3802 targets configured)
Analyzing: target //pkg/sql/schemachanger/scbuild:scbuild_test (476 packages loaded, 11137 targets configured)
Analyzing: target //pkg/sql/schemachanger/scbuild:scbuild_test (528 packages loaded, 12107 targets configured)
Analyzing: target //pkg/sql/schemachanger/scbuild:scbuild_test (590 packages loaded, 12402 targets configured)
Analyzing: target //pkg/sql/schemachanger/scbuild:scbuild_test (635 packages loaded, 12853 targets configured)
Analyzing: target //pkg/sql/schemachanger/scbuild:scbuild_test (719 packages loaded, 13686 targets configured)
Analyzing: target //pkg/sql/schemachanger/scbuild:scbuild_test (787 packages loaded, 14942 targets configured)
Analyzing: target //pkg/sql/schemachanger/scbuild:scbuild_test (865 packages loaded, 16653 targets configured)
Analyzing: target //pkg/sql/schemachanger/scbuild:scbuild_test (977 packages loaded, 18163 targets configured)
Analyzing: target //pkg/sql/schemachanger/scbuild:scbuild_test (1162 packages loaded, 20826 targets configured)
Analyzing: target //pkg/sql/schemachanger/scbuild:scbuild_test (1319 packages loaded, 24064 targets configured)
Analyzing: target //pkg/sql/schemachanger/scbuild:scbuild_test (1411 packages loaded, 26722 targets configured)
Analyzing: target //pkg/sql/schemachanger/scbuild:scbuild_test (1477 packages loaded, 29097 targets configured)
Analyzing: target //pkg/sql/schemachanger/scbuild:scbuild_test (1496 packages loaded, 31112 targets configured)
INFO: Analyzed target //pkg/sql/schemachanger/scbuild:scbuild_test (1507 packages loaded, 31215 targets configured).
INFO: Found 1 test target...
[0 / 3] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[429 / 1,344] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (3 actions running)
[429 / 1,344] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox ... (4 actions running)
[429 / 1,344] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 11s processwrapper-sandbox ... (4 actions running)
[430 / 1,344] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 34s processwrapper-sandbox ... (4 actions, 3 running)
[433 / 1,344] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 35s processwrapper-sandbox ... (4 actions, 3 running)
[436 / 1,344] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 36s processwrapper-sandbox ... (4 actions, 3 running)
[440 / 1,344] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 37s processwrapper-sandbox ... (4 actions, 3 running)
[443 / 1,344] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 39s processwrapper-sandbox ... (4 actions running)
[444 / 1,344] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 40s processwrapper-sandbox ... (4 actions, 3 running)
[448 / 1,344] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 41s processwrapper-sandbox ... (4 actions, 3 running)
[450 / 1,344] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 42s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:143:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the san

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 9b7662ecca3809ad9acae9b0d7604d2c3596e7d4:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/schemachanger/rel:rel_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/schemachanger/rel:rel_test (53 packages loaded, 12458 targets configured)
Analyzing: target //pkg/sql/schemachanger/rel:rel_test (138 packages loaded, 15324 targets configured)
Analyzing: target //pkg/sql/schemachanger/rel:rel_test (201 packages loaded, 17906 targets configured)
Analyzing: target //pkg/sql/schemachanger/rel:rel_test (210 packages loaded, 21138 targets configured)
INFO: Analyzed target //pkg/sql/schemachanger/rel:rel_test (210 packages loaded, 21139 targets configured).
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[329 / 1,101] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 0s processwrapper-sandbox ... (4 actions, 3 running)
[336 / 1,180] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (4 actions running)
[336 / 1,180] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[337 / 1,180] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 18s processwrapper-sandbox ... (4 actions, 3 running)
[344 / 1,181] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 18s processwrapper-sandbox ... (4 actions, 3 running)
[347 / 1,181] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[347 / 1,181] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 2s processwrapper-sandbox ... (4 actions running)
[347 / 1,181] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 13s processwrapper-sandbox ... (4 actions running)
[348 / 1,181] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 31s processwrapper-sandbox ... (4 actions, 3 running)
[351 / 1,181] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 32s processwrapper-sandbox ... (4 actions, 3 running)
[354 / 1,181] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 33s processwrapper-sandbox ... (4 actions running)
[356 / 1,181] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 34s processwrapper-sandbox ... (4 actions running)
[358 / 1,181] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 35s processwrapper-sandbox ... (4 actions running)
[359 / 1,181] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 36s processwrapper-sandbox ... (4 actions running)
[360 / 1,181] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 39s processwrapper-sandbox ... (4 actions, 3 running)
[365 / 1,181] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 40s processwrapper-sandbox ... (4 actions, 3 running)
[371 / 1,181] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 41s processwrapper-sandbox ... (4 actions running)
[375 / 1,181] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 42s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:143:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runti

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 9b7662ecca3809ad9acae9b0d7604d2c3596e7d4:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/schemachanger/scdecomp:scdecomp_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/schemachanger/scdecomp:scdecomp_test (166 packages loaded, 10246 targets configured)
Analyzing: target //pkg/sql/schemachanger/scdecomp:scdecomp_test (301 packages loaded, 11583 targets configured)
Analyzing: target //pkg/sql/schemachanger/scdecomp:scdecomp_test (397 packages loaded, 12267 targets configured)
Analyzing: target //pkg/sql/schemachanger/scdecomp:scdecomp_test (552 packages loaded, 13704 targets configured)
Analyzing: target //pkg/sql/schemachanger/scdecomp:scdecomp_test (622 packages loaded, 15855 targets configured)
Analyzing: target //pkg/sql/schemachanger/scdecomp:scdecomp_test (714 packages loaded, 17507 targets configured)
Analyzing: target //pkg/sql/schemachanger/scdecomp:scdecomp_test (832 packages loaded, 20105 targets configured)
Analyzing: target //pkg/sql/schemachanger/scdecomp:scdecomp_test (948 packages loaded, 22757 targets configured)
Analyzing: target //pkg/sql/schemachanger/scdecomp:scdecomp_test (1025 packages loaded, 25869 targets configured)
Analyzing: target //pkg/sql/schemachanger/scdecomp:scdecomp_test (1042 packages loaded, 28472 targets configured)
INFO: Analyzed target //pkg/sql/schemachanger/scdecomp:scdecomp_test (1042 packages loaded, 28472 targets configured).
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[139 / 577] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[139 / 577] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[140 / 577] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 18s processwrapper-sandbox ... (4 actions, 3 running)
[296 / 974] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (3 actions, 2 running)
[369 / 1,306] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox ... (4 actions running)
[369 / 1,306] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 11s processwrapper-sandbox ... (4 actions running)
[370 / 1,306] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 30s processwrapper-sandbox ... (3 actions running)
[373 / 1,306] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 31s processwrapper-sandbox ... (4 actions running)
[377 / 1,306] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 32s processwrapper-sandbox ... (4 actions running)
[379 / 1,306] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 33s processwrapper-sandbox ... (4 actions running)
[380 / 1,306] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 34s processwrapper-sandbox ... (4 actions, 3 running)
[385 / 1,306] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 35s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:143:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked)

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 9b7662ecca3809ad9acae9b0d7604d2c3596e7d4:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/schemachanger/scexec:scexec_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/schemachanger/scexec:scexec_test (464 packages loaded, 10859 targets configured)
Analyzing: target //pkg/sql/schemachanger/scexec:scexec_test (517 packages loaded, 12843 targets configured)
Analyzing: target //pkg/sql/schemachanger/scexec:scexec_test (612 packages loaded, 14491 targets configured)
Analyzing: target //pkg/sql/schemachanger/scexec:scexec_test (773 packages loaded, 17992 targets configured)
Analyzing: target //pkg/sql/schemachanger/scexec:scexec_test (827 packages loaded, 19568 targets configured)
Analyzing: target //pkg/sql/schemachanger/scexec:scexec_test (871 packages loaded, 22821 targets configured)
Analyzing: target //pkg/sql/schemachanger/scexec:scexec_test (989 packages loaded, 25296 targets configured)
Analyzing: target //pkg/sql/schemachanger/scexec:scexec_test (1028 packages loaded, 28205 targets configured)
INFO: Analyzed target //pkg/sql/schemachanger/scexec:scexec_test (1045 packages loaded, 29361 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 6] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[131 / 557] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 0s processwrapper-sandbox ... (4 actions running)
[131 / 557] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[132 / 557] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 18s processwrapper-sandbox ... (4 actions, 3 running)
[342 / 1,135] [Prepa] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool] ... (3 actions, 2 running)
[342 / 1,135] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (4 actions running)
[342 / 1,135] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 10s processwrapper-sandbox ... (4 actions running)
[343 / 1,135] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 32s processwrapper-sandbox ... (4 actions, 3 running)
[346 / 1,135] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 33s processwrapper-sandbox ... (4 actions, 3 running)
[348 / 1,135] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 34s processwrapper-sandbox ... (4 actions running)
[351 / 1,135] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 35s processwrapper-sandbox ... (4 actions running)
[353 / 1,135] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 36s processwrapper-sandbox ... (4 actions running)
[355 / 1,135] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 37s processwrapper-sandbox ... (4 actions running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:143:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 9b7662ecca3809ad9acae9b0d7604d2c3596e7d4:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/schemachanger/scexec/backfiller:backfiller_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/schemachanger/scexec/backfiller:backfiller_test (156 packages loaded, 10776 targets configured)
Analyzing: target //pkg/sql/schemachanger/scexec/backfiller:backfiller_test (214 packages loaded, 12932 targets configured)
Analyzing: target //pkg/sql/schemachanger/scexec/backfiller:backfiller_test (364 packages loaded, 15605 targets configured)
Analyzing: target //pkg/sql/schemachanger/scexec/backfiller:backfiller_test (498 packages loaded, 18287 targets configured)
Analyzing: target //pkg/sql/schemachanger/scexec/backfiller:backfiller_test (560 packages loaded, 20615 targets configured)
Analyzing: target //pkg/sql/schemachanger/scexec/backfiller:backfiller_test (593 packages loaded, 23516 targets configured)
INFO: Analyzed target //pkg/sql/schemachanger/scexec/backfiller:backfiller_test (600 packages loaded, 24835 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 7] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[131 / 604] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[131 / 604] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[133 / 604] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 17s processwrapper-sandbox ... (3 actions, 2 running)
[396 / 1,296] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (3 actions, 2 running)
[416 / 1,356] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox ... (4 actions running)
[416 / 1,356] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 11s processwrapper-sandbox ... (4 actions running)
[417 / 1,356] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 36s processwrapper-sandbox ... (4 actions, 3 running)
[421 / 1,356] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 37s processwrapper-sandbox ... (4 actions, 3 running)
[425 / 1,356] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 38s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:143:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relo

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 9b7662ecca3809ad9acae9b0d7604d2c3596e7d4:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/schemachanger/scplan:scplan_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/schemachanger/scplan:scplan_test (366 packages loaded, 11744 targets configured)
Analyzing: target //pkg/sql/schemachanger/scplan:scplan_test (534 packages loaded, 13756 targets configured)
Analyzing: target //pkg/sql/schemachanger/scplan:scplan_test (689 packages loaded, 15862 targets configured)
Analyzing: target //pkg/sql/schemachanger/scplan:scplan_test (810 packages loaded, 19135 targets configured)
Analyzing: target //pkg/sql/schemachanger/scplan:scplan_test (864 packages loaded, 21813 targets configured)
Analyzing: target //pkg/sql/schemachanger/scplan:scplan_test (874 packages loaded, 23830 targets configured)
Analyzing: target //pkg/sql/schemachanger/scplan:scplan_test (996 packages loaded, 26787 targets configured)
INFO: Analyzed target //pkg/sql/schemachanger/scplan:scplan_test (1039 packages loaded, 28468 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 5] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[575 / 1,946] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 0s processwrapper-sandbox
[828 / 3,579] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[829 / 3,581] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 3s processwrapper-sandbox ... (4 actions running)
[829 / 3,581] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 13s processwrapper-sandbox ... (4 actions running)
[830 / 3,581] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 34s processwrapper-sandbox ... (4 actions, 3 running)
[834 / 3,581] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 35s processwrapper-sandbox ... (4 actions, 3 running)
[838 / 3,581] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 36s processwrapper-sandbox ... (4 actions, 3 running)
[845 / 3,581] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 37s processwrapper-sandbox ... (4 actions, 3 running)
[854 / 3,581] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 38s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:143:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_m

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 9b7662ecca3809ad9acae9b0d7604d2c3596e7d4:

[21 / 219] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 4s processwrapper-sandbox ... (4 actions running)
[24 / 219] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 5s processwrapper-sandbox ... (4 actions running)
[26 / 219] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 6s processwrapper-sandbox ... (4 actions running)
[27 / 219] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 7s processwrapper-sandbox ... (4 actions running)
[29 / 219] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 8s processwrapper-sandbox ... (4 actions running)
[30 / 219] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 9s processwrapper-sandbox ... (4 actions running)
[34 / 219] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 10s processwrapper-sandbox ... (4 actions running)
[36 / 219] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[37 / 219] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 12s processwrapper-sandbox ... (4 actions, 3 running)
[41 / 219] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 13s processwrapper-sandbox ... (4 actions, 3 running)
[44 / 219] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 14s processwrapper-sandbox ... (4 actions, 3 running)
[46 / 219] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 15s processwrapper-sandbox ... (4 actions, 3 running)
[48 / 219] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 16s processwrapper-sandbox ... (4 actions, 3 running)
[53 / 219] Compiling src/google/protobuf/util/message_differencer.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[56 / 219] Compiling src/google/protobuf/util/message_differencer.cc [for tool]; 2s processwrapper-sandbox ... (4 actions running)
[63 / 219] Compiling src/google/protobuf/util/internal/utility.cc [for tool]; 0s processwrapper-sandbox ... (4 actions running)
[65 / 219] Compiling src/google/protobuf/util/internal/proto_writer.cc [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[69 / 219] Compiling src/google/protobuf/util/internal/protostream_objectsource.cc [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[74 / 219] Compiling src/google/protobuf/compiler/command_line_interface.cc [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[76 / 219] Compiling src/google/protobuf/compiler/command_line_interface.cc [for tool]; 2s processwrapper-sandbox ... (4 actions running)
[79 / 219] Compiling src/google/protobuf/compiler/command_line_interface.cc [for tool]; 3s processwrapper-sandbox ... (4 actions running)
[81 / 219] Compiling src/google/protobuf/struct.pb.cc [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[84 / 219] Compiling src/google/protobuf/struct.pb.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[88 / 219] Compiling src/google/protobuf/compiler/parser.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[91 / 219] Compiling src/google/protobuf/generated_message_table_driven.cc [for tool]; 2s processwrapper-sandbox ... (4 actions running)
[94 / 219] Compiling src/google/protobuf/generated_message_reflection.cc [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[96 / 219] Compiling src/google/protobuf/generated_message_reflection.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[101 / 219] Compiling src/google/protobuf/descriptor_database.cc [for tool]; 0s processwrapper-sandbox ... (4 actions, 3 running)
[103 / 219] Compiling src/google/protobuf/descriptor.pb.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[106 / 219] Compiling src/google/protobuf/descriptor.pb.cc [for tool]; 3s processwrapper-sandbox ... (4 actions running)
[108 / 219] Compiling src/google/protobuf/descriptor.pb.cc [for tool]; 4s processwrapper-sandbox ... (4 actions running)
[111 / 222] Compiling src/google/protobuf/descriptor.pb.cc [for tool]; 5s processwrapper-sandbox ... (4 actions, 3 running)
[126 / 496] Compiling src/google/protobuf/compiler/js/js_generator.cc [for tool]; 3s processwrapper-sandbox ... (4 actions running)
[129 / 538] Compiling src/google/protobuf/descriptor.cc [for tool]; 7s processwrapper-sandbox ... (4 actions, 3 running)
[129 / 538] Compiling src/google/protobuf/descriptor.cc [for tool]; 9s processwrapper-sandbox ... (4 actions running)
[130 / 538] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 14s processwrapper-sandbox ... (4 actions, 3 running)
[142 / 649] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 15s processwrapper-sandbox ... (4 actions, 3 running)
[167 / 649] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 16s processwrapper-sandbox ... (4 actions, 3 running)
[180 / 649] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 17s processwrapper-sandbox ... (4 actions, 3 running)
[194 / 649] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 19s processwrapper-sandbox ... (4 actions running)
[199 / 649] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 20s processwrapper-sandbox ... (4 actions running)
[210 / 649] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 21s processwrapper-sandbox ... (4 actions, 3 running)
[220 / 649] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 22s processwrapper-sandbox ... (4 actions, 3 running)
[232 / 649] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 23s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/cmd/protoc-gen-gogoroach/BUILD.bazel:16:10: GoLink pkg/cmd/protoc-gen-gogoroach/protoc-gen-gogoroach_/protoc-gen-gogoroach [for tool] failed: (Exit 1): builder failed: error executing command (from target //pkg/cmd/protoc-gen-gogoroach:protoc-gen-gogoroach) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -arc ... (remaining 65 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation ta

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 9b7662ecca3809ad9acae9b0d7604d2c3596e7d4:

stdout: 
, stderr: 

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 9b7662ecca3809ad9acae9b0d7604d2c3596e7d4:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/schemachanger/scplan/internal/scgraph:scgraph_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/schemachanger/scplan/internal/scgraph:scgraph_test (137 packages loaded, 13235 targets configured)
Analyzing: target //pkg/sql/schemachanger/scplan/internal/scgraph:scgraph_test (258 packages loaded, 16416 targets configured)
Analyzing: target //pkg/sql/schemachanger/scplan/internal/scgraph:scgraph_test (335 packages loaded, 19612 targets configured)
Analyzing: target //pkg/sql/schemachanger/scplan/internal/scgraph:scgraph_test (355 packages loaded, 23009 targets configured)
INFO: Analyzed target //pkg/sql/schemachanger/scplan/internal/scgraph:scgraph_test (355 packages loaded, 23104 targets configured).
INFO: Found 1 test target...
[0 / 11] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[128 / 523] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[128 / 523] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[131 / 523] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 19s processwrapper-sandbox ... (2 actions, 1 running)
[331 / 1,071] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (3 actions, 2 running)
[371 / 1,288] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox ... (4 actions running)
[371 / 1,288] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 13s processwrapper-sandbox ... (4 actions running)
[372 / 1,288] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 29s processwrapper-sandbox ... (4 actions, 3 running)
[376 / 1,288] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 30s processwrapper-sandbox ... (4 actions, 3 running)
[381 / 1,288] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 32s processwrapper-sandbox ... (4 actions, 3 running)
[381 / 1,288] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 33s processwrapper-sandbox ... (4 actions running)
[382 / 1,288] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 34s processwrapper-sandbox ... (4 actions running)
[387 / 1,288] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 35s processwrapper-sandbox ... (4 actions running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:143:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 9b7662ecca3809ad9acae9b0d7604d2c3596e7d4:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/schemachanger/scplan/internal/rules/release_22_2:release_22_2_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/schemachanger/scplan/internal/rules/release_22_2:release_22_2_test (107 packages loaded, 11369 targets configured)
Analyzing: target //pkg/sql/schemachanger/scplan/internal/rules/release_22_2:release_22_2_test (241 packages loaded, 14447 targets configured)
Analyzing: target //pkg/sql/schemachanger/scplan/internal/rules/release_22_2:release_22_2_test (348 packages loaded, 17907 targets configured)
Analyzing: target //pkg/sql/schemachanger/scplan/internal/rules/release_22_2:release_22_2_test (398 packages loaded, 20598 targets configured)
Analyzing: target //pkg/sql/schemachanger/scplan/internal/rules/release_22_2:release_22_2_test (401 packages loaded, 22671 targets configured)
INFO: Analyzed target //pkg/sql/schemachanger/scplan/internal/rules/release_22_2:release_22_2_test (408 packages loaded, 23491 targets configured).
INFO: Found 1 test target...
[0 / 3] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[372 / 1,249] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (4 actions, 3 running)
[372 / 1,249] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox ... (4 actions running)
[372 / 1,249] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 11s processwrapper-sandbox ... (4 actions running)
[373 / 1,249] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 34s processwrapper-sandbox ... (4 actions, 3 running)
[376 / 1,249] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 36s processwrapper-sandbox ... (4 actions, 3 running)
[379 / 1,249] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 37s processwrapper-sandbox ... (4 actions running)
[381 / 1,249] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 38s processwrapper-sandbox ... (4 actions running)
[383 / 1,249] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 39s processwrapper-sandbox ... (4 actions running)
[387 / 1,249] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 40s processwrapper-sandbox ... (4 actions, 3 running)
[390 / 1,249] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 41s processwrapper-sandbox ... (4 actions, 3 running)
[397 / 1,249] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 42s processwrapper-sandbox ... (4 actions, 3 running)
[407 / 1,249] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 43s processwrapper-sandbox ... (4 actions, 3 running)
[418 / 1,249] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 44s processwrapper-sandbox ... (4 actions, 3 running)
[430 / 1,249] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 45s processwrapper-sandbox ... (4 actions, 3 running)
[446 / 1,249] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 46s processwrapper-sandbox ... (4 actions, 3 running)
[475 / 1,249] GoCompilePkg external/co_honnef_go_tools/go/ir/ir.a [for tool]; 0s processwrapper-sandbox ... (4 actions, 3 running)
[486 / 1,249] GoCompilePkg external/com_github_gogo_protobuf/proto/proto.a [for tool]; 0s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:143:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sa

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 9b7662ecca3809ad9acae9b0d7604d2c3596e7d4:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/schemachanger/screl:screl_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/schemachanger/screl:screl_test (141 packages loaded, 12888 targets configured)
Analyzing: target //pkg/sql/schemachanger/screl:screl_test (248 packages loaded, 15044 targets configured)
Analyzing: target //pkg/sql/schemachanger/screl:screl_test (341 packages loaded, 19803 targets configured)
Analyzing: target //pkg/sql/schemachanger/screl:screl_test (353 packages loaded, 22577 targets configured)
INFO: Analyzed target //pkg/sql/schemachanger/screl:screl_test (353 packages loaded, 23033 targets configured).
INFO: Found 1 test target...
[0 / 7] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[6 / 76] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[6 / 76] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[8 / 76] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 18s processwrapper-sandbox ... (3 actions, 2 running)
[224 / 671] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (4 actions, 3 running)
[237 / 736] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox ... (4 actions running)
[237 / 736] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 13s processwrapper-sandbox ... (4 actions running)
[238 / 736] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 29s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:143:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcomma

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 9b7662ecca3809ad9acae9b0d7604d2c3596e7d4:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/schemachanger/scrun:scrun_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/schemachanger/scrun:scrun_test (199 packages loaded, 12044 targets configured)
Analyzing: target //pkg/sql/schemachanger/scrun:scrun_test (413 packages loaded, 16848 targets configured)
Analyzing: target //pkg/sql/schemachanger/scrun:scrun_test (520 packages loaded, 20317 targets configured)
Analyzing: target //pkg/sql/schemachanger/scrun:scrun_test (557 packages loaded, 22122 targets configured)
Analyzing: target //pkg/sql/schemachanger/scrun:scrun_test (561 packages loaded, 24491 targets configured)
INFO: Analyzed target //pkg/sql/schemachanger/scrun:scrun_test (561 packages loaded, 24491 targets configured).
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[132 / 565] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[132 / 565] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[134 / 565] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 18s processwrapper-sandbox ... (3 actions, 2 running)
[265 / 784] [Prepa] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool] ... (3 actions, 2 running)
[265 / 784] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (4 actions running)
[265 / 784] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 10s processwrapper-sandbox ... (4 actions running)
[266 / 784] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 34s processwrapper-sandbox ... (4 actions, 3 running)
[268 / 784] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 35s processwrapper-sandbox ... (4 actions running)
[271 / 784] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 36s processwrapper-sandbox ... (4 actions running)
[274 / 784] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 37s processwrapper-sandbox ... (3 actions running)
[277 / 784] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 38s processwrapper-sandbox ... (4 actions running)
[281 / 784] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 39s processwrapper-sandbox ... (4 actions running)
[282 / 784] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 41s processwrapper-sandbox ... (4 actions, 3 running)
[285 / 784] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 42s processwrapper-sandbox ... (4 actions, 3 running)
[288 / 784] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 44s processwrapper-sandbox ... (4 actions, 3 running)
[293 / 784] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 45s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:143:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 9b7662ecca3809ad9acae9b0d7604d2c3596e7d4:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/sem/builtins:builtins_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/sem/builtins:builtins_test (444 packages loaded, 11351 targets configured)
Analyzing: target //pkg/sql/sem/builtins:builtins_test (485 packages loaded, 11995 targets configured)
Analyzing: target //pkg/sql/sem/builtins:builtins_test (547 packages loaded, 13392 targets configured)
Analyzing: target //pkg/sql/sem/builtins:builtins_test (609 packages loaded, 14917 targets configured)
Analyzing: target //pkg/sql/sem/builtins:builtins_test (645 packages loaded, 15263 targets configured)
Analyzing: target //pkg/sql/sem/builtins:builtins_test (710 packages loaded, 17050 targets configured)
Analyzing: target //pkg/sql/sem/builtins:builtins_test (742 packages loaded, 19608 targets configured)
Analyzing: target //pkg/sql/sem/builtins:builtins_test (761 packages loaded, 23283 targets configured)
Analyzing: target //pkg/sql/sem/builtins:builtins_test (888 packages loaded, 25228 targets configured)
Analyzing: target //pkg/sql/sem/builtins:builtins_test (968 packages loaded, 27367 targets configured)
Analyzing: target //pkg/sql/sem/builtins:builtins_test (1002 packages loaded, 27884 targets configured)
INFO: Analyzed target //pkg/sql/sem/builtins:builtins_test (1043 packages loaded, 28478 targets configured).
INFO: Found 1 test target...
[0 / 6] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[128 / 583] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[128 / 583] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[130 / 583] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 18s processwrapper-sandbox ... (3 actions, 2 running)
[348 / 1,189] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (4 actions, 3 running)
[397 / 1,376] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (4 actions, 3 running)
[397 / 1,376] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 3s processwrapper-sandbox ... (4 actions running)
[397 / 1,376] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 13s processwrapper-sandbox ... (4 actions running)
[398 / 1,376] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 29s processwrapper-sandbox ... (4 actions, 3 running)
[402 / 1,376] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 30s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:143:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 9b7662ecca3809ad9acae9b0d7604d2c3596e7d4:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/sem/builtins/pgformat:pgformat_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/sem/builtins/pgformat:pgformat_test (300 packages loaded, 10669 targets configured)
Analyzing: target //pkg/sql/sem/builtins/pgformat:pgformat_test (349 packages loaded, 11367 targets configured)
Analyzing: target //pkg/sql/sem/builtins/pgformat:pgformat_test (392 packages loaded, 12073 targets configured)
Analyzing: target //pkg/sql/sem/builtins/pgformat:pgformat_test (450 packages loaded, 12714 targets configured)
Analyzing: target //pkg/sql/sem/builtins/pgformat:pgformat_test (515 packages loaded, 13286 targets configured)
Analyzing: target //pkg/sql/sem/builtins/pgformat:pgformat_test (626 packages loaded, 15387 targets configured)
Analyzing: target //pkg/sql/sem/builtins/pgformat:pgformat_test (674 packages loaded, 18293 targets configured)
Analyzing: target //pkg/sql/sem/builtins/pgformat:pgformat_test (725 packages loaded, 20885 targets configured)
Analyzing: target //pkg/sql/sem/builtins/pgformat:pgformat_test (832 packages loaded, 22986 targets configured)
Analyzing: target //pkg/sql/sem/builtins/pgformat:pgformat_test (943 packages loaded, 25649 targets configured)
Analyzing: target //pkg/sql/sem/builtins/pgformat:pgformat_test (968 packages loaded, 27559 targets configured)
INFO: Analyzed target //pkg/sql/sem/builtins/pgformat:pgformat_test (1039 packages loaded, 28451 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 7] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[297 / 997] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (4 actions, 3 running)
[308 / 997] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (4 actions, 3 running)
[320 / 997] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox ... (4 actions, 3 running)
[332 / 997] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 3s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:143:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation 

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 9b7662ecca3809ad9acae9b0d7604d2c3596e7d4:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/sem/eval:eval_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/sem/eval:eval_test (253 packages loaded, 11921 targets configured)
Analyzing: target //pkg/sql/sem/eval:eval_test (477 packages loaded, 15656 targets configured)
Analyzing: target //pkg/sql/sem/eval:eval_test (579 packages loaded, 18666 targets configured)
Analyzing: target //pkg/sql/sem/eval:eval_test (606 packages loaded, 21656 targets configured)
Analyzing: target //pkg/sql/sem/eval:eval_test (615 packages loaded, 24387 targets configured)
INFO: Analyzed target //pkg/sql/sem/eval:eval_test (615 packages loaded, 24923 targets configured).
INFO: Found 1 test target...
 checking cached actions
[0 / 5] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[361 / 1,173] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (3 actions, 2 running)
[361 / 1,173] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox ... (4 actions running)
[361 / 1,173] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 11s processwrapper-sandbox ... (4 actions running)
[362 / 1,173] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 33s processwrapper-sandbox ... (4 actions, 3 running)
[365 / 1,173] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 34s processwrapper-sandbox ... (4 actions, 3 running)
[368 / 1,173] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 35s processwrapper-sandbox ... (4 actions, 3 running)
[370 / 1,173] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 36s processwrapper-sandbox ... (4 actions running)
[373 / 1,173] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 37s processwrapper-sandbox ... (4 actions running)
[374 / 1,173] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 40s processwrapper-sandbox ... (4 actions, 3 running)
[378 / 1,173] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 41s processwrapper-sandbox ... (4 actions, 3 running)
[380 / 1,173] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 43s processwrapper-sandbox ... (4 actions, 3 running)
[383 / 1,173] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 44s processwrapper-sandbox ... (4 actions, 3 running)
[386 / 1,173] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 45s processwrapper-sandbox ... (4 actions, 3 running)
[391 / 1,173] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 46s processwrapper-sandbox ... (4 actions, 3 running)
[394 / 1,173] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 47s processwrapper-sandbox ... (4 actions, 3 running)
[408 / 1,173] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 47s processwrapper-sandbox ... (4 actions running)
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/cmd/protoc-gen-gogoroach/BUILD.bazel:16:10: GoLink pkg/cmd/protoc-gen-gogoroach/protoc-gen-gogoroach_/protoc-gen-gogoroach [for tool] failed: (Exit 1): builder failed: error executing command (from target //pkg/cmd/protoc-gen-gogoroach:protoc-gen-gogoroach) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -arc ... (remaining 65 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: 

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 9b7662ecca3809ad9acae9b0d7604d2c3596e7d4:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/sem/cast:cast_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/sem/cast:cast_test (47 packages loaded, 12083 targets configured)
Analyzing: target //pkg/sql/sem/cast:cast_test (86 packages loaded, 14974 targets configured)
INFO: Analyzed target //pkg/sql/sem/cast:cast_test (109 packages loaded, 16294 targets configured).
INFO: Found 1 test target...
[0 / 3] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[273 / 920] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (3 actions, 2 running)
[273 / 920] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox ... (4 actions running)
[273 / 920] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 11s processwrapper-sandbox ... (4 actions running)
[274 / 920] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 38s processwrapper-sandbox ... (4 actions, 3 running)
[277 / 920] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 40s processwrapper-sandbox ... (4 actions running)
[281 / 920] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 41s processwrapper-sandbox ... (3 actions running)
[284 / 920] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 42s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:143:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
Target //pkg/sql/sem/cast:cast_test failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/com_github_coc

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 9b7662ecca3809ad9acae9b0d7604d2c3596e7d4:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/sem/normalize:normalize_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/sem/normalize:normalize_test (187 packages loaded, 12126 targets configured)
Analyzing: target //pkg/sql/sem/normalize:normalize_test (368 packages loaded, 16218 targets configured)
Analyzing: target //pkg/sql/sem/normalize:normalize_test (399 packages loaded, 18227 targets configured)
Analyzing: target //pkg/sql/sem/normalize:normalize_test (423 packages loaded, 21004 targets configured)
Analyzing: target //pkg/sql/sem/normalize:normalize_test (473 packages loaded, 23404 targets configured)
INFO: Analyzed target //pkg/sql/sem/normalize:normalize_test (481 packages loaded, 23816 targets configured).
INFO: Found 1 test target...
[0 / 7] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[129 / 556] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[129 / 556] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[131 / 556] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 18s processwrapper-sandbox ... (3 actions, 2 running)
[345 / 1,235] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (3 actions running)
[345 / 1,235] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox ... (4 actions running)
[345 / 1,235] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 11s processwrapper-sandbox ... (4 actions running)
[346 / 1,235] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 28s processwrapper-sandbox ... (4 actions, 3 running)
[349 / 1,235] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 29s processwrapper-sandbox ... (4 actions, 3 running)
[354 / 1,235] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 31s processwrapper-sandbox ... (4 actions, 3 running)
[355 / 1,235] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 32s processwrapper-sandbox ... (4 actions running)
[356 / 1,235] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 33s processwrapper-sandbox ... (4 actions running)
[362 / 1,235] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 34s processwrapper-sandbox ... (4 actions running)
[370 / 1,235] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 35s processwrapper-sandbox ... (4 actions running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:143:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignor

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 9b7662ecca3809ad9acae9b0d7604d2c3596e7d4:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/sem/eval/cast_test:cast_test_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/sem/eval/cast_test:cast_test_test (281 packages loaded, 11033 targets configured)
Analyzing: target //pkg/sql/sem/eval/cast_test:cast_test_test (404 packages loaded, 13077 targets configured)
Analyzing: target //pkg/sql/sem/eval/cast_test:cast_test_test (433 packages loaded, 14096 targets configured)
Analyzing: target //pkg/sql/sem/eval/cast_test:cast_test_test (593 packages loaded, 17179 targets configured)
Analyzing: target //pkg/sql/sem/eval/cast_test:cast_test_test (703 packages loaded, 19944 targets configured)
Analyzing: target //pkg/sql/sem/eval/cast_test:cast_test_test (729 packages loaded, 22006 targets configured)
Analyzing: target //pkg/sql/sem/eval/cast_test:cast_test_test (942 packages loaded, 24523 targets configured)
Analyzing: target //pkg/sql/sem/eval/cast_test:cast_test_test (1040 packages loaded, 28024 targets configured)
INFO: Analyzed target //pkg/sql/sem/eval/cast_test:cast_test_test (1040 packages loaded, 28459 targets configured).
INFO: Found 1 test target...
 checking cached actions
[0 / 5] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[264 / 833] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (4 actions, 3 running)
[264 / 833] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox ... (4 actions running)
[264 / 833] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 11s processwrapper-sandbox ... (4 actions running)
[265 / 833] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 34s processwrapper-sandbox ... (3 actions running)
[268 / 833] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 35s processwrapper-sandbox ... (4 actions, 3 running)
[271 / 833] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 36s processwrapper-sandbox ... (4 actions, 3 running)
[274 / 833] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 37s processwrapper-sandbox ... (4 actions, 3 running)
[278 / 833] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 39s processwrapper-sandbox ... (4 actions, 3 running)
[282 / 833] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 40s processwrapper-sandbox ... (4 actions, 3 running)
[287 / 833] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 41s processwrapper-sandbox ... (4 actions, 3 running)
[295 / 833] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 42s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:143:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
r

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 9b7662ecca3809ad9acae9b0d7604d2c3596e7d4:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/sem/eval/eval_test:eval_test_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/sem/eval/eval_test:eval_test_test (210 packages loaded, 3261 targets configured)
Analyzing: target //pkg/sql/sem/eval/eval_test:eval_test_test (370 packages loaded, 10645 targets configured)
Analyzing: target //pkg/sql/sem/eval/eval_test:eval_test_test (449 packages loaded, 12110 targets configured)
Analyzing: target //pkg/sql/sem/eval/eval_test:eval_test_test (466 packages loaded, 12192 targets configured)
Analyzing: target //pkg/sql/sem/eval/eval_test:eval_test_test (614 packages loaded, 14754 targets configured)
Analyzing: target //pkg/sql/sem/eval/eval_test:eval_test_test (670 packages loaded, 16136 targets configured)
Analyzing: target //pkg/sql/sem/eval/eval_test:eval_test_test (754 packages loaded, 17746 targets configured)
Analyzing: target //pkg/sql/sem/eval/eval_test:eval_test_test (814 packages loaded, 20445 targets configured)
Analyzing: target //pkg/sql/sem/eval/eval_test:eval_test_test (832 packages loaded, 22948 targets configured)
Analyzing: target //pkg/sql/sem/eval/eval_test:eval_test_test (947 packages loaded, 25474 targets configured)
Analyzing: target //pkg/sql/sem/eval/eval_test:eval_test_test (969 packages loaded, 27396 targets configured)
Analyzing: target //pkg/sql/sem/eval/eval_test:eval_test_test (1024 packages loaded, 27946 targets configured)
INFO: Analyzed target //pkg/sql/sem/eval/eval_test:eval_test_test (1040 packages loaded, 28498 targets configured).
INFO: Found 1 test target...
[0 / 7] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[496 / 1,767] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 0s processwrapper-sandbox ... (2 actions, 1 running)
[540 / 1,927] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[540 / 1,927] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[541 / 1,927] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 35s processwrapper-sandbox ... (4 actions, 3 running)
[544 / 1,927] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 36s processwrapper-sandbox ... (4 actions, 3 running)
[550 / 1,927] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 37s processwrapper-sandbox ... (4 actions, 3 running)
[559 / 1,927] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 38s processwrapper-sandbox ... (4 actions, 2 running)
[564 / 1,927] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 39s processwrapper-sandbox ... (4 actions, 3 running)
[572 / 1,927] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 41s processwrapper-sandbox ... (4 actions running)
[577 / 1,927] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 42s processwrapper-sandbox ... (4 actions running)
[587 / 1,927] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 43s processwrapper-sandbox ... (4 actions, 3 running)
[592 / 1,927] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 44s processwrapper-sandbox ... (4 actions, 3 running)
[600 / 1,927] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 45s processwrapper-sandbox ... (4 actions, 3 running)
[607 / 1,927] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 46s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:143:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 39ea7d84a7dff00f7324bd317c9df84fae4dfa07:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/sem/tree:tree_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/sem/tree:tree_test (175 packages loaded, 11290 targets configured)
Analyzing: target //pkg/sql/sem/tree:tree_test (246 packages loaded, 13338 targets configured)
Analyzing: target //pkg/sql/sem/tree:tree_test (423 packages loaded, 16763 targets configured)
Analyzing: target //pkg/sql/sem/tree:tree_test (491 packages loaded, 19847 targets configured)
Analyzing: target //pkg/sql/sem/tree:tree_test (558 packages loaded, 22780 targets configured)
Analyzing: target //pkg/sql/sem/tree:tree_test (566 packages loaded, 24864 targets configured)
INFO: Analyzed target //pkg/sql/sem/tree:tree_test (566 packages loaded, 24864 targets configured).
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[311 / 1,106] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (4 actions, 2 running)
[349 / 1,209] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox ... (4 actions running)
[349 / 1,209] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 11s processwrapper-sandbox ... (4 actions running)
[350 / 1,209] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 29s processwrapper-sandbox ... (4 actions, 3 running)
[354 / 1,209] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 30s processwrapper-sandbox ... (4 actions, 3 running)
[359 / 1,209] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 31s processwrapper-sandbox ... (4 actions running)
[361 / 1,209] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 32s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:143:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsa

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 39ea7d84a7dff00f7324bd317c9df84fae4dfa07:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/sessiondata:sessiondata_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/sessiondata:sessiondata_test (40 packages loaded, 12821 targets configured)
INFO: Analyzed target //pkg/sql/sessiondata:sessiondata_test (66 packages loaded, 15557 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 6] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[323 / 956] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (2 actions, 1 running)
[328 / 956] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox ... (4 actions, 3 running)
[329 / 956] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 3s processwrapper-sandbox ... (4 actions, 3 running)
[331 / 956] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 4s processwrapper-sandbox ... (4 actions running)
[341 / 956] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 5s processwrapper-sandbox ... (4 actions running)
[371 / 956] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 6s processwrapper-sandbox ... (4 actions running)
[388 / 956] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 7s processwrapper-sandbox ... (4 actions, 3 running)
[406 / 956] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 8s processwrapper-sandbox ... (4 actions, 3 running)
[410 / 956] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 10s processwrapper-sandbox ... (4 actions, 3 running)
[411 / 956] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 11s processwrapper-sandbox ... (4 actions running)
[413 / 956] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 12s processwrapper-sandbox ... (4 actions, 3 running)
[415 / 956] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 14s processwrapper-sandbox ... (4 actions running)
[417 / 956] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 15s processwrapper-sandbox ... (4 actions, 3 running)
[419 / 956] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 17s processwrapper-sandbox ... (4 actions, 3 running)
[420 / 956] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 18s processwrapper-sandbox ... (4 actions running)
[422 / 956] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 19s processwrapper-sandbox ... (4 actions, 3 running)
[423 / 956] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 20s processwrapper-sandbox ... (4 actions, 3 running)
[425 / 956] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 22s processwrapper-sandbox ... (4 actions, 3 running)
[426 / 956] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 23s processwrapper-sandbox ... (4 actions running)
[428 / 956] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 24s processwrapper-sandbox ... (4 actions, 3 running)
[429 / 956] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 26s processwrapper-sandbox ... (4 actions running)
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/cmd/protoc-gen-gogoroach/BUILD.bazel:16:10: GoLink pkg/cmd/protoc-gen-gogoroach/protoc-gen-gogoroach_/protoc-gen-gogoroach [for tool] failed: (Exit 1): builder failed: error executing command (from target //pkg/cmd/protoc-gen-gogoroach:protoc-gen-gogoroach) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -arc ... (remaining 65 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 39ea7d84a7dff00f7324bd317c9df84fae4dfa07:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/sqlinstance/instancestorage:instancestorage_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/sqlinstance/instancestorage:instancestorage_test (382 packages loaded, 11399 targets configured)
Analyzing: target //pkg/sql/sqlinstance/instancestorage:instancestorage_test (604 packages loaded, 13835 targets configured)
Analyzing: target //pkg/sql/sqlinstance/instancestorage:instancestorage_test (743 packages loaded, 16399 targets configured)
Analyzing: target //pkg/sql/sqlinstance/instancestorage:instancestorage_test (852 packages loaded, 19456 targets configured)
Analyzing: target //pkg/sql/sqlinstance/instancestorage:instancestorage_test (898 packages loaded, 21955 targets configured)
Analyzing: target //pkg/sql/sqlinstance/instancestorage:instancestorage_test (914 packages loaded, 24986 targets configured)
Analyzing: target //pkg/sql/sqlinstance/instancestorage:instancestorage_test (1021 packages loaded, 27452 targets configured)
Analyzing: target //pkg/sql/sqlinstance/instancestorage:instancestorage_test (1039 packages loaded, 28456 targets configured)
INFO: Analyzed target //pkg/sql/sqlinstance/instancestorage:instancestorage_test (1039 packages loaded, 28456 targets configured).
INFO: Found 1 test target...
[0 / 8] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[369 / 1,085] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:143:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
Target //pkg/sql/sqlinst

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 39ea7d84a7dff00f7324bd317c9df84fae4dfa07:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/sessiondatapb:sessiondatapb_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/sessiondatapb:sessiondatapb_test (78 packages loaded, 13216 targets configured)
INFO: Analyzed target //pkg/sql/sessiondatapb:sessiondatapb_test (101 packages loaded, 15765 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 8] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[130 / 520] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[130 / 520] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[131 / 520] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 18s processwrapper-sandbox ... (4 actions, 3 running)
[300 / 953] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (2 actions, 1 running)
[312 / 1,000] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox ... (4 actions running)
[312 / 1,000] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 11s processwrapper-sandbox ... (4 actions running)
[313 / 1,000] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 35s processwrapper-sandbox ... (4 actions, 3 running)
[316 / 1,000] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 36s processwrapper-sandbox ... (4 actions, 3 running)
[320 / 1,000] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 37s processwrapper-sandbox ... (4 actions, 3 running)
[324 / 1,000] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 38s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:143:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 39ea7d84a7dff00f7324bd317c9df84fae4dfa07:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/span:span_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/span:span_test (329 packages loaded, 11235 targets configured)
Analyzing: target //pkg/sql/span:span_test (429 packages loaded, 12836 targets configured)
Analyzing: target //pkg/sql/span:span_test (606 packages loaded, 16955 targets configured)
Analyzing: target //pkg/sql/span:span_test (637 packages loaded, 19148 targets configured)
Analyzing: target //pkg/sql/span:span_test (685 packages loaded, 21981 targets configured)
Analyzing: target //pkg/sql/span:span_test (898 packages loaded, 24386 targets configured)
Analyzing: target //pkg/sql/span:span_test (1007 packages loaded, 27353 targets configured)
INFO: Analyzed target //pkg/sql/span:span_test (1036 packages loaded, 28439 targets configured).
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[131 / 552] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[131 / 552] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[132 / 552] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 18s processwrapper-sandbox ... (4 actions, 3 running)
[321 / 868] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[321 / 868] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 10s processwrapper-sandbox ... (4 actions running)
[322 / 868] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 23s processwrapper-sandbox ... (4 actions, 3 running)
[331 / 868] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 24s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:143:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleas

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 39ea7d84a7dff00f7324bd317c9df84fae4dfa07:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/sessioninit:sessioninit_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/sessioninit:sessioninit_test (366 packages loaded, 10636 targets configured)
Analyzing: target //pkg/sql/sessioninit:sessioninit_test (472 packages loaded, 11607 targets configured)
Analyzing: target //pkg/sql/sessioninit:sessioninit_test (568 packages loaded, 13948 targets configured)
Analyzing: target //pkg/sql/sessioninit:sessioninit_test (677 packages loaded, 15867 targets configured)
Analyzing: target //pkg/sql/sessioninit:sessioninit_test (821 packages loaded, 17997 targets configured)
Analyzing: target //pkg/sql/sessioninit:sessioninit_test (865 packages loaded, 19660 targets configured)
Analyzing: target //pkg/sql/sessioninit:sessioninit_test (904 packages loaded, 23137 targets configured)
Analyzing: target //pkg/sql/sessioninit:sessioninit_test (972 packages loaded, 25499 targets configured)
Analyzing: target //pkg/sql/sessioninit:sessioninit_test (1038 packages loaded, 28146 targets configured)
INFO: Analyzed target //pkg/sql/sessioninit:sessioninit_test (1038 packages loaded, 28449 targets configured).
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[140 / 555] [Prepa] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool] ... (4 actions, 2 running)
[140 / 555] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (4 actions running)
[140 / 555] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 11s processwrapper-sandbox ... (4 actions running)
[141 / 555] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 36s processwrapper-sandbox ... (3 actions running)
[143 / 555] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 37s processwrapper-sandbox ... (4 actions running)
[146 / 555] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 38s processwrapper-sandbox ... (4 actions running)
[150 / 555] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 40s processwrapper-sandbox ... (4 actions, 3 running)
[157 / 555] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 41s processwrapper-sandbox ... (4 actions, 3 running)
[161 / 555] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 42s processwrapper-sandbox ... (4 actions, 3 running)
[166 / 555] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 43s processwrapper-sandbox ... (4 actions, 3 running)
[168 / 555] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 44s processwrapper-sandbox ... (4 actions running)
[175 / 555] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 45s processwrapper-sandbox ... (4 actions, 3 running)
[185 / 555] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 46s processwrapper-sandbox ... (4 actions, 3 running)
[196 / 555] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 47s processwrapper-sandbox ... (4 actions, 3 running)
[226 / 555] GoCompilePkg external/org_golang_x_tools/go/analysis/passes/unmarshal/unmarshal.a [for tool]; 0s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:143:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: 

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 39ea7d84a7dff00f7324bd317c9df84fae4dfa07:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist:fakedist_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist:fakedist_test (15 packages loaded, 296 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist:fakedist_test (15 packages loaded, 296 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist:fakedist_test (15 packages loaded, 296 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist:fakedist_test (15 packages loaded, 296 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist:fakedist_test (272 packages loaded, 11150 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist:fakedist_test (402 packages loaded, 12522 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist:fakedist_test (531 packages loaded, 12732 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist:fakedist_test (556 packages loaded, 13171 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist:fakedist_test (609 packages loaded, 14324 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist:fakedist_test (628 packages loaded, 15051 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist:fakedist_test (732 packages loaded, 16989 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist:fakedist_test (818 packages loaded, 18514 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist:fakedist_test (968 packages loaded, 20913 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist:fakedist_test (1046 packages loaded, 23473 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist:fakedist_test (1153 packages loaded, 25606 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist:fakedist_test (1190 packages loaded, 28219 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist:fakedist_test (1200 packages loaded, 29664 targets configured)
INFO: Analyzed target //pkg/sql/sqlitelogictest/tests/fakedist:fakedist_test (1261 packages loaded, 30563 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 3] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[131 / 497] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (3 actions running)
[131 / 519] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 4s processwrapper-sandbox ... (4 actions, 3 running)
[131 / 519] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 5s processwrapper-sandbox ... (4 actions running)
[131 / 519] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[132 / 519] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 17s processwrapper-sandbox ... (4 actions, 3 running)
[357 / 884] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 14s processwrapper-sandbox ... (4 actions, 2 running)
[358 / 884] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 16s processwrapper-sandbox ... (4 actions running)
[359 / 884] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 5s processwrapper-sandbox ... (4 actions, 3 running)
[392 / 1,345] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 6s processwrapper-sandbox ... (4 actions running)
[392 / 1,345] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 17s processwrapper-sandbox ... (4 actions running)
[393 / 1,345] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 29s processwrapper-sandbox ... (4 actions, 3 running)
[398 / 1,345] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 3

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 39ea7d84a7dff00f7324bd317c9df84fae4dfa07:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/sqlitelogictest/tests/local:local_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local:local_test (15 packages loaded, 296 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local:local_test (15 packages loaded, 296 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local:local_test (15 packages loaded, 296 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local:local_test (15 packages loaded, 296 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local:local_test (298 packages loaded, 11336 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local:local_test (360 packages loaded, 13030 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local:local_test (663 packages loaded, 15207 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local:local_test (860 packages loaded, 18977 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local:local_test (1069 packages loaded, 22009 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local:local_test (1129 packages loaded, 24358 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local:local_test (1165 packages loaded, 26411 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local:local_test (1261 packages loaded, 30248 targets configured)
INFO: Analyzed target //pkg/sql/sqlitelogictest/tests/local:local_test (1261 packages loaded, 30563 targets configured).
INFO: Found 1 test target...
[0 / 5] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[606 / 1,849] [Prepa] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool] ... (2 actions, 1 running)
[789 / 2,987] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 1s processwrapper-sandbox ... (3 actions running)
[828 / 3,801] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 3s processwrapper-sandbox ... (4 actions, 3 running)
[828 / 3,801] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 4s processwrapper-sandbox ... (4 actions running)
[828 / 3,801] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 13s processwrapper-sandbox ... (4 actions running)
[829 / 3,801] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 35s processwrapper-sandbox ... (4 actions, 3 running)
[833 / 3,801] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 36s processwrapper-sandbox ... (4 actions, 3 running)
[839 / 3,801] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 37s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:143:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not d

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 39ea7d84a7dff00f7324bd317c9df84fae4dfa07:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/sqlliveness/slinstance:slinstance_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/sqlliveness/slinstance:slinstance_test (158 packages loaded, 12881 targets configured)
Analyzing: target //pkg/sql/sqlliveness/slinstance:slinstance_test (379 packages loaded, 17170 targets configured)
Analyzing: target //pkg/sql/sqlliveness/slinstance:slinstance_test (442 packages loaded, 20244 targets configured)
Analyzing: target //pkg/sql/sqlliveness/slinstance:slinstance_test (465 packages loaded, 23225 targets configured)
INFO: Analyzed target //pkg/sql/sqlliveness/slinstance:slinstance_test (465 packages loaded, 23723 targets configured).
INFO: Found 1 test target...
[0 / 9] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[131 / 555] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[131 / 555] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[134 / 555] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 18s processwrapper-sandbox ... (2 actions, 1 running)
[335 / 1,071] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (4 actions running)
[335 / 1,071] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 11s processwrapper-sandbox ... (4 actions running)
[336 / 1,071] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 28s processwrapper-sandbox ... (4 actions, 3 running)
[339 / 1,071] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 29s processwrapper-sandbox ... (4 actions running)
[344 / 1,071] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 30s processwrapper-sandbox ... (4 actions running)
[350 / 1,071] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 31s processwrapper-sandbox ... (4 actions running)
[351 / 1,071] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 32s processwrapper-sandbox ... (4 actions, 3 running)
[357 / 1,071] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 34s processwrapper-sandbox ... (4 actions, 3 running)
[370 / 1,071] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 35s processwrapper-sandbox ... (4 actions, 3 running)
[381 / 1,071] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 36s processwrapper-sandbox ... (4 actions, 3 running)
[389 / 1,071] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 36s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:143:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __ts

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 39ea7d84a7dff00f7324bd317c9df84fae4dfa07:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-disk:fakedist-disk_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-disk:fakedist-disk_test (173 packages loaded, 2258 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-disk:fakedist-disk_test (294 packages loaded, 12233 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-disk:fakedist-disk_test (374 packages loaded, 13531 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-disk:fakedist-disk_test (531 packages loaded, 13835 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-disk:fakedist-disk_test (584 packages loaded, 14830 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-disk:fakedist-disk_test (625 packages loaded, 15584 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-disk:fakedist-disk_test (700 packages loaded, 17116 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-disk:fakedist-disk_test (775 packages loaded, 19244 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-disk:fakedist-disk_test (837 packages loaded, 20986 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-disk:fakedist-disk_test (905 packages loaded, 21838 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-disk:fakedist-disk_test (979 packages loaded, 23889 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-disk:fakedist-disk_test (1048 packages loaded, 25431 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-disk:fakedist-disk_test (1170 packages loaded, 28038 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-disk:fakedist-disk_test (1190 packages loaded, 29548 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/fakedist-disk:fakedist-disk_test (1260 packages loaded, 30450 targets configured)
INFO: Analyzed target //pkg/sql/sqlitelogictest/tests/fakedist-disk:fakedist-disk_test (1261 packages loaded, 30563 targets configured).
INFO: Found 1 test target...
[0 / 3] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[131 / 497] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (3 actions running)
[131 / 519] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 4s processwrapper-sandbox ... (4 actions, 3 running)
[131 / 519] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 5s processwrapper-sandbox ... (4 actions running)
[131 / 519] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[132 / 519] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 19s processwrapper-sandbox ... (4 actions, 3 running)
[261 / 722] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 16s processwrapper-sandbox ... (3 actions running)
[261 / 722] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 17s processwrapper-sandbox ... (4 actions running)
[262 / 722] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 5s processwrapper-sandbox ... (4 actions, 3 running)
[366 / 938] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 6s processwrapper-sandbox ... (4 actions, 3 running)
[391 / 1,342] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 7s processwrapper-sandbox ... (4 actions running)
[391 / 1,342] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 19s processwrapper-sandbox ... (4 actions running)
[392 / 1,342] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 33s processwrapper-sandbox ... (4 actions, 3 running)
[400 / 1,342] GoStdlib external/io_baze

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 39ea7d84a7dff00f7324bd317c9df84fae4dfa07:

[0 / 8] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[131 / 497] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (3 actions running)
[131 / 519] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 4s processwrapper-sandbox ... (4 actions, 3 running)
[131 / 519] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 6s processwrapper-sandbox ... (4 actions running)
[131 / 519] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[132 / 519] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 18s processwrapper-sandbox ... (4 actions, 3 running)
[261 / 722] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 15s processwrapper-sandbox ... (3 actions, 2 running)
[261 / 722] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 16s processwrapper-sandbox ... (4 actions running)
[262 / 722] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 6s processwrapper-sandbox ... (4 actions, 3 running)
[358 / 884] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 7s processwrapper-sandbox ... (4 actions, 3 running)
[391 / 1,342] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 8s processwrapper-sandbox ... (4 actions running)
[391 / 1,342] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 17s processwrapper-sandbox ... (4 actions running)
[392 / 1,342] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 30s processwrapper-sandbox ... (4 actions, 3 running)
[396 / 1,342] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 31s processwrapper-sandbox ... (4 actions, 3 running)
[402 / 1,342] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 32s processwrapper-sandbox ... (4 actions, 3 running)
[410 / 1,342] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 33s processwrapper-sandbox ... (4 actions, 3 running)
[417 / 1,342] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 35s processwrapper-sandbox ... (4 actions, 3 running)
[423 / 1,342] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 36s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:143:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
[433 / 1,342] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 37s processwrapper-sandbox ... (2 actions running)
Target //pkg/sql/sqlitelogictest/tests/fakedist-vec-off:fakedist-vec-off_test failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/util/log/logpb/BUILD.bazel:5:11 GoCompilePkg pkg/util/log/logpb/logpb.a [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 39ea7d84a7dff00f7324bd317c9df84fae4dfa07:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-vec-off:local-vec-off_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-vec-off:local-vec-off_test (15 packages loaded, 296 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-vec-off:local-vec-off_test (15 packages loaded, 296 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-vec-off:local-vec-off_test (240 packages loaded, 11219 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-vec-off:local-vec-off_test (298 packages loaded, 12630 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-vec-off:local-vec-off_test (304 packages loaded, 12660 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-vec-off:local-vec-off_test (395 packages loaded, 13205 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-vec-off:local-vec-off_test (594 packages loaded, 14572 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-vec-off:local-vec-off_test (635 packages loaded, 15037 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-vec-off:local-vec-off_test (738 packages loaded, 17807 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-vec-off:local-vec-off_test (839 packages loaded, 19250 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-vec-off:local-vec-off_test (914 packages loaded, 22042 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-vec-off:local-vec-off_test (1015 packages loaded, 23520 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-vec-off:local-vec-off_test (1082 packages loaded, 26031 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-vec-off:local-vec-off_test (1156 packages loaded, 27935 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-vec-off:local-vec-off_test (1220 packages loaded, 29814 targets configured)
INFO: Analyzed target //pkg/sql/sqlitelogictest/tests/local-vec-off:local-vec-off_test (1261 packages loaded, 30563 targets configured).
INFO: Found 1 test target...
[0 / 8] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[154 / 497] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (4 actions, 3 running)
[167 / 497] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (4 actions running)
[183 / 497] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox ... (4 actions running)
[203 / 497] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 3s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:143:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation targ

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 39ea7d84a7dff00f7324bd317c9df84fae4dfa07:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-legacy-schema-changer:local-legacy-schema-changer_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-legacy-schema-changer:local-legacy-schema-changer_test (15 packages loaded, 296 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-legacy-schema-changer:local-legacy-schema-changer_test (15 packages loaded, 296 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-legacy-schema-changer:local-legacy-schema-changer_test (295 packages loaded, 11594 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-legacy-schema-changer:local-legacy-schema-changer_test (347 packages loaded, 12794 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-legacy-schema-changer:local-legacy-schema-changer_test (544 packages loaded, 13458 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-legacy-schema-changer:local-legacy-schema-changer_test (588 packages loaded, 14037 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-legacy-schema-changer:local-legacy-schema-changer_test (699 packages loaded, 16574 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-legacy-schema-changer:local-legacy-schema-changer_test (770 packages loaded, 17787 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-legacy-schema-changer:local-legacy-schema-changer_test (930 packages loaded, 21232 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-legacy-schema-changer:local-legacy-schema-changer_test (1022 packages loaded, 23277 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-legacy-schema-changer:local-legacy-schema-changer_test (1122 packages loaded, 26463 targets configured)
Analyzing: target //pkg/sql/sqlitelogictest/tests/local-legacy-schema-changer:local-legacy-schema-changer_test (1234 packages loaded, 29321 targets configured)
INFO: Analyzed target //pkg/sql/sqlitelogictest/tests/local-legacy-schema-changer:local-legacy-schema-changer_test (1261 packages loaded, 30563 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 10] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[131 / 542] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[131 / 542] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[133 / 542] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 17s processwrapper-sandbox ... (3 actions, 2 running)
[342 / 1,350] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (4 actions, 3 running)
[342 / 1,350] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox ... (4 actions running)
[342 / 1,350] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 11s processwrapper-sandbox ... (4 actions running)
[343 / 1,350] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 28s processwrapper-sandbox ... (4 actions, 3 running)
[347 / 1,350] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 29s processwrapper-sandbox ... (4 actions, 3 running)
[355 / 1,350] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 30s processwrapper-sandbox ... (4 actions, 3 running)
[364 / 1,350] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 31s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:143:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: e

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 39ea7d84a7dff00f7324bd317c9df84fae4dfa07:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/sqlstats/persistedsqlstats:persistedsqlstats_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/sqlstats/persistedsqlstats:persistedsqlstats_test (495 packages loaded, 10894 targets configured)
Analyzing: target //pkg/sql/sqlstats/persistedsqlstats:persistedsqlstats_test (564 packages loaded, 12625 targets configured)
Analyzing: target //pkg/sql/sqlstats/persistedsqlstats:persistedsqlstats_test (737 packages loaded, 15624 targets configured)
Analyzing: target //pkg/sql/sqlstats/persistedsqlstats:persistedsqlstats_test (856 packages loaded, 19436 targets configured)
Analyzing: target //pkg/sql/sqlstats/persistedsqlstats:persistedsqlstats_test (905 packages loaded, 22072 targets configured)
Analyzing: target //pkg/sql/sqlstats/persistedsqlstats:persistedsqlstats_test (942 packages loaded, 24423 targets configured)
Analyzing: target //pkg/sql/sqlstats/persistedsqlstats:persistedsqlstats_test (1030 packages loaded, 27243 targets configured)
Analyzing: target //pkg/sql/sqlstats/persistedsqlstats:persistedsqlstats_test (1041 packages loaded, 28470 targets configured)
INFO: Analyzed target //pkg/sql/sqlstats/persistedsqlstats:persistedsqlstats_test (1041 packages loaded, 28470 targets configured).
INFO: Found 1 test target...
[0 / 9] [Prepa] BazelWorkspaceStatusAction stable-status.txt ... (2 actions, 0 running)
[356 / 1,202] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (3 actions, 2 running)
[356 / 1,202] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox ... (4 actions running)
[356 / 1,202] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 11s processwrapper-sandbox ... (4 actions running)
[357 / 1,202] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 33s processwrapper-sandbox ... (4 actions, 3 running)
[361 / 1,202] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 35s processwrapper-sandbox ... (4 actions, 3 running)
[364 / 1,202] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 36s processwrapper-sandbox ... (4 actions, 3 running)
[367 / 1,202] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 37s processwrapper-sandbox ... (4 actions running)
[370 / 1,202] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 38s processwrapper-sandbox ... (4 actions running)
[373 / 1,202] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 39s processwrapper-sandbox ... (4 actions running)
[375 / 1,202] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 40s processwrapper-sandbox ... (4 actions running)
[378 / 1,202] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 41s processwrapper-sandbox ... (4 actions running)
[387 / 1,202] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 42s processwrapper-sandbox ... (4 actions running)
[398 / 1,202] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 43s processwrapper-sandbox ... (4 actions running)
[405 / 1,202] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 44s processwrapper-sandbox ... (3 actions running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:143:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: re

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 39ea7d84a7dff00f7324bd317c9df84fae4dfa07:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/sqlliveness/slstorage:slstorage_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/sqlliveness/slstorage:slstorage_test (354 packages loaded, 11072 targets configured)
Analyzing: target //pkg/sql/sqlliveness/slstorage:slstorage_test (473 packages loaded, 12818 targets configured)
Analyzing: target //pkg/sql/sqlliveness/slstorage:slstorage_test (600 packages loaded, 15580 targets configured)
Analyzing: target //pkg/sql/sqlliveness/slstorage:slstorage_test (686 packages loaded, 18089 targets configured)
Analyzing: target //pkg/sql/sqlliveness/slstorage:slstorage_test (729 packages loaded, 21039 targets configured)
Analyzing: target //pkg/sql/sqlliveness/slstorage:slstorage_test (736 packages loaded, 23474 targets configured)
Analyzing: target //pkg/sql/sqlliveness/slstorage:slstorage_test (938 packages loaded, 26082 targets configured)
INFO: Analyzed target //pkg/sql/sqlliveness/slstorage:slstorage_test (1039 packages loaded, 28454 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 3] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[131 / 520] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[131 / 520] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[132 / 520] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 18s processwrapper-sandbox ... (4 actions, 3 running)
[343 / 1,162] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (4 actions, 3 running)
[350 / 1,253] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (4 actions running)
[350 / 1,253] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 11s processwrapper-sandbox ... (4 actions running)
[351 / 1,253] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 27s processwrapper-sandbox ... (4 actions, 3 running)
[355 / 1,253] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 28s processwrapper-sandbox ... (4 actions, 3 running)
[358 / 1,253] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 29s processwrapper-sandbox ... (4 actions running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:143:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 39ea7d84a7dff00f7324bd317c9df84fae4dfa07:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/sqlstats/insights/integration:integration_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/sqlstats/insights/integration:integration_test (440 packages loaded, 11266 targets configured)
Analyzing: target //pkg/sql/sqlstats/insights/integration:integration_test (530 packages loaded, 12386 targets configured)
Analyzing: target //pkg/sql/sqlstats/insights/integration:integration_test (588 packages loaded, 13521 targets configured)
Analyzing: target //pkg/sql/sqlstats/insights/integration:integration_test (700 packages loaded, 14387 targets configured)
Analyzing: target //pkg/sql/sqlstats/insights/integration:integration_test (774 packages loaded, 15055 targets configured)
Analyzing: target //pkg/sql/sqlstats/insights/integration:integration_test (829 packages loaded, 17060 targets configured)
Analyzing: target //pkg/sql/sqlstats/insights/integration:integration_test (890 packages loaded, 20517 targets configured)
Analyzing: target //pkg/sql/sqlstats/insights/integration:integration_test (905 packages loaded, 22955 targets configured)
Analyzing: target //pkg/sql/sqlstats/insights/integration:integration_test (913 packages loaded, 24990 targets configured)
Analyzing: target //pkg/sql/sqlstats/insights/integration:integration_test (968 packages loaded, 27381 targets configured)
Analyzing: target //pkg/sql/sqlstats/insights/integration:integration_test (1025 packages loaded, 28017 targets configured)
INFO: Analyzed target //pkg/sql/sqlstats/insights/integration:integration_test (1039 packages loaded, 28448 targets configured).
INFO: Found 1 test target...
[0 / 3] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[651 / 2,317] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 0s processwrapper-sandbox ... (2 actions, 1 running)
[758 / 2,908] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[811 / 3,241] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[811 / 3,241] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 3s processwrapper-sandbox ... (4 actions running)
[811 / 3,241] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 13s processwrapper-sandbox ... (4 actions running)
[812 / 3,241] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 32s processwrapper-sandbox ... (4 actions, 3 running)
[815 / 3,241] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 33s processwrapper-sandbox ... (4 actions, 3 running)
[819 / 3,241] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 34s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:143:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

. failed with artifacts on release-23.1.12-rc @ 39ea7d84a7dff00f7324bd317c9df84fae4dfa07:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/sql/sqlstats/insights:insights_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/sql/sqlstats/insights:insights_test (34 packages loaded, 11309 targets configured)
Analyzing: target //pkg/sql/sqlstats/insights:insights_test (121 packages loaded, 13856 targets configured)
Analyzing: target //pkg/sql/sqlstats/insights:insights_test (193 packages loaded, 16361 targets configured)
Analyzing: target //pkg/sql/sqlstats/insights:insights_test (293 packages loaded, 19707 targets configured)
INFO: Analyzed target //pkg/sql/sqlstats/insights:insights_test (303 packages loaded, 21906 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 6] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[131 / 601] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[131 / 601] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[132 / 601] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 18s processwrapper-sandbox ... (4 actions, 3 running)
[346 / 1,179] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (4 actions, 3 running)
[346 / 1,179] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox ... (4 actions running)
[346 / 1,179] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 11s processwrapper-sandbox ... (4 actions running)
[347 / 1,179] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 32s processwrapper-sandbox ... (4 actions, 3 running)
[351 / 1,179] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 33s processwrapper-sandbox ... (4 actions, 3 running)
[354 / 1,179] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 34s processwrapper-sandbox ... (4 actions, 3 running)
[356 / 1,179] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 35s processwrapper-sandbox ... (4 actions running)
[357 / 1,179] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 38s processwrapper-sandbox ... (4 actions, 3 running)
[361 / 1,179] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 39s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:143:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: r

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113225 : failed [C-test-failure O-robot T-testeng branch-release-23.1.12-rc.FROZEN]

This test on roachdash | Improve this report!