MSBuild crashing in the build

jkoritzinsky commented 9 months ago

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=410579 Build error leg or test failing: Build / Mono Product Build windows x64 release / Build product Pull request: https://github.com/dotnet/runtime/pull/91768

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "",
  "ErrorPattern": "Child Node \"[0-9]+\" exited prematurely.",
  "BuildRetry": true,
  "ExcludeConsoleLog": false
}

Report

Build	Definition	Step Name	Console log	Pull Request
727724	dotnet/runtime	Build product	Log	dotnet/runtime#104288
727577	dotnet/runtime	Build product	Log	dotnet/runtime#104164
726676	dotnet/runtime	Build product	Log	dotnet/runtime#104262
726672	dotnet/runtime	Build product	Log	dotnet/runtime#104120
2485593	dotnet-runtime	Send tests to Helix (Unix)	Log
724200	dotnet/runtime	Build product	Log	dotnet/runtime#103574
722821	dotnet/runtime	Build product	Log	dotnet/runtime#104104
2482650	dotnet-runtime	Build product	Log
2473768	dotnet-runtime	Send tests to Helix (Unix)	Log
706096	dotnet/runtime	Build product	Log	dotnet/runtime#103389
2470984	dotnet-runtime	Build product	Log
2470420	dotnet-runtime	Restore and Build Product	Log
697148	dotnet/runtime	Restore and Build Product	Log
696985	dotnet/runtime	Build	Log	dotnet/runtime#102494
696832	dotnet/runtime	Build product	Log
2466157	dotnet-runtime	Build product	Log
696153	dotnet/runtime	Build	Log	dotnet/runtime#103003

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
2	8	17

Known issue validation

Build: :mag_right: https://dev.azure.com/dnceng-public/public/_build/results?buildId=410579 Error message validated: Child Node "[0-9]+" exited prematurely. Result validation: :white_check_mark: Known issue matched with the provided build. Validation performed at: 9/19/2023 6:06:29 PM UTC

ghost commented 9 months ago

Tagging subscribers to this area: @dotnet/runtime-infrastructure See info in area-owners.md if you want to be subscribed.

Issue Details

## Build Information Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=410579 Build error leg or test failing: Build / Mono Product Build windows x64 release / Build product Pull request: https://github.com/dotnet/runtime/pull/91768 ## Error Message Fill the error message using [step by step known issues guidance](https://github.com/dotnet/arcade/blob/main/Documentation/Projects/Build%20Analysis/KnownIssues.md#how-to-fill-out-a-known-issue-error-section). ```json { "ErrorMessage": "", "ErrorPattern": "Child Node \"[0-9]+\" exited prematurely.", "BuildRetry": true, "ExcludeConsoleLog": false } ```

Author:	jkoritzinsky
Assignees:	-
Labels:	`blocking-clean-ci`, `area-Infrastructure`, `untriaged`, `Known Build Error`
Milestone:	-

ViktorHofer commented 8 months ago

190 hits per month

cc @rainersigwald @rokonec

lewing commented 7 months ago

reup for 97 hits per month

MichalStrehovsky commented 4 months ago

We now have more useful information in the logs for these. Two of the available logs have this in it:

2024-02-19T21:13:25.8115210Z MSBUILD : error MSB4166: Child node "2" exited prematurely. Shutting down. Diagnostic information may be found in files in "/var/folders/24/8k48jl6d249_n_qfxwsl6xvm0000gn/T/MSBuildTemprunner/" and will be named MSBuild_*.failure.txt. This location can be changed by setting the MSBUILDDEBUGPATH environment variable to a different directory.
2024-02-19T21:13:25.8126770Z MSBUILD : error MSB4166: /var/folders/24/8k48jl6d249_n_qfxwsl6xvm0000gn/T/MSBuildTemprunner/MSBuild_pid-50918_4ee39488d5ca4c7d9fb049f19f43c144.failure.txt:
2024-02-19T21:13:25.8128200Z MSBUILD : error MSB4166: UNHANDLED EXCEPTIONS FROM PROCESS 50918:
2024-02-19T21:13:25.8129250Z MSBUILD : error MSB4166: =====================
2024-02-19T21:13:25.8140670Z MSBUILD : error MSB4166: 2/19/2024 9:13:25 PM
2024-02-19T21:13:25.8241810Z MSBUILD : error MSB4166: System.IO.IOException: No buffer space available
2024-02-19T21:13:25.8260730Z MSBUILD : error MSB4166:  ---> System.Net.Sockets.SocketException (55): No buffer space available
2024-02-19T21:13:25.8363710Z MSBUILD : error MSB4166:    at System.IO.Pipes.PipeStream.WriteCore(ReadOnlySpan`1 buffer)
2024-02-19T21:13:25.8364490Z MSBUILD : error MSB4166:    --- End of inner exception stack trace ---
2024-02-19T21:13:25.8465500Z MSBUILD : error MSB4166:    at System.IO.Pipes.PipeStream.WriteCore(ReadOnlySpan`1 buffer)
2024-02-19T21:13:25.8569320Z MSBUILD : error MSB4166:    at System.IO.Pipes.PipeStream.Write(Byte[] buffer, Int32 offset, Int32 count)
2024-02-19T21:13:25.8670730Z MSBUILD : error MSB4166:    at Microsoft.Build.BackEnd.NodeEndpointOutOfProcBase.RunReadLoop(Stream localReadPipe, Stream localWritePipe, ConcurrentQueue`1 localPacketQueue, AutoResetEvent localPacketAvailable, AutoResetEvent localTerminatePacketPump)
2024-02-19T21:13:25.8773480Z MSBUILD : error MSB4166: ===================

@rainersigwald does this ring any bell?

dotnet / runtime