Error reported in diagnostic logs. Please examine the log for more details

[jeffschwMSFT]

Build

https://dev.azure.com/dnceng/internal/_build/results?buildId=2367532

Error:

System.Net.Http.HttpRequestException: No route to host (dev.azure.com:443)
 ---> System.Net.Sockets.SocketException (65): No route to host
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16 token)
   at System.Net.Sockets.Socket.<ConnectAsync>g__WaitForConnectWithCancellation|277_0(AwaitableSocketAsyncEventArgs saea, ValueTask connectTask, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at Microsoft.VisualStudio.Services.Common.VssHttpRetryMessageHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.SendAsync(HttpRequestMessage message, HttpCompletionOption completionOption, Object userState, CancellationToken cancellationToken)
   at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.SendAsync[T](HttpRequestMessage message, Object userState, CancellationToken cancellationToken)
   at Microsoft.VisualStudio.Services.Location.Client.LocationHttpClient.GetConnectionDataAsync(ConnectOptions connectOptions, Int64 lastChangeId, CancellationToken cancellationToken, Object userState)
   at Microsoft.VisualStudio.Services.WebApi.Location.VssServerDataProvider.GetConnectionDataAsync(ConnectOptions connectOptions, Int32 lastChangeId, CancellationToken cancellationToken)
   at Microsoft.VisualStudio.Services.WebApi.Location.VssServerDataProvider.ConnectAsync(ConnectOptions connectOptions, CancellationToken cancellationToken)
   at Microsoft.VisualStudio.Services.Agent.TaskServer.ConnectAsync(VssConnection jobConnection) in /Users/runner/work/1/s/src/Microsoft.VisualStudio.Services.Agent/TaskServer.cs:line 42
   at Microsoft.VisualStudio.Services.Agent.Worker.JobRunner.RunAsync(AgentJobRequestMessage message, CancellationToken jobRequestCancellationToken) in /Users/runner/work/1/s/src/Agent.Worker/JobRunner.cs:line 224
   at Microsoft.VisualStudio.Services.Agent.Worker.JobRunner.RunAsync(AgentJobRequestMessage message, CancellationToken jobRequestCancellationToken) in /Users/runner/work/1/s/src/Agent.Worker/JobRunner.cs:line 397
   at Microsoft.VisualStudio.Services.Agent.Worker.Worker.RunAsync(String pipeIn, String pipeOut) in /Users/runner/work/1/s/src/Agent.Worker/Worker.cs:line 97
   at Microsoft.VisualStudio.Services.Agent.Worker.Program.MainAsync(IHostContext context, String[] args) in /Users/runner/work/1/s/src/Agent.Worker/Program.cs:line 52

Error reported in diagnostic logs. Please examine the log for more details

Build leg reported

No response

Pull Request

No response

Known issue core information

Fill out the known issue JSON section by following the step by step documentation on how to create a known issue

 {
    "ErrorMessage" : "",
    "BuildRetry": false,
    "ErrorPattern": "Error reported in diagnostic logs. Please examine the log for more details",
    "ExcludeConsoleLog": false
 }

@dotnet/dnceng

Release Note Category

• [ ] Feature changes/additions
• [ ] Bug fixes
• [ ] Internal Infrastructure Improvements

  Release Note Description

Additional information about the issue reported

No response

Known issue validation

Build: :mag_right: https://dev.azure.com/dnceng/internal/_build/results?buildId=2367532 Error message validated: Error reported in diagnostic logs. Please examine the log for more details Result validation: :white_check_mark: Known issue matched with the provided build. Validation performed at: 2/1/2024 3:50:06 PM UTC

Report

Build	Definition	Step Name	Console log	Pull Request
884899	dotnet/runtime	browser-wasm linux Release LibraryTests	dotnet/runtime#110083
884037	dotnet/runtime	browser-wasm linux Release LibraryTests	dotnet/runtime#110229
883455	dotnet/runtime	browser-wasm linux Release LibraryTests	dotnet/runtime#109087
882454	dotnet/runtime	browser-wasm linux Release LibraryTests	dotnet/runtime#109928
882012	dotnet/runtime	browser-wasm linux Release LibraryTests	dotnet/runtime#110254
879353	dotnet/runtime	browser-wasm linux Release LibraryTests
878074	dotnet/runtime	browser-wasm linux Release LibraryTests	dotnet/runtime#109996
877751	dotnet/runtime	browser-wasm linux Release LibraryTests	dotnet/runtime#109806
877737	dotnet/runtime	browser-wasm linux Release LibraryTests_Threading	dotnet/runtime#110114
876414	dotnet/runtime	browser-wasm linux Release LibraryTests_Threading
873781	dotnet/runtime	browser-wasm linux Release LibraryTests
873041	dotnet/runtime	browser-wasm linux Release LibraryTests	dotnet/runtime#109232
872671	dotnet/runtime	browser-wasm linux Release LibraryTests	dotnet/runtime#109137
872620	dotnet/runtime	browser-wasm linux Release LibraryTests_Threading	dotnet/runtime#109901
871544	dotnet/runtime	browser-wasm linux Release LibraryTests
869504	dotnet/runtime	browser-wasm linux Release LibraryTests	dotnet/runtime#109806
869513	dotnet/runtime	browser-wasm linux Release LibraryTests	dotnet/runtime#109808
867430	dotnet/runtime	browser-wasm linux Release LibraryTests	dotnet/runtime#109610
866509	dotnet/runtime	browser-wasm linux Release LibraryTests	dotnet/runtime#109540
864584	dotnet/runtime	browser-wasm linux Release LibraryTests	dotnet/runtime#108559
863727	dotnet/runtime	browser-wasm linux Release LibraryTests	dotnet/runtime#109526

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
1	5	21

[lewing]

Looks like mostly macs? not sure where Build Source Index runs

[epananth]

Looked at the latest builds all are failing cos out of space on the device

[epananth]

`##[error]Error reported in diagnostic logs. Please examine the log for more details.

• /Users/runner/runners/3.242.1/_diag/Worker_20240806-221514-utc.log System.IO.IOException: No space left on device : '/Users/runner/runners/3.242.1/_diag/Worker_20240806-221514-utc.log' at System.IO.RandomAccess.WriteAtOffset(SafeFileHandle handle, ReadOnlySpan1 buffer, Int64 fileOffset) at System.IO.Strategies.BufferedFileStreamStrategy.FlushWrite() at System.IO.StreamWriter.Flush(Boolean flushStream, Boolean flushEncoder) at System.Diagnostics.TextWriterTraceListener.Flush() at Microsoft.VisualStudio.Services.Agent.HostTraceListener.WriteHeader(String source, TraceEventType eventType, Int32 id) in /Users/runner/work/1/s/src/Microsoft.VisualStudio.Services.Agent/HostTraceListener.cs:line 151 at Microsoft.VisualStudio.Services.Agent.HostTraceListener.TraceEvent(TraceEventCache eventCache, String source, TraceEventType eventType, Int32 id, String message) in /Users/runner/work/1/s/src/Microsoft.VisualStudio.Services.Agent/HostTraceListener.cs:line 81 at System.Diagnostics.TraceSource.TraceEvent(TraceEventType eventType, Int32 id, String message) at Microsoft.VisualStudio.Services.Agent.Worker.Worker.RunAsync(String pipeIn, String pipeOut) in /Users/runner/work/1/s/src/Agent.Worker/Worker.cs:line 93 at Microsoft.VisualStudio.Services.Agent.Worker.Program.MainAsync(IHostContext context, String[] args) in /Users/runner/work/1/s/src/Agent.Worker/Program.cs:line 52

[epananth]

I am going to go ahead an add a check for disk utilization, to know more why this is failing.

[epananth]

Is it possible to add this check to your pipeline to get more data (like aspnet-core team did)

https://github.com/dotnet/aspnetcore/blob/42af9fe6ddd7c3f9cde04ac003bf97509881873b/.azure/pipelines/jobs/default-build.yml#L163-L165