"We stopped hearing from agent Azure Pipelines 32. Verify the agent machine is running and has a healthy network connection"

jeffschwMSFT commented 3 months ago

Build

https://dev.azure.com/dnceng/internal/_build/results?buildId=2361240

Error:

##[error]We stopped hearing from agent Azure Pipelines 32. Verify the agent machine is running and has a healthy network connection. Anything that terminates an agent process, starves it for CPU, or blocks its network access can cause this error. For more information, see: https://go.microsoft.com/fwlink/?linkid=846610

Build leg reported

No response

Pull Request

No response

Known issue core information

Fill out the known issue JSON section by following the step by step documentation on how to create a known issue

 {
    "ErrorMessage" : "",
    "BuildRetry": false,
    "ErrorPattern": "We stopped hearing from agent Azure Pipelines .*. Verify the agent machine is running and has a healthy network connection. Anything that terminates an agent process, starves it for CPU, or blocks its network access can cause this error.",
    "ExcludeConsoleLog": false
 }

@dotnet/dnceng

Release Note Category

[ ] Feature changes/additions
[ ] Bug fixes
[ ] Internal Infrastructure Improvements
Release Note Description

Additional information about the issue reported

No response

Known issue validation

Build: :mag_right: https://dev.azure.com/dnceng/internal/_build/results?buildId=2361240 Error message validated: [We stopped hearing from agent Azure Pipelines .*. Verify the agent machine is running and has a healthy network connection. Anything that terminates an agent process, starves it for CPU, or blocks its network access can cause this error.] Result validation: :white_check_mark: Known issue matched with the provided build. Validation performed at: 2/7/2024 1:03:13 AM UTC

Report

Build	Definition	Step Name	Console log
680066	dotnet/sdk	iOSSimulator_Shortstack_arm64	dotnet/sdk#40988
2454010	dotnet-runtime	iossimulator-x64 release NativeAOT
2453853	dotnet-runtime	Libraries SuperPMI collection libraries_tests Checked coreclr osx arm64 Release
2452705	dotnet-runtime	iossimulator-arm64 release NativeAOT
2452680	dotnet-performance	osx 13 x64 maui_scenarios_ios iPhoneMini12 release/7.0
677500	dotnet/sdk	Darwin Build_Release	dotnet/sdk#40887
673710	dotnet/aspnetcore	Tests: macOS	dotnet/aspnetcore#55691
673708	dotnet/aspnetcore	Build: macOS x64	dotnet/aspnetcore#55691
2449760	dotnet-runtime	Libraries SuperPMI collection libraries_tests_no_tiered_compilation Checked coreclr osx arm64 Release
2443746	dotnet-performance	osx 13 x64 maui_scenarios_ios coreclr iPhoneMini12 8.0_Link
2440639	dotnet-runtime	Libraries SuperPMI collection libraries_tests_no_tiered_compilation Checked coreclr osx arm64 Release
657044	dotnet/runtime	osx-arm64 Release NativeAOT_Libraries	dotnet/runtime#101288
657017	dotnet/runtime	osx-arm64 Release CoreCLR_Release
656016	dotnet/runtime	CoreCLR Product Build OSX arm64 release
2438483	dotnet-dotnet	OSX_Mono_arm64
655885	dotnet/runtime	tvossimulator-x64 Debug AllSubsets_Mono	dotnet/runtime#101378
655888	dotnet/sdk	Darwin Build_Release	dotnet/sdk#40336
655832	dotnet/runtime	tvos-arm64 Release AllSubsets_NativeAOT	dotnet/runtime#101330
655807	dotnet/runtime	osx-x64 Release AllSubsets_Mono_Interpreter_RuntimeTests monointerpreter	dotnet/runtime#101492
2438420	dotnet-dotnet	OSX_Mono_arm64
2438365	dotnet-dotnet	OSX_Mono_arm64
2438046	dotnet-dotnet	OSX_x64
655024	dotnet/runtime	maccatalyst-x64 Release AllSubsets_Mono	dotnet/runtime#101509
654972	dotnet/runtime	osx-arm64 release Runtime_Debug	dotnet/runtime#101220
2437839	dotnet-dotnet	OSX_arm64
2437832	dotnet-dotnet	OSX_ShortStack_Mono_LLVMJIT_x64
2437732	dotnet-dotnet	OSX_arm64
2437716	dotnet-dotnet	OSX_arm64
2437664	dotnet-dotnet-monitor	CodeQL MacOS arm64 Release
2437636	dotnet-dotnet	OSX_x64
2437592	dotnet-dotnet	OSX_Mono_arm64
2437451	dotnet-dotnet	OSX_Mono_arm64
2437121	dotnet-dotnet	OSX_ShortStack_Mono_LLVMJIT_x64
2437001	dotnet-dotnet	OSX_Mono_arm64
2436988	dotnet-dotnet	OSX_Mono_x64
2436901	dotnet-dotnet	OSX_ShortStack_Mono_LLVMJIT_x64
2436757	dotnet-dotnet	OSX_Mono_x64
2436737	dotnet-dotnet	OSX_x64
2436523	dotnet-dotnet	OSX_Mono_x64
653048	dotnet/runtime	osx-arm64 Debug AllSubsets_CoreCLR	dotnet/runtime#100951
653029	dotnet/runtime	osx-x64 Debug Libraries_CheckedCoreCLR	dotnet/runtime#101299
653012	dotnet/runtime	osx-arm64 release Runtime_Debug	dotnet/runtime#100743
653011	dotnet/runtime	osx-x64 Debug Libraries_CheckedCoreCLR	dotnet/runtime#100743
652294	dotnet/runtime	ios-arm64 release MonoAOTOffsets	dotnet/runtime#101391
652289	dotnet/runtime	osx-arm64 release Runtime_Debug	dotnet/runtime#100697
2435940	dotnet-dotnet	OSX_arm64
2435820	dotnet-node	macOS x64	Log
2435773	dotnet-dotnet	OSX_Mono_x64
651764	dotnet/runtime	osx-arm64 release Runtime_Debug	dotnet/runtime#101288
2435469	dotnet-dotnet	OSX_arm64
2435350	dotnet-runtime	Libraries SuperPMI collection libraries_tests_no_tiered_compilation Checked coreclr osx arm64 Release
2435330	dotnet-dotnet	OSX_Mono_x64
2434850	dotnet-dotnet	OSX_x64
2434678	dotnet-dotnet	OSX_ShortStack_Mono_LLVMJIT_x64

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
0	9	54

lewing commented 3 months ago

https://github.com/dotnet/dnceng/issues/1919 is a similar looking mac host infra failure

lewing commented 3 months ago

as is https://github.com/dotnet/dnceng/issues/1883

dotnet / dnceng