dotnet / sdk

Core functionality needed to create .NET Core projects, that is shared between Visual Studio and CLI
https://dot.net/core
MIT License
2.73k stars 1.07k forks source link

Failure on Helix tests - Tests timing out #40074

Open MiYanni opened 7 months ago

MiYanni commented 7 months ago

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=635799 Build error leg or test failing: Microsoft.DotNet.MSBuildSdkResolver.Tests.dll.3.WorkItemExecution Pull request: https://github.com/dotnet/sdk/pull/40059

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "END OF WORK ITEM LOG: Command timed out, and was killed",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: :mag_right: https://dev.azure.com/dnceng-public/public/_build/results?buildId=635799 Error message validated: [END OF WORK ITEM LOG: Command timed out, and was killed] Result validation: :white_check_mark: Known issue matched with the provided build. Validation performed at: 4/9/2024 5:21:23 PM UTC

Report

Build Definition Test Pull Request
871083 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#44802
871054 dotnet/sdk Microsoft.NET.Build.Tests.dll.24.WorkItemExecution dotnet/sdk#44765
871038 dotnet/sdk dotnet-watch.Tests.dll.3.WorkItemExecution dotnet/sdk#44834
871017 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution dotnet/sdk#44849
871013 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution dotnet/sdk#44815
871002 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution dotnet/sdk#44808
871010 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution dotnet/sdk#44813
870971 dotnet/sdk Microsoft.NET.Build.Tests.dll.24.WorkItemExecution dotnet/sdk#44810
870893 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution dotnet/sdk#44890
870741 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution dotnet/sdk#44816
870714 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#44802
870716 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution dotnet/sdk#44803
869655 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution dotnet/sdk#44864
870458 dotnet/sdk dotnet-watch.Tests.dll.5.WorkItemExecution dotnet/sdk#44691
870523 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#44882
870258 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.2.WorkItemExecution dotnet/sdk#44807
869940 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution dotnet/sdk#44876
869884 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution dotnet/sdk#44871
869653 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution dotnet/sdk#44866
869600 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#44540
869570 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution dotnet/sdk#44861
869535 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#44810
869469 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution dotnet/sdk#44804
869461 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution dotnet/sdk#44757
869404 dotnet/sdk dotnet.Tests.dll.6.WorkItemExecution dotnet/sdk#44786
869397 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution dotnet/sdk#44855
869322 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution dotnet/sdk#44834
869324 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution dotnet/sdk#44804
869306 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution dotnet/sdk#44803
869305 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution dotnet/sdk#44802
869059 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution dotnet/sdk#44850
869041 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution dotnet/sdk#44804
868896 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution dotnet/sdk#44757
868784 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution dotnet/sdk#44816
868773 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution dotnet/sdk#44815
868628 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#44810
868411 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution dotnet/sdk#44803
867682 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution dotnet/sdk#44809
867645 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution dotnet/sdk#44814
867642 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution dotnet/sdk#44813
867632 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution dotnet/sdk#44812
867649 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution dotnet/sdk#44815
868410 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution dotnet/sdk#44802
868415 dotnet/sdk Microsoft.NET.Build.Tests.dll.23.WorkItemExecution dotnet/sdk#44805
868202 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution dotnet/sdk#44828
868087 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution dotnet/sdk#44802
868044 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution dotnet/sdk#44824
867981 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution dotnet/sdk#44820
867734 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution dotnet/sdk#44805
867685 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution dotnet/sdk#44816
867420 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#44764
867301 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution dotnet/sdk#44807
867379 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#44802
867326 dotnet/sdk Microsoft.NET.Build.Tests.dll.23.WorkItemExecution dotnet/sdk#44810
867321 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution dotnet/sdk#44803
867320 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution dotnet/sdk#44802
867221 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution dotnet/sdk#44805
866658 dotnet/sdk Microsoft.NET.Build.Tests.dll.23.WorkItemExecution dotnet/sdk#44795
867202 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution dotnet/sdk#44570
867060 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#44802
866618 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution dotnet/sdk#44791
866933 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution dotnet/sdk#44699
866598 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution dotnet/sdk#44785
866566 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution dotnet/sdk#44790
866495 dotnet/sdk Microsoft.NET.Build.Tests.dll.23.WorkItemExecution dotnet/sdk#44786
866309 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.5.WorkItemExecution dotnet/sdk#44785
866190 dotnet/sdk Microsoft.NET.Build.Tests.dll.24.WorkItemExecution dotnet/sdk#44764
866133 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#44540
866136 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution dotnet/sdk#44779
866111 dotnet/sdk dotnet-watch.Tests.dll.3.WorkItemExecution dotnet/sdk#44761
866086 dotnet/sdk Microsoft.NET.Build.Tests.dll.23.WorkItemExecution dotnet/sdk#44699
866026 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution dotnet/sdk#44751
865871 dotnet/sdk dotnet-watch.Tests.dll.5.WorkItemExecution dotnet/sdk#44691
865857 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution dotnet/sdk#44699
865846 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#44774
865854 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution dotnet/sdk#44761
865756 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#44603
865634 dotnet/sdk Microsoft.DotNet.MSBuildSdkResolver.Tests.dll.netfx.WorkItemExecution dotnet/sdk#44751
865474 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution dotnet/sdk#44768
865370 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution dotnet/sdk#44695
865316 dotnet/sdk dotnet-watch.Tests.dll.3.WorkItemExecution dotnet/sdk#44570
865273 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution dotnet/sdk#44710
865258 dotnet/sdk Microsoft.NET.Build.Tests.dll.23.WorkItemExecution dotnet/sdk#44767
865246 dotnet/sdk dotnet-watch.Tests.dll.3.WorkItemExecution dotnet/sdk#44766
865147 dotnet/sdk dotnet-watch.Tests.dll.4.WorkItemExecution dotnet/sdk#44603
865079 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution dotnet/sdk#44763
865022 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution dotnet/sdk#44762
864884 dotnet/sdk dotnet-watch.Tests.dll.4.WorkItemExecution dotnet/sdk#44691
864943 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution dotnet/sdk#44603
864866 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution dotnet/sdk#44759
864823 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution dotnet/sdk#44749
864717 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution dotnet/sdk#44755
864712 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution dotnet/sdk#44753
864568 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution dotnet/sdk#44745
864671 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution dotnet/sdk#44748
864619 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution dotnet/sdk#44744
864620 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution dotnet/sdk#44743
864611 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution dotnet/sdk#44746
864562 dotnet/sdk Microsoft.NET.Build.Tests.dll.24.WorkItemExecution dotnet/sdk#44744
864384 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.6.WorkItemExecution dotnet/sdk#44729

Displaying 100 of 284 results

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
15 86 284
nagilson commented 5 months ago

@tmat May you please look at this dotnet watch failure?

tmat commented 5 months ago

@nagilson I checked a few logs from above and it looks like the failures are in release/8.0.1xx branch. That wouldn't have various test infra fixes.

nagilson commented 5 months ago

Thank you for checking :) @tmat, which test infra fixes are you referring to? It may be worth porting them over to 8.0.1xx. Any disagreements @marcpopMSFT?

nagilson commented 5 months ago

We also just hit it in main, so there might be another existing problem: https://github.com/dotnet/sdk/pull/41045

baronfel commented 3 months ago

@tmat this is popping up again in the rc1 branches, when you get back can you take a look?

tmat commented 3 months ago

@baronfel I can take a look. Do you have a link to the failed run? The test log should be good enough to determine the issue on main/rc1 branches.

baronfel commented 3 months ago

The helix timeouts are most of the failed tests in this pipeline, but you can't access them right now due to helix auth issues.