search

dotnet / runtime

.NET is a cross-platform runtime for cloud, mobile, desktop, and IoT apps.
https://docs.microsoft.com/dotnet/core/
MIT License
15.42k stars 4.76k forks source link

[wasm][debugger] Debugger tests getting randomly aborted on CI #89409

Open radical opened 1 year ago

radical commented 1 year ago

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=351450 log:

...
The active test run was aborted. Reason: Test host process crashed
Results File: /root/helix/work/workitem/uploads/xharness-output/logs/testResults.trx

Passed!  - Failed:     0, Passed:    85, Skipped:     0, Total:    85, Duration: 9 m 18 s - DebuggerTestSuite.dll (net8.0)
Test Run Aborted.

Known Issue Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "Reason: Test host process crashed",
  "ErrorPattern": "",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Report

Build Definition Test Pull Request
873041 dotnet/runtime chrome-DebuggerTests.EvaluateOnCallFrame2Tests.WorkItemExecution dotnet/runtime#109232
872280 dotnet/runtime chrome-DebuggerTests.GetPropertiesTests.WorkItemExecution dotnet/runtime#109826
871770 dotnet/runtime chrome-DebuggerTests.GetPropertiesTests.WorkItemExecution
870136 dotnet/runtime chrome-DebuggerTests.BreakpointTests.WorkItemExecution dotnet/runtime#104637
869615 dotnet/runtime chrome-DebuggerTests.GetPropertiesTests.WorkItemExecution
868925 dotnet/runtime chrome-DebuggerTests.GetPropertiesTests.WorkItemExecution dotnet/runtime#104637
868540 dotnet/runtime chrome-DebuggerTests.MiscTests.WorkItemExecution dotnet/runtime#99596
868388 dotnet/runtime chrome-DebuggerTests.CallFunctionOnTests.WorkItemExecution dotnet/runtime#106557
866931 dotnet/runtime chrome-DebuggerTests.EvaluateOnCallFrameTests.WorkItemExecution
866215 dotnet/runtime chrome-DebuggerTests.GetPropertiesTests.WorkItemExecution
866081 dotnet/runtime chrome-DebuggerTests.BreakpointTests.WorkItemExecution
865123 dotnet/runtime chrome-DebuggerTests.MiscTests.WorkItemExecution
863764 dotnet/runtime chrome-DebuggerTests.SteppingTests.WorkItemExecution dotnet/runtime#109584
862338 dotnet/runtime chrome-DebuggerTests.BreakpointTests.WorkItemExecution
860682 dotnet/runtime chrome-DebuggerTests.GetPropertiesTests.WorkItemExecution dotnet/runtime#104637
859609 dotnet/runtime chrome-DebuggerTests.EvaluateOnCallFrameTests.WorkItemExecution dotnet/runtime#109495
859264 dotnet/runtime chrome-DebuggerTests.BreakpointTests.WorkItemExecution dotnet/runtime#108469
858983 dotnet/runtime chrome-DebuggerTests.MiscTests.WorkItemExecution dotnet/runtime#108469
858594 dotnet/runtime chrome-DebuggerTests.MiscTests.WorkItemExecution dotnet/runtime#109381
857377 dotnet/runtime chrome-DebuggerTests.GetPropertiesTests.WorkItemExecution dotnet/runtime#109079
856935 dotnet/runtime chrome-DebuggerTests.BreakpointTests.WorkItemExecution
856647 dotnet/runtime chrome-DebuggerTests.MiscTests.WorkItemExecution dotnet/runtime#109278

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
0 3 22

Known issue validation

Build: :mag_right: https://dev.azure.com/dnceng-public/public/_build/results?buildId=484656 Error message validated: Reason: Test host process crashed Result validation: :white_check_mark: Known issue matched with the provided build. Validation performed at: 11/30/2023 10:40:39 PM UTC

ghost commented 1 year ago

Tagging subscribers to 'arch-wasm': @lewing See info in area-owners.md if you want to be subscribed.

Issue Details
[log](https://helixre107v0xdcypoyl9e7f.blob.core.windows.net/dotnet-runtime-refs-pull-89395-merge-93f9180bd3f44ef8bb/chrome-DebuggerTests.EvaluateOnCallFrameTests/1/console.2085d9ea.log?helixlogtype=result): ``` ... Detected a container, disabling sandboxing for debugger tests. The active test run was aborted. Reason: Test host process crashed Results File: /root/helix/work/workitem/uploads/xharness-output/logs/testResults.trx Passed! - Failed: 0, Passed: 85, Skipped: 0, Total: 85, Duration: 9 m 18 s - DebuggerTestSuite.dll (net8.0) Test Run Aborted. ```
Author: radical
Assignees: radical
Labels: `arch-wasm`, `blocking-clean-ci`, `area-Debugger-mono`
Milestone: 8.0.0
lewing commented 1 year ago

I bet we are taking longer than 100ms to close https://github.com/microsoft/vstest/blob/main/src/Microsoft.TestPlatform.CrossPlatEngine/Client/ProxyOperationManager.cs#L325-L327

See the discussion at https://github.com/microsoft/vstest/issues/2952

radical commented 1 year ago

I haven't seen this issue since Jul 26. It would still be a good idea to change the timeout like @lewing suggested.

radical commented 1 year ago

This hasn't been hit on main again, but it is being seen on 7.0 .

SamMonoRT commented 1 year ago

hit again in https://github.com/dotnet/runtime/pull/91393

SamMonoRT commented 1 year ago

also in https://github.com/dotnet/runtime/pull/91664

pavelsavara commented 1 year ago

Hit again in #94299 log

pavelsavara commented 1 year ago

This hasn't been hit on main again, but it is being seen on 7.0 .

I see it on main Log

radical commented 1 year ago

Yeah, I have been seeing this on rolling builds pretty regularly :/

pavelsavara commented 1 year ago

See also https://github.com/dotnet/dnceng/issues/451