Open carlossanlop opened 4 months ago
Tagging subscribers to 'arch-wasm': @lewing See info in area-owners.md if you want to be subscribed.
cc @ilonatommy
I think this is just slow helix machine. It usually recovers from it eventually.
Should we set BuildRetry to true?
Should we set BuildRetry to true?
Good idea. I wonder if we could somehow detect re-run like that and eventually enable more logging. Does CI set some env variable ?
That's a great question for which I don't have an answer. @AlitzelMendez is it possible to detect that a CI run was triggered a second time due to BuildRetry
being set to true
?
This is kind of "catch all" filter and it was hiding https://github.com/dotnet/runtime/issues/108175 and maybe more.
Build Information
Build: https://dev.azure.com/dnceng-public/public/_build/results?buildId=728515 Build error leg or test failing:
browser-wasm linux Release WasmBuildTests
Error Message
browser-wasm linux Release WasmBuildTests
Output (expand)
``` [wasm test-browser] [9.0.0-prerelease.24317.3+65d0584b517952962b7a79195b5d7606b52fcbfe] XHarness command issued: wasm test-browser --app=. --output-directory=/root/helix/work/workitem/uploads/xharness-output/logs/j0lhm4ui_bff/Chrome --expected-exit-code=42 -v trace -b Chrome --locale=en-US --web-server-use-cop --browser-path=/root/helix/work/correlation/chrome-linux/chrome --browser-arg=--no-sandbox -- --setenv=XHARNESS_DISABLE_COLORED_OUTPUT=true --setenv=DOTNET_ROOT=/root/helix/work/workitem/e/dotnet-latest --setenv=DOTNET_INSTALL_DIR=/root/helix/work/workitem/e/dotnet-latest --setenv=DOTNET_MULTILEVEL_LOOKUP=0 --setenv=DOTNET_SKIP_FIRST_TIME_EXPERIENCE=1 --setenv=EM_WORKAROUND_PYTHON_BUG_34780=1 --setenv=WasmEnableWebCil=false --run build_publish_Release_鿀蜒枛遫䡫煉.dll [wasm test-browser] [01:21:37] info: Using Chrome from /root/helix/work/correlation/chrome-linux/chrome [wasm test-browser] [01:21:37] info: Starting chromedriver with args: --no-sandbox --headless --incognito --disable-background-timer-throttling --disable-backgrounding-occluded-windows --disable-renderer-backgrounding --enable-features=NetworkService,NetworkServiceInProcess --allow-insecure-localhost --disable-breakpad --disable-component-extensions-with-background-pages --disable-dev-shm-usage --disable-extensions --disable-features=TranslateUI --disable-ipc-flooding-protection --force-color-profile=srgb --metrics-recording-only --no-sandbox [wasm test-browser] Connection refused [::ffff:127.0.0.1]:40349 (localhost:40349) [wasm test-browser] Connection refused [::ffff:127.0.0.1]:40349 (localhost:40349) [wasm test-browser] Connection refused [::ffff:127.0.0.1]:40349 (localhost:40349) [wasm test-browser] Connection refused [::ffff:127.0.0.1]:40349 (localhost:40349) [wasm test-browser] Connection refused [::ffff:127.0.0.1]:40349 (localhost:40349) [wasm test-browser] Connection refused [::ffff:127.0.0.1]:40349 (localhost:40349) ... ... ... ... [wasm test-browser] Connection refused [::ffff:127.0.0.1]:40349 (localhost:40349) [wasm test-browser] ChromeDriver was started successfully. [wasm test-browser] Connection refused [::ffff:127.0.0.1]:40349 (localhost:40349) [wasm test-browser] [01:21:53] dbug: Opening in browser: http://127.0.0.1:41599/index.html?arg=--setenv%3dXHARNESS_DISABLE_COLORED_OUTPUT%3dtrue&arg=--setenv%3dDOTNET_ROOT%3d%2froot%2fhelix%2fwork%2fworkitem%2fe%2fdotnet-latest&arg=--setenv%3dDOTNET_INSTALL_DIR%3d%2froot%2fhelix%2fwork%2fworkitem%2fe%2fdotnet-latest&arg=--setenv%3dDOTNET_MULTILEVEL_LOOKUP%3d0&arg=--setenv%3dDOTNET_SKIP_FIRST_TIME_EXPERIENCE%3d1&arg=--setenv%3dEM_WORKAROUND_PYTHON_BUG_34780%3d1&arg=--setenv%3dWasmEnableWebCil%3dfalse&arg=--run&arg=build_publish_Release_%e9%bf%80%e8%9c%92%e6%9e%9b%e9%81%ab%e4%a1%ab%e7%85%89.dll&arg=-verbosity&arg=Debug [wasm test-browser] [01:21:53] fail: [out of order message from the browser]: http://127.0.0.1:41599/runArgs.json - Failed to load resource: the server responded with a status of 404 (Not Found) [wasm test-browser] [01:21:53] info: Running in: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) HeadlessChrome/126.0.6478.0 Safari/537.36 [wasm test-browser] [01:21:53] info: Running at: http://127.0.0.1:41599/index.html?arg=--setenv%3dXHARNESS_DISABLE_COLORED_OUTPUT%3dtrue&arg=--setenv%3dDOTNET_ROOT%3d%2froot%2fhelix%2fwork%2fworkitem%2fe%2fdotnet-latest&arg=--setenv%3dDOTNET_INSTALL_DIR%3d%2froot%2fhelix%2fwork%2fworkitem%2fe%2fdotnet-latest&arg=--setenv%3dDOTNET_MULTILEVEL_LOOKUP%3d0&arg=--setenv%3dDOTNET_SKIP_FIRST_TIME_EXPERIENCE%3d1&arg=--setenv%3dEM_WORKAROUND_PYTHON_BUG_34780%3d1&arg=--setenv%3dWasmEnableWebCil%3dfalse&arg=--run&arg=build_publish_Release_%e9%bf%80%e8%9c%92%e6%9e%9b%e9%81%ab%e4%a1%ab%e7%85%89.dll&arg=-verbosity&arg=Debug [wasm test-browser] [01:21:53] info: could not load /runArgs.json: 404. Ignoring [wasm test-browser] [01:21:53] info: Incoming arguments: --setenv=XHARNESS_DISABLE_COLORED_OUTPUT=true --setenv=DOTNET_ROOT=/root/helix/work/workitem/e/dotnet-latest --setenv=DOTNET_INSTALL_DIR=/root/helix/work/workitem/e/dotnet-latest --setenv=DOTNET_MULTILEVEL_LOOKUP=0 --setenv=DOTNET_SKIP_FIRST_TIME_EXPERIENCE=1 --setenv=EM_WORKAROUND_PYTHON_BUG_34780=1 --setenv=WasmEnableWebCil=false --run build_publish_Release_鿀蜒枛遫䡫煉.dll -verbosity Debug [wasm test-browser] [01:21:53] info: Application arguments: --run build_publish_Release_鿀蜒枛遫䡫煉.dll -verbosity Debug [wasm test-browser] [01:21:55] info: Initializing dotnet version 9.0.0-ci commit hash 80f20f07bd83fd39b42dccb42ffafcc668f01579 [wasm test-browser] [01:21:55] info: test-main.js exiting build_publish_Release_鿀蜒枛遫䡫煉.dll -verbosity with result 42 Wasm.Build.Tests: [Long Running Test] 'Wasm.Build.Tests.BuildPublishTests.BuildThenPublishWithAOT', Elapsed: 00:03:59 Wasm.Build.Tests: [Long Running Test] 'Wasm.Build.Tests.BuildPublishTests.BuildThenPublishWithAOT', Elapsed: 00:05:59 Wasm.Build.Tests: [Long Running Test] 'Wasm.Build.Tests.BuildPublishTests.BuildThenPublishWithAOT', Elapsed: 00:07:59 Wasm.Build.Tests: [Long Running Test] 'Wasm.Build.Tests.BuildPublishTests.BuildThenPublishWithAOT', Elapsed: 00:09:59 Wasm.Build.Tests: [Long Running Test] 'Wasm.Build.Tests.BuildPublishTests.BuildThenPublishWithAOT', Elapsed: 00:11:59 Wasm.Build.Tests: [Long Running Test] 'Wasm.Build.Tests.BuildPublishTests.BuildThenPublishWithAOT', Elapsed: 00:13:59 -- exception -- System.Threading.Tasks.TaskCanceledException: A task was canceled. at System.Diagnostics.Process.WaitForExitAsync(CancellationToken cancellationToken) at Wasm.Build.Tests.BuildTestBase.RunProcessAsync(String path, ITestOutputHelper _testOutput, String args, IDictionary`2 envVars, String workingDir, String label, Nullable`1 timeoutMs) in /_/src/mono/wasm/Wasm.Build.Tests/BuildTestBase.cs:line 505 Wasm.Build.Tests.BuildPublishTests.BuildThenPublishWithAOT(buildArgs: BuildArgs { ProjectName = placeholder, Config = Release, AOT = True, ProjectFileContents = placeholder, ExtraBuildArgs = }, host: Chrome, id: "j0lhm4ui_bff") [FAIL] System.AggregateException : One or more errors occurred. (A task was canceled.) ---- System.Threading.Tasks.TaskCanceledException : A task was canceled. Stack Trace: at System.Threading.Tasks.Task.ThrowIfExceptional(Boolean includeTaskCanceledExceptions) at System.Threading.Tasks.Task.Wait(Int32 millisecondsTimeout, CancellationToken cancellationToken) at System.Threading.Tasks.Task.Wait() /_/src/mono/wasm/Wasm.Build.Tests/BuildTestBase.cs(433,0): at Wasm.Build.Tests.BuildTestBase.RunProcess(String path, ITestOutputHelper _testOutput, String args, IDictionary`2 envVars, String workingDir, String label, Nullable`1 timeoutMs) /_/src/mono/wasm/Wasm.Build.Tests/BuildTestBase.cs(298,0): at Wasm.Build.Tests.BuildTestBase.RunWithXHarness(String testCommand, String testLogPath, String projectName, String bundleDir, ITestOutputHelper _testOutput, IDictionary`2 envVars, Int32 expectedAppExitCode, Int32 xharnessExitCode, String extraXHarnessArgs, String appArgs, String extraXHarnessMonoArgs, Boolean useWasmConsoleOutput) /_/src/mono/wasm/Wasm.Build.Tests/BuildTestBase.cs(219,0): at Wasm.Build.Tests.BuildTestBase.RunAndTestWasmApp(BuildArgs buildArgs, RunHost host, String id, Action`1 test, String buildDir, String bundleDir, Int32 expectedExitCode, String args, Dictionary`2 envVars, String targetFramework, String extraXHarnessMonoArgs, String extraXHarnessArgs, String jsRelativePath, String environmentLocale) /_/src/mono/wasm/Wasm.Build.Tests/BuildPublishTests.cs(151,0): at Wasm.Build.Tests.BuildPublishTests.<>c__DisplayClass2_0.Known issue validation
Build: :mag_right: https://dev.azure.com/dnceng-public/public/_build/results?buildId=728515 Error message validated:
[[wasm test-browser] Connection refused
] Result validation: :x: Known issue did not match with the provided build. Validation performed at: 7/3/2024 6:20:59 AM UTCReport
Summary