dotnet / runtime

.NET is a cross-platform runtime for cloud, mobile, desktop, and IoT apps.
https://docs.microsoft.com/dotnet/core/
MIT License
14.25k stars 4.45k forks source link

BinderTracingTest.ResolutionFlow.cmd Timed Out #97735

Open lewing opened 3 months ago

lewing commented 3 months ago

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=545844 Build error leg or test failing: Loader/binding/tracing/BinderTracingTest.ResolutionFlow/BinderTracingTest.ResolutionFlow.cmd Pull request: https://github.com/dotnet/runtime.git/pull/97694

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "binding/tracing/BinderTracingTest.ResolutionFlow/BinderTracingTest.ResolutionFlow.cmd Timed Out",
  "ErrorPattern": "",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: :mag_right: https://dev.azure.com/dnceng-public/public/_build/results?buildId=545844 Error message validated: binding/tracing/BinderTracingTest.ResolutionFlow/BinderTracingTest.ResolutionFlow.cmd Timed Out Result validation: :white_check_mark: Known issue matched with the provided build. Validation performed at: 1/30/2024 11:44:14 PM UTC

Report

Build Definition Test Pull Request
668696 dotnet/runtime Loader/binding/tracing/BinderTracingTest.ResolutionFlow/BinderTracingTest.ResolutionFlow.cmd dotnet/runtime#102000
667190 dotnet/runtime Loader/binding/tracing/BinderTracingTest.ResolutionFlow/BinderTracingTest.ResolutionFlow.cmd dotnet/runtime#95565
658583 dotnet/runtime Loader/binding/tracing/BinderTracingTest.ResolutionFlow/BinderTracingTest.ResolutionFlow.cmd dotnet/runtime#101647
649561 dotnet/runtime Loader/binding/tracing/BinderTracingTest.ResolutionFlow/BinderTracingTest.ResolutionFlow.cmd dotnet/runtime#101189

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
0 0 4
ghost commented 3 months ago

Tagging subscribers to this area: @dotnet/area-infrastructure-libraries See info in area-owners.md if you want to be subscribed.

Issue Details
## Build Information Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=545844 Build error leg or test failing: Loader/binding/tracing/BinderTracingTest.ResolutionFlow/BinderTracingTest.ResolutionFlow.cmd Pull request: https://github.com/dotnet/runtime.git/pull/97694 ## Error Message Fill the error message using [step by step known issues guidance](https://github.com/dotnet/arcade/blob/main/Documentation/Projects/Build%20Analysis/KnownIssues.md#how-to-fill-out-a-known-issue-error-section). ```json { "ErrorMessage": "binding/tracing/BinderTracingTest.ResolutionFlow/BinderTracingTest.ResolutionFlow.cmd Timed Out", "ErrorPattern": "", "BuildRetry": false, "ExcludeConsoleLog": false } ```
Author: lewing
Assignees: -
Labels: `area-Infrastructure-libraries`, `blocking-clean-ci`, `Known Build Error`
Milestone: -
jeffschwMSFT commented 1 month ago

removing blocking-clean-ci since it has not failed in 30 days

24-Hour Hit Count 7-Day Hit Count 1-Month Count
0 0 0
v-wenyuxu commented 1 month ago

Failed in: runtime-coreclr r2r-extra 20240414.1

Failed tests:

R2R-CG2 windows x86 Checked jitstress2 @ Windows.10.Amd64.Open
    - Loader/binding/tracing/BinderTracingTest.ResolutionFlow/BinderTracingTest.ResolutionFlow.cmd

Error message:

cmdLine:C:hwB29F09D3wA8C608E4eLoaderLoader../binding/tracing/BinderTracingTest.ResolutionFlow/BinderTracingTest.ResolutionFlow.cmd Timed Out (timeout in milliseconds: 5400000 from variable __TestTimeout, start: 4/15/2024 4:39:14 AM, end: 4/15/2024 6:09:14 AM)

Return code:      -100
Raw output file:      C:hwB29F09D3wA8C608E4uploadsinding   racingBinderTracingTest.ResolutionFlowoutput.txt
Raw output:
BEGIN EXECUTION
AssemblyToLoad.dll
BinderTracingTest.ResolutionFlow.dll
TestLibrary.dll
        3 file(s) copied.
 4:39:15.03
Response file: C:hwB29F09D3wA8C608E4eLoaderinding  racingBinderTracingTest.ResolutionFlowAssemblyToLoad.dll.rsp
C:hwB29F09D3wA8C608E4eLoaderinding racingBinderTracingTest.ResolutionFlowIL-CG2AssemblyToLoad.dll
-o:C:hwB29F09D3wA8C608E4eLoaderinding  racingBinderTracingTest.ResolutionFlowAssemblyToLoad.dll
--targetarch:x86
--targetos:windows
--verify-type-and-field-layout
--method-layout:random
-r:C:hwB29F09D3pSystem.*.dll
-r:C:hwB29F09D3pMicrosoft.*.dll
-r:C:hwB29F09D3p\xunit.*.dll
-r:C:hwB29F09D3pmscorlib.dll
-r:C:hwB29F09D3p
etstandard.dll
" "dotnet" "C:hwB29F09D3pcrossgen2crossgen2.dll" @"C:hwB29F09D3wA8C608E4eLoaderinding  racingBinderTracingTest.ResolutionFlowAssemblyToLoad.dll.rsp"   -r:C:hwB29F09D3wA8C608E4eLoaderLoaderIL-CG2*.dll  -r:C:hwB29F09D3wA8C608E4eLoaderinding    racingBinderTracingTest.ResolutionFlowIL-CG2*.dll"
Emitting R2R PE file: C:hwB29F09D3wA8C608E4eLoaderinding   racingBinderTracingTest.ResolutionFlowAssemblyToLoad.dll
" "dotnet" "C:hwB29F09D3p
2rdump
2rdump.dll" --header --sc --in C:hwB29F09D3wA8C608E4eLoaderinding  racingBinderTracingTest.ResolutionFlowAssemblyToLoad.dll --out C:hwB29F09D3wA8C608E4eLoaderinding  racingBinderTracingTest.ResolutionFlowAssemblyToLoad.dll.r2rdump --val"
 4:39:16.82
 4:39:16.83
Response file: C:hwB29F09D3wA8C608E4eLoaderinding  racingBinderTracingTest.ResolutionFlowBinderTracingTest.ResolutionFlow.dll.rsp
C:hwB29F09D3wA8C608E4eLoaderinding racingBinderTracingTest.ResolutionFlowIL-CG2BinderTracingTest.ResolutionFlow.dll
-o:C:hwB29F09D3wA8C608E4eLoaderinding  racingBinderTracingTest.ResolutionFlowBinderTracingTest.ResolutionFlow.dll
--targetarch:x86
--targetos:windows
--verify-type-and-field-layout
--method-layout:random
-r:C:hwB29F09D3pSystem.*.dll
-r:C:hwB29F09D3pMicrosoft.*.dll
-r:C:hwB29F09D3p\xunit.*.dll
-r:C:hwB29F09D3pmscorlib.dll
-r:C:hwB29F09D3p
etstandard.dll
" "dotnet" "C:hwB29F09D3pcrossgen2crossgen2.dll" @"C:hwB29F09D3wA8C608E4eLoaderinding  racingBinderTracingTest.ResolutionFlowBinderTracingTest.ResolutionFlow.dll.rsp"   -r:C:hwB29F09D3wA8C608E4eLoaderLoaderIL-CG2*.dll  -r:C:hwB29F09D3wA8C608E4eLoaderinding  racingBinderTracingTest.ResolutionFlowIL-CG2*.dll"
Emitting R2R PE file: C:hwB29F09D3wA8C608E4eLoaderinding   racingBinderTracingTest.ResolutionFlowBinderTracingTest.ResolutionFlow.dll
" "dotnet" "C:hwB29F09D3p
2rdump
2rdump.dll" --header --sc --in C:hwB29F09D3wA8C608E4eLoaderinding  racingBinderTracingTest.ResolutionFlowBinderTracingTest.ResolutionFlow.dll --out C:hwB29F09D3wA8C608E4eLoaderinding    racingBinderTracingTest.ResolutionFlowBinderTracingTest.ResolutionFlow.dll.r2rdump --val"
 4:39:18.99
 4:39:18.99
Response file: C:hwB29F09D3wA8C608E4eLoaderinding  racingBinderTracingTest.ResolutionFlowTestLibrary.dll.rsp
C:hwB29F09D3wA8C608E4eLoaderinding racingBinderTracingTest.ResolutionFlowIL-CG2TestLibrary.dll
-o:C:hwB29F09D3wA8C608E4eLoaderinding  racingBinderTracingTest.ResolutionFlowTestLibrary.dll
--targetarch:x86
--targetos:windows
--verify-type-and-field-layout
--method-layout:random
-r:C:hwB29F09D3pSystem.*.dll
-r:C:hwB29F09D3pMicrosoft.*.dll
-r:C:hwB29F09D3p\xunit.*.dll
-r:C:hwB29F09D3pmscorlib.dll
-r:C:hwB29F09D3p
etstandard.dll
" "dotnet" "C:hwB29F09D3pcrossgen2crossgen2.dll" @"C:hwB29F09D3wA8C608E4eLoaderinding  racingBinderTracingTest.ResolutionFlowTestLibrary.dll.rsp"   -r:C:hwB29F09D3wA8C608E4eLoaderLoaderIL-CG2*.dll  -r:C:hwB29F09D3wA8C608E4eLoaderinding   racingBinderTracingTest.ResolutionFlowIL-CG2*.dll"
Emitting 

Stack trace:

    at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 146
   at Xunit.Assert.True(Boolean condition, String userMessage) in /_/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 128
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath)
   at Program.<<Main>$>g__TestExecutor64|0_65(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)
v-wenyuxu commented 3 weeks ago

Failed in: runtime-coreclr jitstress 20240421.1

Failed tests:

coreclr windows x86 Checked jitminopts @ Windows.10.Amd64.Open
    - Loader/binding/tracing/BinderTracingTest.ResolutionFlow/BinderTracingTest.ResolutionFlow.cmd

Error message:


cmdLine:C:hwC34B09B6wB0DE0977eLoaderLoader../binding/tracing/BinderTracingTest.ResolutionFlow/BinderTracingTest.ResolutionFlow.cmd Timed Out (timeout in milliseconds: 1800000 from variable __TestTimeout, start: 4/22/2024 6:31:12 AM, end: 4/22/2024 7:01:13 AM)

Return code:      -100
Raw output file:      C:hwC34B09B6wB0DE0977uploadsinding   racingBinderTracingTest.ResolutionFlowoutput.txt
Raw output:
BEGIN EXECUTION
 "C:hwC34B09B6pcorerun.exe" -p "System.Reflection.Metadata.MetadataUpdater.IsSupported=false" -p "System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true"  BinderTracingTest.ResolutionFlow.dll 
[6:31:14 AM] Running AssemblyLoadContextResolving_ReturnNull...
[6:31:15 AM] Running AssemblyLoadContextResolving_LoadAssembly...
[6:31:15 AM] Running AssemblyLoadContextResolving_NameMismatch...
[6:31:15 AM] Running AssemblyLoadContextResolving_MultipleHandlers...
[6:31:16 AM] Running AppDomainAssemblyResolve_ReturnNull...
[6:31:16 AM] Running AppDomainAssemblyResolve_LoadAssembly...
[6:31:16 AM] Running AppDomainAssemblyResolve_NameMismatch...
[6:31:16 AM] Running AppDomainAssemblyResolve_MultipleHandlers...
[6:31:16 AM] Launching process for AssemblyLoadFromResolveHandler_LoadDependency...
[6:31:17 AM] Running AssemblyLoadFromResolveHandler_LoadDependency...

[6:31:18 AM] Launching process for AssemblyLoadFromResolveHandler_NotTracked...
[6:31:20 AM] Running AssemblyLoadFromResolveHandler_NotTracked...

cmdLine:C:hwC34B09B6wB0DE0977eLoaderLoader../binding/tracing/BinderTracingTest.ResolutionFlow/BinderTracingTest.ResolutionFlow.cmd Timed Out (timeout in milliseconds: 1800000 from variable __TestTimeout, start: 4/22/2024 6:31:12 AM, end: 4/22/2024 7:01:13 AM)
Invoking: C:Program Files (x86)Windows Kits10Debuggers†cdb.exe -c "$<C:hwC34B09B6       mpclpplf.tmp" -z "C:corescrashdump_1376.dmp"
stdout: 
Microsoft (R) Windows Debugger Version 10.0.18362.1 X86
Copyright (c) Microsoft Corporation. All rights reserved.

Loading Dump File [C:corescrashdump_1376.dmp]
User Mini Dump File with Full Memory: Only application data is available

************* Path validation summary **************
Response                         Time (ms)     Location
OK                                             C:hwC34B09B6pPDB
Symbol search path is: C:hwC34B09B6pPDB
Executable search path is: 
Windows 10 Version 14393 MP (4 procs) Free x86 compatible
Product: Server, suite: TerminalServer DataCenter SingleUserTS
10.0.14393.6343 (rs1_release.230913-1727)
Machine Name:
Debug session time: Mon Apr 22 07:01:13.000 2024 (UTC + 0:00)
System Uptime: 0 days 4:02:58.604
Process Uptime: 0 days 0:30:00.000
..............................................

************* Symbol Loading Error Summary **************
Module name            Error
ntdll                  The system cannot find the file specified

You can troubleshoot most symbol related issues by turning on symbol loading diagnostics (!sym noisy) and repeating the command that caused symbols to be loaded.
You should also verify that your symbol search path (.sympath) is correct.
For analysis of this file, run !analyze -v
*** WARNING: Unable to verify checksum for coreclr.dll
eax=00000000 ebx=00000001 ecx=00000000 edx=00000000 esi=00000001 edi=00000001
eip=7749f18c esp=02ffe06c ebp=02ffe1fc iopl=0         nv up ei pl nz na pe nc
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206
ntdll!ZwWaitForMultipleObjects+0xc:
7749f18c c21400          ret     14h
0:000> cdb: Reading initial command '$<C:hwC34B09B6     mpclpplf.tmp'
0:000> .load C:Users
unner.dotnetsossos.dll
0:000> ~*k

.  0  Id: 560.904 Suspend: 0 Teb: 02d31000 Unfrozen
ChildEBP RetAddr  
WARNING: Stack unwind information not available. Following frames may be wrong.
02ffe1fc 71c9e7c6 ntdll!ZwWaitForMultipleObjects+0xc
02ffe280 71c9ece0 coreclr!Thread::DoAppropriateAptStateWait+0xc6
02ffe3dc 71ca55cf coreclr!Thread::DoAppropriateWaitWorker+0x3d2
02ffe430 71c9e87d coreclr!`Thread::DoAppropriateWait'::`9'::__Body

Stack trace:

   at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 146
   at Xunit.Assert.True(Boolean condition, String userMessage) in /_/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 128
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath)
   at Program.<<Main>$>g__TestExecutor64|0_65(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)
v-wenyuxu commented 3 weeks ago

Failed in: runtime-coreclr jitstress 20240422.1

Failed tests:

coreclr windows x86 Checked jitstress1_tiered @ Windows.10.Amd64.Open
    - Loader/binding/tracing/BinderTracingTest.ResolutionFlow/BinderTracingTest.ResolutionFlow.cmd

Error message:


cmdLine:C:hwA3240967wAAC1097DeLoaderLoader../binding/tracing/BinderTracingTest.ResolutionFlow/BinderTracingTest.ResolutionFlow.cmd Timed Out (timeout in milliseconds: 1800000 from variable __TestTimeout, start: 4/23/2024 5:52:57 AM, end: 4/23/2024 6:22:57 AM)

Return code:      -100
Raw output file:      C:hwA3240967wAAC1097Duploadsinding   racingBinderTracingTest.ResolutionFlowoutput.txt
Raw output:
BEGIN EXECUTION
 "C:hwA3240967pcorerun.exe" -p "System.Reflection.Metadata.MetadataUpdater.IsSupported=false" -p "System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true"  BinderTracingTest.ResolutionFlow.dll 
[5:52:59 AM] Running AssemblyLoadContextResolving_ReturnNull...
[5:53:00 AM] Running AssemblyLoadContextResolving_LoadAssembly...
[5:53:00 AM] Running AssemblyLoadContextResolving_NameMismatch...
[5:53:00 AM] Running AssemblyLoadContextResolving_MultipleHandlers...
[5:53:00 AM] Running AppDomainAssemblyResolve_ReturnNull...
[5:53:00 AM] Running AppDomainAssemblyResolve_LoadAssembly...
[5:53:01 AM] Running AppDomainAssemblyResolve_NameMismatch...
[5:53:01 AM] Running AppDomainAssemblyResolve_MultipleHandlers...
[5:53:01 AM] Launching process for AssemblyLoadFromResolveHandler_LoadDependency...
[5:53:02 AM] Running AssemblyLoadFromResolveHandler_LoadDependency...

[5:53:04 AM] Launching process for AssemblyLoadFromResolveHandler_NotTracked...
[5:53:05 AM] Running AssemblyLoadFromResolveHandler_NotTracked...

[5:53:07 AM] Launching process for FindInLoadContext_CustomALC...
[5:53:09 AM] Running FindInLoadContext_CustomALC...

[5:53:11 AM] Launching process for FindInLoadContext_DefaultALC...
[5:53:12 AM] Running FindInLoadContext_DefaultALC...

[5:53:14 AM] Launching process for FindInLoadContext_DefaultALC_IncompatibleVersion...
[5:53:15 AM] Running FindInLoadContext_DefaultALC_IncompatibleVersion...

[5:53:17 AM] Launching process for ApplicationAssemblies...
[5:53:18 AM] Running ApplicationAssemblies...

[5:53:20 AM] Launching process for ApplicationAssemblies_IncompatibleVersion...
[5:53:21 AM] Running ApplicationAssemblies_IncompatibleVersion...

cmdLine:C:hwA3240967wAAC1097DeLoaderLoader../binding/tracing/BinderTracingTest.ResolutionFlow/BinderTracingTest.ResolutionFlow.cmd Timed Out (timeout in milliseconds: 1800000 from variable __TestTimeout, start: 4/23/2024 5:52:57 AM, end: 4/23/2024 6:22:57 AM)
Invoking: C:Program Files (x86)Windows Kits10Debuggers†cdb.exe -c "$<C:hwA3240967       mp1mmhvu.tmp" -z "C:corescrashdump_760.dmp"
stdout: 
Microsoft (R) Windows Debugger Version 10.0.18362.1 X86
Copyright (c) Microsoft Corporation. All rights reserved.

Loading Dump File [C:corescrashdump_760.dmp]
User Mini Dump File with Full Memory: Only application data is available

************* Path validation summary **************
Response                         Time (ms)     Location
OK                                             C:hwA3240967pPDB
Symbol search path is: C:hwA3240967pPDB
Executable search path is: 
Windows 10 Version 14393 MP (4 procs) Free x86 compatible
Product: Server, suite: TerminalServer DataCenter SingleUserTS
10.0.14393.6343 (rs1_release.230913-1727)
Machine Name:
Debug session time: Tue Apr 23 06:22:57.000 2024 (UTC + 0:00)
System Uptime: 0 days 0:39:24.409
Process Uptime: 0 days 0:30:00.000
..............................................

************* Symbol Loading Error Summary **************
Module name            Error
ntdll                  The system cannot find the file specified

You can troubleshoot most symbol related issues by turning on symbol loading diagnostics (!sym noisy) and repeating the command that caused symbols to be loaded.
You should also verify that your symbol search path (.sympath) is correct.
For analysis of this file, run !analyze -v
*** WARNING: Unable to verify checksum for coreclr.dll
eax=00000000 ebx=00000001 ecx=00000000 edx=00000000 esi=00000001 edi=00000001
eip=77abf18c esp=02f7e034 ebp=02f7e1c4 iopl=0         nv up ei pl nz na po nc
cs=0023  ss=002

Stack trace:

   at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 146
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath)
   at Program.<<Main>$>g__TestExecutor64|0_65(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)