Open v-wenyuxu opened 1 week ago
Failed in: runtime-coreclr outerloop 20241104.8
Failed tests:
R2R-CG2 linux x64 Checked no_tiered_compilation @ (Alpine.317.Amd64.Open)Ubuntu.2204.Amd64.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.17-helix-amd64
- baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd
Error message:
DOTNET_DbgEnableMiniDump is set and the createdump binary does not exist: /root/helix/work/correlation/crossgen2/createdump
Return code: 1
Raw output file: /root/helix/work/workitem/uploads/stackoverflow/stackoverflowtester/output.txt
Raw output:
BEGIN EXECUTION
in takeLock
/root/helix/work/workitem/e/baseservices/exceptions/stackoverflow/stackoverflowtester/IL-CG2/stackoverflowtester.dll
02:36:27
Response file: /root/helix/work/workitem/e/baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.dll.rsp
/root/helix/work/workitem/e/baseservices/exceptions/stackoverflow/stackoverflowtester/IL-CG2/stackoverflowtester.dll
-o:/root/helix/work/workitem/e/baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.dll
--targetarch:x64
--targetos:linux
--verify-type-and-field-layout
--method-layout:random
-r:/root/helix/work/correlation/System.*.dll
-r:/root/helix/work/correlation/Microsoft.*.dll
-r:/root/helix/work/correlation/xunit.*.dll
-r:/root/helix/work/correlation/mscorlib.dll
-r:/root/helix/work/correlation/netstandard.dll
Running CrossGen2: /root/helix/work/correlation/crossgen2/crossgen2 @/root/helix/work/workitem/e/baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.dll.rsp -r:/root/helix/work/workitem/e/baseservices/exceptions/stackoverflow/stackoverflowtester/IL-CG2/*.dll
Emitting R2R PE file: /root/helix/work/workitem/e/baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.dll
Running R2RDump: dotnet /root/helix/work/correlation/R2RDump/R2RDump.dll --header --sc --in /root/helix/work/workitem/e/baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.dll --out /root/helix/work/workitem/e/baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.dll.r2rdump --val
02:36:28
in ReleaseLock
in takeLock
/root/helix/work/correlation/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false -p System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true stackoverflowtester.dll ''
Running stackoverflow test(smallframe main)
"Stack overflow."
"Repeated 174386 times:"
"--------------------------------"
" at TestStackOverflow.Program.InfiniteRecursionC()"
" at TestStackOverflow.Program.InfiniteRecursionB()"
" at TestStackOverflow.Program.InfiniteRecursionA()"
"--------------------------------"
" at TestStackOverflow.Program.Test(Boolean)"
" at TestStackOverflow.Program.Main(System.String[])"
""
Running stackoverflow test(largeframe main)
"Stack overflow."
"Repeated 42 times:"
"--------------------------------"
" at TestStackOverflow.Program.InfiniteRecursionB2()"
" at TestStackOverflow.Program.InfiniteRecursionA2()"
" at TestStackOverflow.Program.InfiniteRecursionC2()"
"--------------------------------"
" at TestStackOverflow.Program.InfiniteRecursionB2()"
" at TestStackOverflow.Program.InfiniteRecursionA2()"
" at TestStackOverflow.Program.Test(Boolean)"
" at TestStackOverflow.Program.Main(System.String[])"
""
Running stackoverflow test(smallframe secondary)
"Stack overflow."
"Repeated 32786 times:"
"--------------------------------"
" at TestStackOverflow.Program.InfiniteRecursionA()"
" at TestStackOverflow.Program.InfiniteRecursionC()"
" at TestStackOverflow.Program.InfiniteRecursionB()"
"--------------------------------"
" at TestStackOverflow.Program.InfiniteRecursionA()"
" at TestStackOverflow.Program.Test(Boolean)"
" at TestStackOverflow.Program+<>c__DisplayClass7_0.<SecondaryThreadsTest>b__0()"
""
Running stackoverflow test(largeframe secondary)
"Stack overflow."
"Repeated 8 times:"
"--------------------------------"
" at TestStackOverflow.Program.InfiniteRecursionA2()"
" at TestStackOverflow.Program.InfiniteRecursionC2()"
" at TestStackOverflow.Program.InfiniteRecursionB2()"
"--------------------------------"
" at TestStackOverflow.Program.InfiniteRecursionA2()"
" at TestStackOverflow.Program.Test(Boolean)"
"
Stack trace:
at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 141
at Xunit.Assert.True(Boolean condition, String userMessage) in /_/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 123
at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
at Program.<<Main>$>g__TestExecutor134|0_135(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)
Failed in: runtime-coreclr r2r 20241104.1
Failed tests:
R2R-CG2 linux x64 Checked @ Ubuntu.2204.Amd64.Open
- baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd
Error message:
DOTNET_DbgEnableMiniDump is set and the createdump binary does not exist: /datadisks/disk1/work/99AE0841/p/crossgen2/createdump
cmdLine:/datadisks/disk1/work/99AE0841/w/A3660904/e/baseservices/exceptions/baseservices-exceptions/../stackoverflow/stackoverflowtester/stackoverflowtester.sh Timed Out (timeout in milliseconds: 1800000 from variable __TestTimeout, start: 11/5/2024 6:55:03 AM, end: 11/5/2024 7:25:03 AM)
Return code: -100
Raw output file: /datadisks/disk1/work/99AE0841/w/A3660904/uploads/stackoverflow/stackoverflowtester/output.txt
Raw output:
BEGIN EXECUTION
in takeLock
/datadisks/disk1/work/99AE0841/w/A3660904/e/baseservices/exceptions/stackoverflow/stackoverflowtester/IL-CG2/stackoverflowtester.dll
06:55:03
Response file: /datadisks/disk1/work/99AE0841/w/A3660904/e/baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.dll.rsp
/datadisks/disk1/work/99AE0841/w/A3660904/e/baseservices/exceptions/stackoverflow/stackoverflowtester/IL-CG2/stackoverflowtester.dll
-o:/datadisks/disk1/work/99AE0841/w/A3660904/e/baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.dll
--targetarch:x64
--targetos:linux
--verify-type-and-field-layout
--method-layout:random
-r:/datadisks/disk1/work/99AE0841/p/System.*.dll
-r:/datadisks/disk1/work/99AE0841/p/Microsoft.*.dll
-r:/datadisks/disk1/work/99AE0841/p/xunit.*.dll
-r:/datadisks/disk1/work/99AE0841/p/mscorlib.dll
-r:/datadisks/disk1/work/99AE0841/p/netstandard.dll
Running CrossGen2: /datadisks/disk1/work/99AE0841/p/crossgen2/crossgen2 @/datadisks/disk1/work/99AE0841/w/A3660904/e/baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.dll.rsp -r:/datadisks/disk1/work/99AE0841/w/A3660904/e/baseservices/exceptions/stackoverflow/stackoverflowtester/IL-CG2/*.dll
Emitting R2R PE file: /datadisks/disk1/work/99AE0841/w/A3660904/e/baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.dll
Running R2RDump: dotnet /datadisks/disk1/work/99AE0841/p/R2RDump/R2RDump.dll --header --sc --in /datadisks/disk1/work/99AE0841/w/A3660904/e/baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.dll --out /datadisks/disk1/work/99AE0841/w/A3660904/e/baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.dll.r2rdump --val
06:55:04
in ReleaseLock
in takeLock
/datadisks/disk1/work/99AE0841/p/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false -p System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true stackoverflowtester.dll ''
Running stackoverflow test(smallframe main)
"Stack overflow."
"Repeated 174421 times:"
"--------------------------------"
" at TestStackOverflow.Program.InfiniteRecursionB()"
" at TestStackOverflow.Program.InfiniteRecursionA()"
" at TestStackOverflow.Program.InfiniteRecursionC()"
"--------------------------------"
" at TestStackOverflow.Program.InfiniteRecursionB()"
" at TestStackOverflow.Program.InfiniteRecursionA()"
" at TestStackOverflow.Program.Test(Boolean)"
" at TestStackOverflow.Program.Main(System.String[])"
""
Running stackoverflow test(largeframe main)
"Stack overflow."
"Repeated 42 times:"
"--------------------------------"
" at TestStackOverflow.Program.InfiniteRecursionB2()"
" at TestStackOverflow.Program.InfiniteRecursionA2()"
" at TestStackOverflow.Program.InfiniteRecursionC2()"
"--------------------------------"
" at TestStackOverflow.Program.InfiniteRecursionB2()"
" at TestStackOverflow.Program.InfiniteRecursionA2()"
" at TestStackOverflow.Program.Test(Boolean)"
" at TestStackOverflow.Program.Main(System.String[])"
cmdLine:/datadisks/disk1/work/99AE0841/w/A3660904/e/baseservices/exceptions/baseservices-exceptions/../stackoverflow/stackoverflowtester/stackoverflowtester.sh Timed Out (timeout in milliseconds: 1800000 from variable __TestTimeout, start: 11/5/2024 6:55:03 AM, end: 11/5/2024 7:25:03 AM)
Printing stacktrace from '/home/helixbot/dotnetbuild/dumps/cr
Stack trace:
at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
at Program.<<Main>$>g__TestExecutor134|0_135(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)
Failed in: runtime-coreclr pgo 20241106.1
Failed tests:
coreclr linux x64 Checked defaultpgo @ Ubuntu.2204.Amd64.Open
- baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd
Error message:
cmdLine:/datadisks/disk1/work/B2FC0A01/w/C7580A4C/e/baseservices/exceptions/baseservices-exceptions/../stackoverflow/stackoverflowtester/stackoverflowtester.sh Timed Out (timeout in milliseconds: 600000 from variable __TestTimeout, start: 11/6/2024 9:23:30 AM, end: 11/6/2024 9:33:30 AM)
Return code: -100
Raw output file: /datadisks/disk1/work/B2FC0A01/w/C7580A4C/uploads/stackoverflow/stackoverflowtester/output.txt
Raw output:
BEGIN EXECUTION
/datadisks/disk1/work/B2FC0A01/p/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false -p System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true stackoverflowtester.dll ''
Running stackoverflow test(smallframe main)
"Stack overflow."
"Repeated 174419 times:"
"--------------------------------"
" at TestStackOverflow.Program.InfiniteRecursionA()"
" at TestStackOverflow.Program.InfiniteRecursionC()"
" at TestStackOverflow.Program.InfiniteRecursionB()"
"--------------------------------"
" at TestStackOverflow.Program.InfiniteRecursionA()"
" at TestStackOverflow.Program.Test(Boolean)"
" at TestStackOverflow.Program.Main(System.String[])"
""
Running stackoverflow test(largeframe main)
"Stack overflow."
"Repeated 42 times:"
"--------------------------------"
" at TestStackOverflow.Program.InfiniteRecursionB2()"
" at TestStackOverflow.Program.InfiniteRecursionA2()"
" at TestStackOverflow.Program.InfiniteRecursionC2()"
"--------------------------------"
" at TestStackOverflow.Program.InfiniteRecursionB2()"
" at TestStackOverflow.Program.InfiniteRecursionA2()"
" at TestStackOverflow.Program.Test(Boolean)"
" at TestStackOverflow.Program.Main(System.String[])"
cmdLine:/datadisks/disk1/work/B2FC0A01/w/C7580A4C/e/baseservices/exceptions/baseservices-exceptions/../stackoverflow/stackoverflowtester/stackoverflowtester.sh Timed Out (timeout in milliseconds: 600000 from variable __TestTimeout, start: 11/6/2024 9:23:30 AM, end: 11/6/2024 9:33:30 AM)
Printing stacktrace from '/home/helixbot/dotnetbuild/dumps/crashdump_54870.dmp.crashreport.json'
Invoking llvm-symbolizer --pretty-print
Stack trace:
----------------------------------
Thread Id: 0xd656
Child SP IP Call Site
0x74d3cf42c260 0x74d3cece57f8 libc.so.6!clock_nanosleep
0x74d3cf42c2e0 0x74d3cecea677 libc.so.6!__nanosleep
0x74d3cf42c2f0 0x74d3cecea5ae libc.so.6!sleep
0x74d3cf42c330 0x74d3ce8918da libcoreclr.so!sigsegv_handler(int, siginfo_t*, void*) at /__w/1/s/src/coreclr/pal/src/exception/signal.cpp:639:21
0x74d3cf42c380 0x74d3cec42520 libc.so.6!
0x7ffda2dfa680 0x74d3508e274e stackoverflow.dll!TestStackOverflow.Program.InfiniteRecursionB2()
0x7ffda2dfa690 0x74d3508e271c stackoverflow.dll!TestStackOverflow.Program.InfiniteRecursionA2()
0x7ffda2e0a6a0 0x74d3508e281c stackoverflow.dll!TestStackOverflow.Program.InfiniteRecursionC2()
0x7ffda2e1a6b0 0x74d3508e279c stackoverflow.dll!TestStackOverflow.Program.InfiniteRecursionB2()
0x7ffda2e2a6c0 0x74d3508e271c stackoverflow.dll!TestStackOverflow.Program.InfiniteRecursionA2()
0x7ffda2e3a6d0 0x74d3508e281c stackoverflow.dll!TestStackOverflow.Program.InfiniteRecursionC2()
0x7ffda2e4a6e0 0x74d3508e279c stackoverflow.dll!TestStackOverflow.Program.InfiniteRecursionB2()
0x7ffda2e5a6f0 0x74d3508e271c stackoverflow.dll!TestStackOverflow.Program.InfiniteRecursionA2()
0x7ffda2e6a700 0x74d3508e281c stackoverflow.dll!TestStackOverflow.Program.InfiniteRecursionC2()
0x7ffda2e7a710 0x74d3508e279c stackoverflow.dll!TestStackOverflow.Program.InfiniteRecursionB2()
0x7ffda2e8a720 0x74d3508e271c stackoverflow.dll!TestStackOverflow.Program.InfiniteRecursionA2()
0x7ffda2e9a730 0x74d3508e281c stackoverflow.dll!TestStackOverflow.Program.InfiniteRecursionC2()
0x7ffda2eaa740 0x74d3508e279c stackoverflow.dll!TestStackOverflow.Program.InfiniteRecursionB2()
0x7ffda2eba750 0x74d3508e271c stackoverflow.dll!TestStackOverflow.Program.InfiniteRecursionA2()
0x7ffda2eca760 0x74d3508e281c stackoverflow.dll!TestStackOverflow.Program.
Stack trace:
at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
at Program.<<Main>$>g__TestExecutor134|0_135(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)
Failed in: runtime-coreclr crossgen2 20241106.1
Failed tests:
R2R-CG2 linux x64 Checked @ Ubuntu.2204.Amd64.Open
- baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd
Error message:
DOTNET_DbgEnableMiniDump is set and the createdump binary does not exist: /datadisks/disk1/work/BA7E09FE/p/crossgen2/createdump
cmdLine:/datadisks/disk1/work/BA7E09FE/w/B9DA099F/e/baseservices/exceptions/baseservices-exceptions/../stackoverflow/stackoverflowtester/stackoverflowtester.sh Timed Out (timeout in milliseconds: 1800000 from variable __TestTimeout, start: 11/7/2024 7:27:45 AM, end: 11/7/2024 7:57:45 AM)
Return code: -100
Raw output file: /datadisks/disk1/work/BA7E09FE/w/B9DA099F/uploads/stackoverflow/stackoverflowtester/output.txt
Raw output:
BEGIN EXECUTION
in takeLock
/datadisks/disk1/work/BA7E09FE/w/B9DA099F/e/baseservices/exceptions/stackoverflow/stackoverflowtester/IL-CG2/stackoverflowtester.dll
07:27:45
Response file: /datadisks/disk1/work/BA7E09FE/w/B9DA099F/e/baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.dll.rsp
/datadisks/disk1/work/BA7E09FE/w/B9DA099F/e/baseservices/exceptions/stackoverflow/stackoverflowtester/IL-CG2/stackoverflowtester.dll
-o:/datadisks/disk1/work/BA7E09FE/w/B9DA099F/e/baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.dll
--targetarch:x64
--targetos:linux
--verify-type-and-field-layout
--method-layout:random
-r:/datadisks/disk1/work/BA7E09FE/p/System.*.dll
-r:/datadisks/disk1/work/BA7E09FE/p/Microsoft.*.dll
-r:/datadisks/disk1/work/BA7E09FE/p/xunit.*.dll
-r:/datadisks/disk1/work/BA7E09FE/p/mscorlib.dll
-r:/datadisks/disk1/work/BA7E09FE/p/netstandard.dll
Running CrossGen2: /datadisks/disk1/work/BA7E09FE/p/crossgen2/crossgen2 @/datadisks/disk1/work/BA7E09FE/w/B9DA099F/e/baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.dll.rsp -r:/datadisks/disk1/work/BA7E09FE/w/B9DA099F/e/baseservices/exceptions/stackoverflow/stackoverflowtester/IL-CG2/*.dll
Emitting R2R PE file: /datadisks/disk1/work/BA7E09FE/w/B9DA099F/e/baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.dll
Running R2RDump: dotnet /datadisks/disk1/work/BA7E09FE/p/R2RDump/R2RDump.dll --header --sc --in /datadisks/disk1/work/BA7E09FE/w/B9DA099F/e/baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.dll --out /datadisks/disk1/work/BA7E09FE/w/B9DA099F/e/baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.dll.r2rdump --val
07:27:45
in ReleaseLock
in takeLock
/datadisks/disk1/work/BA7E09FE/p/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false -p System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true stackoverflowtester.dll ''
Running stackoverflow test(smallframe main)
"Stack overflow."
"Repeated 174423 times:"
"--------------------------------"
" at TestStackOverflow.Program.InfiniteRecursionB()"
" at TestStackOverflow.Program.InfiniteRecursionA()"
" at TestStackOverflow.Program.InfiniteRecursionC()"
"--------------------------------"
" at TestStackOverflow.Program.InfiniteRecursionB()"
" at TestStackOverflow.Program.InfiniteRecursionA()"
" at TestStackOverflow.Program.Test(Boolean)"
" at TestStackOverflow.Program.Main(System.String[])"
""
Running stackoverflow test(largeframe main)
"Stack overflow."
"Repeated 42 times:"
"--------------------------------"
" at TestStackOverflow.Program.InfiniteRecursionB2()"
" at TestStackOverflow.Program.InfiniteRecursionA2()"
" at TestStackOverflow.Program.InfiniteRecursionC2()"
"--------------------------------"
" at TestStackOverflow.Program.InfiniteRecursionB2()"
" at TestStackOverflow.Program.InfiniteRecursionA2()"
" at TestStackOverflow.Program.Test(Boolean)"
" at TestStackOverflow.Program.Main(System.String[])"
cmdLine:/datadisks/disk1/work/BA7E09FE/w/B9DA099F/e/baseservices/exceptions/baseservices-exceptions/../stackoverflow/stackoverflowtester/stackoverflowtester.sh Timed Out (timeout in milliseconds: 1800000 from variable __TestTimeout, start: 11/7/2024 7:27:45 AM, end: 11/7/2024 7:57:45 AM)
Printing stacktrace from '/home/helixbot/dotnetbuild/dumps/cr
Stack trace:
at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 141
at Xunit.Assert.True(Boolean condition, String userMessage) in /_/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 123
at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
at Program.<<Main>$>g__TestExecutor14|0_15(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)
Failed in: runtime-coreclr pgostress 20241108.1
Failed tests:
coreclr linux x64 Checked syntheticpgo @ Ubuntu.2204.Amd64.Open
- baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd
Error message:
cmdLine:/datadisks/disk1/work/A90E0911/w/B5DB09C0/e/baseservices/exceptions/baseservices-exceptions/../stackoverflow/stackoverflowtester/stackoverflowtester.sh Timed Out (timeout in milliseconds: 600000 from variable __TestTimeout, start: 11/9/2024 7:29:28 AM, end: 11/9/2024 7:39:28 AM)
Return code: -100
Raw output file: /datadisks/disk1/work/A90E0911/w/B5DB09C0/uploads/stackoverflow/stackoverflowtester/output.txt
Raw output:
BEGIN EXECUTION
/datadisks/disk1/work/A90E0911/p/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false -p System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true stackoverflowtester.dll ''
Running stackoverflow test(smallframe main)
"Stack overflow."
"Repeated 174513 times:"
"--------------------------------"
" at TestStackOverflow.Program.InfiniteRecursionC()"
" at TestStackOverflow.Program.InfiniteRecursionB()"
" at TestStackOverflow.Program.InfiniteRecursionA()"
"--------------------------------"
" at TestStackOverflow.Program.Test(Boolean)"
" at TestStackOverflow.Program.Main(System.String[])"
""
Running stackoverflow test(largeframe main)
"Stack overflow."
"Repeated 42 times:"
"--------------------------------"
" at TestStackOverflow.Program.InfiniteRecursionB2()"
" at TestStackOverflow.Program.InfiniteRecursionA2()"
" at TestStackOverflow.Program.InfiniteRecursionC2()"
"--------------------------------"
" at TestStackOverflow.Program.InfiniteRecursionB2()"
" at TestStackOverflow.Program.InfiniteRecursionA2()"
" at TestStackOverflow.Program.Test(Boolean)"
" at TestStackOverflow.Program.Main(System.String[])"
cmdLine:/datadisks/disk1/work/A90E0911/w/B5DB09C0/e/baseservices/exceptions/baseservices-exceptions/../stackoverflow/stackoverflowtester/stackoverflowtester.sh Timed Out (timeout in milliseconds: 600000 from variable __TestTimeout, start: 11/9/2024 7:29:28 AM, end: 11/9/2024 7:39:28 AM)
Printing stacktrace from '/home/helixbot/dotnetbuild/dumps/crashdump_19633.dmp.crashreport.json'
Invoking llvm-symbolizer --pretty-print
Stack trace:
----------------------------------
Thread Id: 0x4cb1
Child SP IP Call Site
0x720d48df3260 0x720d486e57f8 libc.so.6!clock_nanosleep
0x720d48df32e0 0x720d486ea677 libc.so.6!__nanosleep
0x720d48df32f0 0x720d486ea5ae libc.so.6!sleep
0x720d48df3330 0x720d4829190a libcoreclr.so!sigsegv_handler(int, siginfo_t*, void*) at /__w/1/s/src/coreclr/pal/src/exception/signal.cpp:641:21
0x720d48df3380 0x720d48642520 libc.so.6!
0x7ffdb90e73a0 0x720cca30cbde stackoverflow.dll!TestStackOverflow.Program.InfiniteRecursionB2()
0x7ffdb90e73b0 0x720cca30cbac stackoverflow.dll!TestStackOverflow.Program.InfiniteRecursionA2()
0x7ffdb90f73c0 0x720cca30ccac stackoverflow.dll!TestStackOverflow.Program.InfiniteRecursionC2()
0x7ffdb91073d0 0x720cca30cc2c stackoverflow.dll!TestStackOverflow.Program.InfiniteRecursionB2()
0x7ffdb91173e0 0x720cca30cbac stackoverflow.dll!TestStackOverflow.Program.InfiniteRecursionA2()
0x7ffdb91273f0 0x720cca30ccac stackoverflow.dll!TestStackOverflow.Program.InfiniteRecursionC2()
0x7ffdb9137400 0x720cca30cc2c stackoverflow.dll!TestStackOverflow.Program.InfiniteRecursionB2()
0x7ffdb9147410 0x720cca30cbac stackoverflow.dll!TestStackOverflow.Program.InfiniteRecursionA2()
0x7ffdb9157420 0x720cca30ccac stackoverflow.dll!TestStackOverflow.Program.InfiniteRecursionC2()
0x7ffdb9167430 0x720cca30cc2c stackoverflow.dll!TestStackOverflow.Program.InfiniteRecursionB2()
0x7ffdb9177440 0x720cca30cbac stackoverflow.dll!TestStackOverflow.Program.InfiniteRecursionA2()
0x7ffdb9187450 0x720cca30ccac stackoverflow.dll!TestStackOverflow.Program.InfiniteRecursionC2()
0x7ffdb9197460 0x720cca30cc2c stackoverflow.dll!TestStackOverflow.Program.InfiniteRecursionB2()
0x7ffdb91a7470 0x720cca30cbac stackoverflow.dll!TestStackOverflow.Program.InfiniteRecursionA2()
0x7ffdb91b7480 0x720cca30ccac stackoverflow.dll!TestStackOverflow.Program.InfiniteRecursionC2()
0x7ffdb91c7490 0x720cca30cc2c st
Stack trace:
at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 141
at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
at Program.<<Main>$>g__TestExecutor134|0_135(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)
@mangod9 @janvorli we are seeing this failure impact multiple jit pipelines...
In the last four cases something causes the process that hits stack overflow to never exit. The main thread should exit and the secondary threads should wait forever if they hit a stack overflow. There was no change in the related code for months, so it seems like some seemingly unrelated recent change started to trigger this problem.
I have tried to repro it locally on the same Ubuntu with the same settings as the lab used and I was unable to repro it in hundreds of iterations.
The crashreport.json seems to indicate that the sigsegv_handler has believed that other thread is already handling a stack overflow, so it sleeps forever until the process shutdowns. But it never happens, because this test doesn't have stack overflow on other threads.
The wait is only triggered if g_stackOverflowHandlerStack
was NULL. It is initialized to a non-null value in SEHInitializeSignals
. And if that failed, the PAL initialization would fail and the host would exit before any managed code was executed. Moreover, if it failed, the g_stackOverflowHandlerStack
would contain MAP_FAILED
, which is non-zero.
And on top of that, the console shows the stack overflow logged to the console, so the main thread must have left the sigsegv handler and executed the runtime stack overflow reporting.
The only remote explanation is that somehow after the stack trace was reported, the runtime ended up returning to the original crash location and re-triggering the stack overflow. But I don't see how that could happen.
Failed in: runtime-coreclr outerloop 20241112.2
Failed tests:
coreclr linux x64 Checked no_tiered_compilation @ Ubuntu.2204.Amd64.Open
- baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd
Error message:
cmdLine:/datadisks/disk1/work/A55A0911/w/AF8F09A8/e/baseservices/exceptions/baseservices-exceptions/../stackoverflow/stackoverflowtester/stackoverflowtester.sh Timed Out (timeout in milliseconds: 600000 from variable __TestTimeout, start: 11/12/2024 7:26:52 PM, end: 11/12/2024 7:36:52 PM)
Return code: -100
Raw output file: /datadisks/disk1/work/A55A0911/w/AF8F09A8/uploads/stackoverflow/stackoverflowtester/output.txt
Raw output:
BEGIN EXECUTION
/datadisks/disk1/work/A55A0911/p/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false -p System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true stackoverflowtester.dll ''
Running stackoverflow test(smallframe main)
"Stack overflow."
"Repeated 174502 times:"
"--------------------------------"
" at TestStackOverflow.Program.InfiniteRecursionC()"
" at TestStackOverflow.Program.InfiniteRecursionB()"
" at TestStackOverflow.Program.InfiniteRecursionA()"
"--------------------------------"
" at TestStackOverflow.Program.Test(Boolean)"
" at TestStackOverflow.Program.Main(System.String[])"
""
Running stackoverflow test(largeframe main)
"Stack overflow."
"Repeated 42 times:"
"--------------------------------"
" at TestStackOverflow.Program.InfiniteRecursionB2()"
" at TestStackOverflow.Program.InfiniteRecursionA2()"
" at TestStackOverflow.Program.InfiniteRecursionC2()"
"--------------------------------"
" at TestStackOverflow.Program.InfiniteRecursionB2()"
" at TestStackOverflow.Program.InfiniteRecursionA2()"
" at TestStackOverflow.Program.Test(Boolean)"
" at TestStackOverflow.Program.Main(System.String[])"
""
Running stackoverflow test(smallframe secondary)
"Stack overflow."
"Repeated 174646 times:"
"--------------------------------"
" at TestStackOverflow.Program.InfiniteRecursionA()"
" at TestStackOverflow.Program.InfiniteRecursionC()"
" at TestStackOverflow.Program.InfiniteRecursionB()"
"--------------------------------"
" at TestStackOverflow.Program.InfiniteRecursionA()"
" at TestStackOverflow.Program.Test(Boolean)"
" at TestStackOverflow.Program+<>c__DisplayClass7_0.<SecondaryThreadsTest>b__0()"
""
Running stackoverflow test(largeframe secondary)
"Stack overflow."
"Repeated 42 times:"
"--------------------------------"
" at TestStackOverflow.Program.InfiniteRecursionB2()"
" at TestStackOverflow.Program.InfiniteRecursionA2()"
" at TestStackOverflow.Program.InfiniteRecursionC2()"
"--------------------------------"
" at TestStackOverflow.Program.InfiniteRecursionB2()"
" at TestStackOverflow.Program.InfiniteRecursionA2()"
" at TestStackOverflow.Program.Test(Boolean)"
" at TestStackOverflow.Program+<>c__DisplayClass7_0.<SecondaryThreadsTest>b__0()"
cmdLine:/datadisks/disk1/work/A55A0911/w/AF8F09A8/e/baseservices/exceptions/baseservices-exceptions/../stackoverflow/stackoverflowtester/stackoverflowtester.sh Timed Out (timeout in milliseconds: 600000 from variable __TestTimeout, start: 11/12/2024 7:26:52 PM, end: 11/12/2024 7:36:52 PM)
Printing stacktrace from '/home/helixbot/dotnetbuild/dumps/crashdump_53569.dmp.crashreport.json'
Invoking llvm-symbolizer --pretty-print
Stack trace:
----------------------------------
Thread Id: 0xd141
Child SP IP Call Site
0x7ffe8294cbf0 0x70a82c091117 libc.so.6!
0x7ffe8294cc30 0x70a82c093a41 libc.so.6!pthread_cond_wait
0x7ffe8294cd10 0x70a82bcdeb8b libcoreclr.so!CorUnix::CPalSynchronizationManager::ThreadNativeWait(CorUnix::_ThreadNativeWaitData*, unsigned int, CorUnix::ThreadWakeupReason*, unsigned int*) at /__w/1/s/src/coreclr/pal/src/synchmgr/synchmanager.cpp:0:28
0x7ffe8294cd70 0x70a82bcde110 libcoreclr.so!CorUnix::CPalSynchronizationManager::BlockThread(CorUnix::CPalThread*, unsigned int, bool, bool, CorUnix::ThreadWakeupReason*, unsigned int*) at /__w/1/s/src/coreclr/pal/src/synchmgr/synchmanager.cpp:303:22
0x7ffe8294cdd0 0x70a82bce7b10 libcoreclr.so!CorUnix::InternalWaitForMultipleObjectsEx(CorUnix::CPalThread*, unsigned int, void* co
Stack trace:
at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 141
at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
at Program.<<Main>$>g__TestExecutor134|0_135(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)
Failed in: runtime-coreclr outerloop 20241113.1
Failed tests:
R2R-CG2 linux x64 Checked no_tiered_compilation @ Ubuntu.2204.Amd64.Open
- baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd
Error message:
DOTNET_DbgEnableMiniDump is set and the createdump binary does not exist: /datadisks/disk1/work/B59E0A77/p/crossgen2/createdump
cmdLine:/datadisks/disk1/work/B59E0A77/w/AC130948/e/baseservices/exceptions/baseservices-exceptions/../stackoverflow/stackoverflowtester/stackoverflowtester.sh Timed Out (timeout in milliseconds: 1800000 from variable __TestTimeout, start: 11/13/2024 10:22:57 AM, end: 11/13/2024 10:52:57 AM)
Return code: -100
Raw output file: /datadisks/disk1/work/B59E0A77/w/AC130948/uploads/stackoverflow/stackoverflowtester/output.txt
Raw output:
BEGIN EXECUTION
in takeLock
/datadisks/disk1/work/B59E0A77/w/AC130948/e/baseservices/exceptions/stackoverflow/stackoverflowtester/IL-CG2/stackoverflowtester.dll
10:22:57
Response file: /datadisks/disk1/work/B59E0A77/w/AC130948/e/baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.dll.rsp
/datadisks/disk1/work/B59E0A77/w/AC130948/e/baseservices/exceptions/stackoverflow/stackoverflowtester/IL-CG2/stackoverflowtester.dll
-o:/datadisks/disk1/work/B59E0A77/w/AC130948/e/baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.dll
--targetarch:x64
--targetos:linux
--verify-type-and-field-layout
--method-layout:random
-r:/datadisks/disk1/work/B59E0A77/p/System.*.dll
-r:/datadisks/disk1/work/B59E0A77/p/Microsoft.*.dll
-r:/datadisks/disk1/work/B59E0A77/p/xunit.*.dll
-r:/datadisks/disk1/work/B59E0A77/p/mscorlib.dll
-r:/datadisks/disk1/work/B59E0A77/p/netstandard.dll
Running CrossGen2: /datadisks/disk1/work/B59E0A77/p/crossgen2/crossgen2 @/datadisks/disk1/work/B59E0A77/w/AC130948/e/baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.dll.rsp -r:/datadisks/disk1/work/B59E0A77/w/AC130948/e/baseservices/exceptions/stackoverflow/stackoverflowtester/IL-CG2/*.dll
Emitting R2R PE file: /datadisks/disk1/work/B59E0A77/w/AC130948/e/baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.dll
Running R2RDump: dotnet /datadisks/disk1/work/B59E0A77/p/R2RDump/R2RDump.dll --header --sc --in /datadisks/disk1/work/B59E0A77/w/AC130948/e/baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.dll --out /datadisks/disk1/work/B59E0A77/w/AC130948/e/baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.dll.r2rdump --val
10:22:58
in ReleaseLock
in takeLock
/datadisks/disk1/work/B59E0A77/p/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false -p System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true stackoverflowtester.dll ''
Running stackoverflow test(smallframe main)
"Stack overflow."
"Repeated 174415 times:"
"--------------------------------"
" at TestStackOverflow.Program.InfiniteRecursionA()"
" at TestStackOverflow.Program.InfiniteRecursionC()"
" at TestStackOverflow.Program.InfiniteRecursionB()"
"--------------------------------"
" at TestStackOverflow.Program.InfiniteRecursionA()"
" at TestStackOverflow.Program.Test(Boolean)"
" at TestStackOverflow.Program.Main(System.String[])"
""
Running stackoverflow test(largeframe main)
"Stack overflow."
"Repeated 42 times:"
"--------------------------------"
" at TestStackOverflow.Program.InfiniteRecursionB2()"
" at TestStackOverflow.Program.InfiniteRecursionA2()"
" at TestStackOverflow.Program.InfiniteRecursionC2()"
"--------------------------------"
" at TestStackOverflow.Program.InfiniteRecursionB2()"
" at TestStackOverflow.Program.InfiniteRecursionA2()"
" at TestStackOverflow.Program.Test(Boolean)"
" at TestStackOverflow.Program.Main(System.String[])"
""
Running stackoverflow test(smallframe secondary)
"Stack overflow."
"Repeated 174646 times:"
"--------------------------------"
" at TestStackOverflow.Program.InfiniteRecursionA()"
" at TestStackOverflow.Program.InfiniteRecursionC()"
" at TestStackOverflow.Program.InfiniteRecursionB()"
"--------------------------------"
" at TestStackOverflow.Program.InfiniteRecursionA()"
" at TestStackO
Stack trace:
at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 141
at Xunit.Assert.True(Boolean condition, String userMessage) in /_/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 123
at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
at Program.<<Main>$>g__TestExecutor134|0_135(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)
Failed in: runtime-coreclr crossgen2 20241113.1
Failed tests:
R2R-CG2 linux x64 Checked no_tiered_compilation @ Ubuntu.2204.Amd64.Open
- baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd
Error message:
DOTNET_DbgEnableMiniDump is set and the createdump binary does not exist: /datadisks/disk1/work/A99309E8/p/crossgen2/createdump
cmdLine:/datadisks/disk1/work/A99309E8/w/A93109AA/e/baseservices/exceptions/baseservices-exceptions/../stackoverflow/stackoverflowtester/stackoverflowtester.sh Timed Out (timeout in milliseconds: 1800000 from variable __TestTimeout, start: 11/14/2024 7:12:34 AM, end: 11/14/2024 7:42:34 AM)
Return code: -100
Raw output file: /datadisks/disk1/work/A99309E8/w/A93109AA/uploads/stackoverflow/stackoverflowtester/output.txt
Raw output:
BEGIN EXECUTION
in takeLock
/datadisks/disk1/work/A99309E8/w/A93109AA/e/baseservices/exceptions/stackoverflow/stackoverflowtester/IL-CG2/stackoverflowtester.dll
07:12:34
Response file: /datadisks/disk1/work/A99309E8/w/A93109AA/e/baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.dll.rsp
/datadisks/disk1/work/A99309E8/w/A93109AA/e/baseservices/exceptions/stackoverflow/stackoverflowtester/IL-CG2/stackoverflowtester.dll
-o:/datadisks/disk1/work/A99309E8/w/A93109AA/e/baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.dll
--targetarch:x64
--targetos:linux
--verify-type-and-field-layout
--method-layout:random
--hot-cold-splitting
-r:/datadisks/disk1/work/A99309E8/p/System.*.dll
-r:/datadisks/disk1/work/A99309E8/p/Microsoft.*.dll
-r:/datadisks/disk1/work/A99309E8/p/xunit.*.dll
-r:/datadisks/disk1/work/A99309E8/p/mscorlib.dll
-r:/datadisks/disk1/work/A99309E8/p/netstandard.dll
Running CrossGen2: /datadisks/disk1/work/A99309E8/p/crossgen2/crossgen2 @/datadisks/disk1/work/A99309E8/w/A93109AA/e/baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.dll.rsp -r:/datadisks/disk1/work/A99309E8/w/A93109AA/e/baseservices/exceptions/stackoverflow/stackoverflowtester/IL-CG2/*.dll
Emitting R2R PE file: /datadisks/disk1/work/A99309E8/w/A93109AA/e/baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.dll
Running R2RDump: dotnet /datadisks/disk1/work/A99309E8/p/R2RDump/R2RDump.dll --header --sc --in /datadisks/disk1/work/A99309E8/w/A93109AA/e/baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.dll --out /datadisks/disk1/work/A99309E8/w/A93109AA/e/baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.dll.r2rdump --val
07:12:34
in ReleaseLock
in takeLock
/datadisks/disk1/work/A99309E8/p/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false -p System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true stackoverflowtester.dll ''
Running stackoverflow test(smallframe main)
"Stack overflow."
"Repeated 174501 times:"
"--------------------------------"
" at TestStackOverflow.Program.InfiniteRecursionA()"
" at TestStackOverflow.Program.InfiniteRecursionC()"
" at TestStackOverflow.Program.InfiniteRecursionB()"
"--------------------------------"
" at TestStackOverflow.Program.InfiniteRecursionA()"
" at TestStackOverflow.Program.Test(Boolean)"
" at TestStackOverflow.Program.Main(System.String[])"
""
Running stackoverflow test(largeframe main)
"Stack overflow."
"Repeated 42 times:"
"--------------------------------"
" at TestStackOverflow.Program.InfiniteRecursionB2()"
" at TestStackOverflow.Program.InfiniteRecursionA2()"
" at TestStackOverflow.Program.InfiniteRecursionC2()"
"--------------------------------"
" at TestStackOverflow.Program.InfiniteRecursionB2()"
" at TestStackOverflow.Program.InfiniteRecursionA2()"
" at TestStackOverflow.Program.Test(Boolean)"
" at TestStackOverflow.Program.Main(System.String[])"
""
Running stackoverflow test(smallframe secondary)
"Stack overflow."
"Repeated 174646 times:"
"--------------------------------"
" at TestStackOverflow.Program.InfiniteRecursionA()"
" at TestStackOverflow.Program.InfiniteRecursionC()"
" at TestStackOverflow.Program.InfiniteRecursionB()"
"--------------------------------"
" at TestStackOverflow.Program.InfiniteRecursionA()
Stack trace:
at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 141
at Xunit.Assert.True(Boolean condition, String userMessage) in /_/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 123
at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
at Program.<<Main>$>g__TestExecutor14|0_15(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)
Failed in: runtime-coreclr jitstress-random 20241103.1
Failed tests:
Error message:
Stack trace: