dotnet / runtime

.NET is a cross-platform runtime for cloud, mobile, desktop, and IoT apps.
https://docs.microsoft.com/dotnet/core/
MIT License
15.27k stars 4.73k forks source link

Test failed: new unknown error in reliability framework test #106853

Open VincentBu opened 2 months ago

VincentBu commented 2 months ago

Description

The following lines are call stacks of new unknow error. This error occurs in following cases:

  1. DATAS-linux-normal(STRESS_DYNAMIC_HEAP_COUNT enabled)
  2. DATAS-Windows-finalization(STRESS_DYNAMIC_HEAP_COUNT enabled)
Child-SP          RetAddr               Call Site
00007ef5`99ff4550 00007f37`3cf9e340     libc_so!wait4+0x57
00007ef5`99ff4580 00007f37`3cf9f5e8     libcoreclr!PROCCreateCrashDump+0x410 [/home/vbibu/runtime-datas-validate/src/coreclr/pal/src/thread/process.cpp @ 2308]
00007ef5`99ff45f0 00007f37`3cf9c99d     libcoreclr!PROCCreateCrashDumpIfEnabled+0xad8 [/home/vbibu/runtime-datas-validate/src/coreclr/pal/src/thread/process.cpp @ 15732480]
00007ef5`99ff4690 00007f37`3cf9c731 (T) libcoreclr!PROCAbort+0x2d [/home/vbibu/runtime-datas-validate/src/coreclr/pal/src/thread/process.cpp @ 2559]
00007ef5`99ff46b0 00007f37`3cf9c7c2     libcoreclr!PROCEndProcess+0x2ac [/home/vbibu/runtime-datas-validate/src/coreclr/pal/src/thread/process.cpp @ 1354]
00007ef5`99ff46e0 00007f37`3cb358a0     libcoreclr!TerminateProcess+0x82 [/home/vbibu/runtime-datas-validate/src/coreclr/pal/src/thread/process.cpp @ 1251]
00007ef5`99ff4710 00007f37`3cb36bba     libcoreclr!SafeExitProcess+0xf0 [/home/vbibu/runtime-datas-validate/src/coreclr/vm/eepolicy.cpp @ 15732480]
00007ef5`99ff4750 00007f37`3cdee287     libcoreclr!EEPolicy::HandleFatalError+0xfa [/usr/include/x86_64-linux-gnu/bits/stdint-uintn.h @ 831]
00007ef5`99ff5490 00007f37`3cdcad0a     libcoreclr!ExecutableAllocator::MapRW+0x297 [/home/vbibu/runtime-datas-validate/src/coreclr/utilcode/executableallocator.cpp @ 15732480]
(Inline Function) --------`--------     libcoreclr!ExecutableWriterHolderNoLog<void>::ExecutableWriterHolderNoLog+0x19 [/home/vbibu/runtime-datas-validate/src/coreclr/inc/executableallocator.h @ 328]
(Inline Function) --------`--------     libcoreclr!ExecutableWriterHolderNoLog<void>::AssignExecutableWriterHolder+0x19 [/home/vbibu/runtime-datas-validate/src/coreclr/inc/sbuffer.inl @ 345]
00007ef5`99ff5500 00007f37`3cdcaf19     libcoreclr!UnlockedLoaderHeap::UnlockedAllocAlignedMem_NoThrow+0x1ba [/home/vbibu/runtime-datas-validate/src/coreclr/inc/utilcode.h @ 1788]
00007ef5`99ff55b0 00007f37`3c957729     libcoreclr!UnlockedLoaderHeap::UnlockedAllocAlignedMem+0x9 [/home/vbibu/runtime-datas-validate/src/coreclr/utilcode/loaderheap.cpp @ 1859]
00007ef5`99ff55c0 00007f37`3ca63ee7     libcoreclr!LoaderHeap::RealAllocAlignedMem+0x89 [/home/vbibu/runtime-datas-validate/src/coreclr/inc/loaderheap.h @ 690]
00007ef5`99ff5630 00007f37`3ca2f6ff     libcoreclr!Precode::Allocate+0x77 [/home/vbibu/runtime-datas-validate/src/coreclr/vm/precode.cpp @ 221]
00007ef5`99ff5740 00007f37`3ca2f595     libcoreclr!MethodDesc::EnsureTemporaryEntryPointCore+0xef [/home/vbibu/runtime-datas-validate/src/coreclr/vm/method.cpp @ 15732480]
00007ef5`99ff5820 00007f37`3c9dc9b5     libcoreclr!MethodDesc::SetTemporaryEntryPoint+0x35 [/home/vbibu/runtime-datas-validate/src/coreclr/vm/method.cpp @ 2713]
00007ef5`99ff5840 00007f37`3c9ddb7f     libcoreclr!ILStubCache::CreateNewMethodDesc+0xa5 [/home/vbibu/runtime-datas-validate/src/coreclr/vm/ilstubcache.cpp @ 15732480]
00007ef5`99ff5990 00007f37`3cb299e4     libcoreclr!ILStubCache::GetStubMethodDesc+0x33f [/home/vbibu/runtime-datas-validate/src/coreclr/vm/ilstubcache.cpp @ 549]
(Inline Function) --------`--------     libcoreclr!<unnamed-namespace>::GetStubMethodDesc+0x86 [/home/vbibu/runtime-datas-validate/src/coreclr/vm/dllimport.cpp @ 4204]
(Inline Function) --------`--------     libcoreclr!<unnamed-namespace>::ILStubCreatorHelper::GetStubMethodDesc+0xc3 [/home/vbibu/runtime-datas-validate/src/coreclr/inc/corinfo.h @ 4787]
00007ef5`99ff5cd0 00007f37`3cb28fe4     libcoreclr!<unnamed-namespace>::CreateInteropILStub+0x704 [/home/vbibu/runtime-datas-validate/src/coreclr/inc/corinfo.h @ 4922]
00007ef5`99ff6310 00007f37`3cb2cd44     libcoreclr!NDirect::CreateCLRToNativeILStub+0x344 [/home/vbibu/runtime-datas-validate/src/coreclr/vm/dllimport.cpp @ 5220]
(Inline Function) --------`--------     libcoreclr!NDirect::CreateCLRToNativeILStub+0x95 [/home/vbibu/runtime-datas-validate/src/coreclr/vm/dllimport.cpp @ 5453]
(Inline Function) --------`--------     libcoreclr!NDirect::GetILStubMethodDesc+0x181 [/home/vbibu/runtime-datas-validate/src/coreclr/inc/corinfo.h @ 5473]
00007ef5`99ff6440 00007f37`3cb2d3cb     libcoreclr!NDirect::GetStubForILStub+0x294 [/home/vbibu/runtime-datas-validate/src/coreclr/inc/corinfo.h @ 5600]
00007ef5`99ff6530 00007f37`3ca6d244     libcoreclr!GetStubForInteropMethod+0x2eb [/home/vbibu/runtime-datas-validate/src/coreclr/vm/dllimport.cpp @ 15732480]
00007ef5`99ff65d0 00007f37`3ca6c33d     libcoreclr!MethodDesc::DoPrestub+0x8b4 [/home/vbibu/runtime-datas-validate/src/coreclr/vm/prestub.cpp @ 15732480]
00007ef5`99ff66b0 00007f37`3cd4b690     libcoreclr!PreStubWorker+0x77d [/home/vbibu/runtime-datas-validate/src/coreclr/vm/prestub.cpp @ 15732480]
00007ef5`99ff67e0 00007f36`c096440c     libcoreclr!ThePreStub+0x64 [/home/vbibu/runtime-datas-validate/src/coreclr/vm/amd64/theprestubamd64.S @ 18]
00007ef5`99ff68e0 00007f36`c0964bc3     0x00007f36`c096440c
00007ef5`99ff69f0 00007f36`c0969dc0     0x00007f36`c0964bc3
00007ef5`99ff6b00 00007f37`3cd4a674     0x00007f36`c0969dc0
00007ef5`99ff6b20 00007f37`3caed7c0     libcoreclr!CallDescrWorkerInternal+0x7c [/home/vbibu/runtime-datas-validate/src/coreclr/vm/amd64/calldescrworkeramd64.S @ 74]
00007ef5`99ff6b40 00007f37`3caedac9     libcoreclr!CallDescrWorkerWithHandler+0x140 [/home/vbibu/runtime-datas-validate/src/coreclr/inc/check.h @ 65]
00007ef5`99ff6b90 00007f37`3cc670c7     libcoreclr!DispatchCallSimple+0xc9 [/home/vbibu/runtime-datas-validate/src/coreclr/vm/callhelpers.cpp @ 15732480]
00007ef5`99ff6c10 00007f37`3cc676c4 (T) libcoreclr!DispatchManagedException+0x287 [/home/vbibu/runtime-datas-validate/src/coreclr/vm/exceptionhandling.cpp @ 15732480]
00007ef5`99ff98e0 00007f37`3c9b78c8     libcoreclr!DispatchManagedException+0x3f [/home/vbibu/runtime-datas-validate/src/coreclr/vm/exceptionhandling.cpp @ 5721]
00007ef5`99ffa540 00007f37`3cb0e5b5     libcoreclr!UnwindAndContinueRethrowHelperAfterCatch+0xe8 [/home/vbibu/runtime-datas-validate/src/coreclr/vm/excep.cpp @ 15732480]
00007ef5`99ffa590 00007f36`c0669e18     libcoreclr!ThreadNative_Start+0x275 [/home/vbibu/runtime-datas-validate/src/coreclr/vm/comsynchronizable.cpp @ 15732480]
00007ef5`99ffa640 00007f36`c097d2d7     0x00007f36`c0669e18
00007ef5`99ffa6e0 00007f36`c08b02b9     0x00007f36`c097d2d7
00007ef5`99ffa720 00007f36`c0673bc4     0x00007f36`c08b02b9
00007ef5`99ffa780 00007f36`c0679d7d     0x00007f36`c0673bc4
00007ef5`99ffa7f0 00007f36`c0679779     0x00007f36`c0679d7d
00007ef5`99ffa880 00007f36`c06792e0     0x00007f36`c0679779
00007ef5`99ffa8d0 00007f36`c0678f00     0x00007f36`c06792e0
00007ef5`99ffa950 00007f36`bd9a56a5     0x00007f36`c0678f00
00007ef5`99ffa9e0 00007f37`3cd4a674     System_Private_CoreLib+0x2956a5
00007ef5`99ffaab0 00007f37`3caed7c0     libcoreclr!CallDescrWorkerInternal+0x7c [/home/vbibu/runtime-datas-validate/src/coreclr/vm/amd64/calldescrworkeramd64.S @ 74]
00007ef5`99ffaad0 00007f37`3caedac9     libcoreclr!CallDescrWorkerWithHandler+0x140 [/home/vbibu/runtime-datas-validate/src/coreclr/inc/check.h @ 65]
00007ef5`99ffab20 00007f37`3cb0ddf5     libcoreclr!DispatchCallSimple+0xc9 [/home/vbibu/runtime-datas-validate/src/coreclr/vm/callhelpers.cpp @ 15732480]
00007ef5`99ffaba0 00007f37`3caa5883     libcoreclr!ThreadNative::KickOffThread_Worker+0x125 [/home/vbibu/runtime-datas-validate/src/coreclr/vm/comsynchronizable.cpp @ 15732480]
(Inline Function) --------`--------     libcoreclr!ManagedThreadBase_DispatchInner+0x7 [/home/vbibu/runtime-datas-validate/src/coreclr/vm/threads.cpp @ 7110]
(Inline Function) --------`--------     libcoreclr!ManagedThreadBase_DispatchMiddle+0x112 [/home/vbibu/runtime-datas-validate/src/coreclr/vm/threads.h @ 7154]
(Inline Function) --------`--------     libcoreclr!<unnamed-class>::operator()+0x116 [/home/vbibu/runtime-datas-validate/src/coreclr/vm/threads.h @ 7312]
(Inline Function) --------`--------     libcoreclr!<unnamed-class>::operator()+0x190 [/home/vbibu/runtime-datas-validate/src/coreclr/vm/threads.h @ 7314]
00007ef5`99ffac10 00007f37`3caa605d     libcoreclr!ManagedThreadBase_DispatchOuter+0x253 [/home/vbibu/runtime-datas-validate/src/coreclr/vm/threads.h @ 7338]
(Inline Function) --------`--------     libcoreclr!ManagedThreadBase_FullTransition+0x18 [/home/vbibu/runtime-datas-validate/src/coreclr/vm/threads.cpp @ 7358]
00007ef5`99ffad70 00007f37`3cb0df90     libcoreclr!ManagedThreadBase::KickOff+0x2d [/home/vbibu/runtime-datas-validate/src/coreclr/vm/threads.h @ 7393]
00007ef5`99ffada0 00007f37`3cfa2652     libcoreclr!ThreadNative::KickOffThread+0x160 [/home/vbibu/runtime-datas-validate/src/coreclr/vm/comsynchronizable.cpp @ 230]
00007ef5`99ffae20 00007f37`3d147134     libcoreclr!CorUnix::CPalThread::ThreadEntry+0x3c2 [/home/vbibu/runtime-datas-validate/src/coreclr/pal/src/thread/thread.cpp @ 1744]
00007ef5`99ffaee0 00007f37`3d1c77dc     libc_so!pthread_condattr_setpshared+0x4d4
00007ef5`99ffaf80 ffffffff`ffffffff     libc_so!_xmknodat+0x23c
00007ef5`99ffaf88 00000000`00000000     0xffffffff`ffffffff

Occurrences

DATAS-linux-normal

Attributed Error Count/Total(percentage%) Dump Name Log Name(Call Stacks of All Threads) Source File Path Line Number
Unknown error 2/10(20%) stress_3.dmp stress_3_callstack_allthreads.txt
stress_7.dmp stress_7_callstack_allthreads.txt

DATAS-Windows-finalization

Attributed Error Count/Total(percentage%) Dump Name Log Name(Call Stacks of All Threads) Source File Path Line Number
Unknown error 4/5(80%) stress_1c64_2024-08-20_14-50-43-430_37cc.dmp stress_1c64_2024-08-20_14-50-43-430_37cc_callstack_allthreads.txt
stress_1c6c_2024-08-20_14-50-47-873_4d20.dmp stress_1c6c_2024-08-20_14-50-47-873_4d20_callstack_allthreads.txt
stress_26e8_2024-08-20_14-50-58-833_071c.dmp stress_26e8_2024-08-20_14-50-58-833_071c_callstack_allthreads.txt
stress_54a4_2024-08-20_14-50-52-209_3674.dmp stress_54a4_2024-08-20_14-50-52-209_3674_callstack_allthreads.txt
dotnet-policy-service[bot] commented 2 months ago

Tagging subscribers to this area: @dotnet/gc See info in area-owners.md if you want to be subscribed.

mrsharm commented 1 day ago

@VincentBu, has this issue repro'd since? I don't think I saw this in the latest set of runs. If it hasn't, we should close this issue.