search

dotnet / runtime

.NET is a cross-platform runtime for cloud, mobile, desktop, and IoT apps.
https://docs.microsoft.com/dotnet/core/
MIT License
15.24k stars 4.73k forks source link

CI failure: Native mono arm64 crash in System.Net.Requests.Tests #75368

Closed carlossanlop closed 2 years ago

carlossanlop commented 2 years ago

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=8084 Build error leg or test failing: Libraries Test Run release mono Linux arm64 Debug / Send to Helix Pull request: https://github.com/dotnet/runtime/pull/75222

Error Message

Fill the error message using known issues guidance.

{
  "ErrorMessage": "(NETCORE_ENGINEERING_TELEMETRY=Test) Work item System.Net.Requests.Tests in job",
  "BuildRetry": false
}

Job results: https://dev.azure.com/dnceng-public/public/_build/results?buildId=8084&view=logs&j=3f95ca23-483b-5dc9-4b05-6bd24fb925c2&t=0c1dd9d1-4ef7-54d5-2d62-e4ab330605ca&l=72 Failure log: https://helixre107v0xdeko0k025g8.blob.core.windows.net/dotnet-runtime-refs-pull-75222-merge-15abc173720b496cad/System.Net.Requests.Tests/1/console.ff9bd480.log?helixlogtype=result

Callstack (in case log file is deleted) ``` ----- start Thu Sep 8 00:56:53 UTC 2022 =============== To repro directly: ===================================================== pushd . /root/helix/work/correlation/dotnet exec --runtimeconfig System.Net.Requests.Tests.runtimeconfig.json --depsfile System.Net.Requests.Tests.deps.json xunit.console.dll System.Net.Requests.Tests.dll -xml testResults.xml -nologo -nocolor -notrait category=IgnoreForCI -notrait category=OuterLoop -notrait category=failing popd =========================================================================================================== /root/helix/work/workitem/e /root/helix/work/workitem/e Discovering: System.Net.Requests.Tests (method display = ClassAndMethod, method display options = None) Discovered: System.Net.Requests.Tests (found 349 of 367 test cases) Starting: System.Net.Requests.Tests (parallel test collections = on, max threads = 6) System.Net.Tests.FtpWebRequestTest.Ftp_AppendFile [SKIP] Condition(s) not met: "LocalServerAvailable" System.Net.Tests.FtpWebRequestTest.Ftp_RenameFile [SKIP] Condition(s) not met: "LocalServerAvailable" System.Net.Tests.FtpWebRequestTest.Ftp_LargeFile [SKIP] Condition(s) not met: "LocalServerAvailable" System.Net.Tests.FtpWebRequestTest.Ftp_CreateAndDelete [SKIP] Condition(s) not met: "LocalServerAvailable" System.Net.Tests.FtpWebRequestTest.Ftp_RenameFileSubDir_Success [SKIP] Condition(s) not met: "LocalServerAvailable" System.Net.Tests.FtpWebRequestTest.Ftp_MakeAndRemoveDir_Success [SKIP] Condition(s) not met: "LocalServerAvailable" Process terminated. Error while reaping child. errno = 10 ================================================================= Native Crash Reporting ================================================================= Got a SIGABRT while executing native code. This usually indicates a fatal error in the mono runtime or one of the native libraries used by your application. ================================================================= ================================================================= Native stacktrace: ================================================================= 0x7f9fab3e70 - Unknown ================================================================= External Debugger Dump: ================================================================= [New LWP 25] [New LWP 26] [New LWP 27] [New LWP 28] [New LWP 31] [New LWP 32] [New LWP 33] [New LWP 34] [New LWP 35] [New LWP 36] [New LWP 37] [New LWP 38] [New LWP 39] [New LWP 40] [New LWP 41] [New LWP 42] [New LWP 43] [New LWP 44] [New LWP 47] [New LWP 57] [New LWP 58] [New LWP 63] [New LWP 65] [New LWP 67] [New LWP 68] [New LWP 69] [New LWP 70] [New LWP 71] [New LWP 72] [New LWP 74] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/aarch64-linux-gnu/libthread_db.so.1". 0x0000007fa00db2a4 in futex_wait_cancelable (private=, expected=0, futex_word=0x557e0be89c) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 88 ../sysdeps/unix/sysv/linux/futex-internal.h: No such file or directory. Id Target Id Frame * 1 Thread 0x7fa0119ff0 (LWP 24) "dotnet" 0x0000007fa00db2a4 in futex_wait_cancelable (private=, expected=0, futex_word=0x557e0be89c) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 2 Thread 0x7f9efff1c0 (LWP 25) "SGen worker" 0x0000007fa00db2a4 in futex_wait_cancelable (private=, expected=0, futex_word=0x7f9fb747b8 ) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 3 Thread 0x7f9d3b71c0 (LWP 26) "dotnet" 0x0000007f9fdb5ef8 in __GI___poll (fds=0x7f98003af0, nfds=548137295368, timeout=) at ../sysdeps/unix/sysv/linux/poll.c:41 4 Thread 0x7f9d1b61c0 (LWP 27) "Finalizer" 0x0000007fa00dda40 in futex_abstimed_wait_cancelable (private=0, abstime=0x0, expected=0, futex_word=0x7f9fb657d8 ) at ../sysdeps/unix/sysv/linux/futex-internal.h:205 5 Thread 0x7f962491c0 (LWP 28) "dotnet" 0x0000007fa00dfd5c in __waitpid (pid=, stat_loc=0x7f962462b0, options=) at ../sysdeps/unix/sysv/linux/waitpid.c:30 6 Thread 0x7f95f2e1c0 (LWP 31) ".NET Long Runni" 0x0000007fa00db2a4 in futex_wait_cancelable (private=, expected=0, futex_word=0x7f8411a378) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 7 Thread 0x7f9612f1c0 (LWP 32) ".NET ThreadPool" 0x0000007fa00db5bc in futex_reltimed_wait_cancelable (private=, reltime=0x7f00000000, expected=0, futex_word=0x7f8802d138) at ../sysdeps/unix/sysv/linux/futex-internal.h:142 8 Thread 0x7f94ccb1c0 (LWP 33) ".NET ThreadPool" 0x0000007fa00db5bc in futex_reltimed_wait_cancelable (private=, reltime=0x7f00000000, expected=0, futex_word=0x7f7c020e28) at ../sysdeps/unix/sysv/linux/futex-internal.h:142 9 Thread 0x7f94c7a1c0 (LWP 34) ".NET ThreadPool" 0x0000007fa00db5bc in futex_reltimed_wait_cancelable (private=, reltime=0x0, expected=0, futex_word=0x7f44033628) at ../sysdeps/unix/sysv/linux/futex-internal.h:142 10 Thread 0x7f94a101c0 (LWP 35) ".NET Long Runni" 0x0000007fa00db5bc in futex_reltimed_wait_cancelable (private=, reltime=0x7f00000000, expected=0, futex_word=0x7f7400848c) at ../sysdeps/unix/sysv/linux/futex-internal.h:142 11 Thread 0x7f9480f1c0 (LWP 36) ".NET Long Runni" 0x0000007fa00db2a4 in futex_wait_cancelable (private=, expected=0, futex_word=0x557d699cf0) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 12 Thread 0x7f9460e1c0 (LWP 37) ".NET Long Runni" 0x0000007fa00db5bc in futex_reltimed_wait_cancelable (private=, reltime=0x7f00000000, expected=0, futex_word=0x7f6c014b5c) at ../sysdeps/unix/sysv/linux/futex-internal.h:142 13 Thread 0x7f9440d1c0 (LWP 38) ".NET Long Runni" 0x0000007fa00de668 in __lll_lock_wait (futex=futex@entry=0x7f9fb7c120 , private=0) at lowlevellock.c:43 14 Thread 0x7f9420c1c0 (LWP 39) ".NET Long Runni" 0x0000007fa00de690 in __lll_lock_wait (futex=0x7f9fb646b0 , private=0) at lowlevellock.c:46 15 Thread 0x7f6bfff1c0 (LWP 40) ".NET Long Runni" 0x0000007fa00db5bc in futex_reltimed_wait_cancelable (private=, reltime=0x7f00000000, expected=0, futex_word=0x7f600039b8) at ../sysdeps/unix/sysv/linux/futex-internal.h:142 16 Thread 0x7f6b9c41c0 (LWP 41) ".NET ThreadPool" 0x0000007fa00db5bc in futex_reltimed_wait_cancelable (private=, reltime=0x7f00000000, expected=0, futex_word=0x7f580fd3f8) at ../sysdeps/unix/sysv/linux/futex-internal.h:142 17 Thread 0x7f6b7731c0 (LWP 42) ".NET Sockets" 0x0000007f9fdbf1e0 in __GI_epoll_pwait (epfd=, events=0x7f6405e9d0, maxevents=, timeout=-1664380165, set=0x0) at ../sysdeps/unix/sysv/linux/epoll_pwait.c:42 18 Thread 0x7f6b5521c0 (LWP 43) ".NET ThreadPool" 0x0000007fa00dda40 in futex_abstimed_wait_cancelable (private=0, abstime=0x0, expected=0, futex_word=0x7f9fb6a890 ) at ../sysdeps/unix/sysv/linux/futex-internal.h:205 19 Thread 0x7f6b3311c0 (LWP 44) ".NET ThreadPool" 0x0000007fa00de690 in __lll_lock_wait (futex=futex@entry=0x7f9fb7c120 , private=0) at lowlevellock.c:46 20 Thread 0x7f6b0481c0 (LWP 47) ".NET Timer" 0x0000007fa00de690 in __lll_lock_wait (futex=0x7f9fb646b0 , private=0) at lowlevellock.c:46 21 Thread 0x7f6a8841c0 (LWP 57) ".NET Long Runni" syscall () at ../sysdeps/unix/sysv/linux/aarch64/syscall.S:38 22 Thread 0x7f6a0831c0 (LWP 58) ".NET Long Runni" 0x0000007f9fd915e8 in __GI___nanosleep (requested_time=0x7f6a081ef8, requested_time@entry=0x7f6a081f18, remaining=0x7f6a081ef8, remaining@entry=0x7f6a081f18) at ../sysdeps/unix/sysv/linux/nanosleep.c:28 23 Thread 0x7f698821c0 (LWP 63) ".NET Long Runni" 0x0000007f9fdbf1e0 in __GI_epoll_pwait (epfd=, events=events@entry=0x7f69881858, maxevents=maxevents@entry=16, timeout=1770527136, timeout@entry=-1, set=set@entry=0x0) at ../sysdeps/unix/sysv/linux/epoll_pwait.c:42 24 Thread 0x7f688801c0 (LWP 65) ".NET Long Runni" 0x0000007f9fdbf1e0 in __GI_epoll_pwait (epfd=, events=events@entry=0x7f6887f858, maxevents=maxevents@entry=16, timeout=1753741728, timeout@entry=-1, set=set@entry=0x0) at ../sysdeps/unix/sysv/linux/epoll_pwait.c:42 25 Thread 0x7f4f7fe1c0 (LWP 67) ".NET Long Runni" 0x0000007f9fdbf1e0 in __GI_epoll_pwait (epfd=, events=events@entry=0x7f4f7fd858, maxevents=maxevents@entry=16, timeout=1333778848, timeout@entry=-1, set=set@entry=0x0) at ../sysdeps/unix/sysv/linux/epoll_pwait.c:42 26 Thread 0x7f4effd1c0 (LWP 68) ".NET Long Runni" 0x0000007f9fdbf1e0 in __GI_epoll_pwait (epfd=, events=events@entry=0x7f4effc858, maxevents=maxevents@entry=16, timeout=1325386144, timeout@entry=-1, set=set@entry=0x0) at ../sysdeps/unix/sysv/linux/epoll_pwait.c:42 27 Thread 0x7f4e7fc1c0 (LWP 69) ".NET Long Runni" 0x0000007fa00db2a4 in futex_wait_cancelable (private=, expected=0, futex_word=0x7f78172628) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 28 Thread 0x7f4dffb1c0 (LWP 70) ".NET Long Runni" 0x0000007fa00db2a4 in futex_wait_cancelable (private=, expected=0, futex_word=0x7f78172d78) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 29 Thread 0x7f4d7fa1c0 (LWP 71) ".NET Long Runni" 0x0000007fa00db2a4 in futex_wait_cancelable (private=, expected=0, futex_word=0x7f781734c8) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 30 Thread 0x7f4cff91c0 (LWP 72) ".NET Long Runni" 0x0000007fa00db2a4 in futex_wait_cancelable (private=, expected=0, futex_word=0x7f78173c18) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 31 Thread 0x7f4c7f81c0 (LWP 74) ".NET ThreadPool" 0x0000007fa00de690 in __lll_lock_wait (futex=0x7f9fb646b0 , private=0) at lowlevellock.c:46 Thread 31 (Thread 0x7f4c7f81c0 (LWP 74)): #0 0x0000007fa00de690 in __lll_lock_wait (futex=0x7f9fb646b0 , private=0) at lowlevellock.c:46 #1 0x0000007fa00d77d8 in __GI___pthread_mutex_lock (mutex=0x7f9fb646b0 ) at pthread_mutex_lock.c:115 #2 0x0000007f9f8e4760 in mono_os_mutex_lock (mutex=0x7f9fb646b0 ) at /__w/1/s/src/mono/mono/mini/../../mono/utils/mono-os-mutex.h:105 #3 mono_coop_mutex_lock (mutex=) at /__w/1/s/src/mono/mono/mini/../../mono/utils/mono-coop-mutex.h:57 #4 mono_loader_lock () at /__w/1/s/src/mono/mono/metadata/loader.c:136 #5 0x0000007f9f9d7408 in mono_jit_compile_method_inner (method=0x7f5004b2f0, opt=, error=0x7f4c7f7208) at /__w/1/s/src/mono/mono/mini/mini.c:4173 #6 0x0000007f9f9dbd98 in mono_jit_compile_method_with_opt (method=0x7f5004b2f0, opt=374417919, jit_only=0, error=) at /__w/1/s/src/mono/mono/mini/mini-runtime.c:2707 #7 jit_compile_method_with_opt_cb (arg=) at /__w/1/s/src/mono/mono/mini/mini-runtime.c:2762 #8 jit_compile_method_with_opt (params=) at /__w/1/s/src/mono/mono/mini/mini-runtime.c:2778 #9 0x0000007f9f9db210 in mono_jit_compile_method (method=, error=0x7f4c7f7208) at /__w/1/s/src/mono/mono/mini/mini-runtime.c:2797 #10 0x0000007f9fa75614 in mono_delegate_trampoline (regs=, code=, arg=0x7f7817c590, tramp=) at /__w/1/s/src/mono/mono/mini/mini-trampolines.c:1100 #11 0x0000007f9f64d204 in ?? () #12 0x0000007f9f3711b8 in ?? () #13 0x0000007f6acca438 in ?? () Backtrace stopped: not enough registers or memory available to unwind further Thread 30 (Thread 0x7f4cff91c0 (LWP 72)): #0 0x0000007fa00db2a4 in futex_wait_cancelable (private=, expected=0, futex_word=0x7f78173c18) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x7f78173bc0, cond=0x7f78173bf0) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=cond@entry=0x7f78173bf0, mutex=mutex@entry=0x7f78173bc0) at pthread_cond_wait.c:655 #3 0x0000007f6ab9918c in CxPlatInternalEventWaitForever (Event=0x7f78173bc0) at /tmp/msquic/src/msquic/src/inc/quic_platform_posix.h:829 #4 QuicWorkerThread (Context=0x7f78173af0) at /tmp/msquic/src/msquic/src/core/worker.c:737 #5 0x0000007fa00d5088 in start_thread (arg=0x7f94808b3f) at pthread_create.c:463 #6 0x0000007f9fdbf0cc in thread_start () at ../sysdeps/unix/sysv/linux/aarch64/clone.S:78 Thread 29 (Thread 0x7f4d7fa1c0 (LWP 71)): #0 0x0000007fa00db2a4 in futex_wait_cancelable (private=, expected=0, futex_word=0x7f781734c8) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x7f78173470, cond=0x7f781734a0) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=cond@entry=0x7f781734a0, mutex=mutex@entry=0x7f78173470) at pthread_cond_wait.c:655 #3 0x0000007f6ab9918c in CxPlatInternalEventWaitForever (Event=0x7f78173470) at /tmp/msquic/src/msquic/src/inc/quic_platform_posix.h:829 #4 QuicWorkerThread (Context=0x7f781733a0) at /tmp/msquic/src/msquic/src/core/worker.c:737 #5 0x0000007fa00d5088 in start_thread (arg=0x7f94808b3f) at pthread_create.c:463 #6 0x0000007f9fdbf0cc in thread_start () at ../sysdeps/unix/sysv/linux/aarch64/clone.S:78 Thread 28 (Thread 0x7f4dffb1c0 (LWP 70)): #0 0x0000007fa00db2a4 in futex_wait_cancelable (private=, expected=0, futex_word=0x7f78172d78) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x7f78172d20, cond=0x7f78172d50) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=cond@entry=0x7f78172d50, mutex=mutex@entry=0x7f78172d20) at pthread_cond_wait.c:655 #3 0x0000007f6ab9918c in CxPlatInternalEventWaitForever (Event=0x7f78172d20) at /tmp/msquic/src/msquic/src/inc/quic_platform_posix.h:829 #4 QuicWorkerThread (Context=0x7f78172c50) at /tmp/msquic/src/msquic/src/core/worker.c:737 #5 0x0000007fa00d5088 in start_thread (arg=0x7f94808b3f) at pthread_create.c:463 #6 0x0000007f9fdbf0cc in thread_start () at ../sysdeps/unix/sysv/linux/aarch64/clone.S:78 Thread 27 (Thread 0x7f4e7fc1c0 (LWP 69)): #0 0x0000007fa00db2a4 in futex_wait_cancelable (private=, expected=0, futex_word=0x7f78172628) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x7f781725d0, cond=0x7f78172600) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=cond@entry=0x7f78172600, mutex=mutex@entry=0x7f781725d0) at pthread_cond_wait.c:655 #3 0x0000007f6ab9918c in CxPlatInternalEventWaitForever (Event=0x7f781725d0) at /tmp/msquic/src/msquic/src/inc/quic_platform_posix.h:829 #4 QuicWorkerThread (Context=0x7f78172500) at /tmp/msquic/src/msquic/src/core/worker.c:737 #5 0x0000007fa00d5088 in start_thread (arg=0x7f94808b3f) at pthread_create.c:463 #6 0x0000007f9fdbf0cc in thread_start () at ../sysdeps/unix/sysv/linux/aarch64/clone.S:78 Thread 26 (Thread 0x7f4effd1c0 (LWP 68)): #0 0x0000007f9fdbf1e0 in __GI_epoll_pwait (epfd=, events=events@entry=0x7f4effc858, maxevents=maxevents@entry=16, timeout=1325386144, timeout@entry=-1, set=set@entry=0x0) at ../sysdeps/unix/sysv/linux/epoll_pwait.c:42 #1 0x0000007f9fdbf330 in epoll_wait (epfd=, events=events@entry=0x7f4effc858, maxevents=maxevents@entry=16, timeout=timeout@entry=-1) at ../sysdeps/unix/sysv/linux/epoll_wait.c:32 #2 0x0000007f6abe63dc in CxPlatDataPathRunEC (Context=Context@entry=0x7f780aaf70, CurThreadId=, WaitTime=WaitTime@entry=4294967295) at /tmp/msquic/src/msquic/src/platform/datapath_epoll.c:2769 #3 0x0000007f6abecb70 in CxPlatWorkerThread (Context=0x7f780aaee0) at /tmp/msquic/src/msquic/src/platform/platform_worker.c:317 #4 0x0000007fa00d5088 in start_thread (arg=0x7f94808b8f) at pthread_create.c:463 #5 0x0000007f9fdbf0cc in thread_start () at ../sysdeps/unix/sysv/linux/aarch64/clone.S:78 Thread 25 (Thread 0x7f4f7fe1c0 (LWP 67)): #0 0x0000007f9fdbf1e0 in __GI_epoll_pwait (epfd=, events=events@entry=0x7f4f7fd858, maxevents=maxevents@entry=16, timeout=1333778848, timeout@entry=-1, set=set@entry=0x0) at ../sysdeps/unix/sysv/linux/epoll_pwait.c:42 #1 0x0000007f9fdbf330 in epoll_wait (epfd=, events=events@entry=0x7f4f7fd858, maxevents=maxevents@entry=16, timeout=timeout@entry=-1) at ../sysdeps/unix/sysv/linux/epoll_wait.c:32 #2 0x0000007f6abe63dc in CxPlatDataPathRunEC (Context=Context@entry=0x7f780aaed0, CurThreadId=, WaitTime=WaitTime@entry=4294967295) at /tmp/msquic/src/msquic/src/platform/datapath_epoll.c:2769 #3 0x0000007f6abecb70 in CxPlatWorkerThread (Context=0x7f780aae40) at /tmp/msquic/src/msquic/src/platform/platform_worker.c:317 #4 0x0000007fa00d5088 in start_thread (arg=0x7f94808b8f) at pthread_create.c:463 #5 0x0000007f9fdbf0cc in thread_start () at ../sysdeps/unix/sysv/linux/aarch64/clone.S:78 Thread 24 (Thread 0x7f688801c0 (LWP 65)): #0 0x0000007f9fdbf1e0 in __GI_epoll_pwait (epfd=, events=events@entry=0x7f6887f858, maxevents=maxevents@entry=16, timeout=1753741728, timeout@entry=-1, set=set@entry=0x0) at ../sysdeps/unix/sysv/linux/epoll_pwait.c:42 #1 0x0000007f9fdbf330 in epoll_wait (epfd=, events=events@entry=0x7f6887f858, maxevents=maxevents@entry=16, timeout=timeout@entry=-1) at ../sysdeps/unix/sysv/linux/epoll_wait.c:32 #2 0x0000007f6abe63dc in CxPlatDataPathRunEC (Context=Context@entry=0x7f780aae30, CurThreadId=, WaitTime=WaitTime@entry=4294967295) at /tmp/msquic/src/msquic/src/platform/datapath_epoll.c:2769 #3 0x0000007f6abecb70 in CxPlatWorkerThread (Context=0x7f780aada0) at /tmp/msquic/src/msquic/src/platform/platform_worker.c:317 #4 0x0000007fa00d5088 in start_thread (arg=0x7f94808b8f) at pthread_create.c:463 #5 0x0000007f9fdbf0cc in thread_start () at ../sysdeps/unix/sysv/linux/aarch64/clone.S:78 Thread 23 (Thread 0x7f698821c0 (LWP 63)): #0 0x0000007f9fdbf1e0 in __GI_epoll_pwait (epfd=, events=events@entry=0x7f69881858, maxevents=maxevents@entry=16, timeout=1770527136, timeout@entry=-1, set=set@entry=0x0) at ../sysdeps/unix/sysv/linux/epoll_pwait.c:42 #1 0x0000007f9fdbf330 in epoll_wait (epfd=, events=events@entry=0x7f69881858, maxevents=maxevents@entry=16, timeout=timeout@entry=-1) at ../sysdeps/unix/sysv/linux/epoll_wait.c:32 #2 0x0000007f6abe63dc in CxPlatDataPathRunEC (Context=Context@entry=0x7f780aad90, CurThreadId=, WaitTime=WaitTime@entry=4294967295) at /tmp/msquic/src/msquic/src/platform/datapath_epoll.c:2769 #3 0x0000007f6abecb70 in CxPlatWorkerThread (Context=0x7f780aad00) at /tmp/msquic/src/msquic/src/platform/platform_worker.c:317 #4 0x0000007fa00d5088 in start_thread (arg=0x7f94808b8f) at pthread_create.c:463 #5 0x0000007f9fdbf0cc in thread_start () at ../sysdeps/unix/sysv/linux/aarch64/clone.S:78 Thread 22 (Thread 0x7f6a0831c0 (LWP 58)): #0 0x0000007f9fd915e8 in __GI___nanosleep (requested_time=0x7f6a081ef8, requested_time@entry=0x7f6a081f18, remaining=0x7f6a081ef8, remaining@entry=0x7f6a081f18) at ../sysdeps/unix/sysv/linux/nanosleep.c:28 #1 0x0000007f9fd9143c in __sleep (seconds=0) at ../sysdeps/posix/sleep.c:55 #2 0x0000007f6a8f95c4 in ?? () from /usr/lib/aarch64-linux-gnu/liblttng-ust.so.0 #3 0x0000007f94807770 in ?? () Backtrace stopped: previous frame identical to this frame (corrupt stack?) Thread 21 (Thread 0x7f6a8841c0 (LWP 57)): #0 syscall () at ../sysdeps/unix/sysv/linux/aarch64/syscall.S:38 #1 0x0000007f6a8f9220 in ?? () from /usr/lib/aarch64-linux-gnu/liblttng-ust.so.0 #2 0x0000007f94807770 in ?? () Backtrace stopped: previous frame identical to this frame (corrupt stack?) Thread 20 (Thread 0x7f6b0481c0 (LWP 47)): #0 0x0000007fa00de690 in __lll_lock_wait (futex=0x7f9fb646b0 , private=0) at lowlevellock.c:46 #1 0x0000007fa00d77d8 in __GI___pthread_mutex_lock (mutex=0x7f9fb646b0 ) at pthread_mutex_lock.c:115 #2 0x0000007f9f8e4760 in mono_os_mutex_lock (mutex=0x7f9fb646b0 ) at /__w/1/s/src/mono/mono/mini/../../mono/utils/mono-os-mutex.h:105 #3 mono_coop_mutex_lock (mutex=) at /__w/1/s/src/mono/mono/mini/../../mono/utils/mono-coop-mutex.h:57 #4 mono_loader_lock () at /__w/1/s/src/mono/mono/metadata/loader.c:136 #5 0x0000007f9f9d7408 in mono_jit_compile_method_inner (method=0x7f6011d838, opt=, error=0x7f6b0473a0) at /__w/1/s/src/mono/mono/mini/mini.c:4173 #6 0x0000007f9f9dbd98 in mono_jit_compile_method_with_opt (method=0x7f6011d838, opt=374417919, jit_only=0, error=) at /__w/1/s/src/mono/mono/mini/mini-runtime.c:2707 #7 jit_compile_method_with_opt_cb (arg=) at /__w/1/s/src/mono/mono/mini/mini-runtime.c:2762 #8 jit_compile_method_with_opt (params=) at /__w/1/s/src/mono/mono/mini/mini-runtime.c:2778 #9 0x0000007f9f9db210 in mono_jit_compile_method (method=, error=0x7f6b0473a0) at /__w/1/s/src/mono/mono/mini/mini-runtime.c:2797 #10 0x0000007f9fa74c6c in common_call_trampoline (regs=0x7f6b047430, code=0x7f6b056e24 "\017", m=0x7f6011d838, vt=0x0, vtable_slot=, error=0x7f6b0473a0) at /__w/1/s/src/mono/mono/mini/mini-trampolines.c:618 #11 0x0000007f9fa7478c in mono_magic_trampoline (regs=0x7f6b047430, code=0x7f6b056e24 "\017", arg=0x7f6011d838, tramp=) at /__w/1/s/src/mono/mono/mini/mini-trampolines.c:759 #12 0x0000007f9f64c304 in ?? () #13 0x0000007f9e35723b in ?? () #14 0x0000007f9f270468 in ?? () Backtrace stopped: not enough registers or memory available to unwind further Thread 19 (Thread 0x7f6b3311c0 (LWP 44)): #0 0x0000007fa00de690 in __lll_lock_wait (futex=futex@entry=0x7f9fb7c120 , private=0) at lowlevellock.c:46 #1 0x0000007fa00d77c8 in __GI___pthread_mutex_lock (mutex=0x7f9fb7c120 ) at pthread_mutex_lock.c:80 #2 0x0000007f9f990634 in mono_os_mutex_lock (mutex=) at /__w/1/s/src/mono/mono/mini/../../mono/utils/mono-os-mutex.h:105 #3 mono_coop_mutex_lock (mutex=) at /__w/1/s/src/mono/mono/mini/../../mono/utils/mono-coop-mutex.h:57 #4 sgen_gc_lock () at /__w/1/s/src/mono/mono/sgen/sgen-gc.c:3937 #5 0x0000007f9f985084 in sgen_alloc_obj_pinned (vtable=0x557d71b900, size=32) at /__w/1/s/src/mono/mono/sgen/sgen-alloc.c:474 #6 0x0000007f9f954a48 in mono_gc_alloc_pinned_obj (vtable=0x7f9fb7c120 , size=128) at /__w/1/s/src/mono/mono/metadata/sgen-mono.c:922 #7 0x0000007f9f912e44 in mono_object_new_pinned (klass=0x557d707928, error=0x7f6b330080) at /__w/1/s/src/mono/mono/metadata/object.c:5141 #8 0x0000007f9f929b80 in mono_type_get_object_checked (type=0x7f70118ad0, error=0x7f6b330080) at /__w/1/s/src/mono/mono/metadata/reflection.c:537 #9 0x0000007f9f929dc8 in mono_type_get_object_handle (type=0x7f9fb7c120 , error=0x80) at /__w/1/s/src/mono/mono/metadata/reflection.c:566 #10 0x0000007f9f90b64c in mono_class_create_runtime_vtable (klass=0x7f70118a20, error=0x7f6b330080) at /__w/1/s/src/mono/mono/metadata/object.c:2195 #11 mono_class_vtable_checked (klass=0x7f70118a20, error=0x7f6b330080) at /__w/1/s/src/mono/mono/metadata/object.c:1883 #12 0x0000007f9fa7b614 in class_type_info (mem_manager=0x557d6a5250, klass=, info_type=MONO_RGCTX_INFO_VTABLE, error=0x7f6b330080) at /__w/1/s/src/mono/mono/mini/mini-generic-sharing.c:942 #13 instantiate_info (mem_manager=0x557d6a5250, oti=0x7f44010320, context=0x7f5406e228, klass=, error=0x7f6b330080) at /__w/1/s/src/mono/mono/mini/mini-generic-sharing.c:2197 #14 0x0000007f9fa7ac7c in mini_instantiate_gshared_info (oti=0x7f44010320, context=0x7f5406e228, klass=0x7f6c0567d0) at /__w/1/s/src/mono/mono/mini/mini-generic-sharing.c:2636 #15 0x0000007f9fa25874 in mini_init_method_rgctx (mrgctx=0x7f80050860, info=0x7f580f4060) at /__w/1/s/src/mono/mono/mini/jit-icalls.c:1683 #16 0x0000007f6acb4d28 in ?? () #17 0x0000007f9f1b7190 in ?? () #18 0x0000000400000001 in ?? () Backtrace stopped: previous frame identical to this frame (corrupt stack?) Thread 18 (Thread 0x7f6b5521c0 (LWP 43)): #0 0x0000007fa00dda40 in futex_abstimed_wait_cancelable (private=0, abstime=0x0, expected=0, futex_word=0x7f9fb6a890 ) at ../sysdeps/unix/sysv/linux/futex-internal.h:205 #1 do_futex_wait (sem=sem@entry=0x7f9fb6a890 , abstime=0x0) at sem_waitcommon.c:111 #2 0x0000007fa00ddb60 in __new_sem_wait_slow (sem=0x7f9fb6a890 , abstime=0x0) at sem_waitcommon.c:181 #3 0x0000007f9f97ad54 in mono_os_sem_wait (sem=, flags=) at /__w/1/s/src/mono/mono/utils/mono-os-semaphore.h:204 #4 mono_os_sem_timedwait (sem=0x7f9fb6a890 , timeout_ms=4294967295, flags=MONO_SEM_FLAGS_NONE) at /__w/1/s/src/mono/mono/utils/mono-os-semaphore.h:237 #5 0x0000007f9f97aa78 in mono_threads_wait_pending_operations () at /__w/1/s/src/mono/mono/utils/mono-threads.c:323 #6 0x0000007f9f952c40 in unified_suspend_stop_world (flags=MONO_THREAD_INFO_FLAGS_NO_GC, thread_stopped_callback=0x7f9f95306c ) at /__w/1/s/src/mono/mono/metadata/sgen-stw.c:345 #7 0x0000007f9f952928 in sgen_client_stop_world (generation=0, serial_collection=0) at /__w/1/s/src/mono/mono/metadata/sgen-stw.c:155 #8 0x0000007f9f99317c in sgen_stop_world (generation=0, serial_collection=0) at /__w/1/s/src/mono/mono/sgen/sgen-gc.c:3995 #9 0x0000007f9f98fc54 in sgen_perform_collection_inner (requested_size=, generation_to_collect=, reason=, forced_serial=, stw=) at /__w/1/s/src/mono/mono/sgen/sgen-gc.c:2643 #10 sgen_perform_collection (requested_size=4096, generation_to_collect=0, reason=0x7f9f862851 "Nursery full", forced_serial=0, stw=1) at /__w/1/s/src/mono/mono/sgen/sgen-gc.c:2766 #11 0x0000007f9f98fb90 in sgen_ensure_free_space (size=4096, generation=) at /__w/1/s/src/mono/mono/sgen/sgen-gc.c:2622 #12 0x0000007f9f984a88 in sgen_alloc_obj_nolock (vtable=0x7f5403ff18, size=208) at /__w/1/s/src/mono/mono/sgen/sgen-alloc.c:279 #13 0x0000007f9f984fa0 in sgen_alloc_obj (vtable=0x7f5403ff18, size=208) at /__w/1/s/src/mono/mono/sgen/sgen-alloc.c:454 #14 0x0000007f9f9549f0 in mono_gc_alloc_obj (vtable=0x7f9fb6a890 , size=393) at /__w/1/s/src/mono/mono/metadata/sgen-mono.c:911 #15 0x0000007f9cd00af4 in ?? () Backtrace stopped: previous frame identical to this frame (corrupt stack?) Thread 17 (Thread 0x7f6b7731c0 (LWP 42)): #0 0x0000007f9fdbf1e0 in __GI_epoll_pwait (epfd=, events=0x7f6405e9d0, maxevents=, timeout=-1664380165, set=0x0) at ../sysdeps/unix/sysv/linux/epoll_pwait.c:42 #1 0x0000007f9cccdc84 in WaitForSocketEventsInner (port=9, buffer=0x7f6405e9d0, count=0x7f6b772710) at /__w/1/s/src/native/libs/System.Native/pal_networking.c:2723 #2 0x0000007f9cccdb98 in SystemNative_WaitForSocketEvents (port=9, buffer=0x7f6405e9d0, count=0x7f6b772710) at /__w/1/s/src/native/libs/System.Native/pal_networking.c:3023 #3 0x0000007f6b77c07c in ?? () #4 0x0000000000000001 in ?? () Backtrace stopped: previous frame identical to this frame (corrupt stack?) Thread 16 (Thread 0x7f6b9c41c0 (LWP 41)): #0 0x0000007fa00db5bc in futex_reltimed_wait_cancelable (private=, reltime=0x7f00000000, expected=0, futex_word=0x7f580fd3f8) at ../sysdeps/unix/sysv/linux/futex-internal.h:142 #1 __pthread_cond_wait_common (abstime=0x7f6b9c2f58, mutex=0x7f580fd3a0, cond=0x7f580fd3d0) at pthread_cond_wait.c:533 #2 __pthread_cond_timedwait (cond=0x7f580fd3d0, mutex=0x7f580fd3a0, abstime=0x7f6b9c2f58) at pthread_cond_wait.c:667 #3 0x0000007f9ccd3490 in SystemNative_LowLevelMonitor_TimedWait (monitor=0x7f580fd3a0, timeoutMilliseconds=100000) at /__w/1/s/src/native/libs/System.Native/pal_threading.c:195 #4 0x0000007f94c7fd4c in ?? () #5 0x0000007f9613b8d8 in ?? () #6 0x0000007f6b9c3910 in ?? () #7 0xf90047bda907f3bb in ?? () Backtrace stopped: previous frame identical to this frame (corrupt stack?) Thread 15 (Thread 0x7f6bfff1c0 (LWP 40)): #0 0x0000007fa00db5bc in futex_reltimed_wait_cancelable (private=, reltime=0x7f00000000, expected=0, futex_word=0x7f600039b8) at ../sysdeps/unix/sysv/linux/futex-internal.h:142 #1 __pthread_cond_wait_common (abstime=0x7f6bff9fc8, mutex=0x7f60003960, cond=0x7f60003990) at pthread_cond_wait.c:533 #2 __pthread_cond_timedwait (cond=0x7f60003990, mutex=0x7f60003960, abstime=0x7f6bff9fc8) at pthread_cond_wait.c:667 #3 0x0000007f9ccd3490 in SystemNative_LowLevelMonitor_TimedWait (monitor=0x7f60003960, timeoutMilliseconds=30000) at /__w/1/s/src/native/libs/System.Native/pal_threading.c:195 #4 0x0000007f94c7fd4c in ?? () #5 0x0000007f9613b8d8 in ?? () #6 0x0000007f9d423790 in ?? () #7 0xf90047bda907f3bb in ?? () Backtrace stopped: previous frame identical to this frame (corrupt stack?) Thread 14 (Thread 0x7f9420c1c0 (LWP 39)): #0 0x0000007fa00de690 in __lll_lock_wait (futex=0x7f9fb646b0 , private=0) at lowlevellock.c:46 #1 0x0000007fa00d77d8 in __GI___pthread_mutex_lock (mutex=0x7f9fb646b0 ) at pthread_mutex_lock.c:115 #2 0x0000007f9f8e4760 in mono_os_mutex_lock (mutex=0x7f9fb646b0 ) at /__w/1/s/src/mono/mono/mini/../../mono/utils/mono-os-mutex.h:105 #3 mono_coop_mutex_lock (mutex=) at /__w/1/s/src/mono/mono/mini/../../mono/utils/mono-coop-mutex.h:57 #4 mono_loader_lock () at /__w/1/s/src/mono/mono/metadata/loader.c:136 #5 0x0000007f9f9d7408 in mono_jit_compile_method_inner (method=0x7f740f2a28, opt=, error=0x7f94205630) at /__w/1/s/src/mono/mono/mini/mini.c:4173 #6 0x0000007f9f9dbd98 in mono_jit_compile_method_with_opt (method=0x7f740f2a28, opt=374417919, jit_only=0, error=) at /__w/1/s/src/mono/mono/mini/mini-runtime.c:2707 #7 jit_compile_method_with_opt_cb (arg=) at /__w/1/s/src/mono/mono/mini/mini-runtime.c:2762 #8 jit_compile_method_with_opt (params=) at /__w/1/s/src/mono/mono/mini/mini-runtime.c:2778 #9 0x0000007f9f9db210 in mono_jit_compile_method (method=, error=0x7f94205630) at /__w/1/s/src/mono/mono/mini/mini-runtime.c:2797 #10 0x0000007f9fa74c6c in common_call_trampoline (regs=0x7f942056e0, code=0x7f6bd94f8c "\277+", m=0x7f740f2a28, vt=0x7f80050de8, vtable_slot=, error=0x7f94205630) at /__w/1/s/src/mono/mono/mini/mini-trampolines.c:618 #11 0x0000007f9fa759dc in mono_vcall_trampoline (regs=0x7f942056e0, code=0x7f6bd94f8c "\277+", slot=-9, tramp=) at /__w/1/s/src/mono/mono/mini/mini-trampolines.c:840 #12 0x0000007f9f64d504 in ?? () #13 0x0000007f80050de8 in ?? () #14 0x0000007f9f050cf8 in ?? () Backtrace stopped: not enough registers or memory available to unwind further Thread 13 (Thread 0x7f9440d1c0 (LWP 38)): #0 0x0000007fa00de668 in __lll_lock_wait (futex=futex@entry=0x7f9fb7c120 , private=0) at lowlevellock.c:43 #1 0x0000007fa00d77c8 in __GI___pthread_mutex_lock (mutex=0x7f9fb7c120 ) at pthread_mutex_lock.c:80 #2 0x0000007f9f990634 in mono_os_mutex_lock (mutex=) at /__w/1/s/src/mono/mono/mini/../../mono/utils/mono-os-mutex.h:105 #3 mono_coop_mutex_lock (mutex=) at /__w/1/s/src/mono/mono/mini/../../mono/utils/mono-coop-mutex.h:57 #4 sgen_gc_lock () at /__w/1/s/src/mono/mono/sgen/sgen-gc.c:3937 #5 0x0000007f9f984f94 in sgen_alloc_obj (vtable=0x7f8000df70, size=136) at /__w/1/s/src/mono/mono/sgen/sgen-alloc.c:453 #6 0x0000007f9f9549f0 in mono_gc_alloc_obj (vtable=0x7f9fb7c120 , size=128) at /__w/1/s/src/mono/mono/metadata/sgen-mono.c:911 #7 0x0000007f9cd00af4 in ?? () #8 0x0000007f8412b960 in ?? () Backtrace stopped: previous frame inner to this frame (corrupt stack?) Thread 12 (Thread 0x7f9460e1c0 (LWP 37)): #0 0x0000007fa00db5bc in futex_reltimed_wait_cancelable (private=, reltime=0x7f00000000, expected=0, futex_word=0x7f6c014b5c) at ../sysdeps/unix/sysv/linux/futex-internal.h:142 #1 __pthread_cond_wait_common (abstime=0x7f94608fc8, mutex=0x7f6c014b00, cond=0x7f6c014b30) at pthread_cond_wait.c:533 #2 __pthread_cond_timedwait (cond=0x7f6c014b30, mutex=0x7f6c014b00, abstime=0x7f94608fc8) at pthread_cond_wait.c:667 #3 0x0000007f9ccd3490 in SystemNative_LowLevelMonitor_TimedWait (monitor=0x7f6c014b00, timeoutMilliseconds=30000) at /__w/1/s/src/native/libs/System.Native/pal_threading.c:195 #4 0x0000007f94c7fd4c in ?? () #5 0x0000007f9613b8d8 in ?? () #6 0x0000007f9d423790 in ?? () #7 0xf90047bda907f3bb in ?? () Backtrace stopped: previous frame identical to this frame (corrupt stack?) Thread 11 (Thread 0x7f9480f1c0 (LWP 36)): #0 0x0000007fa00db2a4 in futex_wait_cancelable (private=, expected=0, futex_word=0x557d699cf0) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x557d699c98, cond=0x557d699cc8) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=0x557d699cc8, mutex=0x557d699c98) at pthread_cond_wait.c:655 #3 0x0000007f9f973090 in mono_os_cond_wait (cond=0x557d699cc8, mutex=0x557d699c98) at /__w/1/s/src/mono/mono/utils/mono-os-mutex.h:219 #4 mono_os_cond_timedwait (cond=0x557d699cc8, mutex=0x557d699c98, timeout_ms=0) at /__w/1/s/src/mono/mono/utils/mono-os-mutex.c:32 #5 0x0000007f9f928aac in mono_coop_cond_timedwait (cond=0x557d699cc8, mutex=0x557d699c98, timeout_ms=4294967295) at /__w/1/s/src/mono/mono/mini/../../mono/utils/mono-coop-mutex.h:103 #6 mono_w32handle_timedwait_signal_naked (cond=0x557d699cc8, mutex=0x557d699c98, timeout=4294967295, poll=0, alerted=) at /__w/1/s/src/mono/mono/metadata/w32handle.c:514 #7 mono_w32handle_timedwait_signal_handle (handle_data=0x557d699c88, timeout=4294967295, poll=0, alerted=0x7f94808b9c) at /__w/1/s/src/mono/mono/metadata/w32handle.c:629 #8 0x0000007f9f928940 in mono_w32handle_wait_one (handle=, timeout=, alertable=) at /__w/1/s/src/mono/mono/metadata/w32handle.c:728 #9 0x0000007f9f94a7dc in mono_monitor_wait (obj_handle=..., ms=, allow_interruption=, error=) at /__w/1/s/src/mono/mono/metadata/monitor.c:1364 #10 ves_icall_System_Threading_Monitor_Monitor_wait (obj_handle=..., ms=4294967295, allow_interruption=1 '\001', error=) at /__w/1/s/src/mono/mono/metadata/monitor.c:1443 #11 0x0000007f9f8db824 in ves_icall_System_Threading_Monitor_Monitor_wait_raw (a0=0x7f94808d20, a1=4294967295, a2=1 '\001') at /__w/1/s/src/mono/mono/mini/../metadata/icall-def.h:570 #12 0x0000007f6ac89ef0 in ?? () #13 0x0000007f9480b508 in ?? () Backtrace stopped: previous frame identical to this frame (corrupt stack?) Thread 10 (Thread 0x7f94a101c0 (LWP 35)): #0 0x0000007fa00db5bc in futex_reltimed_wait_cancelable (private=, reltime=0x7f00000000, expected=0, futex_word=0x7f7400848c) at ../sysdeps/unix/sysv/linux/futex-internal.h:142 #1 __pthread_cond_wait_common (abstime=0x7f94a0afc8, mutex=0x7f74008430, cond=0x7f74008460) at pthread_cond_wait.c:533 #2 __pthread_cond_timedwait (cond=0x7f74008460, mutex=0x7f74008430, abstime=0x7f94a0afc8) at pthread_cond_wait.c:667 #3 0x0000007f9ccd3490 in SystemNative_LowLevelMonitor_TimedWait (monitor=0x7f74008430, timeoutMilliseconds=30000) at /__w/1/s/src/native/libs/System.Native/pal_threading.c:195 #4 0x0000007f94c7fd4c in ?? () #5 0x0000007f9613b8d8 in ?? () #6 0x0000007f9d423790 in ?? () #7 0xf90047bda907f3bb in ?? () Backtrace stopped: previous frame identical to this frame (corrupt stack?) Thread 9 (Thread 0x7f94c7a1c0 (LWP 34)): #0 0x0000007fa00db5bc in futex_reltimed_wait_cancelable (private=, reltime=0x0, expected=0, futex_word=0x7f44033628) at ../sysdeps/unix/sysv/linux/futex-internal.h:142 #1 __pthread_cond_wait_common (abstime=0x7f94c78c90, mutex=0x7f9fb74f38 , cond=0x7f44033600) at pthread_cond_wait.c:533 #2 __pthread_cond_timedwait (cond=0x7f44033600, mutex=0x7f9fb74f38 , abstime=0x7f94c78c90) at pthread_cond_wait.c:667 #3 0x0000007f9f973068 in mono_os_cond_timedwait (cond=0x7f44033600, mutex=0x7f9fb74f38 , timeout_ms=1000) at /__w/1/s/src/mono/mono/utils/mono-os-mutex.c:75 #4 0x0000007f9f9dba54 in mono_coop_cond_timedwait (cond=, timeout_ms=1000, mutex=) at /__w/1/s/src/mono/mono/mini/../../mono/utils/mono-coop-mutex.h:103 #5 wait_or_register_method_to_compile (method=) at /__w/1/s/src/mono/mono/mini/mini-runtime.c:2338 #6 mono_jit_compile_method_with_opt (method=0x7f5004b2f0, opt=374417919, jit_only=0, error=) at /__w/1/s/src/mono/mono/mini/mini-runtime.c:2705 #7 jit_compile_method_with_opt_cb (arg=) at /__w/1/s/src/mono/mono/mini/mini-runtime.c:2762 #8 jit_compile_method_with_opt (params=) at /__w/1/s/src/mono/mono/mini/mini-runtime.c:2778 #9 0x0000007f9f9db210 in mono_jit_compile_method (method=, error=0x7f94c79208) at /__w/1/s/src/mono/mono/mini/mini-runtime.c:2797 #10 0x0000007f9fa75614 in mono_delegate_trampoline (regs=, code=, arg=0x7f7817c590, tramp=) at /__w/1/s/src/mono/mono/mini/mini-trampolines.c:1100 #11 0x0000007f9f64d204 in ?? () #12 0x0000007f9f3a1e68 in ?? () #13 0x0000007f6acca438 in ?? () Backtrace stopped: not enough registers or memory available to unwind further Thread 8 (Thread 0x7f94ccb1c0 (LWP 33)): #0 0x0000007fa00db5bc in futex_reltimed_wait_cancelable (private=, reltime=0x7f00000000, expected=0, futex_word=0x7f7c020e28) at ../sysdeps/unix/sysv/linux/futex-internal.h:142 #1 __pthread_cond_wait_common (abstime=0x7f94cca2b8, mutex=0x7f7c020dd0, cond=0x7f7c020e00) at pthread_cond_wait.c:533 #2 __pthread_cond_timedwait (cond=0x7f7c020e00, mutex=0x7f7c020dd0, abstime=0x7f94cca2b8) at pthread_cond_wait.c:667 #3 0x0000007f9ccd3490 in SystemNative_LowLevelMonitor_TimedWait (monitor=0x7f7c020dd0, timeoutMilliseconds=500) at /__w/1/s/src/native/libs/System.Native/pal_threading.c:195 #4 0x0000007f94c7fd4c in ?? () #5 0x0000007f9613b8d8 in ?? () #6 0x0000007f94cca910 in ?? () Backtrace stopped: previous frame inner to this frame (corrupt stack?) Thread 7 (Thread 0x7f9612f1c0 (LWP 32)): #0 0x0000007fa00db5bc in futex_reltimed_wait_cancelable (private=, reltime=0x7f00000000, expected=0, futex_word=0x7f8802d138) at ../sysdeps/unix/sysv/linux/futex-internal.h:142 #1 __pthread_cond_wait_common (abstime=0x7f9612e0f8, mutex=0x7f8802d0e0, cond=0x7f8802d110) at pthread_cond_wait.c:533 #2 __pthread_cond_timedwait (cond=0x7f8802d110, mutex=0x7f8802d0e0, abstime=0x7f9612e0f8) at pthread_cond_wait.c:667 #3 0x0000007f9ccd3490 in SystemNative_LowLevelMonitor_TimedWait (monitor=0x7f8802d0e0, timeoutMilliseconds=12000) at /__w/1/s/src/native/libs/System.Native/pal_threading.c:195 #4 0x0000007f94c7fd4c in ?? () #5 0x0000007f9613b8d8 in ?? () #6 0x0000007f9612e910 in ?? () Backtrace stopped: previous frame inner to this frame (corrupt stack?) Thread 6 (Thread 0x7f95f2e1c0 (LWP 31)): #0 0x0000007fa00db2a4 in futex_wait_cancelable (private=, expected=0, futex_word=0x7f8411a378) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x7f8411a320, cond=0x7f8411a350) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=0x7f8411a350, mutex=0x7f8411a320) at pthread_cond_wait.c:655 #3 0x0000007f9ccd332c in SystemNative_LowLevelMonitor_Wait (monitor=0x7f8411a320) at /__w/1/s/src/native/libs/System.Native/pal_threading.c:155 #4 0x0000007f9613c004 in ?? () #5 0x0000007f9f0313e8 in ?? () #6 0x0000007f94d16a98 in ?? () Backtrace stopped: previous frame inner to this frame (corrupt stack?) Thread 5 (Thread 0x7f962491c0 (LWP 28)): #0 0x0000007fa00dfd5c in __waitpid (pid=, stat_loc=0x7f962462b0, options=) at ../sysdeps/unix/sysv/linux/waitpid.c:30 #1 0x0000007f9fab3f70 in dump_native_stacktrace (signal=, mctx=) at /__w/1/s/src/mono/mono/mini/mini-posix.c:843 #2 mono_dump_native_crash_info (signal=, mctx=0x7f96246ce0, info=) at /__w/1/s/src/mono/mono/mini/mini-posix.c:870 #3 0x0000007f9fa72800 in mono_handle_native_crash (signal=0x7f9f8642a7 "SIGABRT", mctx=0x7f96246ce0, info=0x7f96247020) at /__w/1/s/src/mono/mono/mini/mini-exceptions.c:3005 #4 0x0000007f9fab367c in sigabrt_signal_handler (_dummy=6, _info=0x7f96247020, context=0x7f962470a0) at /__w/1/s/src/mono/mono/mini/mini-posix.c:225 #5 #6 __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51 #7 0x0000007f9fd22974 in __GI_abort () at abort.c:79 #8 0x0000007f9f8d226c in ves_icall_System_Environment_FailFast (message=..., exception=..., errorSource=..., error=) at /__w/1/s/src/mono/mono/metadata/icall.c:6068 #9 0x0000007f9f8d487c in ves_icall_System_Environment_FailFast_raw (a0=0x7f962485b0, a1=0x7f962485b8, a2=0x7f962485c0) at /__w/1/s/src/mono/mono/mini/../metadata/icall-def.h:194 #10 0x0000007f6acfcb68 in ?? () Backtrace stopped: previous frame identical to this frame (corrupt stack?) Thread 4 (Thread 0x7f9d1b61c0 (LWP 27)): #0 0x0000007fa00dda40 in futex_abstimed_wait_cancelable (private=0, abstime=0x0, expected=0, futex_word=0x7f9fb657d8 ) at ../sysdeps/unix/sysv/linux/futex-internal.h:205 #1 do_futex_wait (sem=sem@entry=0x7f9fb657d8 , abstime=0x0) at sem_waitcommon.c:111 #2 0x0000007fa00ddb60 in __new_sem_wait_slow (sem=0x7f9fb657d8 , abstime=0x0) at sem_waitcommon.c:181 #3 0x0000007f9f948d84 in mono_os_sem_wait (sem=, flags=MONO_SEM_FLAGS_ALERTABLE) at /__w/1/s/src/mono/mono/mini/../utils/mono-os-semaphore.h:204 #4 mono_coop_sem_wait (sem=, flags=MONO_SEM_FLAGS_ALERTABLE) at /__w/1/s/src/mono/mono/mini/../../mono/utils/mono-coop-semaphore.h:41 #5 finalizer_thread (unused=) at /__w/1/s/src/mono/mono/metadata/gc.c:891 #6 0x0000007f9f923b4c in start_wrapper_internal (start_info=0x0, stack_ptr=) at /__w/1/s/src/mono/mono/metadata/threads.c:1202 #7 0x0000007f9f9239f8 in start_wrapper (data=0x557d736990) at /__w/1/s/src/mono/mono/metadata/threads.c:1264 #8 0x0000007fa00d5088 in start_thread (arg=0x7fc91d3e3f) at pthread_create.c:463 #9 0x0000007f9fdbf0cc in thread_start () at ../sysdeps/unix/sysv/linux/aarch64/clone.S:78 Thread 3 (Thread 0x7f9d3b71c0 (LWP 26)): #0 0x0000007f9fdb5ef8 in __GI___poll (fds=0x7f98003af0, nfds=548137295368, timeout=) at ../sysdeps/unix/sysv/linux/poll.c:41 #1 0x0000007f9fb3ecc8 in ipc_poll_fds (fds=, nfds=1, timeout=4294967295) at /__w/1/s/src/native/eventpipe/ds-ipc-pal-socket.c:470 #2 ds_ipc_poll (poll_handles_data=0x7f980032e0, poll_handles_data_len=1, timeout_ms=4294967295, callback=0x7f9fb3e078 ) at /__w/1/s/src/native/eventpipe/ds-ipc-pal-socket.c:1096 #3 0x0000007f9fb3c274 in ds_ipc_stream_factory_get_next_available_stream (callback=0x7f9fb3e078 ) at /__w/1/s/src/native/eventpipe/ds-ipc.c:395 #4 0x0000007f9fb3aaec in server_thread (data=) at /__w/1/s/src/native/eventpipe/ds-server.c:127 #5 0x0000007f9fb3e058 in ep_rt_thread_mono_start_func (data=0x557d71fd30) at /__w/1/s/src/mono/mono/mini/../eventpipe/ep-rt-mono.h:1332 #6 0x0000007fa00d5088 in start_thread (arg=0x7fc91d3f8f) at pthread_create.c:463 #7 0x0000007f9fdbf0cc in thread_start () at ../sysdeps/unix/sysv/linux/aarch64/clone.S:78 Thread 2 (Thread 0x7f9efff1c0 (LWP 25)): #0 0x0000007fa00db2a4 in futex_wait_cancelable (private=, expected=0, futex_word=0x7f9fb747b8 ) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x7f9fb74760 , cond=0x7f9fb74790 ) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=0x7f9fb74790 , mutex=0x7f9fb74760 ) at pthread_cond_wait.c:655 #3 0x0000007f9f9c4e50 in mono_os_cond_wait (cond=0x7f9fb747b8 , mutex=) at /__w/1/s/src/mono/mono/mini/../../mono/utils/mono-os-mutex.h:219 #4 get_work (worker_index=, work_context=, do_idle=, job=) at /__w/1/s/src/mono/mono/sgen/sgen-thread-pool.c:167 #5 thread_func (data=0x0) at /__w/1/s/src/mono/mono/sgen/sgen-thread-pool.c:198 #6 0x0000007fa00d5088 in start_thread (arg=0x7fc91d3f2f) at pthread_create.c:463 #7 0x0000007f9fdbf0cc in thread_start () at ../sysdeps/unix/sysv/linux/aarch64/clone.S:78 Thread 1 (Thread 0x7fa0119ff0 (LWP 24)): #0 0x0000007fa00db2a4 in futex_wait_cancelable (private=, expected=0, futex_word=0x557e0be89c) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x557e0be840, cond=0x557e0be870) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=0x557e0be870, mutex=0x557e0be840) at pthread_cond_wait.c:655 #3 0x0000007f9ccd332c in SystemNative_LowLevelMonitor_Wait (monitor=0x557e0be840) at /__w/1/s/src/native/libs/System.Native/pal_threading.c:155 #4 0x0000007f9613c004 in ?? () #5 0x0000007f9fb74000 in pin_hash_filter () from /root/helix/work/correlation/shared/Microsoft.NETCore.App/8.0.0/libcoreclr.so Backtrace stopped: previous frame identical to this frame (corrupt stack?) ================================================================= Basic Fault Address Reporting ================================================================= Memory around native instruction pointer (0x7f9fd21598):0x7f9fd21588 02 00 80 d2 03 01 80 d2 e8 10 80 d2 01 00 00 d4 ................ 0x7f9fd21598 73 72 47 f9 e0 03 04 2a a2 97 40 f9 61 02 40 f9 srG....*..@.a.@. 0x7f9fd215a8 41 00 01 ca 61 01 00 b5 f3 53 41 a9 fd 7b d3 a8 A...a....SA..{.. 0x7f9fd215b8 c0 03 5f d6 01 09 00 90 21 0c 47 f9 42 d0 3b d5 .._.....!.G.B.;. ================================================================= Managed Stacktrace: ================================================================= at <0xffffffff> at System.Environment:FailFast <0x00007> at System.Environment:FailFast <0x00033> at System.Diagnostics.ProcessWaitState:TryReapChild <0x001a3> at System.Diagnostics.ProcessWaitState:CheckChildren <0x00273> at System.Diagnostics.Process:OnSigChild <0x0006f> at System.Diagnostics.Process:OnSigChild <0x00053> ================================================================= ./RunTests.sh: line 168: 24 Aborted (core dumped) "$RUNTIME_PATH/dotnet" exec --runtimeconfig System.Net.Requests.Tests.runtimeconfig.json --depsfile System.Net.Requests.Tests.deps.json xunit.console.dll System.Net.Requests.Tests.dll -xml testResults.xml -nologo -nocolor -notrait category=IgnoreForCI -notrait category=OuterLoop -notrait category=failing $RSP_FILE /root/helix/work/workitem/e ----- end Thu Sep 8 00:57:00 UTC 2022 ----- exit code 134 ---------------------------------------------------------- ```
ghost commented 2 years ago

Tagging subscribers to this area: @dotnet/ncl See info in area-owners.md if you want to be subscribed.

Issue Details
## Build Information Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=8084 Build error leg or test failing: Libraries Test Run release mono Linux arm64 Debug / Send to Helix Pull request: https://github.com/dotnet/runtime/pull/75222 ## Error Message Fill the error message using [known issues guidance](https://github.com/dotnet/arcade/blob/main/Documentation/Projects/Build%20Analysis/KnownIssues.md#how-to-fill-out-a-known-issue-error-message-section). ```json { "ErrorMessage": "(NETCORE_ENGINEERING_TELEMETRY=Test) Work item System.Net.Requests.Tests in job", "BuildRetry": false } ``` Job results: https://dev.azure.com/dnceng-public/public/_build/results?buildId=8084&view=logs&j=3f95ca23-483b-5dc9-4b05-6bd24fb925c2&t=0c1dd9d1-4ef7-54d5-2d62-e4ab330605ca&l=72 Failure log: https://helixre107v0xdeko0k025g8.blob.core.windows.net/dotnet-runtime-refs-pull-75222-merge-15abc173720b496cad/System.Net.Requests.Tests/1/console.ff9bd480.log?helixlogtype=result
Callstack (in case log file is deleted) ``` ----- start Thu Sep 8 00:56:53 UTC 2022 =============== To repro directly: ===================================================== pushd . /root/helix/work/correlation/dotnet exec --runtimeconfig System.Net.Requests.Tests.runtimeconfig.json --depsfile System.Net.Requests.Tests.deps.json xunit.console.dll System.Net.Requests.Tests.dll -xml testResults.xml -nologo -nocolor -notrait category=IgnoreForCI -notrait category=OuterLoop -notrait category=failing popd =========================================================================================================== /root/helix/work/workitem/e /root/helix/work/workitem/e Discovering: System.Net.Requests.Tests (method display = ClassAndMethod, method display options = None) Discovered: System.Net.Requests.Tests (found 349 of 367 test cases) Starting: System.Net.Requests.Tests (parallel test collections = on, max threads = 6) System.Net.Tests.FtpWebRequestTest.Ftp_AppendFile [SKIP] Condition(s) not met: "LocalServerAvailable" System.Net.Tests.FtpWebRequestTest.Ftp_RenameFile [SKIP] Condition(s) not met: "LocalServerAvailable" System.Net.Tests.FtpWebRequestTest.Ftp_LargeFile [SKIP] Condition(s) not met: "LocalServerAvailable" System.Net.Tests.FtpWebRequestTest.Ftp_CreateAndDelete [SKIP] Condition(s) not met: "LocalServerAvailable" System.Net.Tests.FtpWebRequestTest.Ftp_RenameFileSubDir_Success [SKIP] Condition(s) not met: "LocalServerAvailable" System.Net.Tests.FtpWebRequestTest.Ftp_MakeAndRemoveDir_Success [SKIP] Condition(s) not met: "LocalServerAvailable" Process terminated. Error while reaping child. errno = 10 ================================================================= Native Crash Reporting ================================================================= Got a SIGABRT while executing native code. This usually indicates a fatal error in the mono runtime or one of the native libraries used by your application. ================================================================= ================================================================= Native stacktrace: ================================================================= 0x7f9fab3e70 - Unknown ================================================================= External Debugger Dump: ================================================================= [New LWP 25] [New LWP 26] [New LWP 27] [New LWP 28] [New LWP 31] [New LWP 32] [New LWP 33] [New LWP 34] [New LWP 35] [New LWP 36] [New LWP 37] [New LWP 38] [New LWP 39] [New LWP 40] [New LWP 41] [New LWP 42] [New LWP 43] [New LWP 44] [New LWP 47] [New LWP 57] [New LWP 58] [New LWP 63] [New LWP 65] [New LWP 67] [New LWP 68] [New LWP 69] [New LWP 70] [New LWP 71] [New LWP 72] [New LWP 74] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/aarch64-linux-gnu/libthread_db.so.1". 0x0000007fa00db2a4 in futex_wait_cancelable (private=, expected=0, futex_word=0x557e0be89c) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 88 ../sysdeps/unix/sysv/linux/futex-internal.h: No such file or directory. Id Target Id Frame * 1 Thread 0x7fa0119ff0 (LWP 24) "dotnet" 0x0000007fa00db2a4 in futex_wait_cancelable (private=, expected=0, futex_word=0x557e0be89c) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 2 Thread 0x7f9efff1c0 (LWP 25) "SGen worker" 0x0000007fa00db2a4 in futex_wait_cancelable (private=, expected=0, futex_word=0x7f9fb747b8 ) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 3 Thread 0x7f9d3b71c0 (LWP 26) "dotnet" 0x0000007f9fdb5ef8 in __GI___poll (fds=0x7f98003af0, nfds=548137295368, timeout=) at ../sysdeps/unix/sysv/linux/poll.c:41 4 Thread 0x7f9d1b61c0 (LWP 27) "Finalizer" 0x0000007fa00dda40 in futex_abstimed_wait_cancelable (private=0, abstime=0x0, expected=0, futex_word=0x7f9fb657d8 ) at ../sysdeps/unix/sysv/linux/futex-internal.h:205 5 Thread 0x7f962491c0 (LWP 28) "dotnet" 0x0000007fa00dfd5c in __waitpid (pid=, stat_loc=0x7f962462b0, options=) at ../sysdeps/unix/sysv/linux/waitpid.c:30 6 Thread 0x7f95f2e1c0 (LWP 31) ".NET Long Runni" 0x0000007fa00db2a4 in futex_wait_cancelable (private=, expected=0, futex_word=0x7f8411a378) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 7 Thread 0x7f9612f1c0 (LWP 32) ".NET ThreadPool" 0x0000007fa00db5bc in futex_reltimed_wait_cancelable (private=, reltime=0x7f00000000, expected=0, futex_word=0x7f8802d138) at ../sysdeps/unix/sysv/linux/futex-internal.h:142 8 Thread 0x7f94ccb1c0 (LWP 33) ".NET ThreadPool" 0x0000007fa00db5bc in futex_reltimed_wait_cancelable (private=, reltime=0x7f00000000, expected=0, futex_word=0x7f7c020e28) at ../sysdeps/unix/sysv/linux/futex-internal.h:142 9 Thread 0x7f94c7a1c0 (LWP 34) ".NET ThreadPool" 0x0000007fa00db5bc in futex_reltimed_wait_cancelable (private=, reltime=0x0, expected=0, futex_word=0x7f44033628) at ../sysdeps/unix/sysv/linux/futex-internal.h:142 10 Thread 0x7f94a101c0 (LWP 35) ".NET Long Runni" 0x0000007fa00db5bc in futex_reltimed_wait_cancelable (private=, reltime=0x7f00000000, expected=0, futex_word=0x7f7400848c) at ../sysdeps/unix/sysv/linux/futex-internal.h:142 11 Thread 0x7f9480f1c0 (LWP 36) ".NET Long Runni" 0x0000007fa00db2a4 in futex_wait_cancelable (private=, expected=0, futex_word=0x557d699cf0) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 12 Thread 0x7f9460e1c0 (LWP 37) ".NET Long Runni" 0x0000007fa00db5bc in futex_reltimed_wait_cancelable (private=, reltime=0x7f00000000, expected=0, futex_word=0x7f6c014b5c) at ../sysdeps/unix/sysv/linux/futex-internal.h:142 13 Thread 0x7f9440d1c0 (LWP 38) ".NET Long Runni" 0x0000007fa00de668 in __lll_lock_wait (futex=futex@entry=0x7f9fb7c120 , private=0) at lowlevellock.c:43 14 Thread 0x7f9420c1c0 (LWP 39) ".NET Long Runni" 0x0000007fa00de690 in __lll_lock_wait (futex=0x7f9fb646b0 , private=0) at lowlevellock.c:46 15 Thread 0x7f6bfff1c0 (LWP 40) ".NET Long Runni" 0x0000007fa00db5bc in futex_reltimed_wait_cancelable (private=, reltime=0x7f00000000, expected=0, futex_word=0x7f600039b8) at ../sysdeps/unix/sysv/linux/futex-internal.h:142 16 Thread 0x7f6b9c41c0 (LWP 41) ".NET ThreadPool" 0x0000007fa00db5bc in futex_reltimed_wait_cancelable (private=, reltime=0x7f00000000, expected=0, futex_word=0x7f580fd3f8) at ../sysdeps/unix/sysv/linux/futex-internal.h:142 17 Thread 0x7f6b7731c0 (LWP 42) ".NET Sockets" 0x0000007f9fdbf1e0 in __GI_epoll_pwait (epfd=, events=0x7f6405e9d0, maxevents=, timeout=-1664380165, set=0x0) at ../sysdeps/unix/sysv/linux/epoll_pwait.c:42 18 Thread 0x7f6b5521c0 (LWP 43) ".NET ThreadPool" 0x0000007fa00dda40 in futex_abstimed_wait_cancelable (private=0, abstime=0x0, expected=0, futex_word=0x7f9fb6a890 ) at ../sysdeps/unix/sysv/linux/futex-internal.h:205 19 Thread 0x7f6b3311c0 (LWP 44) ".NET ThreadPool" 0x0000007fa00de690 in __lll_lock_wait (futex=futex@entry=0x7f9fb7c120 , private=0) at lowlevellock.c:46 20 Thread 0x7f6b0481c0 (LWP 47) ".NET Timer" 0x0000007fa00de690 in __lll_lock_wait (futex=0x7f9fb646b0 , private=0) at lowlevellock.c:46 21 Thread 0x7f6a8841c0 (LWP 57) ".NET Long Runni" syscall () at ../sysdeps/unix/sysv/linux/aarch64/syscall.S:38 22 Thread 0x7f6a0831c0 (LWP 58) ".NET Long Runni" 0x0000007f9fd915e8 in __GI___nanosleep (requested_time=0x7f6a081ef8, requested_time@entry=0x7f6a081f18, remaining=0x7f6a081ef8, remaining@entry=0x7f6a081f18) at ../sysdeps/unix/sysv/linux/nanosleep.c:28 23 Thread 0x7f698821c0 (LWP 63) ".NET Long Runni" 0x0000007f9fdbf1e0 in __GI_epoll_pwait (epfd=, events=events@entry=0x7f69881858, maxevents=maxevents@entry=16, timeout=1770527136, timeout@entry=-1, set=set@entry=0x0) at ../sysdeps/unix/sysv/linux/epoll_pwait.c:42 24 Thread 0x7f688801c0 (LWP 65) ".NET Long Runni" 0x0000007f9fdbf1e0 in __GI_epoll_pwait (epfd=, events=events@entry=0x7f6887f858, maxevents=maxevents@entry=16, timeout=1753741728, timeout@entry=-1, set=set@entry=0x0) at ../sysdeps/unix/sysv/linux/epoll_pwait.c:42 25 Thread 0x7f4f7fe1c0 (LWP 67) ".NET Long Runni" 0x0000007f9fdbf1e0 in __GI_epoll_pwait (epfd=, events=events@entry=0x7f4f7fd858, maxevents=maxevents@entry=16, timeout=1333778848, timeout@entry=-1, set=set@entry=0x0) at ../sysdeps/unix/sysv/linux/epoll_pwait.c:42 26 Thread 0x7f4effd1c0 (LWP 68) ".NET Long Runni" 0x0000007f9fdbf1e0 in __GI_epoll_pwait (epfd=, events=events@entry=0x7f4effc858, maxevents=maxevents@entry=16, timeout=1325386144, timeout@entry=-1, set=set@entry=0x0) at ../sysdeps/unix/sysv/linux/epoll_pwait.c:42 27 Thread 0x7f4e7fc1c0 (LWP 69) ".NET Long Runni" 0x0000007fa00db2a4 in futex_wait_cancelable (private=, expected=0, futex_word=0x7f78172628) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 28 Thread 0x7f4dffb1c0 (LWP 70) ".NET Long Runni" 0x0000007fa00db2a4 in futex_wait_cancelable (private=, expected=0, futex_word=0x7f78172d78) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 29 Thread 0x7f4d7fa1c0 (LWP 71) ".NET Long Runni" 0x0000007fa00db2a4 in futex_wait_cancelable (private=, expected=0, futex_word=0x7f781734c8) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 30 Thread 0x7f4cff91c0 (LWP 72) ".NET Long Runni" 0x0000007fa00db2a4 in futex_wait_cancelable (private=, expected=0, futex_word=0x7f78173c18) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 31 Thread 0x7f4c7f81c0 (LWP 74) ".NET ThreadPool" 0x0000007fa00de690 in __lll_lock_wait (futex=0x7f9fb646b0 , private=0) at lowlevellock.c:46 Thread 31 (Thread 0x7f4c7f81c0 (LWP 74)): #0 0x0000007fa00de690 in __lll_lock_wait (futex=0x7f9fb646b0 , private=0) at lowlevellock.c:46 #1 0x0000007fa00d77d8 in __GI___pthread_mutex_lock (mutex=0x7f9fb646b0 ) at pthread_mutex_lock.c:115 #2 0x0000007f9f8e4760 in mono_os_mutex_lock (mutex=0x7f9fb646b0 ) at /__w/1/s/src/mono/mono/mini/../../mono/utils/mono-os-mutex.h:105 #3 mono_coop_mutex_lock (mutex=) at /__w/1/s/src/mono/mono/mini/../../mono/utils/mono-coop-mutex.h:57 #4 mono_loader_lock () at /__w/1/s/src/mono/mono/metadata/loader.c:136 #5 0x0000007f9f9d7408 in mono_jit_compile_method_inner (method=0x7f5004b2f0, opt=, error=0x7f4c7f7208) at /__w/1/s/src/mono/mono/mini/mini.c:4173 #6 0x0000007f9f9dbd98 in mono_jit_compile_method_with_opt (method=0x7f5004b2f0, opt=374417919, jit_only=0, error=) at /__w/1/s/src/mono/mono/mini/mini-runtime.c:2707 #7 jit_compile_method_with_opt_cb (arg=) at /__w/1/s/src/mono/mono/mini/mini-runtime.c:2762 #8 jit_compile_method_with_opt (params=) at /__w/1/s/src/mono/mono/mini/mini-runtime.c:2778 #9 0x0000007f9f9db210 in mono_jit_compile_method (method=, error=0x7f4c7f7208) at /__w/1/s/src/mono/mono/mini/mini-runtime.c:2797 #10 0x0000007f9fa75614 in mono_delegate_trampoline (regs=, code=, arg=0x7f7817c590, tramp=) at /__w/1/s/src/mono/mono/mini/mini-trampolines.c:1100 #11 0x0000007f9f64d204 in ?? () #12 0x0000007f9f3711b8 in ?? () #13 0x0000007f6acca438 in ?? () Backtrace stopped: not enough registers or memory available to unwind further Thread 30 (Thread 0x7f4cff91c0 (LWP 72)): #0 0x0000007fa00db2a4 in futex_wait_cancelable (private=, expected=0, futex_word=0x7f78173c18) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x7f78173bc0, cond=0x7f78173bf0) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=cond@entry=0x7f78173bf0, mutex=mutex@entry=0x7f78173bc0) at pthread_cond_wait.c:655 #3 0x0000007f6ab9918c in CxPlatInternalEventWaitForever (Event=0x7f78173bc0) at /tmp/msquic/src/msquic/src/inc/quic_platform_posix.h:829 #4 QuicWorkerThread (Context=0x7f78173af0) at /tmp/msquic/src/msquic/src/core/worker.c:737 #5 0x0000007fa00d5088 in start_thread (arg=0x7f94808b3f) at pthread_create.c:463 #6 0x0000007f9fdbf0cc in thread_start () at ../sysdeps/unix/sysv/linux/aarch64/clone.S:78 Thread 29 (Thread 0x7f4d7fa1c0 (LWP 71)): #0 0x0000007fa00db2a4 in futex_wait_cancelable (private=, expected=0, futex_word=0x7f781734c8) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x7f78173470, cond=0x7f781734a0) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=cond@entry=0x7f781734a0, mutex=mutex@entry=0x7f78173470) at pthread_cond_wait.c:655 #3 0x0000007f6ab9918c in CxPlatInternalEventWaitForever (Event=0x7f78173470) at /tmp/msquic/src/msquic/src/inc/quic_platform_posix.h:829 #4 QuicWorkerThread (Context=0x7f781733a0) at /tmp/msquic/src/msquic/src/core/worker.c:737 #5 0x0000007fa00d5088 in start_thread (arg=0x7f94808b3f) at pthread_create.c:463 #6 0x0000007f9fdbf0cc in thread_start () at ../sysdeps/unix/sysv/linux/aarch64/clone.S:78 Thread 28 (Thread 0x7f4dffb1c0 (LWP 70)): #0 0x0000007fa00db2a4 in futex_wait_cancelable (private=, expected=0, futex_word=0x7f78172d78) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x7f78172d20, cond=0x7f78172d50) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=cond@entry=0x7f78172d50, mutex=mutex@entry=0x7f78172d20) at pthread_cond_wait.c:655 #3 0x0000007f6ab9918c in CxPlatInternalEventWaitForever (Event=0x7f78172d20) at /tmp/msquic/src/msquic/src/inc/quic_platform_posix.h:829 #4 QuicWorkerThread (Context=0x7f78172c50) at /tmp/msquic/src/msquic/src/core/worker.c:737 #5 0x0000007fa00d5088 in start_thread (arg=0x7f94808b3f) at pthread_create.c:463 #6 0x0000007f9fdbf0cc in thread_start () at ../sysdeps/unix/sysv/linux/aarch64/clone.S:78 Thread 27 (Thread 0x7f4e7fc1c0 (LWP 69)): #0 0x0000007fa00db2a4 in futex_wait_cancelable (private=, expected=0, futex_word=0x7f78172628) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x7f781725d0, cond=0x7f78172600) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=cond@entry=0x7f78172600, mutex=mutex@entry=0x7f781725d0) at pthread_cond_wait.c:655 #3 0x0000007f6ab9918c in CxPlatInternalEventWaitForever (Event=0x7f781725d0) at /tmp/msquic/src/msquic/src/inc/quic_platform_posix.h:829 #4 QuicWorkerThread (Context=0x7f78172500) at /tmp/msquic/src/msquic/src/core/worker.c:737 #5 0x0000007fa00d5088 in start_thread (arg=0x7f94808b3f) at pthread_create.c:463 #6 0x0000007f9fdbf0cc in thread_start () at ../sysdeps/unix/sysv/linux/aarch64/clone.S:78 Thread 26 (Thread 0x7f4effd1c0 (LWP 68)): #0 0x0000007f9fdbf1e0 in __GI_epoll_pwait (epfd=, events=events@entry=0x7f4effc858, maxevents=maxevents@entry=16, timeout=1325386144, timeout@entry=-1, set=set@entry=0x0) at ../sysdeps/unix/sysv/linux/epoll_pwait.c:42 #1 0x0000007f9fdbf330 in epoll_wait (epfd=, events=events@entry=0x7f4effc858, maxevents=maxevents@entry=16, timeout=timeout@entry=-1) at ../sysdeps/unix/sysv/linux/epoll_wait.c:32 #2 0x0000007f6abe63dc in CxPlatDataPathRunEC (Context=Context@entry=0x7f780aaf70, CurThreadId=, WaitTime=WaitTime@entry=4294967295) at /tmp/msquic/src/msquic/src/platform/datapath_epoll.c:2769 #3 0x0000007f6abecb70 in CxPlatWorkerThread (Context=0x7f780aaee0) at /tmp/msquic/src/msquic/src/platform/platform_worker.c:317 #4 0x0000007fa00d5088 in start_thread (arg=0x7f94808b8f) at pthread_create.c:463 #5 0x0000007f9fdbf0cc in thread_start () at ../sysdeps/unix/sysv/linux/aarch64/clone.S:78 Thread 25 (Thread 0x7f4f7fe1c0 (LWP 67)): #0 0x0000007f9fdbf1e0 in __GI_epoll_pwait (epfd=, events=events@entry=0x7f4f7fd858, maxevents=maxevents@entry=16, timeout=1333778848, timeout@entry=-1, set=set@entry=0x0) at ../sysdeps/unix/sysv/linux/epoll_pwait.c:42 #1 0x0000007f9fdbf330 in epoll_wait (epfd=, events=events@entry=0x7f4f7fd858, maxevents=maxevents@entry=16, timeout=timeout@entry=-1) at ../sysdeps/unix/sysv/linux/epoll_wait.c:32 #2 0x0000007f6abe63dc in CxPlatDataPathRunEC (Context=Context@entry=0x7f780aaed0, CurThreadId=, WaitTime=WaitTime@entry=4294967295) at /tmp/msquic/src/msquic/src/platform/datapath_epoll.c:2769 #3 0x0000007f6abecb70 in CxPlatWorkerThread (Context=0x7f780aae40) at /tmp/msquic/src/msquic/src/platform/platform_worker.c:317 #4 0x0000007fa00d5088 in start_thread (arg=0x7f94808b8f) at pthread_create.c:463 #5 0x0000007f9fdbf0cc in thread_start () at ../sysdeps/unix/sysv/linux/aarch64/clone.S:78 Thread 24 (Thread 0x7f688801c0 (LWP 65)): #0 0x0000007f9fdbf1e0 in __GI_epoll_pwait (epfd=, events=events@entry=0x7f6887f858, maxevents=maxevents@entry=16, timeout=1753741728, timeout@entry=-1, set=set@entry=0x0) at ../sysdeps/unix/sysv/linux/epoll_pwait.c:42 #1 0x0000007f9fdbf330 in epoll_wait (epfd=, events=events@entry=0x7f6887f858, maxevents=maxevents@entry=16, timeout=timeout@entry=-1) at ../sysdeps/unix/sysv/linux/epoll_wait.c:32 #2 0x0000007f6abe63dc in CxPlatDataPathRunEC (Context=Context@entry=0x7f780aae30, CurThreadId=, WaitTime=WaitTime@entry=4294967295) at /tmp/msquic/src/msquic/src/platform/datapath_epoll.c:2769 #3 0x0000007f6abecb70 in CxPlatWorkerThread (Context=0x7f780aada0) at /tmp/msquic/src/msquic/src/platform/platform_worker.c:317 #4 0x0000007fa00d5088 in start_thread (arg=0x7f94808b8f) at pthread_create.c:463 #5 0x0000007f9fdbf0cc in thread_start () at ../sysdeps/unix/sysv/linux/aarch64/clone.S:78 Thread 23 (Thread 0x7f698821c0 (LWP 63)): #0 0x0000007f9fdbf1e0 in __GI_epoll_pwait (epfd=, events=events@entry=0x7f69881858, maxevents=maxevents@entry=16, timeout=1770527136, timeout@entry=-1, set=set@entry=0x0) at ../sysdeps/unix/sysv/linux/epoll_pwait.c:42 #1 0x0000007f9fdbf330 in epoll_wait (epfd=, events=events@entry=0x7f69881858, maxevents=maxevents@entry=16, timeout=timeout@entry=-1) at ../sysdeps/unix/sysv/linux/epoll_wait.c:32 #2 0x0000007f6abe63dc in CxPlatDataPathRunEC (Context=Context@entry=0x7f780aad90, CurThreadId=, WaitTime=WaitTime@entry=4294967295) at /tmp/msquic/src/msquic/src/platform/datapath_epoll.c:2769 #3 0x0000007f6abecb70 in CxPlatWorkerThread (Context=0x7f780aad00) at /tmp/msquic/src/msquic/src/platform/platform_worker.c:317 #4 0x0000007fa00d5088 in start_thread (arg=0x7f94808b8f) at pthread_create.c:463 #5 0x0000007f9fdbf0cc in thread_start () at ../sysdeps/unix/sysv/linux/aarch64/clone.S:78 Thread 22 (Thread 0x7f6a0831c0 (LWP 58)): #0 0x0000007f9fd915e8 in __GI___nanosleep (requested_time=0x7f6a081ef8, requested_time@entry=0x7f6a081f18, remaining=0x7f6a081ef8, remaining@entry=0x7f6a081f18) at ../sysdeps/unix/sysv/linux/nanosleep.c:28 #1 0x0000007f9fd9143c in __sleep (seconds=0) at ../sysdeps/posix/sleep.c:55 #2 0x0000007f6a8f95c4 in ?? () from /usr/lib/aarch64-linux-gnu/liblttng-ust.so.0 #3 0x0000007f94807770 in ?? () Backtrace stopped: previous frame identical to this frame (corrupt stack?) Thread 21 (Thread 0x7f6a8841c0 (LWP 57)): #0 syscall () at ../sysdeps/unix/sysv/linux/aarch64/syscall.S:38 #1 0x0000007f6a8f9220 in ?? () from /usr/lib/aarch64-linux-gnu/liblttng-ust.so.0 #2 0x0000007f94807770 in ?? () Backtrace stopped: previous frame identical to this frame (corrupt stack?) Thread 20 (Thread 0x7f6b0481c0 (LWP 47)): #0 0x0000007fa00de690 in __lll_lock_wait (futex=0x7f9fb646b0 , private=0) at lowlevellock.c:46 #1 0x0000007fa00d77d8 in __GI___pthread_mutex_lock (mutex=0x7f9fb646b0 ) at pthread_mutex_lock.c:115 #2 0x0000007f9f8e4760 in mono_os_mutex_lock (mutex=0x7f9fb646b0 ) at /__w/1/s/src/mono/mono/mini/../../mono/utils/mono-os-mutex.h:105 #3 mono_coop_mutex_lock (mutex=) at /__w/1/s/src/mono/mono/mini/../../mono/utils/mono-coop-mutex.h:57 #4 mono_loader_lock () at /__w/1/s/src/mono/mono/metadata/loader.c:136 #5 0x0000007f9f9d7408 in mono_jit_compile_method_inner (method=0x7f6011d838, opt=, error=0x7f6b0473a0) at /__w/1/s/src/mono/mono/mini/mini.c:4173 #6 0x0000007f9f9dbd98 in mono_jit_compile_method_with_opt (method=0x7f6011d838, opt=374417919, jit_only=0, error=) at /__w/1/s/src/mono/mono/mini/mini-runtime.c:2707 #7 jit_compile_method_with_opt_cb (arg=) at /__w/1/s/src/mono/mono/mini/mini-runtime.c:2762 #8 jit_compile_method_with_opt (params=) at /__w/1/s/src/mono/mono/mini/mini-runtime.c:2778 #9 0x0000007f9f9db210 in mono_jit_compile_method (method=, error=0x7f6b0473a0) at /__w/1/s/src/mono/mono/mini/mini-runtime.c:2797 #10 0x0000007f9fa74c6c in common_call_trampoline (regs=0x7f6b047430, code=0x7f6b056e24 "\017", m=0x7f6011d838, vt=0x0, vtable_slot=, error=0x7f6b0473a0) at /__w/1/s/src/mono/mono/mini/mini-trampolines.c:618 #11 0x0000007f9fa7478c in mono_magic_trampoline (regs=0x7f6b047430, code=0x7f6b056e24 "\017", arg=0x7f6011d838, tramp=) at /__w/1/s/src/mono/mono/mini/mini-trampolines.c:759 #12 0x0000007f9f64c304 in ?? () #13 0x0000007f9e35723b in ?? () #14 0x0000007f9f270468 in ?? () Backtrace stopped: not enough registers or memory available to unwind further Thread 19 (Thread 0x7f6b3311c0 (LWP 44)): #0 0x0000007fa00de690 in __lll_lock_wait (futex=futex@entry=0x7f9fb7c120 , private=0) at lowlevellock.c:46 #1 0x0000007fa00d77c8 in __GI___pthread_mutex_lock (mutex=0x7f9fb7c120 ) at pthread_mutex_lock.c:80 #2 0x0000007f9f990634 in mono_os_mutex_lock (mutex=) at /__w/1/s/src/mono/mono/mini/../../mono/utils/mono-os-mutex.h:105 #3 mono_coop_mutex_lock (mutex=) at /__w/1/s/src/mono/mono/mini/../../mono/utils/mono-coop-mutex.h:57 #4 sgen_gc_lock () at /__w/1/s/src/mono/mono/sgen/sgen-gc.c:3937 #5 0x0000007f9f985084 in sgen_alloc_obj_pinned (vtable=0x557d71b900, size=32) at /__w/1/s/src/mono/mono/sgen/sgen-alloc.c:474 #6 0x0000007f9f954a48 in mono_gc_alloc_pinned_obj (vtable=0x7f9fb7c120 , size=128) at /__w/1/s/src/mono/mono/metadata/sgen-mono.c:922 #7 0x0000007f9f912e44 in mono_object_new_pinned (klass=0x557d707928, error=0x7f6b330080) at /__w/1/s/src/mono/mono/metadata/object.c:5141 #8 0x0000007f9f929b80 in mono_type_get_object_checked (type=0x7f70118ad0, error=0x7f6b330080) at /__w/1/s/src/mono/mono/metadata/reflection.c:537 #9 0x0000007f9f929dc8 in mono_type_get_object_handle (type=0x7f9fb7c120 , error=0x80) at /__w/1/s/src/mono/mono/metadata/reflection.c:566 #10 0x0000007f9f90b64c in mono_class_create_runtime_vtable (klass=0x7f70118a20, error=0x7f6b330080) at /__w/1/s/src/mono/mono/metadata/object.c:2195 #11 mono_class_vtable_checked (klass=0x7f70118a20, error=0x7f6b330080) at /__w/1/s/src/mono/mono/metadata/object.c:1883 #12 0x0000007f9fa7b614 in class_type_info (mem_manager=0x557d6a5250, klass=, info_type=MONO_RGCTX_INFO_VTABLE, error=0x7f6b330080) at /__w/1/s/src/mono/mono/mini/mini-generic-sharing.c:942 #13 instantiate_info (mem_manager=0x557d6a5250, oti=0x7f44010320, context=0x7f5406e228, klass=, error=0x7f6b330080) at /__w/1/s/src/mono/mono/mini/mini-generic-sharing.c:2197 #14 0x0000007f9fa7ac7c in mini_instantiate_gshared_info (oti=0x7f44010320, context=0x7f5406e228, klass=0x7f6c0567d0) at /__w/1/s/src/mono/mono/mini/mini-generic-sharing.c:2636 #15 0x0000007f9fa25874 in mini_init_method_rgctx (mrgctx=0x7f80050860, info=0x7f580f4060) at /__w/1/s/src/mono/mono/mini/jit-icalls.c:1683 #16 0x0000007f6acb4d28 in ?? () #17 0x0000007f9f1b7190 in ?? () #18 0x0000000400000001 in ?? () Backtrace stopped: previous frame identical to this frame (corrupt stack?) Thread 18 (Thread 0x7f6b5521c0 (LWP 43)): #0 0x0000007fa00dda40 in futex_abstimed_wait_cancelable (private=0, abstime=0x0, expected=0, futex_word=0x7f9fb6a890 ) at ../sysdeps/unix/sysv/linux/futex-internal.h:205 #1 do_futex_wait (sem=sem@entry=0x7f9fb6a890 , abstime=0x0) at sem_waitcommon.c:111 #2 0x0000007fa00ddb60 in __new_sem_wait_slow (sem=0x7f9fb6a890 , abstime=0x0) at sem_waitcommon.c:181 #3 0x0000007f9f97ad54 in mono_os_sem_wait (sem=, flags=) at /__w/1/s/src/mono/mono/utils/mono-os-semaphore.h:204 #4 mono_os_sem_timedwait (sem=0x7f9fb6a890 , timeout_ms=4294967295, flags=MONO_SEM_FLAGS_NONE) at /__w/1/s/src/mono/mono/utils/mono-os-semaphore.h:237 #5 0x0000007f9f97aa78 in mono_threads_wait_pending_operations () at /__w/1/s/src/mono/mono/utils/mono-threads.c:323 #6 0x0000007f9f952c40 in unified_suspend_stop_world (flags=MONO_THREAD_INFO_FLAGS_NO_GC, thread_stopped_callback=0x7f9f95306c ) at /__w/1/s/src/mono/mono/metadata/sgen-stw.c:345 #7 0x0000007f9f952928 in sgen_client_stop_world (generation=0, serial_collection=0) at /__w/1/s/src/mono/mono/metadata/sgen-stw.c:155 #8 0x0000007f9f99317c in sgen_stop_world (generation=0, serial_collection=0) at /__w/1/s/src/mono/mono/sgen/sgen-gc.c:3995 #9 0x0000007f9f98fc54 in sgen_perform_collection_inner (requested_size=, generation_to_collect=, reason=, forced_serial=, stw=) at /__w/1/s/src/mono/mono/sgen/sgen-gc.c:2643 #10 sgen_perform_collection (requested_size=4096, generation_to_collect=0, reason=0x7f9f862851 "Nursery full", forced_serial=0, stw=1) at /__w/1/s/src/mono/mono/sgen/sgen-gc.c:2766 #11 0x0000007f9f98fb90 in sgen_ensure_free_space (size=4096, generation=) at /__w/1/s/src/mono/mono/sgen/sgen-gc.c:2622 #12 0x0000007f9f984a88 in sgen_alloc_obj_nolock (vtable=0x7f5403ff18, size=208) at /__w/1/s/src/mono/mono/sgen/sgen-alloc.c:279 #13 0x0000007f9f984fa0 in sgen_alloc_obj (vtable=0x7f5403ff18, size=208) at /__w/1/s/src/mono/mono/sgen/sgen-alloc.c:454 #14 0x0000007f9f9549f0 in mono_gc_alloc_obj (vtable=0x7f9fb6a890 , size=393) at /__w/1/s/src/mono/mono/metadata/sgen-mono.c:911 #15 0x0000007f9cd00af4 in ?? () Backtrace stopped: previous frame identical to this frame (corrupt stack?) Thread 17 (Thread 0x7f6b7731c0 (LWP 42)): #0 0x0000007f9fdbf1e0 in __GI_epoll_pwait (epfd=, events=0x7f6405e9d0, maxevents=, timeout=-1664380165, set=0x0) at ../sysdeps/unix/sysv/linux/epoll_pwait.c:42 #1 0x0000007f9cccdc84 in WaitForSocketEventsInner (port=9, buffer=0x7f6405e9d0, count=0x7f6b772710) at /__w/1/s/src/native/libs/System.Native/pal_networking.c:2723 #2 0x0000007f9cccdb98 in SystemNative_WaitForSocketEvents (port=9, buffer=0x7f6405e9d0, count=0x7f6b772710) at /__w/1/s/src/native/libs/System.Native/pal_networking.c:3023 #3 0x0000007f6b77c07c in ?? () #4 0x0000000000000001 in ?? () Backtrace stopped: previous frame identical to this frame (corrupt stack?) Thread 16 (Thread 0x7f6b9c41c0 (LWP 41)): #0 0x0000007fa00db5bc in futex_reltimed_wait_cancelable (private=, reltime=0x7f00000000, expected=0, futex_word=0x7f580fd3f8) at ../sysdeps/unix/sysv/linux/futex-internal.h:142 #1 __pthread_cond_wait_common (abstime=0x7f6b9c2f58, mutex=0x7f580fd3a0, cond=0x7f580fd3d0) at pthread_cond_wait.c:533 #2 __pthread_cond_timedwait (cond=0x7f580fd3d0, mutex=0x7f580fd3a0, abstime=0x7f6b9c2f58) at pthread_cond_wait.c:667 #3 0x0000007f9ccd3490 in SystemNative_LowLevelMonitor_TimedWait (monitor=0x7f580fd3a0, timeoutMilliseconds=100000) at /__w/1/s/src/native/libs/System.Native/pal_threading.c:195 #4 0x0000007f94c7fd4c in ?? () #5 0x0000007f9613b8d8 in ?? () #6 0x0000007f6b9c3910 in ?? () #7 0xf90047bda907f3bb in ?? () Backtrace stopped: previous frame identical to this frame (corrupt stack?) Thread 15 (Thread 0x7f6bfff1c0 (LWP 40)): #0 0x0000007fa00db5bc in futex_reltimed_wait_cancelable (private=, reltime=0x7f00000000, expected=0, futex_word=0x7f600039b8) at ../sysdeps/unix/sysv/linux/futex-internal.h:142 #1 __pthread_cond_wait_common (abstime=0x7f6bff9fc8, mutex=0x7f60003960, cond=0x7f60003990) at pthread_cond_wait.c:533 #2 __pthread_cond_timedwait (cond=0x7f60003990, mutex=0x7f60003960, abstime=0x7f6bff9fc8) at pthread_cond_wait.c:667 #3 0x0000007f9ccd3490 in SystemNative_LowLevelMonitor_TimedWait (monitor=0x7f60003960, timeoutMilliseconds=30000) at /__w/1/s/src/native/libs/System.Native/pal_threading.c:195 #4 0x0000007f94c7fd4c in ?? () #5 0x0000007f9613b8d8 in ?? () #6 0x0000007f9d423790 in ?? () #7 0xf90047bda907f3bb in ?? () Backtrace stopped: previous frame identical to this frame (corrupt stack?) Thread 14 (Thread 0x7f9420c1c0 (LWP 39)): #0 0x0000007fa00de690 in __lll_lock_wait (futex=0x7f9fb646b0 , private=0) at lowlevellock.c:46 #1 0x0000007fa00d77d8 in __GI___pthread_mutex_lock (mutex=0x7f9fb646b0 ) at pthread_mutex_lock.c:115 #2 0x0000007f9f8e4760 in mono_os_mutex_lock (mutex=0x7f9fb646b0 ) at /__w/1/s/src/mono/mono/mini/../../mono/utils/mono-os-mutex.h:105 #3 mono_coop_mutex_lock (mutex=) at /__w/1/s/src/mono/mono/mini/../../mono/utils/mono-coop-mutex.h:57 #4 mono_loader_lock () at /__w/1/s/src/mono/mono/metadata/loader.c:136 #5 0x0000007f9f9d7408 in mono_jit_compile_method_inner (method=0x7f740f2a28, opt=, error=0x7f94205630) at /__w/1/s/src/mono/mono/mini/mini.c:4173 #6 0x0000007f9f9dbd98 in mono_jit_compile_method_with_opt (method=0x7f740f2a28, opt=374417919, jit_only=0, error=) at /__w/1/s/src/mono/mono/mini/mini-runtime.c:2707 #7 jit_compile_method_with_opt_cb (arg=) at /__w/1/s/src/mono/mono/mini/mini-runtime.c:2762 #8 jit_compile_method_with_opt (params=) at /__w/1/s/src/mono/mono/mini/mini-runtime.c:2778 #9 0x0000007f9f9db210 in mono_jit_compile_method (method=, error=0x7f94205630) at /__w/1/s/src/mono/mono/mini/mini-runtime.c:2797 #10 0x0000007f9fa74c6c in common_call_trampoline (regs=0x7f942056e0, code=0x7f6bd94f8c "\277+", m=0x7f740f2a28, vt=0x7f80050de8, vtable_slot=, error=0x7f94205630) at /__w/1/s/src/mono/mono/mini/mini-trampolines.c:618 #11 0x0000007f9fa759dc in mono_vcall_trampoline (regs=0x7f942056e0, code=0x7f6bd94f8c "\277+", slot=-9, tramp=) at /__w/1/s/src/mono/mono/mini/mini-trampolines.c:840 #12 0x0000007f9f64d504 in ?? () #13 0x0000007f80050de8 in ?? () #14 0x0000007f9f050cf8 in ?? () Backtrace stopped: not enough registers or memory available to unwind further Thread 13 (Thread 0x7f9440d1c0 (LWP 38)): #0 0x0000007fa00de668 in __lll_lock_wait (futex=futex@entry=0x7f9fb7c120 , private=0) at lowlevellock.c:43 #1 0x0000007fa00d77c8 in __GI___pthread_mutex_lock (mutex=0x7f9fb7c120 ) at pthread_mutex_lock.c:80 #2 0x0000007f9f990634 in mono_os_mutex_lock (mutex=) at /__w/1/s/src/mono/mono/mini/../../mono/utils/mono-os-mutex.h:105 #3 mono_coop_mutex_lock (mutex=) at /__w/1/s/src/mono/mono/mini/../../mono/utils/mono-coop-mutex.h:57 #4 sgen_gc_lock () at /__w/1/s/src/mono/mono/sgen/sgen-gc.c:3937 #5 0x0000007f9f984f94 in sgen_alloc_obj (vtable=0x7f8000df70, size=136) at /__w/1/s/src/mono/mono/sgen/sgen-alloc.c:453 #6 0x0000007f9f9549f0 in mono_gc_alloc_obj (vtable=0x7f9fb7c120 , size=128) at /__w/1/s/src/mono/mono/metadata/sgen-mono.c:911 #7 0x0000007f9cd00af4 in ?? () #8 0x0000007f8412b960 in ?? () Backtrace stopped: previous frame inner to this frame (corrupt stack?) Thread 12 (Thread 0x7f9460e1c0 (LWP 37)): #0 0x0000007fa00db5bc in futex_reltimed_wait_cancelable (private=, reltime=0x7f00000000, expected=0, futex_word=0x7f6c014b5c) at ../sysdeps/unix/sysv/linux/futex-internal.h:142 #1 __pthread_cond_wait_common (abstime=0x7f94608fc8, mutex=0x7f6c014b00, cond=0x7f6c014b30) at pthread_cond_wait.c:533 #2 __pthread_cond_timedwait (cond=0x7f6c014b30, mutex=0x7f6c014b00, abstime=0x7f94608fc8) at pthread_cond_wait.c:667 #3 0x0000007f9ccd3490 in SystemNative_LowLevelMonitor_TimedWait (monitor=0x7f6c014b00, timeoutMilliseconds=30000) at /__w/1/s/src/native/libs/System.Native/pal_threading.c:195 #4 0x0000007f94c7fd4c in ?? () #5 0x0000007f9613b8d8 in ?? () #6 0x0000007f9d423790 in ?? () #7 0xf90047bda907f3bb in ?? () Backtrace stopped: previous frame identical to this frame (corrupt stack?) Thread 11 (Thread 0x7f9480f1c0 (LWP 36)): #0 0x0000007fa00db2a4 in futex_wait_cancelable (private=, expected=0, futex_word=0x557d699cf0) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x557d699c98, cond=0x557d699cc8) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=0x557d699cc8, mutex=0x557d699c98) at pthread_cond_wait.c:655 #3 0x0000007f9f973090 in mono_os_cond_wait (cond=0x557d699cc8, mutex=0x557d699c98) at /__w/1/s/src/mono/mono/utils/mono-os-mutex.h:219 #4 mono_os_cond_timedwait (cond=0x557d699cc8, mutex=0x557d699c98, timeout_ms=0) at /__w/1/s/src/mono/mono/utils/mono-os-mutex.c:32 #5 0x0000007f9f928aac in mono_coop_cond_timedwait (cond=0x557d699cc8, mutex=0x557d699c98, timeout_ms=4294967295) at /__w/1/s/src/mono/mono/mini/../../mono/utils/mono-coop-mutex.h:103 #6 mono_w32handle_timedwait_signal_naked (cond=0x557d699cc8, mutex=0x557d699c98, timeout=4294967295, poll=0, alerted=) at /__w/1/s/src/mono/mono/metadata/w32handle.c:514 #7 mono_w32handle_timedwait_signal_handle (handle_data=0x557d699c88, timeout=4294967295, poll=0, alerted=0x7f94808b9c) at /__w/1/s/src/mono/mono/metadata/w32handle.c:629 #8 0x0000007f9f928940 in mono_w32handle_wait_one (handle=, timeout=, alertable=) at /__w/1/s/src/mono/mono/metadata/w32handle.c:728 #9 0x0000007f9f94a7dc in mono_monitor_wait (obj_handle=..., ms=, allow_interruption=, error=) at /__w/1/s/src/mono/mono/metadata/monitor.c:1364 #10 ves_icall_System_Threading_Monitor_Monitor_wait (obj_handle=..., ms=4294967295, allow_interruption=1 '\001', error=) at /__w/1/s/src/mono/mono/metadata/monitor.c:1443 #11 0x0000007f9f8db824 in ves_icall_System_Threading_Monitor_Monitor_wait_raw (a0=0x7f94808d20, a1=4294967295, a2=1 '\001') at /__w/1/s/src/mono/mono/mini/../metadata/icall-def.h:570 #12 0x0000007f6ac89ef0 in ?? () #13 0x0000007f9480b508 in ?? () Backtrace stopped: previous frame identical to this frame (corrupt stack?) Thread 10 (Thread 0x7f94a101c0 (LWP 35)): #0 0x0000007fa00db5bc in futex_reltimed_wait_cancelable (private=, reltime=0x7f00000000, expected=0, futex_word=0x7f7400848c) at ../sysdeps/unix/sysv/linux/futex-internal.h:142 #1 __pthread_cond_wait_common (abstime=0x7f94a0afc8, mutex=0x7f74008430, cond=0x7f74008460) at pthread_cond_wait.c:533 #2 __pthread_cond_timedwait (cond=0x7f74008460, mutex=0x7f74008430, abstime=0x7f94a0afc8) at pthread_cond_wait.c:667 #3 0x0000007f9ccd3490 in SystemNative_LowLevelMonitor_TimedWait (monitor=0x7f74008430, timeoutMilliseconds=30000) at /__w/1/s/src/native/libs/System.Native/pal_threading.c:195 #4 0x0000007f94c7fd4c in ?? () #5 0x0000007f9613b8d8 in ?? () #6 0x0000007f9d423790 in ?? () #7 0xf90047bda907f3bb in ?? () Backtrace stopped: previous frame identical to this frame (corrupt stack?) Thread 9 (Thread 0x7f94c7a1c0 (LWP 34)): #0 0x0000007fa00db5bc in futex_reltimed_wait_cancelable (private=, reltime=0x0, expected=0, futex_word=0x7f44033628) at ../sysdeps/unix/sysv/linux/futex-internal.h:142 #1 __pthread_cond_wait_common (abstime=0x7f94c78c90, mutex=0x7f9fb74f38 , cond=0x7f44033600) at pthread_cond_wait.c:533 #2 __pthread_cond_timedwait (cond=0x7f44033600, mutex=0x7f9fb74f38 , abstime=0x7f94c78c90) at pthread_cond_wait.c:667 #3 0x0000007f9f973068 in mono_os_cond_timedwait (cond=0x7f44033600, mutex=0x7f9fb74f38 , timeout_ms=1000) at /__w/1/s/src/mono/mono/utils/mono-os-mutex.c:75 #4 0x0000007f9f9dba54 in mono_coop_cond_timedwait (cond=, timeout_ms=1000, mutex=) at /__w/1/s/src/mono/mono/mini/../../mono/utils/mono-coop-mutex.h:103 #5 wait_or_register_method_to_compile (method=) at /__w/1/s/src/mono/mono/mini/mini-runtime.c:2338 #6 mono_jit_compile_method_with_opt (method=0x7f5004b2f0, opt=374417919, jit_only=0, error=) at /__w/1/s/src/mono/mono/mini/mini-runtime.c:2705 #7 jit_compile_method_with_opt_cb (arg=) at /__w/1/s/src/mono/mono/mini/mini-runtime.c:2762 #8 jit_compile_method_with_opt (params=) at /__w/1/s/src/mono/mono/mini/mini-runtime.c:2778 #9 0x0000007f9f9db210 in mono_jit_compile_method (method=, error=0x7f94c79208) at /__w/1/s/src/mono/mono/mini/mini-runtime.c:2797 #10 0x0000007f9fa75614 in mono_delegate_trampoline (regs=, code=, arg=0x7f7817c590, tramp=) at /__w/1/s/src/mono/mono/mini/mini-trampolines.c:1100 #11 0x0000007f9f64d204 in ?? () #12 0x0000007f9f3a1e68 in ?? () #13 0x0000007f6acca438 in ?? () Backtrace stopped: not enough registers or memory available to unwind further Thread 8 (Thread 0x7f94ccb1c0 (LWP 33)): #0 0x0000007fa00db5bc in futex_reltimed_wait_cancelable (private=, reltime=0x7f00000000, expected=0, futex_word=0x7f7c020e28) at ../sysdeps/unix/sysv/linux/futex-internal.h:142 #1 __pthread_cond_wait_common (abstime=0x7f94cca2b8, mutex=0x7f7c020dd0, cond=0x7f7c020e00) at pthread_cond_wait.c:533 #2 __pthread_cond_timedwait (cond=0x7f7c020e00, mutex=0x7f7c020dd0, abstime=0x7f94cca2b8) at pthread_cond_wait.c:667 #3 0x0000007f9ccd3490 in SystemNative_LowLevelMonitor_TimedWait (monitor=0x7f7c020dd0, timeoutMilliseconds=500) at /__w/1/s/src/native/libs/System.Native/pal_threading.c:195 #4 0x0000007f94c7fd4c in ?? () #5 0x0000007f9613b8d8 in ?? () #6 0x0000007f94cca910 in ?? () Backtrace stopped: previous frame inner to this frame (corrupt stack?) Thread 7 (Thread 0x7f9612f1c0 (LWP 32)): #0 0x0000007fa00db5bc in futex_reltimed_wait_cancelable (private=, reltime=0x7f00000000, expected=0, futex_word=0x7f8802d138) at ../sysdeps/unix/sysv/linux/futex-internal.h:142 #1 __pthread_cond_wait_common (abstime=0x7f9612e0f8, mutex=0x7f8802d0e0, cond=0x7f8802d110) at pthread_cond_wait.c:533 #2 __pthread_cond_timedwait (cond=0x7f8802d110, mutex=0x7f8802d0e0, abstime=0x7f9612e0f8) at pthread_cond_wait.c:667 #3 0x0000007f9ccd3490 in SystemNative_LowLevelMonitor_TimedWait (monitor=0x7f8802d0e0, timeoutMilliseconds=12000) at /__w/1/s/src/native/libs/System.Native/pal_threading.c:195 #4 0x0000007f94c7fd4c in ?? () #5 0x0000007f9613b8d8 in ?? () #6 0x0000007f9612e910 in ?? () Backtrace stopped: previous frame inner to this frame (corrupt stack?) Thread 6 (Thread 0x7f95f2e1c0 (LWP 31)): #0 0x0000007fa00db2a4 in futex_wait_cancelable (private=, expected=0, futex_word=0x7f8411a378) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x7f8411a320, cond=0x7f8411a350) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=0x7f8411a350, mutex=0x7f8411a320) at pthread_cond_wait.c:655 #3 0x0000007f9ccd332c in SystemNative_LowLevelMonitor_Wait (monitor=0x7f8411a320) at /__w/1/s/src/native/libs/System.Native/pal_threading.c:155 #4 0x0000007f9613c004 in ?? () #5 0x0000007f9f0313e8 in ?? () #6 0x0000007f94d16a98 in ?? () Backtrace stopped: previous frame inner to this frame (corrupt stack?) Thread 5 (Thread 0x7f962491c0 (LWP 28)): #0 0x0000007fa00dfd5c in __waitpid (pid=, stat_loc=0x7f962462b0, options=) at ../sysdeps/unix/sysv/linux/waitpid.c:30 #1 0x0000007f9fab3f70 in dump_native_stacktrace (signal=, mctx=) at /__w/1/s/src/mono/mono/mini/mini-posix.c:843 #2 mono_dump_native_crash_info (signal=, mctx=0x7f96246ce0, info=) at /__w/1/s/src/mono/mono/mini/mini-posix.c:870 #3 0x0000007f9fa72800 in mono_handle_native_crash (signal=0x7f9f8642a7 "SIGABRT", mctx=0x7f96246ce0, info=0x7f96247020) at /__w/1/s/src/mono/mono/mini/mini-exceptions.c:3005 #4 0x0000007f9fab367c in sigabrt_signal_handler (_dummy=6, _info=0x7f96247020, context=0x7f962470a0) at /__w/1/s/src/mono/mono/mini/mini-posix.c:225 #5 #6 __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51 #7 0x0000007f9fd22974 in __GI_abort () at abort.c:79 #8 0x0000007f9f8d226c in ves_icall_System_Environment_FailFast (message=..., exception=..., errorSource=..., error=) at /__w/1/s/src/mono/mono/metadata/icall.c:6068 #9 0x0000007f9f8d487c in ves_icall_System_Environment_FailFast_raw (a0=0x7f962485b0, a1=0x7f962485b8, a2=0x7f962485c0) at /__w/1/s/src/mono/mono/mini/../metadata/icall-def.h:194 #10 0x0000007f6acfcb68 in ?? () Backtrace stopped: previous frame identical to this frame (corrupt stack?) Thread 4 (Thread 0x7f9d1b61c0 (LWP 27)): #0 0x0000007fa00dda40 in futex_abstimed_wait_cancelable (private=0, abstime=0x0, expected=0, futex_word=0x7f9fb657d8 ) at ../sysdeps/unix/sysv/linux/futex-internal.h:205 #1 do_futex_wait (sem=sem@entry=0x7f9fb657d8 , abstime=0x0) at sem_waitcommon.c:111 #2 0x0000007fa00ddb60 in __new_sem_wait_slow (sem=0x7f9fb657d8 , abstime=0x0) at sem_waitcommon.c:181 #3 0x0000007f9f948d84 in mono_os_sem_wait (sem=, flags=MONO_SEM_FLAGS_ALERTABLE) at /__w/1/s/src/mono/mono/mini/../utils/mono-os-semaphore.h:204 #4 mono_coop_sem_wait (sem=, flags=MONO_SEM_FLAGS_ALERTABLE) at /__w/1/s/src/mono/mono/mini/../../mono/utils/mono-coop-semaphore.h:41 #5 finalizer_thread (unused=) at /__w/1/s/src/mono/mono/metadata/gc.c:891 #6 0x0000007f9f923b4c in start_wrapper_internal (start_info=0x0, stack_ptr=) at /__w/1/s/src/mono/mono/metadata/threads.c:1202 #7 0x0000007f9f9239f8 in start_wrapper (data=0x557d736990) at /__w/1/s/src/mono/mono/metadata/threads.c:1264 #8 0x0000007fa00d5088 in start_thread (arg=0x7fc91d3e3f) at pthread_create.c:463 #9 0x0000007f9fdbf0cc in thread_start () at ../sysdeps/unix/sysv/linux/aarch64/clone.S:78 Thread 3 (Thread 0x7f9d3b71c0 (LWP 26)): #0 0x0000007f9fdb5ef8 in __GI___poll (fds=0x7f98003af0, nfds=548137295368, timeout=) at ../sysdeps/unix/sysv/linux/poll.c:41 #1 0x0000007f9fb3ecc8 in ipc_poll_fds (fds=, nfds=1, timeout=4294967295) at /__w/1/s/src/native/eventpipe/ds-ipc-pal-socket.c:470 #2 ds_ipc_poll (poll_handles_data=0x7f980032e0, poll_handles_data_len=1, timeout_ms=4294967295, callback=0x7f9fb3e078 ) at /__w/1/s/src/native/eventpipe/ds-ipc-pal-socket.c:1096 #3 0x0000007f9fb3c274 in ds_ipc_stream_factory_get_next_available_stream (callback=0x7f9fb3e078 ) at /__w/1/s/src/native/eventpipe/ds-ipc.c:395 #4 0x0000007f9fb3aaec in server_thread (data=) at /__w/1/s/src/native/eventpipe/ds-server.c:127 #5 0x0000007f9fb3e058 in ep_rt_thread_mono_start_func (data=0x557d71fd30) at /__w/1/s/src/mono/mono/mini/../eventpipe/ep-rt-mono.h:1332 #6 0x0000007fa00d5088 in start_thread (arg=0x7fc91d3f8f) at pthread_create.c:463 #7 0x0000007f9fdbf0cc in thread_start () at ../sysdeps/unix/sysv/linux/aarch64/clone.S:78 Thread 2 (Thread 0x7f9efff1c0 (LWP 25)): #0 0x0000007fa00db2a4 in futex_wait_cancelable (private=, expected=0, futex_word=0x7f9fb747b8 ) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x7f9fb74760 , cond=0x7f9fb74790 ) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=0x7f9fb74790 , mutex=0x7f9fb74760 ) at pthread_cond_wait.c:655 #3 0x0000007f9f9c4e50 in mono_os_cond_wait (cond=0x7f9fb747b8 , mutex=) at /__w/1/s/src/mono/mono/mini/../../mono/utils/mono-os-mutex.h:219 #4 get_work (worker_index=, work_context=, do_idle=, job=) at /__w/1/s/src/mono/mono/sgen/sgen-thread-pool.c:167 #5 thread_func (data=0x0) at /__w/1/s/src/mono/mono/sgen/sgen-thread-pool.c:198 #6 0x0000007fa00d5088 in start_thread (arg=0x7fc91d3f2f) at pthread_create.c:463 #7 0x0000007f9fdbf0cc in thread_start () at ../sysdeps/unix/sysv/linux/aarch64/clone.S:78 Thread 1 (Thread 0x7fa0119ff0 (LWP 24)): #0 0x0000007fa00db2a4 in futex_wait_cancelable (private=, expected=0, futex_word=0x557e0be89c) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x557e0be840, cond=0x557e0be870) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=0x557e0be870, mutex=0x557e0be840) at pthread_cond_wait.c:655 #3 0x0000007f9ccd332c in SystemNative_LowLevelMonitor_Wait (monitor=0x557e0be840) at /__w/1/s/src/native/libs/System.Native/pal_threading.c:155 #4 0x0000007f9613c004 in ?? () #5 0x0000007f9fb74000 in pin_hash_filter () from /root/helix/work/correlation/shared/Microsoft.NETCore.App/8.0.0/libcoreclr.so Backtrace stopped: previous frame identical to this frame (corrupt stack?) ================================================================= Basic Fault Address Reporting ================================================================= Memory around native instruction pointer (0x7f9fd21598):0x7f9fd21588 02 00 80 d2 03 01 80 d2 e8 10 80 d2 01 00 00 d4 ................ 0x7f9fd21598 73 72 47 f9 e0 03 04 2a a2 97 40 f9 61 02 40 f9 srG....*..@.a.@. 0x7f9fd215a8 41 00 01 ca 61 01 00 b5 f3 53 41 a9 fd 7b d3 a8 A...a....SA..{.. 0x7f9fd215b8 c0 03 5f d6 01 09 00 90 21 0c 47 f9 42 d0 3b d5 .._.....!.G.B.;. ================================================================= Managed Stacktrace: ================================================================= at <0xffffffff> at System.Environment:FailFast <0x00007> at System.Environment:FailFast <0x00033> at System.Diagnostics.ProcessWaitState:TryReapChild <0x001a3> at System.Diagnostics.ProcessWaitState:CheckChildren <0x00273> at System.Diagnostics.Process:OnSigChild <0x0006f> at System.Diagnostics.Process:OnSigChild <0x00053> ================================================================= ./RunTests.sh: line 168: 24 Aborted (core dumped) "$RUNTIME_PATH/dotnet" exec --runtimeconfig System.Net.Requests.Tests.runtimeconfig.json --depsfile System.Net.Requests.Tests.deps.json xunit.console.dll System.Net.Requests.Tests.dll -xml testResults.xml -nologo -nocolor -notrait category=IgnoreForCI -notrait category=OuterLoop -notrait category=failing $RSP_FILE /root/helix/work/workitem/e ----- end Thu Sep 8 00:57:00 UTC 2022 ----- exit code 134 ---------------------------------------------------------- ```
Author: carlossanlop
Assignees: -
Labels: `arch-arm64`, `area-System.Net`, `os-linux`, `blocking-clean-ci`, `runtime-mono`, `Known Build Error`
Milestone: -
wfurt commented 2 years ago

Duplicate of #74795