dotnet / runtime

.NET is a cross-platform runtime for cloud, mobile, desktop, and IoT apps.
https://docs.microsoft.com/dotnet/core/
MIT License
15.06k stars 4.69k forks source link

Test failure: GC/Features/SustainedLowLatency/scenario/scenario.sh #100567

Open v-wenyuxu opened 6 months ago

v-wenyuxu commented 6 months ago

Failed in: runtime-coreclr outerloop 20240402.2

Failed tests:

R2R-CG2 osx x64 Checked @ OSX.1200.Amd64.Open
    - GC/Features/SustainedLowLatency/scenario/scenario.sh

Error message:

 /private/tmp/helix/working/A770093C/w/B12D0911/e/GC/Features/SustainedLowLatency/scenario/scenario.sh: line 322: -r:/private/tmp/helix/working/A770093C/w/B12D0911/e/GC/Features/SustainedLowLatency/scenario/IL-CG2/*.dll: No such file or directory
waitpid() returned successfully (wstatus 00000000) WEXITSTATUS 0 WTERMSIG 0
/private/tmp/helix/working/A770093C/w/B12D0911/e/GC/Features/SustainedLowLatency/scenario/scenario.sh: line 448: 37615 Segmentation fault: 11  (core dumped) $LAUNCHER $ExePath "${CLRTestExecutionArguments[@]}"

Return code:      1
Raw output file:      /tmp/helix/working/A770093C/w/B12D0911/uploads/Reports/GC.Features/SustainedLowLatency/scenario/scenario.output.txt
Raw output:
BEGIN EXECUTION
in takeLock
/private/tmp/helix/working/A770093C/w/B12D0911/e/GC/Features/SustainedLowLatency/scenario/IL-CG2/scenario.dll
16:53:05
Response file: /private/tmp/helix/working/A770093C/w/B12D0911/e/GC/Features/SustainedLowLatency/scenario/scenario.dll.rsp
/private/tmp/helix/working/A770093C/w/B12D0911/e/GC/Features/SustainedLowLatency/scenario/IL-CG2/scenario.dll
-o:/private/tmp/helix/working/A770093C/w/B12D0911/e/GC/Features/SustainedLowLatency/scenario/scenario.dll
-r:/tmp/helix/working/A770093C/p/System.*.dll
-r:/tmp/helix/working/A770093C/p/Microsoft.*.dll
-r:/tmp/helix/working/A770093C/p/xunit.*.dll
-r:/tmp/helix/working/A770093C/p/mscorlib.dll
--verify-type-and-field-layout
--method-layout:random
--targetarch:x64
--targetos:osx
Running CrossGen2:  dotnet /tmp/helix/working/A770093C/p/crossgen2/crossgen2.dll @/private/tmp/helix/working/A770093C/w/B12D0911/e/GC/Features/SustainedLowLatency/scenario/scenario.dll.rsp  
Emitting R2R PE file: /private/tmp/helix/working/A770093C/w/B12D0911/e/GC/Features/SustainedLowLatency/scenario/scenario.dll
Running R2RDump:  dotnet /tmp/helix/working/A770093C/p/R2RDump/R2RDump.dll --header --sc --in /private/tmp/helix/working/A770093C/w/B12D0911/e/GC/Features/SustainedLowLatency/scenario/scenario.dll --out /private/tmp/helix/working/A770093C/w/B12D0911/e/GC/Features/SustainedLowLatency/scenario/scenario.dll.r2rdump --val
16:53:08
in ReleaseLock
in takeLock
/tmp/helix/working/A770093C/p/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false -p System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true scenario.dll ''
 Cleaning up-------gen0: 1442, gen1: 479; gen2: 159, heap size: 128,840,984 bytes
 Cleaning up-------gen0: 2853, gen1: 927; gen2: 287, heap size: 126,768,296 bytes
 Cleaning up-------gen0: 4268, gen1: 1378; gen2: 416, heap size: 121,615,664 bytes
 Cleaning up-------gen0: 5681, gen1: 1829; gen2: 545, heap size: 124,337,792 bytes
 Cleaning up-------gen0: 7103, gen1: 2287; gen2: 683, heap size: 131,262,528 bytes
 Cleaning up-------gen0: 8523, gen1: 2744; gen2: 820, heap size: 131,251,152 bytes
 Cleaning up-------gen0: 9949, gen1: 3207; gen2: 961, heap size: 122,991,672 bytes
 Cleaning up-------gen0: 11375, gen1: 3670; gen2: 1102, heap size: 112,445,712 bytes
 Cleaning up-------gen0: 12799, gen1: 4130; gen2: 1241, heap size: 118,389,184 bytes
[createdump] Gathering state for process 37615 
[createdump] Crashing thread 65eaa8 signal 11 (000b)
[createdump] Writing crash report to file /cores/coredump.37615.dmp.crashreport.json
[createdump] Crash report successfully written
[createdump] Writing minidump with heap to file /cores/coredump.37615.dmp
[createdump] Written 538673320 bytes (131512 pages) to core file
[createdump] Target process is alive
[createdump] Dump successfully written in 2455ms
in ReleaseLock
Expected: 100
Actual: 139
END EXECUTION - FAILED
Test failed. Trying to see if dump file was created in /cores since 4/2/2024 4:53:05 PM
Processing /cores/coredump.37615.dmp.crashreport.json
Printing stacktrace from '/cores/coredump.37615.dmp.crashreport.json'
Invoking llvm-symbolizer --pretty-print
Errors while running llvm-symbolizer --pretty-print
System.ComponentModel.Win32Exception (2): An error occurred trying to start process 'llvm-symboli

Stack trace:

    at GC_Features._SustainedLowLatency_scenario_scenario_._SustainedLowLatency_scenario_scenario_sh()
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
   at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)

<html xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:x="urn:schemas-microsoft-com:office:excel" xmlns="http://www.w3.org/TR/REC-html40">

Queued | Pipeline | Pipeline_Configuration | OS | Arch | Test | Outcome | Properties | BuildReason -- | -- | -- | -- | -- | -- | -- | -- | -- 2024-04-02T20:52:33.327Z | runtime-coreclr outerloop | Checked | osx.1200.amd64.open | x64 | GC/Features/SustainedLowLatency/scenario/scenario.sh | Failed | {"System.PhaseName":"run_test_p1_R2R_CG2_osx_x64_checked","Project":"public","Reason":"Schedule","BuildNumber":"20240402.2","AzurePipelinesTestRunId":"15400982","BuildId":"627313","System.JobAttempt":"1","System.PhaseAttempt":"1","System.JobId":"2bb87d59-31ba-55f9-0713-03158c3fd52f","System.StageAttempt":"1","DefinitionId":"108","architecture":"x64","System.StageName":"Build","CollectionUri":"https://dev.azure.com/dnceng-public/","operatingSystem":"OSX.1200.Amd64.Open","configuration":"Checked","DefinitionName":"runtime-coreclr outerloop","System.JobName":"__default"} | Schedule 2024-02-11T18:37:54.24Z | runtime-coreclr superpmi-collect | Checked | osx.1200.arm64 | arm64 | GC/Features/SustainedLowLatency/scenario/scenario.sh | Failed | {"CollectionUri":"https://dev.azure.com/dnceng/","System.StageAttempt":"1","Reason":"Schedule","System.JobAttempt":"1","System.PhaseAttempt":"1","AzurePipelinesTestRunId":"53048233","DefinitionName":"runtime-coreclr superpmi-collect","System.JobId":"765fd5e9-e47f-5cb0-4cbf-499eaaaee93e","BuildNumber":"20240211.1","System.PhaseName":"run_test_p1__osx_arm64_checked","DefinitionId":"977","System.StageName":"Build","architecture":"arm64","BuildId":"2375670","Project":"internal","configuration":"Checked","operatingSystem":"OSX.1200.ARM64","System.JobName":"__default"} | Schedule 2024-02-11T18:27:41.42Z | runtime-coreclr superpmi-collect | Checked | ubuntu.2204.amd64.rt | x64 | GC/Features/SustainedLowLatency/scenario/scenario.sh | Failed | {"BuildNumber":"20240211.1","System.PhaseAttempt":"1","System.PhaseName":"run_test_p1__linux_x64_checked","System.JobName":"__default","configuration":"Checked","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.StageAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng/","DefinitionId":"977","Reason":"Schedule","operatingSystem":"Ubuntu.2204.Amd64","BuildId":"2375670","System.JobAttempt":"1","System.StageName":"Build","AzurePipelinesTestRunId":"53048215","DefinitionName":"runtime-coreclr superpmi-collect","architecture":"x64","Project":"internal"} | Schedule 2024-02-11T18:27:23.571Z | runtime-coreclr superpmi-collect | Checked | ubuntu.2004.armarch | arm64 | GC/Features/SustainedLowLatency/scenario/scenario.sh | Failed | {"configuration":"Checked","Reason":"Schedule","AzurePipelinesTestRunId":"53048211","System.JobAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng/","Project":"internal","System.JobName":"__default","architecture":"arm64","System.PhaseName":"run_test_p1__linux_arm64_checked","System.StageAttempt":"1","operatingSystem":"(Ubuntu.1804.Arm64)Ubuntu.2004.ArmArch@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm64v8","DefinitionId":"977","DefinitionName":"runtime-coreclr superpmi-collect","System.JobId":"34b2f53b-add1-5e74-7a39-5a11483297fc","BuildNumber":"20240211.1","System.PhaseAttempt":"1","BuildId":"2375670","System.StageName":"Build"} | Schedule 2024-02-11T18:25:32.517Z | runtime-coreclr superpmi-collect | Checked | ubuntu.2004.armarch | arm | GC/Features/SustainedLowLatency/scenario/scenario.sh | Failed | {"System.PhaseName":"run_test_p1__linux_arm_checked","Project":"internal","System.JobId":"860c965f-b28e-50d5-65d2-e40bd59f3a69","Reason":"Schedule","AzurePipelinesTestRunId":"53048207","BuildId":"2375670","DefinitionId":"977","configuration":"Checked","BuildNumber":"20240211.1","System.JobName":"__default","System.StageName":"Build","DefinitionName":"runtime-coreclr superpmi-collect","operatingSystem":"(Ubuntu.1804.Arm32)Ubuntu.2004.Armarch@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","CollectionUri":"https://dev.azure.com/dnceng/","System.StageAttempt":"1","System.JobAttempt":"1","System.PhaseAttempt":"1","architecture":"arm"} | Schedule 2024-02-04T18:41:10.867Z | runtime-coreclr superpmi-collect | Checked | osx.1200.arm64 | arm64 | GC/Features/SustainedLowLatency/scenario/scenario.sh | Failed | {"System.JobId":"765fd5e9-e47f-5cb0-4cbf-499eaaaee93e","configuration":"Checked","DefinitionId":"977","System.PhaseName":"run_test_p1__osx_arm64_checked","BuildId":"2369727","System.JobName":"__default","BuildNumber":"20240204.1","DefinitionName":"runtime-coreclr superpmi-collect","architecture":"arm64","System.StageAttempt":"1","System.JobAttempt":"1","System.PhaseAttempt":"1","operatingSystem":"OSX.1200.ARM64","System.StageName":"Build","Project":"internal","Reason":"Schedule","CollectionUri":"https://dev.azure.com/dnceng/","AzurePipelinesTestRunId":"53001665"} | Schedule 2024-02-04T18:26:14.606Z | runtime-coreclr superpmi-collect | Checked | ubuntu.2004.armarch | arm64 | GC/Features/SustainedLowLatency/scenario/scenario.sh | Failed | {"System.StageName":"Build","BuildNumber":"20240204.1","System.StageAttempt":"1","Project":"internal","BuildId":"2369727","System.JobId":"34b2f53b-add1-5e74-7a39-5a11483297fc","architecture":"arm64","DefinitionId":"977","AzurePipelinesTestRunId":"53001609","System.JobName":"__default","operatingSystem":"(Ubuntu.1804.Arm64)Ubuntu.2004.ArmArch@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm64v8","System.PhaseName":"run_test_p1__linux_arm64_checked","Reason":"Schedule","DefinitionName":"runtime-coreclr superpmi-collect","configuration":"Checked","System.JobAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng/","System.PhaseAttempt":"1"} | Schedule 2024-02-04T18:25:21.481Z | runtime-coreclr superpmi-collect | Checked | ubuntu.2204.amd64.rt | x64 | GC/Features/SustainedLowLatency/scenario/scenario.sh | Failed | {"CollectionUri":"https://dev.azure.com/dnceng/","System.StageName":"Build","DefinitionName":"runtime-coreclr superpmi-collect","architecture":"x64","System.JobAttempt":"1","configuration":"Checked","System.JobName":"__default","BuildNumber":"20240204.1","Project":"internal","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.StageAttempt":"1","BuildId":"2369727","operatingSystem":"Ubuntu.2204.Amd64","Reason":"Schedule","AzurePipelinesTestRunId":"53001599","DefinitionId":"977","System.PhaseName":"run_test_p1__linux_x64_checked","System.PhaseAttempt":"1"} | Schedule 2024-02-03T07:21:20.949Z | runtime-coreclr pgostress | Checked-syntheticpgo | ubuntu.2004.armarch.open | arm64 | GC/Features/SustainedLowLatency/scenario/scenario.sh | Failed | {"Project":"public","System.StageAttempt":"1","System.PhaseName":"run_test_p1__linux_arm64_checked","DefinitionId":"230","System.JobId":"34b2f53b-add1-5e74-7a39-5a11483297fc","System.JobName":"__default","System.PhaseAttempt":"1","operatingSystem":"(Ubuntu.1804.Arm64.Open)Ubuntu.2004.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm64v8","DefinitionName":"runtime-coreclr pgostress","System.JobAttempt":"1","System.StageName":"Build","BuildNumber":"20240202.1","Reason":"Schedule","configuration":"Checked-syntheticpgo","CollectionUri":"https://dev.azure.com/dnceng-public/","BuildId":"552059","AzurePipelinesTestRunId":"13130954","architecture":"arm64"} | Schedule 2024-02-03T07:20:52.1Z | runtime-coreclr pgostress | Checked-syntheticpgo | ubuntu.2204.amd64.open.rt | x64 | GC/Features/SustainedLowLatency/scenario/scenario.sh | Failed | {"configuration":"Checked-syntheticpgo","CollectionUri":"https://dev.azure.com/dnceng-public/","DefinitionId":"230","BuildNumber":"20240202.1","System.StageName":"Build","System.PhaseName":"run_test_p1__linux_x64_checked","Reason":"Schedule","AzurePipelinesTestRunId":"13130932","architecture":"x64","System.PhaseAttempt":"1","System.JobAttempt":"1","DefinitionName":"runtime-coreclr pgostress","BuildId":"552059","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.JobName":"__default","System.StageAttempt":"1","Project":"public","operatingSystem":"Ubuntu.2204.Amd64.Open"} | Schedule

SzpejnaDawid commented 4 months ago

At now, I'm working on this issue because we have the same problem on RISC-V64. I notice this test will pass if <ConcurrentGarbageCollection>false</ConcurrentGarbageCollection> is set.

SzpejnaDawid commented 4 months ago

I also found these tests fail from time to time:

All of them use Pinned Objects. Hazards among threads seems to be crucial because on slower machines i could recreate this errors. bestfit test is the most annoying because failure occurs 1/35 tests on my PC and when I used gdb i couldn't recreate the error. For plug.sh and scenario.sh I discovered that both failures are related with background_mark_phase (I used gdb to examine both tests).

v-wenyuxu commented 3 months ago

Failed in: runtime-coreclr outerloop 20240613.3

Failed tests:

coreclr linux arm Checked @ (Alpine.316.Arm32.Open)Ubuntu.2004.ArmArch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.17-helix-arm32v7
    - GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh

Error message:

 waitpid() returned successfully (wstatus 00000000) WEXITSTATUS 0 WTERMSIG 0
/root/helix/work/workitem/e/GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh: line 455:  3496 Segmentation fault      (core dumped) $LAUNCHER $ExePath "${CLRTestExecutionArguments[@]}"

Return code:      1
Raw output file:      /root/helix/work/workitem/uploads/Reports/GC.Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.output.txt
Raw output:
BEGIN EXECUTION
/root/helix/work/correlation/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false -p System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true FinalizeTimeout.dll ''
Main start
Finalizer start
Finalizer end
Main end
Finalizer start
[createdump] Gathering state for process 3496 corerun
[createdump] Crashing thread 0db4 signal 11 (000b)
[createdump] Writing crash report to file /home/helixbot/dotnetbuild/dumps/coredump.3496.dmp.crashreport.json
[createdump] Crash report successfully written
[createdump] Writing minidump with heap to file /home/helixbot/dotnetbuild/dumps/coredump.3496.dmp
[createdump] Written 27295744 bytes (6664 pages) to core file
[createdump] Target process is alive
[createdump] Dump successfully written in 98ms
Expected: 100
Actual: 139
END EXECUTION - FAILED
Test failed. Trying to see if dump file was created in /home/helixbot/dotnetbuild/dumps since 6/13/2024 7:54:52 PM
Processing /home/helixbot/dotnetbuild/dumps/coredump.3496.dmp.crashreport.json
Printing stacktrace from '/home/helixbot/dotnetbuild/dumps/coredump.3496.dmp.crashreport.json'
Invoking llvm-symbolizer --pretty-print
Stack trace:
----------------------------------
Thread Id: 0xda8
      Child SP               IP Call Site
----------------------------------
Thread Id: 0xdab
      Child SP               IP Call Site
----------------------------------
Thread Id: 0xdac
      Child SP               IP Call Site
----------------------------------
Thread Id: 0xdad
      Child SP               IP Call Site
----------------------------------
Thread Id: 0xdae
      Child SP               IP Call Site
----------------------------------
Thread Id: 0xdaf
      Child SP               IP Call Site
 0xf3b47f30 0xf7ab69aa 0xf7ab69aa
 0xf3b48278 0xf105cbb8 FinalizeTimeout+BlockingFinalizerOnShutdown.Finalize()
 0xf3b482e0 0xf76613f6 0xf76613f6
 0xf3b482f0 0xf74d25ea libcoreclr.so!CallDescrWorker(CallDescrData*) at /__w/1/s/src/coreclr/vm/callhelpers.cpp:0:5
 0xf3b48718 0xf74d24ba libcoreclr.so!NativeExceptionHolderBase::~NativeExceptionHolderBase() at /__w/1/s/src/coreclr/pal/inc/pal.h:4236:13
 (inlined by) CallDescrWorkerWithHandler(CallDescrData*, int) at /__w/1/s/src/coreclr/vm/callhelpers.cpp:69:5
 0xf3b48740 0xf74d27f2 libcoreclr.so!DispatchCallSimple(unsigned int*, unsigned int, unsigned int, unsigned int) at /__w/1/s/src/coreclr/vm/callhelpers.cpp:0:9
 0xf3b487a0 0xf74574e8 libcoreclr.so!MethodTable::CallFinalizer(Object*) at /__w/1/s/src/coreclr/vm/methodtable.cpp:0:5
 0xf3b487d8 0xf75183f0 libcoreclr.so!FinalizerThread::GetFinalizerThread() at /__w/1/s/src/coreclr/vm/finalizerthread.h:41:9
 (inlined by) FinalizerThread::FinalizeAllObjects() at /__w/1/s/src/coreclr/vm/finalizerthread.cpp:108:9
 0xf3b48808 0xf7518c10 libcoreclr.so!InterlockedAnd at /__w/1/s/src/coreclr/pal/inc/pal.h:3643:1
 (inlined by) FinalizerThread::SignalFinalizationDone(int) at /__w/1/s/src/coreclr/vm/finalizerthread.cpp:488:9
 (inlined by) FinalizerThread::FinalizerThreadWorker(void*) at /__w/1/s/src/coreclr/vm/finalizerthread.cpp:354:9
 0xf3b48a70 0xf749f976 libcoreclr.so!ManagedThreadBase_DispatchMiddle(ManagedThreadCallState*) at /__w/1/s/src/coreclr/vm/threads.cpp:0:5
 (inlined by) ManagedThreadBase_DispatchOuter(ManagedThreadCallState*)::$_0::operator()(ManagedThreadBase_DispatchOuter(ManagedThreadCallState*)::TryArgs*) const::'lambda'(Param*)::operator()(Param*) const at /__w/1/s/src/coreclr/vm/threads.cpp:7325:13
 (inlined by) ManagedThreadBase_DispatchOuter(ManagedThreadCallState*)::$_0

Stack trace:

   at GC_Scenarios._FinalizeTimeout_FinalizeTimeout_FinalizeTimeout_._FinalizeTimeout_FinalizeTimeout_FinalizeTimeout_sh()

   at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
   at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
Queued Pipeline Pipeline_Configuration OS Arch Test Outcome Properties BuildReason
2024-06-13T19:30:12.492Z runtime-coreclr outerloop Checked ubuntu.2004.armarch.open arm GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh Failed {"DefinitionName":"runtime-coreclr outerloop","System.StageAttempt":"1","System.JobAttempt":"1","System.JobId":"67940218-a6cd-574d-6681-11ea1e4ee273","DefinitionId":"108","System.PhaseAttempt":"1","Project":"public","AzurePipelinesTestRunId":"17640996","configuration":"Checked","BuildId":"706979","Reason":"Schedule","System.JobName":"default","BuildNumber":"20240613.3","operatingSystem":"(Alpine.316.Arm32.Open)Ubuntu.2004.ArmArch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.17-helix-arm32v7","System.StageName":"Build","architecture":"arm","CollectionUri":"https://dev.azure.com/dnceng-public/","System.PhaseName":"run_test_p1linux_musl_arm_checked"} Schedule
2024-05-09T02:18:47.007Z runtime-coreclr outerloop Checked-no_tiered_compilation ubuntu.2004.armarch.open arm GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh Failed {"System.JobName":"default","Reason":"Schedule","System.PhaseAttempt":"1","architecture":"arm","configuration":"Checked-no_tiered_compilation","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobId":"860c965f-b28e-50d5-65d2-e40bd59f3a69","Project":"public","DefinitionName":"runtime-coreclr outerloop","operatingSystem":"(Ubuntu.1804.Arm32.Open)Ubuntu.2004.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","BuildId":"670046","System.StageAttempt":"1","System.JobAttempt":"1","System.StageName":"Build","System.PhaseName":"run_test_p1linux_arm_checked","BuildNumber":"20240508.3","DefinitionId":"108","AzurePipelinesTestRunId":"16612930"} Schedule
2024-05-09T02:18:45.812Z runtime-coreclr outerloop Checked ubuntu.2004.armarch.open arm GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh Failed {"DefinitionId":"108","DefinitionName":"runtime-coreclr outerloop","System.StageName":"Build","System.JobAttempt":"1","BuildId":"670046","Reason":"Schedule","System.JobId":"860c965f-b28e-50d5-65d2-e40bd59f3a69","Project":"public","BuildNumber":"20240508.3","operatingSystem":"(Ubuntu.1804.Arm32.Open)Ubuntu.2004.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","AzurePipelinesTestRunId":"16612920","configuration":"Checked","architecture":"arm","System.PhaseName":"run_test_p1linux_arm_checked","CollectionUri":"https://dev.azure.com/dnceng-public/","System.StageAttempt":"1","System.PhaseAttempt":"1","System.JobName":"default"} Schedule
2024-05-08T23:33:04.014Z runtime-nativeaot-outerloop Checked ubuntu.2004.armarch.open arm GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh Failed {"System.PhaseName":"build_linux_arm_Checked_NativeAOT_Pri0","System.JobAttempt":"1","System.JobId":"531ca2ce-eccb-527e-1ec0-55002e52e870","DefinitionId":"265","BuildNumber":"20240508.2","operatingSystem":"(Ubuntu.1804.Arm32.Open)Ubuntu.2004.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","System.StageAttempt":"1","configuration":"Checked","System.StageName":"Build","Reason":"Schedule","AzurePipelinesTestRunId":"16610852","BuildId":"669858","Project":"public","DefinitionName":"runtime-nativeaot-outerloop","System.JobName":"__default","System.PhaseAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","architecture":"arm"} Schedule
2024-05-08T20:55:20.943Z runtime Checked-no_tiered_compilation ubuntu.2004.armarch.open arm GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh Failed {"System.JobAttempt":"1","System.PhaseName":"run_test_p0_coreclrlinux_arm_checked","Reason":"Schedule","System.StageName":"Build","operatingSystem":"(Ubuntu.1804.Arm32.Open)Ubuntu.2004.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","System.JobId":"5875517b-40f2-5b27-5b45-8b8aba144595","configuration":"Checked-no_tiered_compilation","DefinitionName":"runtime","DefinitionId":"129","System.JobName":"default","System.PhaseAttempt":"1","BuildId":"669797","architecture":"arm","AzurePipelinesTestRunId":"16607856","BuildNumber":"20240508.40","Project":"public","System.StageAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/"} Schedule
2024-05-08T20:55:19.474Z runtime Checked ubuntu.2004.armarch.open arm GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh Failed {"DefinitionName":"runtime","operatingSystem":"(Ubuntu.1804.Arm32.Open)Ubuntu.2004.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","System.PhaseName":"run_test_p0_coreclrlinux_arm_checked","configuration":"Checked","DefinitionId":"129","BuildNumber":"20240508.40","System.JobAttempt":"1","System.StageName":"Build","BuildId":"669797","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobName":"default","Reason":"Schedule","System.StageAttempt":"1","System.JobId":"5875517b-40f2-5b27-5b45-8b8aba144595","Project":"public","System.PhaseAttempt":"1","AzurePipelinesTestRunId":"16607854","architecture":"arm"} Schedule
More failures Queued | Pipeline | Pipeline_Configuration | OS | Arch | Test | Outcome | Properties | BuildReason -- | -- | -- | -- | -- | -- | -- | -- | -- 2024-05-08T19:20:43.463Z | runtime-coreclr outerloop | Checked-no_tiered_compilation | ubuntu.2004.armarch.open | arm | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"AzurePipelinesTestRunId":"16606342","DefinitionName":"runtime-coreclr outerloop","BuildId":"669628","architecture":"arm","configuration":"Checked-no_tiered_compilation","Project":"public","System.JobId":"860c965f-b28e-50d5-65d2-e40bd59f3a69","operatingSystem":"(Ubuntu.1804.Arm32.Open)Ubuntu.2004.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","System.JobAttempt":"1","System.PhaseName":"run_test_p1__linux_arm_checked","Reason":"Schedule","System.PhaseAttempt":"1","System.StageAttempt":"1","System.JobName":"__default","CollectionUri":"https://dev.azure.com/dnceng-public/","BuildNumber":"20240508.2","DefinitionId":"108","System.StageName":"Build"} | Schedule 2024-05-08T19:20:41.712Z | runtime-coreclr outerloop | Checked | ubuntu.2004.armarch.open | arm | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"BuildNumber":"20240508.2","DefinitionId":"108","System.JobId":"860c965f-b28e-50d5-65d2-e40bd59f3a69","System.JobName":"__default","DefinitionName":"runtime-coreclr outerloop","AzurePipelinesTestRunId":"16606340","System.StageName":"Build","Reason":"Schedule","System.PhaseAttempt":"1","configuration":"Checked","architecture":"arm","CollectionUri":"https://dev.azure.com/dnceng-public/","BuildId":"669628","System.JobAttempt":"1","System.StageAttempt":"1","Project":"public","System.PhaseName":"run_test_p1__linux_arm_checked","operatingSystem":"(Ubuntu.1804.Arm32.Open)Ubuntu.2004.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7"} | Schedule 2024-05-08T11:35:56.729Z | runtime-nativeaot-outerloop | Checked | ubuntu.2004.armarch.open | arm | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.PhaseAttempt":"1","System.StageName":"Build","configuration":"Checked","System.JobId":"531ca2ce-eccb-527e-1ec0-55002e52e870","BuildId":"669222","Reason":"Schedule","BuildNumber":"20240508.1","architecture":"arm","Project":"public","AzurePipelinesTestRunId":"16596980","operatingSystem":"(Ubuntu.1804.Arm32.Open)Ubuntu.2004.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","System.StageAttempt":"1","System.JobName":"__default","System.JobAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","System.PhaseName":"build_linux_arm_Checked_NativeAOT_Pri0","DefinitionId":"265","DefinitionName":"runtime-nativeaot-outerloop"} | Schedule 2024-05-08T10:18:34.795Z | runtime-coreclr outerloop | Checked-no_tiered_compilation | ubuntu.2004.armarch.open | arm | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.StageName":"Build","Project":"public","AzurePipelinesTestRunId":"16596180","System.PhaseName":"run_test_p1__linux_arm_checked","BuildNumber":"20240508.1","System.JobAttempt":"1","System.JobName":"__default","BuildId":"669221","configuration":"Checked-no_tiered_compilation","Reason":"Schedule","operatingSystem":"(Ubuntu.1804.Arm32.Open)Ubuntu.2004.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","System.StageAttempt":"1","architecture":"arm","DefinitionId":"108","System.PhaseAttempt":"1","DefinitionName":"runtime-coreclr outerloop","System.JobId":"860c965f-b28e-50d5-65d2-e40bd59f3a69","CollectionUri":"https://dev.azure.com/dnceng-public/"} | Schedule 2024-05-08T10:18:33.232Z | runtime-coreclr outerloop | Checked | ubuntu.2004.armarch.open | arm | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.JobName":"__default","AzurePipelinesTestRunId":"16596178","System.PhaseName":"run_test_p1__linux_arm_checked","architecture":"arm","CollectionUri":"https://dev.azure.com/dnceng-public/","System.StageName":"Build","BuildId":"669221","DefinitionName":"runtime-coreclr outerloop","System.PhaseAttempt":"1","System.JobAttempt":"1","Project":"public","System.JobId":"860c965f-b28e-50d5-65d2-e40bd59f3a69","DefinitionId":"108","BuildNumber":"20240508.1","configuration":"Checked","Reason":"Schedule","System.StageAttempt":"1","operatingSystem":"(Ubuntu.1804.Arm32.Open)Ubuntu.2004.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7"} | Schedule 2024-05-08T09:16:15.601Z | runtime-coreclr pgo | Checked-defaultpgo | ubuntu.2004.armarch.open | arm | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.JobId":"860c965f-b28e-50d5-65d2-e40bd59f3a69","BuildNumber":"20240508.1","Reason":"Schedule","System.JobAttempt":"1","System.PhaseName":"run_test_p1__linux_arm_checked","System.PhaseAttempt":"1","BuildId":"669200","Project":"public","operatingSystem":"(Ubuntu.1804.Arm32.Open)Ubuntu.2004.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","System.JobName":"__default","DefinitionId":"144","AzurePipelinesTestRunId":"16595346","DefinitionName":"runtime-coreclr pgo","System.StageAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","architecture":"arm","configuration":"Checked-defaultpgo","System.StageName":"Build"} | Schedule 2024-05-08T08:55:12.152Z | runtime | Checked-no_tiered_compilation | ubuntu.2004.armarch.open | arm | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.StageName":"Build","AzurePipelinesTestRunId":"16594958","System.JobName":"__default","configuration":"Checked-no_tiered_compilation","BuildNumber":"20240508.1","CollectionUri":"https://dev.azure.com/dnceng-public/","System.StageAttempt":"1","DefinitionId":"129","System.JobId":"5875517b-40f2-5b27-5b45-8b8aba144595","System.PhaseName":"run_test_p0_coreclr__linux_arm_checked","architecture":"arm","Reason":"Schedule","System.PhaseAttempt":"1","operatingSystem":"(Ubuntu.1804.Arm32.Open)Ubuntu.2004.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","DefinitionName":"runtime","BuildId":"669202","System.JobAttempt":"1","Project":"public"} | Schedule 2024-05-08T08:55:10.576Z | runtime | Checked | ubuntu.2004.armarch.open | arm | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.StageName":"Build","DefinitionId":"129","configuration":"Checked","System.StageAttempt":"1","BuildNumber":"20240508.1","System.JobId":"5875517b-40f2-5b27-5b45-8b8aba144595","AzurePipelinesTestRunId":"16594956","DefinitionName":"runtime","Reason":"Schedule","Project":"public","BuildId":"669202","System.JobAttempt":"1","System.PhaseAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","operatingSystem":"(Ubuntu.1804.Arm32.Open)Ubuntu.2004.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","System.PhaseName":"run_test_p0_coreclr__linux_arm_checked","architecture":"arm","System.JobName":"__default"} | Schedule 2024-05-08T07:27:00.809Z | coreclr-release-outerloop-nightly | Release-no_tiered_compilation | ubuntu.2004.armarch.open | arm | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.PhaseAttempt":"1","architecture":"arm","DefinitionName":"coreclr-release-outerloop-nightly","System.JobName":"__default","AzurePipelinesTestRunId":"16592990","configuration":"Release-no_tiered_compilation","BuildNumber":"20240507.1","BuildId":"669106","System.JobAttempt":"1","DefinitionId":"135","System.StageAttempt":"1","System.StageName":"Build","operatingSystem":"(Ubuntu.1804.Arm32.Open)Ubuntu.2004.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","Project":"public","System.PhaseName":"run_test_p1_R2R_linux_arm_release","System.JobId":"72dfe29e-04cf-5892-e89c-87a9854dd748","CollectionUri":"https://dev.azure.com/dnceng-public/","Reason":"Schedule"} | Schedule 2024-05-08T07:27:00.809Z | coreclr-release-outerloop-nightly | Release-no_tiered_compilation | ubuntu.2004.armarch.open | arm | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.PhaseAttempt":"1","architecture":"arm","DefinitionName":"coreclr-release-outerloop-nightly","System.JobName":"__default","AzurePipelinesTestRunId":"16592990","configuration":"Release-no_tiered_compilation","BuildNumber":"20240507.1","BuildId":"669106","System.JobAttempt":"1","DefinitionId":"135","System.StageAttempt":"1","System.StageName":"Build","operatingSystem":"(Ubuntu.1804.Arm32.Open)Ubuntu.2004.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","Project":"public","System.PhaseName":"run_test_p1_R2R_linux_arm_release","System.JobId":"72dfe29e-04cf-5892-e89c-87a9854dd748","CollectionUri":"https://dev.azure.com/dnceng-public/","Reason":"Schedule"} | Schedule 2024-05-08T07:26:57.972Z | coreclr-release-outerloop-nightly | Release | ubuntu.2004.armarch.open | arm | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"BuildId":"669106","AzurePipelinesTestRunId":"16592988","System.PhaseName":"run_test_p1_R2R_linux_arm_release","System.PhaseAttempt":"1","System.JobAttempt":"1","Reason":"Schedule","DefinitionId":"135","architecture":"arm","BuildNumber":"20240507.1","System.StageAttempt":"1","System.JobId":"72dfe29e-04cf-5892-e89c-87a9854dd748","CollectionUri":"https://dev.azure.com/dnceng-public/","Project":"public","System.JobName":"__default","System.StageName":"Build","DefinitionName":"coreclr-release-outerloop-nightly","operatingSystem":"(Ubuntu.1804.Arm32.Open)Ubuntu.2004.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","configuration":"Release"} | Schedule 2024-05-08T07:23:41.546Z | coreclr-release-outerloop-nightly | Release-no_tiered_compilation | ubuntu.2004.armarch.open | arm | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"DefinitionName":"coreclr-release-outerloop-nightly","operatingSystem":"(Ubuntu.1804.Arm32.Open)Ubuntu.2004.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","System.PhaseName":"run_test_p1__linux_arm_release","Reason":"Schedule","System.StageAttempt":"1","DefinitionId":"135","System.JobName":"__default","BuildId":"669106","System.StageName":"Build","BuildNumber":"20240507.1","System.JobAttempt":"1","System.PhaseAttempt":"1","AzurePipelinesTestRunId":"16592840","architecture":"arm","configuration":"Release-no_tiered_compilation","Project":"public","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobId":"ae69a820-8040-5321-6217-15d430a2ab03"} | Schedule 2024-05-08T07:23:40.155Z | coreclr-release-outerloop-nightly | Release | ubuntu.2004.armarch.open | arm | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"DefinitionId":"135","System.StageName":"Build","DefinitionName":"coreclr-release-outerloop-nightly","System.JobName":"__default","AzurePipelinesTestRunId":"16592838","Reason":"Schedule","configuration":"Release","System.JobId":"ae69a820-8040-5321-6217-15d430a2ab03","System.StageAttempt":"1","System.PhaseName":"run_test_p1__linux_arm_release","BuildNumber":"20240507.1","Project":"public","BuildId":"669106","System.PhaseAttempt":"1","System.JobAttempt":"1","architecture":"arm","CollectionUri":"https://dev.azure.com/dnceng-public/","operatingSystem":"(Ubuntu.1804.Arm32.Open)Ubuntu.2004.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7"} | Schedule 2024-05-06T05:24:02.857Z | runtime-coreclr jitstress | Checked-jitstress1 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"Reason":"Schedule","Project":"public","System.JobAttempt":"1","configuration":"Checked-jitstress1","CollectionUri":"https://dev.azure.com/dnceng-public/","DefinitionId":"109","DefinitionName":"runtime-coreclr jitstress","architecture":"x64","System.PhaseName":"run_test_p1__linux_x64_checked","System.StageName":"Build","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","BuildId":"666407","AzurePipelinesTestRunId":"16528844","System.PhaseAttempt":"1","operatingSystem":"Ubuntu.2204.Amd64.Open","BuildNumber":"20240505.1","System.JobName":"__default","System.StageAttempt":"1"} | Schedule 2024-05-06T05:24:01.384Z | runtime-coreclr jitstress | Checked-jitstress2_tiered | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"configuration":"Checked-jitstress2_tiered","System.StageAttempt":"1","AzurePipelinesTestRunId":"16528852","System.JobName":"__default","CollectionUri":"https://dev.azure.com/dnceng-public/","Reason":"Schedule","System.JobAttempt":"1","BuildNumber":"20240505.1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.PhaseName":"run_test_p1__linux_x64_checked","operatingSystem":"Ubuntu.2204.Amd64.Open","System.StageName":"Build","System.PhaseAttempt":"1","DefinitionId":"109","BuildId":"666407","DefinitionName":"runtime-coreclr jitstress","architecture":"x64","Project":"public"} | Schedule 2024-05-06T05:24:00.009Z | runtime-coreclr jitstress | Checked-jitstress2 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"Project":"public","BuildNumber":"20240505.1","System.JobName":"__default","Reason":"Schedule","System.StageName":"Build","operatingSystem":"Ubuntu.2204.Amd64.Open","System.PhaseName":"run_test_p1__linux_x64_checked","CollectionUri":"https://dev.azure.com/dnceng-public/","BuildId":"666407","AzurePipelinesTestRunId":"16528842","configuration":"Checked-jitstress2","DefinitionId":"109","System.StageAttempt":"1","architecture":"x64","System.JobAttempt":"1","DefinitionName":"runtime-coreclr jitstress","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.PhaseAttempt":"1"} | Schedule 2024-05-06T05:23:57.087Z | runtime-coreclr jitstress | Checked-jitstress1_tiered | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"architecture":"x64","System.StageAttempt":"1","System.PhaseName":"run_test_p1__linux_x64_checked","Reason":"Schedule","operatingSystem":"Ubuntu.2204.Amd64.Open","System.JobAttempt":"1","BuildId":"666407","AzurePipelinesTestRunId":"16528846","System.JobName":"__default","DefinitionName":"runtime-coreclr jitstress","Project":"public","System.PhaseAttempt":"1","DefinitionId":"109","BuildNumber":"20240505.1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.StageName":"Build","configuration":"Checked-jitstress1_tiered","CollectionUri":"https://dev.azure.com/dnceng-public/"} | Schedule 2024-05-06T03:47:23.446Z | runtime-coreclr r2r-extra | Checked-jitstress2_tiered | osx.1200.arm64.open | arm64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"configuration":"Checked-jitstress2_tiered","System.PhaseName":"run_test_p1_R2R_osx_arm64_checked","DefinitionId":"114","operatingSystem":"OSX.1200.ARM64.Open","System.PhaseAttempt":"1","System.StageName":"Build","Reason":"Schedule","BuildId":"666362","DefinitionName":"runtime-coreclr r2r-extra","System.JobId":"99f15f99-448d-5593-a271-dbdf553789a6","System.JobAttempt":"1","AzurePipelinesTestRunId":"16528362","System.JobName":"__default","System.StageAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","Project":"public","BuildNumber":"20240505.1","architecture":"arm64"} | Schedule 2024-05-06T03:31:02.455Z | runtime-coreclr r2r-extra | Checked-jitstress1_tiered | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"AzurePipelinesTestRunId":"16527936","BuildNumber":"20240505.1","System.StageName":"Build","System.JobName":"__default","DefinitionId":"114","System.PhaseName":"run_test_p1_R2R_linux_x64_checked","System.JobAttempt":"1","architecture":"x64","Project":"public","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobId":"45a39349-90d5-51c8-4429-a48b2907fbdd","DefinitionName":"runtime-coreclr r2r-extra","configuration":"Checked-jitstress1_tiered","System.StageAttempt":"1","operatingSystem":"Ubuntu.2204.Amd64.Open","Reason":"Schedule","System.PhaseAttempt":"1","BuildId":"666362"} | Schedule 2024-05-06T03:30:58.033Z | runtime-coreclr r2r-extra | Checked-jitstress2_tiered | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.JobId":"45a39349-90d5-51c8-4429-a48b2907fbdd","AzurePipelinesTestRunId":"16527918","System.StageAttempt":"1","System.JobName":"__default","System.PhaseName":"run_test_p1_R2R_linux_x64_checked","CollectionUri":"https://dev.azure.com/dnceng-public/","Reason":"Schedule","architecture":"x64","BuildId":"666362","DefinitionName":"runtime-coreclr r2r-extra","System.PhaseAttempt":"1","System.StageName":"Build","operatingSystem":"Ubuntu.2204.Amd64.Open","BuildNumber":"20240505.1","Project":"public","DefinitionId":"114","System.JobAttempt":"1","configuration":"Checked-jitstress2_tiered"} | Schedule 2024-05-05T19:40:59.246Z | runtime-coreclr jitstress-random | Checked-jitstress_random_1 | osx.1200.amd64.open | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"BuildNumber":"20240505.1","System.JobAttempt":"1","Project":"public","operatingSystem":"OSX.1200.Amd64.Open","Reason":"Schedule","BuildId":"666195","System.JobName":"__default","DefinitionId":"159","System.StageName":"Build","DefinitionName":"runtime-coreclr jitstress-random","System.PhaseAttempt":"1","configuration":"Checked-jitstress_random_1","architecture":"x64","CollectionUri":"https://dev.azure.com/dnceng-public/","System.StageAttempt":"1","System.PhaseName":"run_test_p1__osx_x64_checked","System.JobId":"bf644a0b-2dbe-5a03-d8c6-a86fdd97c823","AzurePipelinesTestRunId":"16524440"} | Schedule 2024-05-05T18:24:04.531Z | runtime-coreclr jitstress2-jitstressregs | Checked-jitstress2_jitstressregs0x80 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.StageName":"Build","BuildId":"666175","System.StageAttempt":"1","System.PhaseAttempt":"1","BuildNumber":"20240505.1","configuration":"Checked-jitstress2_jitstressregs0x80","CollectionUri":"https://dev.azure.com/dnceng-public/","System.PhaseName":"run_test_p1__linux_x64_checked","architecture":"x64","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","Project":"public","Reason":"Schedule","operatingSystem":"Ubuntu.2204.Amd64.Open","System.JobName":"__default","AzurePipelinesTestRunId":"16523722","System.JobAttempt":"1","DefinitionId":"111"} | Schedule 2024-05-05T18:24:03.184Z | runtime-coreclr jitstress2-jitstressregs | Checked-jitstress2_jitstressregs0x2000 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"architecture":"x64","DefinitionId":"111","configuration":"Checked-jitstress2_jitstressregs0x2000","System.PhaseName":"run_test_p1__linux_x64_checked","Project":"public","System.StageName":"Build","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","Reason":"Schedule","System.JobAttempt":"1","BuildId":"666175","System.PhaseAttempt":"1","System.StageAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","BuildNumber":"20240505.1","AzurePipelinesTestRunId":"16523730","System.JobName":"__default","operatingSystem":"Ubuntu.2204.Amd64.Open","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5"} | Schedule 2024-05-05T18:24:01.282Z | runtime-coreclr jitstress2-jitstressregs | Checked-jitstress2_jitstressregs8 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.JobName":"__default","System.StageAttempt":"1","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","System.PhaseName":"run_test_p1__linux_x64_checked","Project":"public","System.StageName":"Build","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","operatingSystem":"Ubuntu.2204.Amd64.Open","architecture":"x64","BuildNumber":"20240505.1","BuildId":"666175","System.PhaseAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobAttempt":"1","DefinitionId":"111","Reason":"Schedule","AzurePipelinesTestRunId":"16523724","configuration":"Checked-jitstress2_jitstressregs8"} | Schedule 2024-05-05T18:23:59.746Z | runtime-coreclr jitstress2-jitstressregs | Checked-jitstress2_jitstressregs2 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.PhaseName":"run_test_p1__linux_x64_checked","System.PhaseAttempt":"1","AzurePipelinesTestRunId":"16523728","configuration":"Checked-jitstress2_jitstressregs2","System.StageName":"Build","BuildNumber":"20240505.1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","BuildId":"666175","Reason":"Schedule","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","Project":"public","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobName":"__default","DefinitionId":"111","System.JobAttempt":"1","architecture":"x64","System.StageAttempt":"1","operatingSystem":"Ubuntu.2204.Amd64.Open"} | Schedule 2024-05-05T18:23:57.921Z | runtime-coreclr jitstress2-jitstressregs | Checked-jitstress2_jitstressregs3 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"operatingSystem":"Ubuntu.2204.Amd64.Open","architecture":"x64","System.StageAttempt":"1","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","DefinitionId":"111","Project":"public","System.PhaseName":"run_test_p1__linux_x64_checked","BuildId":"666175","Reason":"Schedule","AzurePipelinesTestRunId":"16523726","System.JobName":"__default","configuration":"Checked-jitstress2_jitstressregs3","BuildNumber":"20240505.1","System.JobAttempt":"1","System.StageName":"Build","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.PhaseAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/"} | Schedule 2024-05-05T18:23:56.453Z | runtime-coreclr jitstress2-jitstressregs | Checked-jitstress2_jitstressregs1 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.JobAttempt":"1","operatingSystem":"Ubuntu.2204.Amd64.Open","System.StageName":"Build","BuildNumber":"20240505.1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","configuration":"Checked-jitstress2_jitstressregs1","System.StageAttempt":"1","BuildId":"666175","DefinitionId":"111","System.PhaseName":"run_test_p1__linux_x64_checked","Reason":"Schedule","architecture":"x64","System.JobName":"__default","AzurePipelinesTestRunId":"16523714","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","Project":"public","System.PhaseAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/"} | Schedule 2024-05-05T18:23:54.983Z | runtime-coreclr jitstress2-jitstressregs | Checked-jitstress2_jitstressregs0x1000 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"AzurePipelinesTestRunId":"16523720","CollectionUri":"https://dev.azure.com/dnceng-public/","operatingSystem":"Ubuntu.2204.Amd64.Open","System.PhaseName":"run_test_p1__linux_x64_checked","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","BuildId":"666175","System.JobName":"__default","System.PhaseAttempt":"1","Reason":"Schedule","System.StageAttempt":"1","System.JobAttempt":"1","Project":"public","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","System.StageName":"Build","configuration":"Checked-jitstress2_jitstressregs0x1000","architecture":"x64","BuildNumber":"20240505.1","DefinitionId":"111"} | Schedule 2024-05-05T18:23:53.463Z | runtime-coreclr jitstress2-jitstressregs | Checked-jitstress2_jitstressregs0x10 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.StageAttempt":"1","DefinitionId":"111","System.PhaseAttempt":"1","System.JobName":"__default","System.StageName":"Build","BuildId":"666175","configuration":"Checked-jitstress2_jitstressregs0x10","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","System.JobAttempt":"1","Project":"public","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.PhaseName":"run_test_p1__linux_x64_checked","AzurePipelinesTestRunId":"16523718","BuildNumber":"20240505.1","architecture":"x64","operatingSystem":"Ubuntu.2204.Amd64.Open","Reason":"Schedule","CollectionUri":"https://dev.azure.com/dnceng-public/"} | Schedule 2024-05-05T18:23:52.046Z | runtime-coreclr jitstress2-jitstressregs | Checked-jitstress2_jitstressregs4 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"configuration":"Checked-jitstress2_jitstressregs4","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","BuildId":"666175","System.JobName":"__default","AzurePipelinesTestRunId":"16523716","operatingSystem":"Ubuntu.2204.Amd64.Open","System.PhaseAttempt":"1","System.JobAttempt":"1","System.StageName":"Build","System.StageAttempt":"1","System.PhaseName":"run_test_p1__linux_x64_checked","Reason":"Schedule","DefinitionId":"111","BuildNumber":"20240505.1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","CollectionUri":"https://dev.azure.com/dnceng-public/","Project":"public","architecture":"x64"} | Schedule 2024-05-05T05:23:23.043Z | runtime-coreclr jitstress | Checked-jitstress2 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"operatingSystem":"Ubuntu.2204.Amd64.Open","System.StageName":"Build","System.JobName":"__default","BuildNumber":"20240504.1","System.StageAttempt":"1","architecture":"x64","CollectionUri":"https://dev.azure.com/dnceng-public/","DefinitionName":"runtime-coreclr jitstress","System.JobAttempt":"1","BuildId":"665914","System.PhaseName":"run_test_p1__linux_x64_checked","System.PhaseAttempt":"1","DefinitionId":"109","configuration":"Checked-jitstress2","Reason":"Schedule","AzurePipelinesTestRunId":"16515340","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","Project":"public"} | Schedule 2024-05-05T05:23:21.689Z | runtime-coreclr jitstress | Checked-jitstress1_tiered | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"BuildNumber":"20240504.1","configuration":"Checked-jitstress1_tiered","Reason":"Schedule","DefinitionName":"runtime-coreclr jitstress","DefinitionId":"109","architecture":"x64","System.PhaseAttempt":"1","Project":"public","System.PhaseName":"run_test_p1__linux_x64_checked","AzurePipelinesTestRunId":"16515342","System.StageName":"Build","System.JobAttempt":"1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","BuildId":"665914","System.JobName":"__default","operatingSystem":"Ubuntu.2204.Amd64.Open","CollectionUri":"https://dev.azure.com/dnceng-public/","System.StageAttempt":"1"} | Schedule 2024-05-05T05:23:18.752Z | runtime-coreclr jitstress | Checked-jitstress1 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"operatingSystem":"Ubuntu.2204.Amd64.Open","System.PhaseName":"run_test_p1__linux_x64_checked","DefinitionName":"runtime-coreclr jitstress","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.PhaseAttempt":"1","BuildNumber":"20240504.1","AzurePipelinesTestRunId":"16515336","System.JobName":"__default","Reason":"Schedule","Project":"public","System.JobAttempt":"1","System.StageAttempt":"1","System.StageName":"Build","architecture":"x64","CollectionUri":"https://dev.azure.com/dnceng-public/","DefinitionId":"109","BuildId":"665914","configuration":"Checked-jitstress1"} | Schedule 2024-05-05T05:23:17.345Z | runtime-coreclr jitstress | Checked-jitstress2_tiered | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"BuildNumber":"20240504.1","DefinitionId":"109","System.PhaseName":"run_test_p1__linux_x64_checked","AzurePipelinesTestRunId":"16515338","System.StageAttempt":"1","BuildId":"665914","operatingSystem":"Ubuntu.2204.Amd64.Open","DefinitionName":"runtime-coreclr jitstress","System.JobName":"__default","Project":"public","CollectionUri":"https://dev.azure.com/dnceng-public/","Reason":"Schedule","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","configuration":"Checked-jitstress2_tiered","architecture":"x64","System.StageName":"Build","System.PhaseAttempt":"1","System.JobAttempt":"1"} | Schedule 2024-05-05T03:50:23.556Z | runtime-coreclr r2r-extra | Checked-jitstress2_tiered | osx.1200.arm64.open | arm64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"BuildId":"665904","architecture":"arm64","System.StageAttempt":"1","System.PhaseAttempt":"1","System.JobName":"__default","CollectionUri":"https://dev.azure.com/dnceng-public/","AzurePipelinesTestRunId":"16514966","operatingSystem":"OSX.1200.ARM64.Open","System.StageName":"Build","DefinitionId":"114","BuildNumber":"20240504.1","DefinitionName":"runtime-coreclr r2r-extra","System.PhaseName":"run_test_p1_R2R_osx_arm64_checked","System.JobAttempt":"1","Project":"public","Reason":"Schedule","configuration":"Checked-jitstress2_tiered","System.JobId":"99f15f99-448d-5593-a271-dbdf553789a6"} | Schedule 2024-05-05T03:50:18.934Z | runtime-coreclr r2r-extra | Checked-jitstress1_tiered | osx.1200.arm64.open | arm64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"DefinitionId":"114","BuildId":"665904","System.StageName":"Build","System.JobAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","architecture":"arm64","operatingSystem":"OSX.1200.ARM64.Open","Project":"public","AzurePipelinesTestRunId":"16514972","System.PhaseAttempt":"1","DefinitionName":"runtime-coreclr r2r-extra","System.PhaseName":"run_test_p1_R2R_osx_arm64_checked","System.StageAttempt":"1","BuildNumber":"20240504.1","System.JobName":"__default","configuration":"Checked-jitstress1_tiered","Reason":"Schedule","System.JobId":"99f15f99-448d-5593-a271-dbdf553789a6"} | Schedule 2024-05-05T03:29:14.895Z | runtime-coreclr r2r-extra | Checked-jitstress2_tiered | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"AzurePipelinesTestRunId":"16514730","System.JobName":"__default","BuildId":"665904","DefinitionName":"runtime-coreclr r2r-extra","Project":"public","System.JobId":"45a39349-90d5-51c8-4429-a48b2907fbdd","System.PhaseAttempt":"1","System.StageAttempt":"1","DefinitionId":"114","Reason":"Schedule","architecture":"x64","operatingSystem":"Ubuntu.2204.Amd64.Open","System.StageName":"Build","configuration":"Checked-jitstress2_tiered","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobAttempt":"1","BuildNumber":"20240504.1","System.PhaseName":"run_test_p1_R2R_linux_x64_checked"} | Schedule 2024-05-04T21:29:31.966Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_2_x86_nossse3 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.PhaseName":"run_test_p1__linux_x64_checked","System.JobName":"__default","System.StageName":"Build","System.StageAttempt":"1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.PhaseAttempt":"1","BuildNumber":"20240504.1","configuration":"Checked-jitstress_isas_2_x86_nossse3","BuildId":"665757","DefinitionId":"115","Reason":"Schedule","CollectionUri":"https://dev.azure.com/dnceng-public/","Project":"public","DefinitionName":"runtime-coreclr jitstress-isas-x86","operatingSystem":"Ubuntu.2204.Amd64.Open","System.JobAttempt":"1","AzurePipelinesTestRunId":"16513136","architecture":"x64"} | Schedule 2024-05-04T21:28:50.478Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_2_x86_nosse42 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"Project":"public","configuration":"Checked-jitstress_isas_2_x86_nosse42","System.StageName":"Build","BuildId":"665757","System.JobName":"__default","DefinitionId":"115","System.PhaseAttempt":"1","operatingSystem":"Ubuntu.2204.Amd64.Open","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","Reason":"Schedule","architecture":"x64","System.JobAttempt":"1","AzurePipelinesTestRunId":"16513126","System.PhaseName":"run_test_p1__linux_x64_checked","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.StageAttempt":"1","BuildNumber":"20240504.1","CollectionUri":"https://dev.azure.com/dnceng-public/"} | Schedule 2024-05-04T21:28:31.425Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_2_x86_nosse41 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.JobName":"__default","CollectionUri":"https://dev.azure.com/dnceng-public/","AzurePipelinesTestRunId":"16513124","operatingSystem":"Ubuntu.2204.Amd64.Open","DefinitionName":"runtime-coreclr jitstress-isas-x86","BuildNumber":"20240504.1","System.StageName":"Build","Project":"public","BuildId":"665757","System.JobAttempt":"1","DefinitionId":"115","Reason":"Schedule","System.StageAttempt":"1","System.PhaseName":"run_test_p1__linux_x64_checked","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","architecture":"x64","configuration":"Checked-jitstress_isas_2_x86_nosse41","System.PhaseAttempt":"1"} | Schedule 2024-05-04T21:27:31.21Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_2_x86_nosse3_4 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"operatingSystem":"Ubuntu.2204.Amd64.Open","architecture":"x64","System.PhaseName":"run_test_p1__linux_x64_checked","BuildId":"665757","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.JobName":"__default","Reason":"Schedule","System.StageName":"Build","configuration":"Checked-jitstress_isas_2_x86_nosse3_4","System.PhaseAttempt":"1","DefinitionId":"115","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.StageAttempt":"1","System.JobAttempt":"1","AzurePipelinesTestRunId":"16513120","CollectionUri":"https://dev.azure.com/dnceng-public/","BuildNumber":"20240504.1","Project":"public"} | Schedule 2024-05-04T21:01:37.259Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_1_x86_nopclmulqdq | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","architecture":"x64","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.PhaseName":"run_test_p1__linux_x64_checked","System.StageName":"Build","DefinitionId":"115","operatingSystem":"Ubuntu.2204.Amd64.Open","Project":"public","AzurePipelinesTestRunId":"16512600","Reason":"Schedule","System.JobAttempt":"1","System.JobName":"__default","System.StageAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","BuildNumber":"20240504.1","BuildId":"665757","System.PhaseAttempt":"1","configuration":"Checked-jitstress_isas_1_x86_nopclmulqdq"} | Schedule 2024-05-04T21:01:32.755Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_1_x86_noaes | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"configuration":"Checked-jitstress_isas_1_x86_noaes","AzurePipelinesTestRunId":"16512576","operatingSystem":"Ubuntu.2204.Amd64.Open","architecture":"x64","DefinitionId":"115","Reason":"Schedule","BuildId":"665757","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","Project":"public","System.JobName":"__default","System.JobAttempt":"1","System.StageName":"Build","System.PhaseAttempt":"1","BuildNumber":"20240504.1","System.PhaseName":"run_test_p1__linux_x64_checked","System.StageAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/"} | Schedule 2024-05-04T21:01:28.211Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_1_x86_nobmi2 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"architecture":"x64","System.PhaseAttempt":"1","System.StageName":"Build","System.JobName":"__default","Reason":"Schedule","CollectionUri":"https://dev.azure.com/dnceng-public/","BuildNumber":"20240504.1","System.PhaseName":"run_test_p1__linux_x64_checked","AzurePipelinesTestRunId":"16512594","Project":"public","System.StageAttempt":"1","System.JobAttempt":"1","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","operatingSystem":"Ubuntu.2204.Amd64.Open","BuildId":"665757","configuration":"Checked-jitstress_isas_1_x86_nobmi2","DefinitionId":"115"} | Schedule 2024-05-04T21:01:26.552Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_1_x86_nolzcnt | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"CollectionUri":"https://dev.azure.com/dnceng-public/","operatingSystem":"Ubuntu.2204.Amd64.Open","configuration":"Checked-jitstress_isas_1_x86_nolzcnt","BuildId":"665757","architecture":"x64","Project":"public","System.PhaseAttempt":"1","Reason":"Schedule","System.StageName":"Build","System.PhaseName":"run_test_p1__linux_x64_checked","AzurePipelinesTestRunId":"16512598","DefinitionId":"115","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.StageAttempt":"1","System.JobAttempt":"1","BuildNumber":"20240504.1","System.JobName":"__default"} | Schedule 2024-05-04T21:01:25.051Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_1_x86_noavx2 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.PhaseName":"run_test_p1__linux_x64_checked","System.StageName":"Build","System.StageAttempt":"1","Reason":"Schedule","architecture":"x64","BuildId":"665757","AzurePipelinesTestRunId":"16512602","operatingSystem":"Ubuntu.2204.Amd64.Open","configuration":"Checked-jitstress_isas_1_x86_noavx2","System.JobAttempt":"1","System.JobName":"__default","BuildNumber":"20240504.1","CollectionUri":"https://dev.azure.com/dnceng-public/","DefinitionName":"runtime-coreclr jitstress-isas-x86","Project":"public","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","DefinitionId":"115","System.PhaseAttempt":"1"} | Schedule 2024-05-04T21:01:23.457Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_2_x86_nobmi2 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.JobName":"__default","AzurePipelinesTestRunId":"16512588","System.StageName":"Build","System.JobAttempt":"1","System.PhaseAttempt":"1","BuildId":"665757","DefinitionName":"runtime-coreclr jitstress-isas-x86","architecture":"x64","BuildNumber":"20240504.1","configuration":"Checked-jitstress_isas_2_x86_nobmi2","System.PhaseName":"run_test_p1__linux_x64_checked","DefinitionId":"115","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","Reason":"Schedule","Project":"public","System.StageAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","operatingSystem":"Ubuntu.2204.Amd64.Open"} | Schedule 2024-05-04T21:01:21.878Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_1_x86_nohwintrinsic | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"DefinitionName":"runtime-coreclr jitstress-isas-x86","CollectionUri":"https://dev.azure.com/dnceng-public/","operatingSystem":"Ubuntu.2204.Amd64.Open","Reason":"Schedule","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","DefinitionId":"115","AzurePipelinesTestRunId":"16512572","configuration":"Checked-jitstress_isas_1_x86_nohwintrinsic","System.StageName":"Build","BuildId":"665757","System.PhaseName":"run_test_p1__linux_x64_checked","System.StageAttempt":"1","System.JobAttempt":"1","System.PhaseAttempt":"1","System.JobName":"__default","Project":"public","architecture":"x64","BuildNumber":"20240504.1"} | Schedule 2024-05-04T21:01:19.011Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_2_x86_noavx512 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"operatingSystem":"Ubuntu.2204.Amd64.Open","System.StageAttempt":"1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.JobAttempt":"1","System.JobName":"__default","AzurePipelinesTestRunId":"16512564","BuildId":"665757","configuration":"Checked-jitstress_isas_2_x86_noavx512","DefinitionId":"115","Reason":"Schedule","architecture":"x64","System.PhaseAttempt":"1","System.StageName":"Build","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.PhaseName":"run_test_p1__linux_x64_checked","CollectionUri":"https://dev.azure.com/dnceng-public/","BuildNumber":"20240504.1","Project":"public"} | Schedule 2024-05-04T21:01:17.808Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_2_x86_nofma | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.PhaseAttempt":"1","Project":"public","Reason":"Schedule","BuildId":"665757","System.StageAttempt":"1","System.PhaseName":"run_test_p1__linux_x64_checked","AzurePipelinesTestRunId":"16512570","BuildNumber":"20240504.1","System.StageName":"Build","configuration":"Checked-jitstress_isas_2_x86_nofma","architecture":"x64","DefinitionId":"115","operatingSystem":"Ubuntu.2204.Amd64.Open","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobName":"__default","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.JobAttempt":"1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5"} | Schedule 2024-05-04T21:01:15.179Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_2_x86_nosse3 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"DefinitionName":"runtime-coreclr jitstress-isas-x86","Project":"public","System.PhaseName":"run_test_p1__linux_x64_checked","operatingSystem":"Ubuntu.2204.Amd64.Open","System.PhaseAttempt":"1","configuration":"Checked-jitstress_isas_2_x86_nosse3","BuildId":"665757","System.JobName":"__default","BuildNumber":"20240504.1","architecture":"x64","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobAttempt":"1","System.StageAttempt":"1","AzurePipelinesTestRunId":"16512586","DefinitionId":"115","System.StageName":"Build","Reason":"Schedule"} | Schedule 2024-05-04T21:01:12.355Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_1_x86_nosse3_4 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.JobName":"__default","BuildId":"665757","configuration":"Checked-jitstress_isas_1_x86_nosse3_4","System.StageAttempt":"1","System.StageName":"Build","System.PhaseAttempt":"1","Reason":"Schedule","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","AzurePipelinesTestRunId":"16512556","architecture":"x64","System.PhaseName":"run_test_p1__linux_x64_checked","DefinitionId":"115","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobAttempt":"1","Project":"public","operatingSystem":"Ubuntu.2204.Amd64.Open","DefinitionName":"runtime-coreclr jitstress-isas-x86","BuildNumber":"20240504.1"} | Schedule 2024-05-04T21:01:10.703Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_1_x86_nosse41 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.StageName":"Build","BuildId":"665757","operatingSystem":"Ubuntu.2204.Amd64.Open","System.StageAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","AzurePipelinesTestRunId":"16512574","System.PhaseName":"run_test_p1__linux_x64_checked","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","DefinitionName":"runtime-coreclr jitstress-isas-x86","configuration":"Checked-jitstress_isas_1_x86_nosse41","DefinitionId":"115","architecture":"x64","System.JobName":"__default","System.JobAttempt":"1","System.PhaseAttempt":"1","BuildNumber":"20240504.1","Reason":"Schedule","Project":"public"} | Schedule 2024-05-04T21:01:08.08Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_1_x86_noavx | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"AzurePipelinesTestRunId":"16512544","System.StageAttempt":"1","System.JobAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","architecture":"x64","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.PhaseName":"run_test_p1__linux_x64_checked","Project":"public","System.StageName":"Build","System.PhaseAttempt":"1","System.JobName":"__default","BuildNumber":"20240504.1","Reason":"Schedule","operatingSystem":"Ubuntu.2204.Amd64.Open","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","configuration":"Checked-jitstress_isas_1_x86_noavx","BuildId":"665757","DefinitionId":"115"} | Schedule 2024-05-04T21:01:02.971Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_2_x86_noavx | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"BuildId":"665757","System.JobAttempt":"1","Reason":"Schedule","configuration":"Checked-jitstress_isas_2_x86_noavx","AzurePipelinesTestRunId":"16512566","Project":"public","System.PhaseAttempt":"1","System.PhaseName":"run_test_p1__linux_x64_checked","DefinitionId":"115","System.StageAttempt":"1","BuildNumber":"20240504.1","operatingSystem":"Ubuntu.2204.Amd64.Open","architecture":"x64","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","CollectionUri":"https://dev.azure.com/dnceng-public/","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.StageName":"Build","System.JobName":"__default"} | Schedule 2024-05-04T21:01:01.511Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_2_x86_noavx2 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.PhaseAttempt":"1","operatingSystem":"Ubuntu.2204.Amd64.Open","System.StageName":"Build","configuration":"Checked-jitstress_isas_2_x86_noavx2","BuildNumber":"20240504.1","System.JobName":"__default","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobAttempt":"1","BuildId":"665757","System.StageAttempt":"1","Reason":"Schedule","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","AzurePipelinesTestRunId":"16512552","System.PhaseName":"run_test_p1__linux_x64_checked","architecture":"x64","DefinitionName":"runtime-coreclr jitstress-isas-x86","Project":"public","DefinitionId":"115"} | Schedule 2024-05-04T21:01:00.266Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_1_x86_nosse | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.JobName":"__default","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.JobAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","System.StageAttempt":"1","operatingSystem":"Ubuntu.2204.Amd64.Open","BuildNumber":"20240504.1","System.PhaseAttempt":"1","architecture":"x64","System.StageName":"Build","Project":"public","AzurePipelinesTestRunId":"16512560","DefinitionId":"115","System.PhaseName":"run_test_p1__linux_x64_checked","DefinitionName":"runtime-coreclr jitstress-isas-x86","BuildId":"665757","configuration":"Checked-jitstress_isas_1_x86_nosse","Reason":"Schedule"} | Schedule 2024-05-04T21:00:58.734Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_1_x86_nossse3 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"Reason":"Schedule","configuration":"Checked-jitstress_isas_1_x86_nossse3","System.PhaseAttempt":"1","System.StageName":"Build","DefinitionId":"115","System.PhaseName":"run_test_p1__linux_x64_checked","System.JobName":"__default","DefinitionName":"runtime-coreclr jitstress-isas-x86","Project":"public","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.StageAttempt":"1","operatingSystem":"Ubuntu.2204.Amd64.Open","AzurePipelinesTestRunId":"16512592","BuildNumber":"20240504.1","architecture":"x64","CollectionUri":"https://dev.azure.com/dnceng-public/","BuildId":"665757","System.JobAttempt":"1"} | Schedule 2024-05-04T21:00:57.267Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_2_x86_nosse2 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.JobName":"__default","configuration":"Checked-jitstress_isas_2_x86_nosse2","System.JobAttempt":"1","operatingSystem":"Ubuntu.2204.Amd64.Open","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","DefinitionId":"115","System.PhaseAttempt":"1","AzurePipelinesTestRunId":"16512512","System.PhaseName":"run_test_p1__linux_x64_checked","DefinitionName":"runtime-coreclr jitstress-isas-x86","CollectionUri":"https://dev.azure.com/dnceng-public/","Reason":"Schedule","System.StageAttempt":"1","Project":"public","System.StageName":"Build","BuildNumber":"20240504.1","architecture":"x64","BuildId":"665757"} | Schedule 2024-05-04T21:00:51.399Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_1_x86_nobmi1 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.JobAttempt":"1","operatingSystem":"Ubuntu.2204.Amd64.Open","BuildNumber":"20240504.1","BuildId":"665757","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","Project":"public","System.StageName":"Build","System.PhaseAttempt":"1","System.PhaseName":"run_test_p1__linux_x64_checked","System.StageAttempt":"1","System.JobName":"__default","AzurePipelinesTestRunId":"16512542","DefinitionId":"115","CollectionUri":"https://dev.azure.com/dnceng-public/","architecture":"x64","Reason":"Schedule","configuration":"Checked-jitstress_isas_1_x86_nobmi1"} | Schedule 2024-05-04T21:00:49.89Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_2_x86_nobmi1 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.PhaseName":"run_test_p1__linux_x64_checked","Project":"public","configuration":"Checked-jitstress_isas_2_x86_nobmi1","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.JobName":"__default","AzurePipelinesTestRunId":"16512516","BuildId":"665757","BuildNumber":"20240504.1","System.JobAttempt":"1","System.StageAttempt":"1","architecture":"x64","CollectionUri":"https://dev.azure.com/dnceng-public/","System.StageName":"Build","System.PhaseAttempt":"1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","Reason":"Schedule","operatingSystem":"Ubuntu.2204.Amd64.Open","DefinitionId":"115"} | Schedule 2024-05-04T21:00:48.53Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_1_x86_nosse3 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"DefinitionId":"115","System.JobAttempt":"1","Reason":"Schedule","AzurePipelinesTestRunId":"16512504","configuration":"Checked-jitstress_isas_1_x86_nosse3","System.StageName":"Build","System.StageAttempt":"1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.JobName":"__default","System.PhaseName":"run_test_p1__linux_x64_checked","System.PhaseAttempt":"1","BuildId":"665757","CollectionUri":"https://dev.azure.com/dnceng-public/","operatingSystem":"Ubuntu.2204.Amd64.Open","architecture":"x64","DefinitionName":"runtime-coreclr jitstress-isas-x86","BuildNumber":"20240504.1","Project":"public"} | Schedule 2024-05-04T21:00:46.952Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_2_x86_nolzcnt | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"CollectionUri":"https://dev.azure.com/dnceng-public/","System.StageName":"Build","DefinitionId":"115","AzurePipelinesTestRunId":"16512526","Reason":"Schedule","DefinitionName":"runtime-coreclr jitstress-isas-x86","BuildNumber":"20240504.1","configuration":"Checked-jitstress_isas_2_x86_nolzcnt","architecture":"x64","System.JobAttempt":"1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.PhaseName":"run_test_p1__linux_x64_checked","BuildId":"665757","Project":"public","System.PhaseAttempt":"1","System.JobName":"__default","operatingSystem":"Ubuntu.2204.Amd64.Open","System.StageAttempt":"1"} | Schedule 2024-05-04T21:00:45.373Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_2_x86_nohwintrinsic | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"DefinitionName":"runtime-coreclr jitstress-isas-x86","Reason":"Schedule","System.StageAttempt":"1","BuildNumber":"20240504.1","AzurePipelinesTestRunId":"16512550","architecture":"x64","System.PhaseAttempt":"1","operatingSystem":"Ubuntu.2204.Amd64.Open","BuildId":"665757","Project":"public","DefinitionId":"115","CollectionUri":"https://dev.azure.com/dnceng-public/","System.StageName":"Build","System.JobName":"__default","System.JobAttempt":"1","System.PhaseName":"run_test_p1__linux_x64_checked","configuration":"Checked-jitstress_isas_2_x86_nohwintrinsic","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5"} | Schedule 2024-05-04T21:00:42.467Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_2_x86_nosse | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobAttempt":"1","BuildId":"665757","System.PhaseName":"run_test_p1__linux_x64_checked","BuildNumber":"20240504.1","operatingSystem":"Ubuntu.2204.Amd64.Open","configuration":"Checked-jitstress_isas_2_x86_nosse","System.JobName":"__default","architecture":"x64","Reason":"Schedule","Project":"public","AzurePipelinesTestRunId":"16512530","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.PhaseAttempt":"1","DefinitionId":"115","System.StageAttempt":"1","System.StageName":"Build"} | Schedule 2024-05-04T21:00:40.919Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_1_x86_nopopcnt | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"BuildNumber":"20240504.1","System.StageAttempt":"1","System.PhaseAttempt":"1","operatingSystem":"Ubuntu.2204.Amd64.Open","BuildId":"665757","configuration":"Checked-jitstress_isas_1_x86_nopopcnt","System.JobName":"__default","Project":"public","Reason":"Schedule","AzurePipelinesTestRunId":"16512522","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.JobAttempt":"1","System.PhaseName":"run_test_p1__linux_x64_checked","architecture":"x64","DefinitionId":"115","DefinitionName":"runtime-coreclr jitstress-isas-x86","CollectionUri":"https://dev.azure.com/dnceng-public/","System.StageName":"Build"} | Schedule 2024-05-04T21:00:32.215Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_1_x86_noavx512 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"BuildId":"665757","System.PhaseName":"run_test_p1__linux_x64_checked","CollectionUri":"https://dev.azure.com/dnceng-public/","AzurePipelinesTestRunId":"16512524","System.StageAttempt":"1","BuildNumber":"20240504.1","System.JobName":"__default","operatingSystem":"Ubuntu.2204.Amd64.Open","architecture":"x64","System.JobAttempt":"1","Reason":"Schedule","DefinitionName":"runtime-coreclr jitstress-isas-x86","DefinitionId":"115","System.PhaseAttempt":"1","System.StageName":"Build","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","Project":"public","configuration":"Checked-jitstress_isas_1_x86_noavx512"} | Schedule 2024-05-04T21:00:30.733Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_1_x86_nosse42 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"architecture":"x64","configuration":"Checked-jitstress_isas_1_x86_nosse42","System.PhaseName":"run_test_p1__linux_x64_checked","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","Reason":"Schedule","CollectionUri":"https://dev.azure.com/dnceng-public/","AzurePipelinesTestRunId":"16512502","BuildId":"665757","System.JobName":"__default","Project":"public","System.StageName":"Build","operatingSystem":"Ubuntu.2204.Amd64.Open","System.PhaseAttempt":"1","System.StageAttempt":"1","BuildNumber":"20240504.1","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.JobAttempt":"1","DefinitionId":"115"} | Schedule 2024-05-04T21:00:29.379Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_1_x86_nosse2 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.JobAttempt":"1","BuildNumber":"20240504.1","System.PhaseAttempt":"1","DefinitionId":"115","configuration":"Checked-jitstress_isas_1_x86_nosse2","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","Project":"public","Reason":"Schedule","operatingSystem":"Ubuntu.2204.Amd64.Open","System.StageAttempt":"1","System.PhaseName":"run_test_p1__linux_x64_checked","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobName":"__default","System.StageName":"Build","BuildId":"665757","architecture":"x64","AzurePipelinesTestRunId":"16512506"} | Schedule 2024-05-04T21:00:26.176Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_2_x86_nopopcnt | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.StageAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","System.PhaseAttempt":"1","DefinitionId":"115","operatingSystem":"Ubuntu.2204.Amd64.Open","AzurePipelinesTestRunId":"16512508","System.JobName":"__default","System.PhaseName":"run_test_p1__linux_x64_checked","configuration":"Checked-jitstress_isas_2_x86_nopopcnt","DefinitionName":"runtime-coreclr jitstress-isas-x86","Reason":"Schedule","System.StageName":"Build","System.JobAttempt":"1","architecture":"x64","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","BuildNumber":"20240504.1","Project":"public","BuildId":"665757"} | Schedule 2024-05-04T21:00:22.863Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_2_x86_noaes | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.JobAttempt":"1","architecture":"x64","System.PhaseAttempt":"1","System.StageAttempt":"1","BuildId":"665757","configuration":"Checked-jitstress_isas_2_x86_noaes","System.StageName":"Build","CollectionUri":"https://dev.azure.com/dnceng-public/","DefinitionId":"115","BuildNumber":"20240504.1","operatingSystem":"Ubuntu.2204.Amd64.Open","AzurePipelinesTestRunId":"16512500","Project":"public","System.JobName":"__default","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.PhaseName":"run_test_p1__linux_x64_checked","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","Reason":"Schedule"} | Schedule 2024-05-04T21:00:18.816Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_2_x86_nopclmulqdq | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.StageName":"Build","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.JobAttempt":"1","operatingSystem":"Ubuntu.2204.Amd64.Open","System.StageAttempt":"1","Reason":"Schedule","DefinitionId":"115","BuildId":"665757","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","AzurePipelinesTestRunId":"16512498","architecture":"x64","System.PhaseName":"run_test_p1__linux_x64_checked","System.PhaseAttempt":"1","System.JobName":"__default","configuration":"Checked-jitstress_isas_2_x86_nopclmulqdq","Project":"public","CollectionUri":"https://dev.azure.com/dnceng-public/","BuildNumber":"20240504.1"} | Schedule 2024-05-04T21:00:17.263Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_1_x86_nofma | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"BuildNumber":"20240504.1","Project":"public","CollectionUri":"https://dev.azure.com/dnceng-public/","System.StageAttempt":"1","configuration":"Checked-jitstress_isas_1_x86_nofma","Reason":"Schedule","BuildId":"665757","System.PhaseName":"run_test_p1__linux_x64_checked","System.JobName":"__default","System.StageName":"Build","architecture":"x64","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.JobAttempt":"1","AzurePipelinesTestRunId":"16512514","operatingSystem":"Ubuntu.2204.Amd64.Open","DefinitionId":"115","System.PhaseAttempt":"1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5"} | Schedule 2024-05-04T18:24:51.244Z | runtime-coreclr jitstress2-jitstressregs | Checked-jitstress2_jitstressregs0x80 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"BuildId":"665686","Reason":"Schedule","System.StageName":"Build","System.PhaseName":"run_test_p1__linux_x64_checked","System.JobAttempt":"1","BuildNumber":"20240504.1","Project":"public","operatingSystem":"Ubuntu.2204.Amd64.Open","System.PhaseAttempt":"1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","architecture":"x64","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobName":"__default","System.StageAttempt":"1","AzurePipelinesTestRunId":"16511542","DefinitionId":"111","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","configuration":"Checked-jitstress2_jitstressregs0x80"} | Schedule 2024-05-04T18:24:49.807Z | runtime-coreclr jitstress2-jitstressregs | Checked-jitstress2_jitstressregs8 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.PhaseAttempt":"1","System.JobAttempt":"1","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","System.StageAttempt":"1","DefinitionId":"111","System.PhaseName":"run_test_p1__linux_x64_checked","System.JobName":"__default","CollectionUri":"https://dev.azure.com/dnceng-public/","BuildNumber":"20240504.1","architecture":"x64","System.StageName":"Build","configuration":"Checked-jitstress2_jitstressregs8","operatingSystem":"Ubuntu.2204.Amd64.Open","BuildId":"665686","AzurePipelinesTestRunId":"16511550","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","Reason":"Schedule","Project":"public"} | Schedule 2024-05-04T18:24:48.244Z | runtime-coreclr jitstress2-jitstressregs | Checked-jitstress2_jitstressregs0x1000 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"Reason":"Schedule","configuration":"Checked-jitstress2_jitstressregs0x1000","CollectionUri":"https://dev.azure.com/dnceng-public/","AzurePipelinesTestRunId":"16511540","System.PhaseName":"run_test_p1__linux_x64_checked","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","System.StageAttempt":"1","System.StageName":"Build","architecture":"x64","BuildId":"665686","Project":"public","operatingSystem":"Ubuntu.2204.Amd64.Open","System.PhaseAttempt":"1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.JobName":"__default","DefinitionId":"111","System.JobAttempt":"1","BuildNumber":"20240504.1"} | Schedule 2024-05-04T18:24:46.915Z | runtime-coreclr jitstress2-jitstressregs | Checked-jitstress2_jitstressregs0x10 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.JobAttempt":"1","operatingSystem":"Ubuntu.2204.Amd64.Open","AzurePipelinesTestRunId":"16511554","DefinitionId":"111","Reason":"Schedule","System.PhaseName":"run_test_p1__linux_x64_checked","architecture":"x64","configuration":"Checked-jitstress2_jitstressregs0x10","Project":"public","System.StageAttempt":"1","System.JobName":"__default","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","BuildNumber":"20240504.1","System.PhaseAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","BuildId":"665686","System.StageName":"Build"} | Schedule 2024-05-04T18:24:45.479Z | runtime-coreclr jitstress2-jitstressregs | Checked-jitstress2_jitstressregs2 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"Reason":"Schedule","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","Project":"public","System.PhaseName":"run_test_p1__linux_x64_checked","System.StageAttempt":"1","DefinitionId":"111","System.PhaseAttempt":"1","AzurePipelinesTestRunId":"16511544","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobAttempt":"1","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","BuildId":"665686","operatingSystem":"Ubuntu.2204.Amd64.Open","System.StageName":"Build","BuildNumber":"20240504.1","System.JobName":"__default","configuration":"Checked-jitstress2_jitstressregs2","architecture":"x64"} | Schedule 2024-05-04T18:24:43.947Z | runtime-coreclr jitstress2-jitstressregs | Checked-jitstress2_jitstressregs4 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"AzurePipelinesTestRunId":"16511552","Project":"public","operatingSystem":"Ubuntu.2204.Amd64.Open","System.StageAttempt":"1","System.PhaseAttempt":"1","System.PhaseName":"run_test_p1__linux_x64_checked","CollectionUri":"https://dev.azure.com/dnceng-public/","DefinitionId":"111","System.StageName":"Build","System.JobAttempt":"1","configuration":"Checked-jitstress2_jitstressregs4","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","Reason":"Schedule","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","System.JobName":"__default","BuildNumber":"20240504.1","architecture":"x64","BuildId":"665686"} | Schedule 2024-05-04T18:24:42.243Z | runtime-coreclr jitstress2-jitstressregs | Checked-jitstress2_jitstressregs1 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"configuration":"Checked-jitstress2_jitstressregs1","System.JobAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","operatingSystem":"Ubuntu.2204.Amd64.Open","System.PhaseName":"run_test_p1__linux_x64_checked","System.StageName":"Build","System.JobName":"__default","AzurePipelinesTestRunId":"16511538","BuildId":"665686","BuildNumber":"20240504.1","Reason":"Schedule","System.StageAttempt":"1","Project":"public","DefinitionId":"111","architecture":"x64","System.PhaseAttempt":"1","DefinitionName":"runtime-coreclr jitstress2-jitstressregs"} | Schedule 2024-05-04T18:24:40.774Z | runtime-coreclr jitstress2-jitstressregs | Checked-jitstress2_jitstressregs3 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.StageName":"Build","configuration":"Checked-jitstress2_jitstressregs3","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","BuildNumber":"20240504.1","System.JobName":"__default","System.JobAttempt":"1","BuildId":"665686","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","System.StageAttempt":"1","DefinitionId":"111","CollectionUri":"https://dev.azure.com/dnceng-public/","AzurePipelinesTestRunId":"16511548","architecture":"x64","operatingSystem":"Ubuntu.2204.Amd64.Open","System.PhaseAttempt":"1","Project":"public","Reason":"Schedule","System.PhaseName":"run_test_p1__linux_x64_checked"} | Schedule 2024-05-04T18:24:39.166Z | runtime-coreclr jitstress2-jitstressregs | Checked-jitstress2_jitstressregs0x2000 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"AzurePipelinesTestRunId":"16511546","architecture":"x64","System.PhaseAttempt":"1","System.PhaseName":"run_test_p1__linux_x64_checked","System.StageName":"Build","System.JobName":"__default","Project":"public","operatingSystem":"Ubuntu.2204.Amd64.Open","BuildNumber":"20240504.1","BuildId":"665686","DefinitionId":"111","configuration":"Checked-jitstress2_jitstressregs0x2000","System.JobAttempt":"1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","CollectionUri":"https://dev.azure.com/dnceng-public/","System.StageAttempt":"1","Reason":"Schedule","DefinitionName":"runtime-coreclr jitstress2-jitstressregs"} | Schedule 2024-05-04T05:26:23.627Z | runtime-coreclr jitstress | Checked-jitstress2 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"CollectionUri":"https://dev.azure.com/dnceng-public/","architecture":"x64","Project":"public","DefinitionId":"109","System.JobAttempt":"1","System.StageAttempt":"1","DefinitionName":"runtime-coreclr jitstress","BuildNumber":"20240503.1","System.PhaseAttempt":"1","Reason":"Schedule","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.StageName":"Build","operatingSystem":"Ubuntu.2204.Amd64.Open","System.PhaseName":"run_test_p1__linux_x64_checked","BuildId":"665438","configuration":"Checked-jitstress2","System.JobName":"__default","AzurePipelinesTestRunId":"16503820"} | Schedule 2024-05-04T05:26:21.923Z | runtime-coreclr jitstress | Checked-jitstress1_tiered | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"architecture":"x64","System.PhaseName":"run_test_p1__linux_x64_checked","AzurePipelinesTestRunId":"16503818","System.PhaseAttempt":"1","BuildId":"665438","DefinitionId":"109","System.JobName":"__default","Reason":"Schedule","operatingSystem":"Ubuntu.2204.Amd64.Open","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","Project":"public","DefinitionName":"runtime-coreclr jitstress","System.JobAttempt":"1","System.StageAttempt":"1","configuration":"Checked-jitstress1_tiered","BuildNumber":"20240503.1","System.StageName":"Build","CollectionUri":"https://dev.azure.com/dnceng-public/"} | Schedule 2024-05-04T05:26:18.658Z | runtime-coreclr jitstress | Checked-jitstress1 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.JobName":"__default","AzurePipelinesTestRunId":"16503822","operatingSystem":"Ubuntu.2204.Amd64.Open","System.JobAttempt":"1","System.PhaseName":"run_test_p1__linux_x64_checked","System.StageAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","Project":"public","DefinitionId":"109","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","BuildId":"665438","System.StageName":"Build","DefinitionName":"runtime-coreclr jitstress","BuildNumber":"20240503.1","System.PhaseAttempt":"1","Reason":"Schedule","architecture":"x64","configuration":"Checked-jitstress1"} | Schedule 2024-05-04T05:26:13.779Z | runtime-coreclr jitstress | Checked-jitstress2_tiered | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.StageName":"Build","System.PhaseName":"run_test_p1__linux_x64_checked","DefinitionId":"109","DefinitionName":"runtime-coreclr jitstress","operatingSystem":"Ubuntu.2204.Amd64.Open","architecture":"x64","CollectionUri":"https://dev.azure.com/dnceng-public/","BuildId":"665438","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","AzurePipelinesTestRunId":"16503824","System.PhaseAttempt":"1","configuration":"Checked-jitstress2_tiered","System.JobAttempt":"1","System.StageAttempt":"1","Project":"public","System.JobName":"__default","Reason":"Schedule","BuildNumber":"20240503.1"} | Schedule
v-wenyuxu commented 3 months ago

Failed in: runtime-coreclr outerloop 20240617.3

Failed tests:

coreclr linux arm Checked @ (Alpine.316.Arm32.Open)Ubuntu.2004.ArmArch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.17-helix-arm32v7
    - GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh

Error message:

 waitpid() returned successfully (wstatus 00000000) WEXITSTATUS 0 WTERMSIG 0
/root/helix/work/workitem/e/GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh: line 455:  3025 Segmentation fault      (core dumped) $LAUNCHER $ExePath "${CLRTestExecutionArguments[@]}"

Return code:      1
Raw output file:      /root/helix/work/workitem/uploads/Reports/GC.Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.output.txt
Raw output:
BEGIN EXECUTION
/root/helix/work/correlation/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false -p System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true FinalizeTimeout.dll ''
Main start
Finalizer start
Finalizer end
Main end
[createdump] Gathering state for process 3025 corerun
[createdump] Crashing thread 0bda signal 11 (000b)
[createdump] Writing crash report to file /home/helixbot/dotnetbuild/dumps/coredump.3025.dmp.crashreport.json
[createdump] Crash report successfully written
[createdump] Writing minidump with heap to file /home/helixbot/dotnetbuild/dumps/coredump.3025.dmp
[createdump] Written 27066368 bytes (6608 pages) to core file
[createdump] Target process is alive
[createdump] Dump successfully written in 85ms
Expected: 100
Actual: 139
END EXECUTION - FAILED
Test failed. Trying to see if dump file was created in /home/helixbot/dotnetbuild/dumps since 6/17/2024 7:34:20 PM
Processing /home/helixbot/dotnetbuild/dumps/coredump.3025.dmp.crashreport.json
Printing stacktrace from '/home/helixbot/dotnetbuild/dumps/coredump.3025.dmp.crashreport.json'
Invoking llvm-symbolizer --pretty-print
Stack trace:
----------------------------------
Thread Id: 0xbd1
      Child SP               IP Call Site
----------------------------------
Thread Id: 0xbd2
      Child SP               IP Call Site
----------------------------------
Thread Id: 0xbd3
      Child SP               IP Call Site
----------------------------------
Thread Id: 0xbd4
      Child SP               IP Call Site
----------------------------------
Thread Id: 0xbd5
      Child SP               IP Call Site
----------------------------------
Thread Id: 0xbd6
      Child SP               IP Call Site
 0xf3b631b0 0xf7ad09aa 0xf7ad09aa
 0xf3b634f8 0xf14ee20e System.Diagnostics.Tracing.EventListener.DisposeOnShutdown()
 0xf3b63530 0xf1258968 System.AppContext.OnProcessExit()
----------------------------------
Thread Id: 0xbd8
      Child SP               IP Call Site
----------------------------------
Thread Id: 0xbd9
      Child SP               IP Call Site
 0xeddb11f8 0xf7ad09aa 0xf7ad09aa
 0xeddb1520 0xf103a7c4 FinalizeTimeout.ThreadMain()
 0xeddb1528 0xf13715b8 System.Threading.Thread.StartCallback()
 0xeddb1540 0xf767b76e 0xf767b76e
 0xeddb1550 0xf74eccea libcoreclr.so!CallDescrWorker(CallDescrData*) at /__w/1/s/src/coreclr/vm/callhelpers.cpp:0:5
 0xeddb1978 0xf74ecbba libcoreclr.so!NativeExceptionHolderBase::~NativeExceptionHolderBase() at /__w/1/s/src/coreclr/pal/inc/pal.h:4220:13
 (inlined by) CallDescrWorkerWithHandler(CallDescrData*, int) at /__w/1/s/src/coreclr/vm/callhelpers.cpp:65:5
 0xeddb19a0 0xf74ecef2 libcoreclr.so!DispatchCallSimple(unsigned int*, unsigned int, unsigned int, unsigned int) at /__w/1/s/src/coreclr/vm/callhelpers.cpp:0:9
 0xeddb1a00 0xf750373a libcoreclr.so!ThreadNative::KickOffThread_Worker(void*) at /__w/1/s/src/coreclr/vm/comsynchronizable.cpp:0:5
 0xeddb1a28 0xf74ba2e6 libcoreclr.so!ManagedThreadBase_DispatchMiddle(ManagedThreadCallState*) at /__w/1/s/src/coreclr/vm/threads.cpp:0:5
 (inlined by) ManagedThreadBase_DispatchOuter(ManagedThreadCallState*)::$_0::operator()(ManagedThreadBase_DispatchOuter(ManagedThreadCallState*)::TryArgs*) const::'lambda'(Param*)::operator()(Param*) const at /__w/1/s/src/coreclr/vm/threads.cpp:7325:13
 (inlined by) ManagedThreadBase_DispatchOuter(ManagedThreadCallState*)::$_0::operator()(ManagedThreadBase_DispatchOuter(ManagedThreadCallState*)::TryArgs*) const at /__w/1/s/src/coreclr/vm/threads.cpp:7327:9
 (inlined by) ManagedTh

Stack trace:

   at GC_Scenarios._FinalizeTimeout_FinalizeTimeout_FinalizeTimeout_._FinalizeTimeout_FinalizeTimeout_FinalizeTimeout_sh()

   at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
   at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
Queued Pipeline Pipeline_Configuration OS Arch Test Outcome Properties BuildReason
2024-06-17T19:24:22.281Z runtime-coreclr outerloop Checked ubuntu.2004.armarch.open arm GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh Failed {"DefinitionName":"runtime-coreclr outerloop","BuildId":"710652","CollectionUri":"https://dev.azure.com/dnceng-public/","architecture":"arm","Reason":"Schedule","configuration":"Checked","System.JobName":"__default","System.JobAttempt":"1","System.PhaseName":"run_test_p1__linux_musl_arm_checked","AzurePipelinesTestRunId":"17758634","operatingSystem":"(Alpine.316.Arm32.Open)Ubuntu.2004.ArmArch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.17-helix-arm32v7","System.JobId":"67940218-a6cd-574d-6681-11ea1e4ee273","System.StageName":"Build","System.StageAttempt":"1","DefinitionId":"108","BuildNumber":"20240617.3","System.PhaseAttempt":"1","Project":"public"} Schedule
2024-06-16T10:22:59.312Z runtime-coreclr outerloop Checked ubuntu.2004.armarch.open arm GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh Failed {"System.PhaseAttempt":"1","System.StageAttempt":"1","operatingSystem":"(Alpine.316.Arm32.Open)Ubuntu.2004.ArmArch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.17-helix-arm32v7","AzurePipelinesTestRunId":"17711704","Reason":"Schedule","System.JobId":"67940218-a6cd-574d-6681-11ea1e4ee273","Project":"public","System.StageName":"Build","DefinitionId":"108","configuration":"Checked","System.JobName":"default","architecture":"arm","System.JobAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","DefinitionName":"runtime-coreclr outerloop","System.PhaseName":"run_test_p1linux_musl_arm_checked","BuildId":"709294","BuildNumber":"20240616.1"} Schedule
2024-06-16T02:20:10.391Z runtime-coreclr outerloop Checked ubuntu.2004.armarch.open arm GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh Failed {"System.JobAttempt":"1","AzurePipelinesTestRunId":"17708296","System.StageAttempt":"1","System.JobName":"default","System.JobId":"67940218-a6cd-574d-6681-11ea1e4ee273","BuildId":"709209","CollectionUri":"https://dev.azure.com/dnceng-public/","DefinitionId":"108","BuildNumber":"20240615.3","System.PhaseAttempt":"1","Project":"public","configuration":"Checked","System.StageName":"Build","Reason":"Schedule","architecture":"arm","System.PhaseName":"run_test_p1linux_musl_arm_checked","operatingSystem":"(Alpine.316.Arm32.Open)Ubuntu.2004.ArmArch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.17-helix-arm32v7","DefinitionName":"runtime-coreclr outerloop"} Schedule
2024-06-15T19:27:07.465Z runtime-coreclr outerloop Checked ubuntu.2004.armarch.open arm64 GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh Failed {"BuildId":"709096","operatingSystem":"(Alpine.317.Arm64.Open)Ubuntu.2004.ArmArch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.17-helix-arm64v8","System.StageName":"Build","Reason":"Schedule","System.PhaseName":"run_test_p1_R2R_CG2_linux_musl_arm64_checked","System.JobId":"8e219403-74a1-530a-f547-c14188aff86d","Project":"public","System.JobName":"__default","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobAttempt":"1","DefinitionName":"runtime-coreclr outerloop","architecture":"arm64","DefinitionId":"108","BuildNumber":"20240615.2","AzurePipelinesTestRunId":"17704484","configuration":"Checked","System.PhaseAttempt":"1","System.StageAttempt":"1"} Schedule
2024-06-15T19:24:24.204Z runtime-coreclr outerloop Checked ubuntu.2004.armarch.open arm GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh Failed {"CollectionUri":"https://dev.azure.com/dnceng-public/","DefinitionName":"runtime-coreclr outerloop","System.JobName":"default","architecture":"arm","System.PhaseName":"run_test_p1linux_musl_arm_checked","System.JobId":"67940218-a6cd-574d-6681-11ea1e4ee273","System.JobAttempt":"1","BuildNumber":"20240615.2","configuration":"Checked","Reason":"Schedule","System.StageName":"Build","operatingSystem":"(Alpine.316.Arm32.Open)Ubuntu.2004.ArmArch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.17-helix-arm32v7","AzurePipelinesTestRunId":"17704432","BuildId":"709096","DefinitionId":"108","Project":"public","System.PhaseAttempt":"1","System.StageAttempt":"1"} Schedule
More failures Queued | Pipeline | Pipeline_Configuration | OS | Arch | Test | Outcome | Properties | BuildReason -- | -- | -- | -- | -- | -- | -- | -- | -- 2024-06-14T10:24:13.999Z | runtime-coreclr outerloop | Checked | ubuntu.2004.armarch.open | arm | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"DefinitionName":"runtime-coreclr outerloop","operatingSystem":"(Alpine.316.Arm32.Open)Ubuntu.2004.ArmArch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.17-helix-arm32v7","DefinitionId":"108","System.PhaseAttempt":"1","System.JobAttempt":"1","BuildNumber":"20240614.1","System.JobName":"__default","System.JobId":"67940218-a6cd-574d-6681-11ea1e4ee273","architecture":"arm","System.PhaseName":"run_test_p1__linux_musl_arm_checked","CollectionUri":"https://dev.azure.com/dnceng-public/","AzurePipelinesTestRunId":"17662376","Project":"public","Reason":"Schedule","System.StageAttempt":"1","BuildId":"707705","configuration":"Checked","System.StageName":"Build"} | Schedule 2024-06-14T02:27:48.012Z | runtime-coreclr outerloop | Checked | ubuntu.2004.armarch.open | arm64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.PhaseName":"run_test_p1__linux_musl_arm64_checked","DefinitionName":"runtime-coreclr outerloop","Project":"public","System.StageName":"Build","BuildNumber":"20240613.5","DefinitionId":"108","System.JobName":"__default","Reason":"Schedule","BuildId":"707420","configuration":"Checked","System.StageAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobId":"7c87b8fc-cd86-5445-5ca8-4814cf8d81d6","architecture":"arm64","System.PhaseAttempt":"1","operatingSystem":"(Alpine.317.Arm64.Open)Ubuntu.2004.ArmArch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.17-helix-arm64v8","AzurePipelinesTestRunId":"17654062","System.JobAttempt":"1"} | Schedule 2024-06-13T19:30:12.492Z | runtime-coreclr outerloop | Checked | ubuntu.2004.armarch.open | arm | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"DefinitionName":"runtime-coreclr outerloop","System.StageAttempt":"1","System.JobAttempt":"1","System.JobId":"67940218-a6cd-574d-6681-11ea1e4ee273","DefinitionId":"108","System.PhaseAttempt":"1","Project":"public","AzurePipelinesTestRunId":"17640996","configuration":"Checked","BuildId":"706979","Reason":"Schedule","System.JobName":"__default","BuildNumber":"20240613.3","operatingSystem":"(Alpine.316.Arm32.Open)Ubuntu.2004.ArmArch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.17-helix-arm32v7","System.StageName":"Build","architecture":"arm","CollectionUri":"https://dev.azure.com/dnceng-public/","System.PhaseName":"run_test_p1__linux_musl_arm_checked"} | Schedule 2024-05-09T02:18:47.007Z | runtime-coreclr outerloop | Checked-no_tiered_compilation | ubuntu.2004.armarch.open | arm | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.JobName":"__default","Reason":"Schedule","System.PhaseAttempt":"1","architecture":"arm","configuration":"Checked-no_tiered_compilation","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobId":"860c965f-b28e-50d5-65d2-e40bd59f3a69","Project":"public","DefinitionName":"runtime-coreclr outerloop","operatingSystem":"(Ubuntu.1804.Arm32.Open)Ubuntu.2004.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","BuildId":"670046","System.StageAttempt":"1","System.JobAttempt":"1","System.StageName":"Build","System.PhaseName":"run_test_p1__linux_arm_checked","BuildNumber":"20240508.3","DefinitionId":"108","AzurePipelinesTestRunId":"16612930"} | Schedule 2024-05-09T02:18:45.812Z | runtime-coreclr outerloop | Checked | ubuntu.2004.armarch.open | arm | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"DefinitionId":"108","DefinitionName":"runtime-coreclr outerloop","System.StageName":"Build","System.JobAttempt":"1","BuildId":"670046","Reason":"Schedule","System.JobId":"860c965f-b28e-50d5-65d2-e40bd59f3a69","Project":"public","BuildNumber":"20240508.3","operatingSystem":"(Ubuntu.1804.Arm32.Open)Ubuntu.2004.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","AzurePipelinesTestRunId":"16612920","configuration":"Checked","architecture":"arm","System.PhaseName":"run_test_p1__linux_arm_checked","CollectionUri":"https://dev.azure.com/dnceng-public/","System.StageAttempt":"1","System.PhaseAttempt":"1","System.JobName":"__default"} | Schedule 2024-05-08T23:33:04.014Z | runtime-nativeaot-outerloop | Checked | ubuntu.2004.armarch.open | arm | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.PhaseName":"build_linux_arm_Checked_NativeAOT_Pri0","System.JobAttempt":"1","System.JobId":"531ca2ce-eccb-527e-1ec0-55002e52e870","DefinitionId":"265","BuildNumber":"20240508.2","operatingSystem":"(Ubuntu.1804.Arm32.Open)Ubuntu.2004.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","System.StageAttempt":"1","configuration":"Checked","System.StageName":"Build","Reason":"Schedule","AzurePipelinesTestRunId":"16610852","BuildId":"669858","Project":"public","DefinitionName":"runtime-nativeaot-outerloop","System.JobName":"__default","System.PhaseAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","architecture":"arm"} | Schedule 2024-05-08T20:55:20.943Z | runtime | Checked-no_tiered_compilation | ubuntu.2004.armarch.open | arm | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.JobAttempt":"1","System.PhaseName":"run_test_p0_coreclr__linux_arm_checked","Reason":"Schedule","System.StageName":"Build","operatingSystem":"(Ubuntu.1804.Arm32.Open)Ubuntu.2004.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","System.JobId":"5875517b-40f2-5b27-5b45-8b8aba144595","configuration":"Checked-no_tiered_compilation","DefinitionName":"runtime","DefinitionId":"129","System.JobName":"__default","System.PhaseAttempt":"1","BuildId":"669797","architecture":"arm","AzurePipelinesTestRunId":"16607856","BuildNumber":"20240508.40","Project":"public","System.StageAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/"} | Schedule 2024-05-08T20:55:19.474Z | runtime | Checked | ubuntu.2004.armarch.open | arm | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"DefinitionName":"runtime","operatingSystem":"(Ubuntu.1804.Arm32.Open)Ubuntu.2004.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","System.PhaseName":"run_test_p0_coreclr__linux_arm_checked","configuration":"Checked","DefinitionId":"129","BuildNumber":"20240508.40","System.JobAttempt":"1","System.StageName":"Build","BuildId":"669797","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobName":"__default","Reason":"Schedule","System.StageAttempt":"1","System.JobId":"5875517b-40f2-5b27-5b45-8b8aba144595","Project":"public","System.PhaseAttempt":"1","AzurePipelinesTestRunId":"16607854","architecture":"arm"} | Schedule 2024-05-08T19:20:43.463Z | runtime-coreclr outerloop | Checked-no_tiered_compilation | ubuntu.2004.armarch.open | arm | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"AzurePipelinesTestRunId":"16606342","DefinitionName":"runtime-coreclr outerloop","BuildId":"669628","architecture":"arm","configuration":"Checked-no_tiered_compilation","Project":"public","System.JobId":"860c965f-b28e-50d5-65d2-e40bd59f3a69","operatingSystem":"(Ubuntu.1804.Arm32.Open)Ubuntu.2004.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","System.JobAttempt":"1","System.PhaseName":"run_test_p1__linux_arm_checked","Reason":"Schedule","System.PhaseAttempt":"1","System.StageAttempt":"1","System.JobName":"__default","CollectionUri":"https://dev.azure.com/dnceng-public/","BuildNumber":"20240508.2","DefinitionId":"108","System.StageName":"Build"} | Schedule 2024-05-08T19:20:41.712Z | runtime-coreclr outerloop | Checked | ubuntu.2004.armarch.open | arm | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"BuildNumber":"20240508.2","DefinitionId":"108","System.JobId":"860c965f-b28e-50d5-65d2-e40bd59f3a69","System.JobName":"__default","DefinitionName":"runtime-coreclr outerloop","AzurePipelinesTestRunId":"16606340","System.StageName":"Build","Reason":"Schedule","System.PhaseAttempt":"1","configuration":"Checked","architecture":"arm","CollectionUri":"https://dev.azure.com/dnceng-public/","BuildId":"669628","System.JobAttempt":"1","System.StageAttempt":"1","Project":"public","System.PhaseName":"run_test_p1__linux_arm_checked","operatingSystem":"(Ubuntu.1804.Arm32.Open)Ubuntu.2004.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7"} | Schedule 2024-05-08T11:35:56.729Z | runtime-nativeaot-outerloop | Checked | ubuntu.2004.armarch.open | arm | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.PhaseAttempt":"1","System.StageName":"Build","configuration":"Checked","System.JobId":"531ca2ce-eccb-527e-1ec0-55002e52e870","BuildId":"669222","Reason":"Schedule","BuildNumber":"20240508.1","architecture":"arm","Project":"public","AzurePipelinesTestRunId":"16596980","operatingSystem":"(Ubuntu.1804.Arm32.Open)Ubuntu.2004.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","System.StageAttempt":"1","System.JobName":"__default","System.JobAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","System.PhaseName":"build_linux_arm_Checked_NativeAOT_Pri0","DefinitionId":"265","DefinitionName":"runtime-nativeaot-outerloop"} | Schedule 2024-05-08T10:18:34.795Z | runtime-coreclr outerloop | Checked-no_tiered_compilation | ubuntu.2004.armarch.open | arm | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.StageName":"Build","Project":"public","AzurePipelinesTestRunId":"16596180","System.PhaseName":"run_test_p1__linux_arm_checked","BuildNumber":"20240508.1","System.JobAttempt":"1","System.JobName":"__default","BuildId":"669221","configuration":"Checked-no_tiered_compilation","Reason":"Schedule","operatingSystem":"(Ubuntu.1804.Arm32.Open)Ubuntu.2004.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","System.StageAttempt":"1","architecture":"arm","DefinitionId":"108","System.PhaseAttempt":"1","DefinitionName":"runtime-coreclr outerloop","System.JobId":"860c965f-b28e-50d5-65d2-e40bd59f3a69","CollectionUri":"https://dev.azure.com/dnceng-public/"} | Schedule 2024-05-08T10:18:33.232Z | runtime-coreclr outerloop | Checked | ubuntu.2004.armarch.open | arm | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.JobName":"__default","AzurePipelinesTestRunId":"16596178","System.PhaseName":"run_test_p1__linux_arm_checked","architecture":"arm","CollectionUri":"https://dev.azure.com/dnceng-public/","System.StageName":"Build","BuildId":"669221","DefinitionName":"runtime-coreclr outerloop","System.PhaseAttempt":"1","System.JobAttempt":"1","Project":"public","System.JobId":"860c965f-b28e-50d5-65d2-e40bd59f3a69","DefinitionId":"108","BuildNumber":"20240508.1","configuration":"Checked","Reason":"Schedule","System.StageAttempt":"1","operatingSystem":"(Ubuntu.1804.Arm32.Open)Ubuntu.2004.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7"} | Schedule 2024-05-08T09:16:15.601Z | runtime-coreclr pgo | Checked-defaultpgo | ubuntu.2004.armarch.open | arm | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.JobId":"860c965f-b28e-50d5-65d2-e40bd59f3a69","BuildNumber":"20240508.1","Reason":"Schedule","System.JobAttempt":"1","System.PhaseName":"run_test_p1__linux_arm_checked","System.PhaseAttempt":"1","BuildId":"669200","Project":"public","operatingSystem":"(Ubuntu.1804.Arm32.Open)Ubuntu.2004.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","System.JobName":"__default","DefinitionId":"144","AzurePipelinesTestRunId":"16595346","DefinitionName":"runtime-coreclr pgo","System.StageAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","architecture":"arm","configuration":"Checked-defaultpgo","System.StageName":"Build"} | Schedule 2024-05-08T08:55:12.152Z | runtime | Checked-no_tiered_compilation | ubuntu.2004.armarch.open | arm | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.StageName":"Build","AzurePipelinesTestRunId":"16594958","System.JobName":"__default","configuration":"Checked-no_tiered_compilation","BuildNumber":"20240508.1","CollectionUri":"https://dev.azure.com/dnceng-public/","System.StageAttempt":"1","DefinitionId":"129","System.JobId":"5875517b-40f2-5b27-5b45-8b8aba144595","System.PhaseName":"run_test_p0_coreclr__linux_arm_checked","architecture":"arm","Reason":"Schedule","System.PhaseAttempt":"1","operatingSystem":"(Ubuntu.1804.Arm32.Open)Ubuntu.2004.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","DefinitionName":"runtime","BuildId":"669202","System.JobAttempt":"1","Project":"public"} | Schedule 2024-05-08T08:55:10.576Z | runtime | Checked | ubuntu.2004.armarch.open | arm | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.StageName":"Build","DefinitionId":"129","configuration":"Checked","System.StageAttempt":"1","BuildNumber":"20240508.1","System.JobId":"5875517b-40f2-5b27-5b45-8b8aba144595","AzurePipelinesTestRunId":"16594956","DefinitionName":"runtime","Reason":"Schedule","Project":"public","BuildId":"669202","System.JobAttempt":"1","System.PhaseAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","operatingSystem":"(Ubuntu.1804.Arm32.Open)Ubuntu.2004.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","System.PhaseName":"run_test_p0_coreclr__linux_arm_checked","architecture":"arm","System.JobName":"__default"} | Schedule 2024-05-08T07:27:00.809Z | coreclr-release-outerloop-nightly | Release-no_tiered_compilation | ubuntu.2004.armarch.open | arm | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.PhaseAttempt":"1","architecture":"arm","DefinitionName":"coreclr-release-outerloop-nightly","System.JobName":"__default","AzurePipelinesTestRunId":"16592990","configuration":"Release-no_tiered_compilation","BuildNumber":"20240507.1","BuildId":"669106","System.JobAttempt":"1","DefinitionId":"135","System.StageAttempt":"1","System.StageName":"Build","operatingSystem":"(Ubuntu.1804.Arm32.Open)Ubuntu.2004.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","Project":"public","System.PhaseName":"run_test_p1_R2R_linux_arm_release","System.JobId":"72dfe29e-04cf-5892-e89c-87a9854dd748","CollectionUri":"https://dev.azure.com/dnceng-public/","Reason":"Schedule"} | Schedule 2024-05-08T07:27:00.809Z | coreclr-release-outerloop-nightly | Release-no_tiered_compilation | ubuntu.2004.armarch.open | arm | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.PhaseAttempt":"1","architecture":"arm","DefinitionName":"coreclr-release-outerloop-nightly","System.JobName":"__default","AzurePipelinesTestRunId":"16592990","configuration":"Release-no_tiered_compilation","BuildNumber":"20240507.1","BuildId":"669106","System.JobAttempt":"1","DefinitionId":"135","System.StageAttempt":"1","System.StageName":"Build","operatingSystem":"(Ubuntu.1804.Arm32.Open)Ubuntu.2004.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","Project":"public","System.PhaseName":"run_test_p1_R2R_linux_arm_release","System.JobId":"72dfe29e-04cf-5892-e89c-87a9854dd748","CollectionUri":"https://dev.azure.com/dnceng-public/","Reason":"Schedule"} | Schedule 2024-05-08T07:26:57.972Z | coreclr-release-outerloop-nightly | Release | ubuntu.2004.armarch.open | arm | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"BuildId":"669106","AzurePipelinesTestRunId":"16592988","System.PhaseName":"run_test_p1_R2R_linux_arm_release","System.PhaseAttempt":"1","System.JobAttempt":"1","Reason":"Schedule","DefinitionId":"135","architecture":"arm","BuildNumber":"20240507.1","System.StageAttempt":"1","System.JobId":"72dfe29e-04cf-5892-e89c-87a9854dd748","CollectionUri":"https://dev.azure.com/dnceng-public/","Project":"public","System.JobName":"__default","System.StageName":"Build","DefinitionName":"coreclr-release-outerloop-nightly","operatingSystem":"(Ubuntu.1804.Arm32.Open)Ubuntu.2004.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","configuration":"Release"} | Schedule 2024-05-08T07:23:41.546Z | coreclr-release-outerloop-nightly | Release-no_tiered_compilation | ubuntu.2004.armarch.open | arm | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"DefinitionName":"coreclr-release-outerloop-nightly","operatingSystem":"(Ubuntu.1804.Arm32.Open)Ubuntu.2004.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","System.PhaseName":"run_test_p1__linux_arm_release","Reason":"Schedule","System.StageAttempt":"1","DefinitionId":"135","System.JobName":"__default","BuildId":"669106","System.StageName":"Build","BuildNumber":"20240507.1","System.JobAttempt":"1","System.PhaseAttempt":"1","AzurePipelinesTestRunId":"16592840","architecture":"arm","configuration":"Release-no_tiered_compilation","Project":"public","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobId":"ae69a820-8040-5321-6217-15d430a2ab03"} | Schedule 2024-05-08T07:23:40.155Z | coreclr-release-outerloop-nightly | Release | ubuntu.2004.armarch.open | arm | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"DefinitionId":"135","System.StageName":"Build","DefinitionName":"coreclr-release-outerloop-nightly","System.JobName":"__default","AzurePipelinesTestRunId":"16592838","Reason":"Schedule","configuration":"Release","System.JobId":"ae69a820-8040-5321-6217-15d430a2ab03","System.StageAttempt":"1","System.PhaseName":"run_test_p1__linux_arm_release","BuildNumber":"20240507.1","Project":"public","BuildId":"669106","System.PhaseAttempt":"1","System.JobAttempt":"1","architecture":"arm","CollectionUri":"https://dev.azure.com/dnceng-public/","operatingSystem":"(Ubuntu.1804.Arm32.Open)Ubuntu.2004.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7"} | Schedule 2024-05-06T05:24:02.857Z | runtime-coreclr jitstress | Checked-jitstress1 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"Reason":"Schedule","Project":"public","System.JobAttempt":"1","configuration":"Checked-jitstress1","CollectionUri":"https://dev.azure.com/dnceng-public/","DefinitionId":"109","DefinitionName":"runtime-coreclr jitstress","architecture":"x64","System.PhaseName":"run_test_p1__linux_x64_checked","System.StageName":"Build","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","BuildId":"666407","AzurePipelinesTestRunId":"16528844","System.PhaseAttempt":"1","operatingSystem":"Ubuntu.2204.Amd64.Open","BuildNumber":"20240505.1","System.JobName":"__default","System.StageAttempt":"1"} | Schedule 2024-05-06T05:24:01.384Z | runtime-coreclr jitstress | Checked-jitstress2_tiered | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"configuration":"Checked-jitstress2_tiered","System.StageAttempt":"1","AzurePipelinesTestRunId":"16528852","System.JobName":"__default","CollectionUri":"https://dev.azure.com/dnceng-public/","Reason":"Schedule","System.JobAttempt":"1","BuildNumber":"20240505.1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.PhaseName":"run_test_p1__linux_x64_checked","operatingSystem":"Ubuntu.2204.Amd64.Open","System.StageName":"Build","System.PhaseAttempt":"1","DefinitionId":"109","BuildId":"666407","DefinitionName":"runtime-coreclr jitstress","architecture":"x64","Project":"public"} | Schedule 2024-05-06T05:24:00.009Z | runtime-coreclr jitstress | Checked-jitstress2 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"Project":"public","BuildNumber":"20240505.1","System.JobName":"__default","Reason":"Schedule","System.StageName":"Build","operatingSystem":"Ubuntu.2204.Amd64.Open","System.PhaseName":"run_test_p1__linux_x64_checked","CollectionUri":"https://dev.azure.com/dnceng-public/","BuildId":"666407","AzurePipelinesTestRunId":"16528842","configuration":"Checked-jitstress2","DefinitionId":"109","System.StageAttempt":"1","architecture":"x64","System.JobAttempt":"1","DefinitionName":"runtime-coreclr jitstress","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.PhaseAttempt":"1"} | Schedule 2024-05-06T05:23:57.087Z | runtime-coreclr jitstress | Checked-jitstress1_tiered | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"architecture":"x64","System.StageAttempt":"1","System.PhaseName":"run_test_p1__linux_x64_checked","Reason":"Schedule","operatingSystem":"Ubuntu.2204.Amd64.Open","System.JobAttempt":"1","BuildId":"666407","AzurePipelinesTestRunId":"16528846","System.JobName":"__default","DefinitionName":"runtime-coreclr jitstress","Project":"public","System.PhaseAttempt":"1","DefinitionId":"109","BuildNumber":"20240505.1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.StageName":"Build","configuration":"Checked-jitstress1_tiered","CollectionUri":"https://dev.azure.com/dnceng-public/"} | Schedule 2024-05-06T03:47:23.446Z | runtime-coreclr r2r-extra | Checked-jitstress2_tiered | osx.1200.arm64.open | arm64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"configuration":"Checked-jitstress2_tiered","System.PhaseName":"run_test_p1_R2R_osx_arm64_checked","DefinitionId":"114","operatingSystem":"OSX.1200.ARM64.Open","System.PhaseAttempt":"1","System.StageName":"Build","Reason":"Schedule","BuildId":"666362","DefinitionName":"runtime-coreclr r2r-extra","System.JobId":"99f15f99-448d-5593-a271-dbdf553789a6","System.JobAttempt":"1","AzurePipelinesTestRunId":"16528362","System.JobName":"__default","System.StageAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","Project":"public","BuildNumber":"20240505.1","architecture":"arm64"} | Schedule 2024-05-06T03:31:02.455Z | runtime-coreclr r2r-extra | Checked-jitstress1_tiered | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"AzurePipelinesTestRunId":"16527936","BuildNumber":"20240505.1","System.StageName":"Build","System.JobName":"__default","DefinitionId":"114","System.PhaseName":"run_test_p1_R2R_linux_x64_checked","System.JobAttempt":"1","architecture":"x64","Project":"public","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobId":"45a39349-90d5-51c8-4429-a48b2907fbdd","DefinitionName":"runtime-coreclr r2r-extra","configuration":"Checked-jitstress1_tiered","System.StageAttempt":"1","operatingSystem":"Ubuntu.2204.Amd64.Open","Reason":"Schedule","System.PhaseAttempt":"1","BuildId":"666362"} | Schedule 2024-05-06T03:30:58.033Z | runtime-coreclr r2r-extra | Checked-jitstress2_tiered | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.JobId":"45a39349-90d5-51c8-4429-a48b2907fbdd","AzurePipelinesTestRunId":"16527918","System.StageAttempt":"1","System.JobName":"__default","System.PhaseName":"run_test_p1_R2R_linux_x64_checked","CollectionUri":"https://dev.azure.com/dnceng-public/","Reason":"Schedule","architecture":"x64","BuildId":"666362","DefinitionName":"runtime-coreclr r2r-extra","System.PhaseAttempt":"1","System.StageName":"Build","operatingSystem":"Ubuntu.2204.Amd64.Open","BuildNumber":"20240505.1","Project":"public","DefinitionId":"114","System.JobAttempt":"1","configuration":"Checked-jitstress2_tiered"} | Schedule 2024-05-05T19:40:59.246Z | runtime-coreclr jitstress-random | Checked-jitstress_random_1 | osx.1200.amd64.open | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"BuildNumber":"20240505.1","System.JobAttempt":"1","Project":"public","operatingSystem":"OSX.1200.Amd64.Open","Reason":"Schedule","BuildId":"666195","System.JobName":"__default","DefinitionId":"159","System.StageName":"Build","DefinitionName":"runtime-coreclr jitstress-random","System.PhaseAttempt":"1","configuration":"Checked-jitstress_random_1","architecture":"x64","CollectionUri":"https://dev.azure.com/dnceng-public/","System.StageAttempt":"1","System.PhaseName":"run_test_p1__osx_x64_checked","System.JobId":"bf644a0b-2dbe-5a03-d8c6-a86fdd97c823","AzurePipelinesTestRunId":"16524440"} | Schedule 2024-05-05T18:24:04.531Z | runtime-coreclr jitstress2-jitstressregs | Checked-jitstress2_jitstressregs0x80 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.StageName":"Build","BuildId":"666175","System.StageAttempt":"1","System.PhaseAttempt":"1","BuildNumber":"20240505.1","configuration":"Checked-jitstress2_jitstressregs0x80","CollectionUri":"https://dev.azure.com/dnceng-public/","System.PhaseName":"run_test_p1__linux_x64_checked","architecture":"x64","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","Project":"public","Reason":"Schedule","operatingSystem":"Ubuntu.2204.Amd64.Open","System.JobName":"__default","AzurePipelinesTestRunId":"16523722","System.JobAttempt":"1","DefinitionId":"111"} | Schedule 2024-05-05T18:24:03.184Z | runtime-coreclr jitstress2-jitstressregs | Checked-jitstress2_jitstressregs0x2000 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"architecture":"x64","DefinitionId":"111","configuration":"Checked-jitstress2_jitstressregs0x2000","System.PhaseName":"run_test_p1__linux_x64_checked","Project":"public","System.StageName":"Build","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","Reason":"Schedule","System.JobAttempt":"1","BuildId":"666175","System.PhaseAttempt":"1","System.StageAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","BuildNumber":"20240505.1","AzurePipelinesTestRunId":"16523730","System.JobName":"__default","operatingSystem":"Ubuntu.2204.Amd64.Open","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5"} | Schedule 2024-05-05T18:24:01.282Z | runtime-coreclr jitstress2-jitstressregs | Checked-jitstress2_jitstressregs8 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.JobName":"__default","System.StageAttempt":"1","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","System.PhaseName":"run_test_p1__linux_x64_checked","Project":"public","System.StageName":"Build","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","operatingSystem":"Ubuntu.2204.Amd64.Open","architecture":"x64","BuildNumber":"20240505.1","BuildId":"666175","System.PhaseAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobAttempt":"1","DefinitionId":"111","Reason":"Schedule","AzurePipelinesTestRunId":"16523724","configuration":"Checked-jitstress2_jitstressregs8"} | Schedule 2024-05-05T18:23:59.746Z | runtime-coreclr jitstress2-jitstressregs | Checked-jitstress2_jitstressregs2 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.PhaseName":"run_test_p1__linux_x64_checked","System.PhaseAttempt":"1","AzurePipelinesTestRunId":"16523728","configuration":"Checked-jitstress2_jitstressregs2","System.StageName":"Build","BuildNumber":"20240505.1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","BuildId":"666175","Reason":"Schedule","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","Project":"public","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobName":"__default","DefinitionId":"111","System.JobAttempt":"1","architecture":"x64","System.StageAttempt":"1","operatingSystem":"Ubuntu.2204.Amd64.Open"} | Schedule 2024-05-05T18:23:57.921Z | runtime-coreclr jitstress2-jitstressregs | Checked-jitstress2_jitstressregs3 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"operatingSystem":"Ubuntu.2204.Amd64.Open","architecture":"x64","System.StageAttempt":"1","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","DefinitionId":"111","Project":"public","System.PhaseName":"run_test_p1__linux_x64_checked","BuildId":"666175","Reason":"Schedule","AzurePipelinesTestRunId":"16523726","System.JobName":"__default","configuration":"Checked-jitstress2_jitstressregs3","BuildNumber":"20240505.1","System.JobAttempt":"1","System.StageName":"Build","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.PhaseAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/"} | Schedule 2024-05-05T18:23:56.453Z | runtime-coreclr jitstress2-jitstressregs | Checked-jitstress2_jitstressregs1 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.JobAttempt":"1","operatingSystem":"Ubuntu.2204.Amd64.Open","System.StageName":"Build","BuildNumber":"20240505.1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","configuration":"Checked-jitstress2_jitstressregs1","System.StageAttempt":"1","BuildId":"666175","DefinitionId":"111","System.PhaseName":"run_test_p1__linux_x64_checked","Reason":"Schedule","architecture":"x64","System.JobName":"__default","AzurePipelinesTestRunId":"16523714","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","Project":"public","System.PhaseAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/"} | Schedule 2024-05-05T18:23:54.983Z | runtime-coreclr jitstress2-jitstressregs | Checked-jitstress2_jitstressregs0x1000 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"AzurePipelinesTestRunId":"16523720","CollectionUri":"https://dev.azure.com/dnceng-public/","operatingSystem":"Ubuntu.2204.Amd64.Open","System.PhaseName":"run_test_p1__linux_x64_checked","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","BuildId":"666175","System.JobName":"__default","System.PhaseAttempt":"1","Reason":"Schedule","System.StageAttempt":"1","System.JobAttempt":"1","Project":"public","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","System.StageName":"Build","configuration":"Checked-jitstress2_jitstressregs0x1000","architecture":"x64","BuildNumber":"20240505.1","DefinitionId":"111"} | Schedule 2024-05-05T18:23:53.463Z | runtime-coreclr jitstress2-jitstressregs | Checked-jitstress2_jitstressregs0x10 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.StageAttempt":"1","DefinitionId":"111","System.PhaseAttempt":"1","System.JobName":"__default","System.StageName":"Build","BuildId":"666175","configuration":"Checked-jitstress2_jitstressregs0x10","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","System.JobAttempt":"1","Project":"public","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.PhaseName":"run_test_p1__linux_x64_checked","AzurePipelinesTestRunId":"16523718","BuildNumber":"20240505.1","architecture":"x64","operatingSystem":"Ubuntu.2204.Amd64.Open","Reason":"Schedule","CollectionUri":"https://dev.azure.com/dnceng-public/"} | Schedule 2024-05-05T18:23:52.046Z | runtime-coreclr jitstress2-jitstressregs | Checked-jitstress2_jitstressregs4 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"configuration":"Checked-jitstress2_jitstressregs4","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","BuildId":"666175","System.JobName":"__default","AzurePipelinesTestRunId":"16523716","operatingSystem":"Ubuntu.2204.Amd64.Open","System.PhaseAttempt":"1","System.JobAttempt":"1","System.StageName":"Build","System.StageAttempt":"1","System.PhaseName":"run_test_p1__linux_x64_checked","Reason":"Schedule","DefinitionId":"111","BuildNumber":"20240505.1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","CollectionUri":"https://dev.azure.com/dnceng-public/","Project":"public","architecture":"x64"} | Schedule 2024-05-05T05:23:23.043Z | runtime-coreclr jitstress | Checked-jitstress2 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"operatingSystem":"Ubuntu.2204.Amd64.Open","System.StageName":"Build","System.JobName":"__default","BuildNumber":"20240504.1","System.StageAttempt":"1","architecture":"x64","CollectionUri":"https://dev.azure.com/dnceng-public/","DefinitionName":"runtime-coreclr jitstress","System.JobAttempt":"1","BuildId":"665914","System.PhaseName":"run_test_p1__linux_x64_checked","System.PhaseAttempt":"1","DefinitionId":"109","configuration":"Checked-jitstress2","Reason":"Schedule","AzurePipelinesTestRunId":"16515340","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","Project":"public"} | Schedule 2024-05-05T05:23:21.689Z | runtime-coreclr jitstress | Checked-jitstress1_tiered | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"BuildNumber":"20240504.1","configuration":"Checked-jitstress1_tiered","Reason":"Schedule","DefinitionName":"runtime-coreclr jitstress","DefinitionId":"109","architecture":"x64","System.PhaseAttempt":"1","Project":"public","System.PhaseName":"run_test_p1__linux_x64_checked","AzurePipelinesTestRunId":"16515342","System.StageName":"Build","System.JobAttempt":"1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","BuildId":"665914","System.JobName":"__default","operatingSystem":"Ubuntu.2204.Amd64.Open","CollectionUri":"https://dev.azure.com/dnceng-public/","System.StageAttempt":"1"} | Schedule 2024-05-05T05:23:18.752Z | runtime-coreclr jitstress | Checked-jitstress1 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"operatingSystem":"Ubuntu.2204.Amd64.Open","System.PhaseName":"run_test_p1__linux_x64_checked","DefinitionName":"runtime-coreclr jitstress","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.PhaseAttempt":"1","BuildNumber":"20240504.1","AzurePipelinesTestRunId":"16515336","System.JobName":"__default","Reason":"Schedule","Project":"public","System.JobAttempt":"1","System.StageAttempt":"1","System.StageName":"Build","architecture":"x64","CollectionUri":"https://dev.azure.com/dnceng-public/","DefinitionId":"109","BuildId":"665914","configuration":"Checked-jitstress1"} | Schedule 2024-05-05T05:23:17.345Z | runtime-coreclr jitstress | Checked-jitstress2_tiered | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"BuildNumber":"20240504.1","DefinitionId":"109","System.PhaseName":"run_test_p1__linux_x64_checked","AzurePipelinesTestRunId":"16515338","System.StageAttempt":"1","BuildId":"665914","operatingSystem":"Ubuntu.2204.Amd64.Open","DefinitionName":"runtime-coreclr jitstress","System.JobName":"__default","Project":"public","CollectionUri":"https://dev.azure.com/dnceng-public/","Reason":"Schedule","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","configuration":"Checked-jitstress2_tiered","architecture":"x64","System.StageName":"Build","System.PhaseAttempt":"1","System.JobAttempt":"1"} | Schedule 2024-05-05T03:50:23.556Z | runtime-coreclr r2r-extra | Checked-jitstress2_tiered | osx.1200.arm64.open | arm64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"BuildId":"665904","architecture":"arm64","System.StageAttempt":"1","System.PhaseAttempt":"1","System.JobName":"__default","CollectionUri":"https://dev.azure.com/dnceng-public/","AzurePipelinesTestRunId":"16514966","operatingSystem":"OSX.1200.ARM64.Open","System.StageName":"Build","DefinitionId":"114","BuildNumber":"20240504.1","DefinitionName":"runtime-coreclr r2r-extra","System.PhaseName":"run_test_p1_R2R_osx_arm64_checked","System.JobAttempt":"1","Project":"public","Reason":"Schedule","configuration":"Checked-jitstress2_tiered","System.JobId":"99f15f99-448d-5593-a271-dbdf553789a6"} | Schedule 2024-05-05T03:50:18.934Z | runtime-coreclr r2r-extra | Checked-jitstress1_tiered | osx.1200.arm64.open | arm64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"DefinitionId":"114","BuildId":"665904","System.StageName":"Build","System.JobAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","architecture":"arm64","operatingSystem":"OSX.1200.ARM64.Open","Project":"public","AzurePipelinesTestRunId":"16514972","System.PhaseAttempt":"1","DefinitionName":"runtime-coreclr r2r-extra","System.PhaseName":"run_test_p1_R2R_osx_arm64_checked","System.StageAttempt":"1","BuildNumber":"20240504.1","System.JobName":"__default","configuration":"Checked-jitstress1_tiered","Reason":"Schedule","System.JobId":"99f15f99-448d-5593-a271-dbdf553789a6"} | Schedule 2024-05-05T03:29:14.895Z | runtime-coreclr r2r-extra | Checked-jitstress2_tiered | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"AzurePipelinesTestRunId":"16514730","System.JobName":"__default","BuildId":"665904","DefinitionName":"runtime-coreclr r2r-extra","Project":"public","System.JobId":"45a39349-90d5-51c8-4429-a48b2907fbdd","System.PhaseAttempt":"1","System.StageAttempt":"1","DefinitionId":"114","Reason":"Schedule","architecture":"x64","operatingSystem":"Ubuntu.2204.Amd64.Open","System.StageName":"Build","configuration":"Checked-jitstress2_tiered","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobAttempt":"1","BuildNumber":"20240504.1","System.PhaseName":"run_test_p1_R2R_linux_x64_checked"} | Schedule 2024-05-04T21:29:31.966Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_2_x86_nossse3 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.PhaseName":"run_test_p1__linux_x64_checked","System.JobName":"__default","System.StageName":"Build","System.StageAttempt":"1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.PhaseAttempt":"1","BuildNumber":"20240504.1","configuration":"Checked-jitstress_isas_2_x86_nossse3","BuildId":"665757","DefinitionId":"115","Reason":"Schedule","CollectionUri":"https://dev.azure.com/dnceng-public/","Project":"public","DefinitionName":"runtime-coreclr jitstress-isas-x86","operatingSystem":"Ubuntu.2204.Amd64.Open","System.JobAttempt":"1","AzurePipelinesTestRunId":"16513136","architecture":"x64"} | Schedule 2024-05-04T21:28:50.478Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_2_x86_nosse42 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"Project":"public","configuration":"Checked-jitstress_isas_2_x86_nosse42","System.StageName":"Build","BuildId":"665757","System.JobName":"__default","DefinitionId":"115","System.PhaseAttempt":"1","operatingSystem":"Ubuntu.2204.Amd64.Open","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","Reason":"Schedule","architecture":"x64","System.JobAttempt":"1","AzurePipelinesTestRunId":"16513126","System.PhaseName":"run_test_p1__linux_x64_checked","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.StageAttempt":"1","BuildNumber":"20240504.1","CollectionUri":"https://dev.azure.com/dnceng-public/"} | Schedule 2024-05-04T21:28:31.425Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_2_x86_nosse41 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.JobName":"__default","CollectionUri":"https://dev.azure.com/dnceng-public/","AzurePipelinesTestRunId":"16513124","operatingSystem":"Ubuntu.2204.Amd64.Open","DefinitionName":"runtime-coreclr jitstress-isas-x86","BuildNumber":"20240504.1","System.StageName":"Build","Project":"public","BuildId":"665757","System.JobAttempt":"1","DefinitionId":"115","Reason":"Schedule","System.StageAttempt":"1","System.PhaseName":"run_test_p1__linux_x64_checked","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","architecture":"x64","configuration":"Checked-jitstress_isas_2_x86_nosse41","System.PhaseAttempt":"1"} | Schedule 2024-05-04T21:27:31.21Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_2_x86_nosse3_4 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"operatingSystem":"Ubuntu.2204.Amd64.Open","architecture":"x64","System.PhaseName":"run_test_p1__linux_x64_checked","BuildId":"665757","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.JobName":"__default","Reason":"Schedule","System.StageName":"Build","configuration":"Checked-jitstress_isas_2_x86_nosse3_4","System.PhaseAttempt":"1","DefinitionId":"115","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.StageAttempt":"1","System.JobAttempt":"1","AzurePipelinesTestRunId":"16513120","CollectionUri":"https://dev.azure.com/dnceng-public/","BuildNumber":"20240504.1","Project":"public"} | Schedule 2024-05-04T21:01:37.259Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_1_x86_nopclmulqdq | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","architecture":"x64","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.PhaseName":"run_test_p1__linux_x64_checked","System.StageName":"Build","DefinitionId":"115","operatingSystem":"Ubuntu.2204.Amd64.Open","Project":"public","AzurePipelinesTestRunId":"16512600","Reason":"Schedule","System.JobAttempt":"1","System.JobName":"__default","System.StageAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","BuildNumber":"20240504.1","BuildId":"665757","System.PhaseAttempt":"1","configuration":"Checked-jitstress_isas_1_x86_nopclmulqdq"} | Schedule 2024-05-04T21:01:32.755Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_1_x86_noaes | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"configuration":"Checked-jitstress_isas_1_x86_noaes","AzurePipelinesTestRunId":"16512576","operatingSystem":"Ubuntu.2204.Amd64.Open","architecture":"x64","DefinitionId":"115","Reason":"Schedule","BuildId":"665757","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","Project":"public","System.JobName":"__default","System.JobAttempt":"1","System.StageName":"Build","System.PhaseAttempt":"1","BuildNumber":"20240504.1","System.PhaseName":"run_test_p1__linux_x64_checked","System.StageAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/"} | Schedule 2024-05-04T21:01:28.211Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_1_x86_nobmi2 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"architecture":"x64","System.PhaseAttempt":"1","System.StageName":"Build","System.JobName":"__default","Reason":"Schedule","CollectionUri":"https://dev.azure.com/dnceng-public/","BuildNumber":"20240504.1","System.PhaseName":"run_test_p1__linux_x64_checked","AzurePipelinesTestRunId":"16512594","Project":"public","System.StageAttempt":"1","System.JobAttempt":"1","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","operatingSystem":"Ubuntu.2204.Amd64.Open","BuildId":"665757","configuration":"Checked-jitstress_isas_1_x86_nobmi2","DefinitionId":"115"} | Schedule 2024-05-04T21:01:26.552Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_1_x86_nolzcnt | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"CollectionUri":"https://dev.azure.com/dnceng-public/","operatingSystem":"Ubuntu.2204.Amd64.Open","configuration":"Checked-jitstress_isas_1_x86_nolzcnt","BuildId":"665757","architecture":"x64","Project":"public","System.PhaseAttempt":"1","Reason":"Schedule","System.StageName":"Build","System.PhaseName":"run_test_p1__linux_x64_checked","AzurePipelinesTestRunId":"16512598","DefinitionId":"115","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.StageAttempt":"1","System.JobAttempt":"1","BuildNumber":"20240504.1","System.JobName":"__default"} | Schedule 2024-05-04T21:01:25.051Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_1_x86_noavx2 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.PhaseName":"run_test_p1__linux_x64_checked","System.StageName":"Build","System.StageAttempt":"1","Reason":"Schedule","architecture":"x64","BuildId":"665757","AzurePipelinesTestRunId":"16512602","operatingSystem":"Ubuntu.2204.Amd64.Open","configuration":"Checked-jitstress_isas_1_x86_noavx2","System.JobAttempt":"1","System.JobName":"__default","BuildNumber":"20240504.1","CollectionUri":"https://dev.azure.com/dnceng-public/","DefinitionName":"runtime-coreclr jitstress-isas-x86","Project":"public","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","DefinitionId":"115","System.PhaseAttempt":"1"} | Schedule 2024-05-04T21:01:23.457Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_2_x86_nobmi2 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.JobName":"__default","AzurePipelinesTestRunId":"16512588","System.StageName":"Build","System.JobAttempt":"1","System.PhaseAttempt":"1","BuildId":"665757","DefinitionName":"runtime-coreclr jitstress-isas-x86","architecture":"x64","BuildNumber":"20240504.1","configuration":"Checked-jitstress_isas_2_x86_nobmi2","System.PhaseName":"run_test_p1__linux_x64_checked","DefinitionId":"115","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","Reason":"Schedule","Project":"public","System.StageAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","operatingSystem":"Ubuntu.2204.Amd64.Open"} | Schedule 2024-05-04T21:01:21.878Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_1_x86_nohwintrinsic | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"DefinitionName":"runtime-coreclr jitstress-isas-x86","CollectionUri":"https://dev.azure.com/dnceng-public/","operatingSystem":"Ubuntu.2204.Amd64.Open","Reason":"Schedule","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","DefinitionId":"115","AzurePipelinesTestRunId":"16512572","configuration":"Checked-jitstress_isas_1_x86_nohwintrinsic","System.StageName":"Build","BuildId":"665757","System.PhaseName":"run_test_p1__linux_x64_checked","System.StageAttempt":"1","System.JobAttempt":"1","System.PhaseAttempt":"1","System.JobName":"__default","Project":"public","architecture":"x64","BuildNumber":"20240504.1"} | Schedule 2024-05-04T21:01:19.011Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_2_x86_noavx512 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"operatingSystem":"Ubuntu.2204.Amd64.Open","System.StageAttempt":"1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.JobAttempt":"1","System.JobName":"__default","AzurePipelinesTestRunId":"16512564","BuildId":"665757","configuration":"Checked-jitstress_isas_2_x86_noavx512","DefinitionId":"115","Reason":"Schedule","architecture":"x64","System.PhaseAttempt":"1","System.StageName":"Build","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.PhaseName":"run_test_p1__linux_x64_checked","CollectionUri":"https://dev.azure.com/dnceng-public/","BuildNumber":"20240504.1","Project":"public"} | Schedule 2024-05-04T21:01:17.808Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_2_x86_nofma | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.PhaseAttempt":"1","Project":"public","Reason":"Schedule","BuildId":"665757","System.StageAttempt":"1","System.PhaseName":"run_test_p1__linux_x64_checked","AzurePipelinesTestRunId":"16512570","BuildNumber":"20240504.1","System.StageName":"Build","configuration":"Checked-jitstress_isas_2_x86_nofma","architecture":"x64","DefinitionId":"115","operatingSystem":"Ubuntu.2204.Amd64.Open","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobName":"__default","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.JobAttempt":"1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5"} | Schedule 2024-05-04T21:01:15.179Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_2_x86_nosse3 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"DefinitionName":"runtime-coreclr jitstress-isas-x86","Project":"public","System.PhaseName":"run_test_p1__linux_x64_checked","operatingSystem":"Ubuntu.2204.Amd64.Open","System.PhaseAttempt":"1","configuration":"Checked-jitstress_isas_2_x86_nosse3","BuildId":"665757","System.JobName":"__default","BuildNumber":"20240504.1","architecture":"x64","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobAttempt":"1","System.StageAttempt":"1","AzurePipelinesTestRunId":"16512586","DefinitionId":"115","System.StageName":"Build","Reason":"Schedule"} | Schedule 2024-05-04T21:01:12.355Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_1_x86_nosse3_4 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.JobName":"__default","BuildId":"665757","configuration":"Checked-jitstress_isas_1_x86_nosse3_4","System.StageAttempt":"1","System.StageName":"Build","System.PhaseAttempt":"1","Reason":"Schedule","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","AzurePipelinesTestRunId":"16512556","architecture":"x64","System.PhaseName":"run_test_p1__linux_x64_checked","DefinitionId":"115","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobAttempt":"1","Project":"public","operatingSystem":"Ubuntu.2204.Amd64.Open","DefinitionName":"runtime-coreclr jitstress-isas-x86","BuildNumber":"20240504.1"} | Schedule 2024-05-04T21:01:10.703Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_1_x86_nosse41 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.StageName":"Build","BuildId":"665757","operatingSystem":"Ubuntu.2204.Amd64.Open","System.StageAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","AzurePipelinesTestRunId":"16512574","System.PhaseName":"run_test_p1__linux_x64_checked","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","DefinitionName":"runtime-coreclr jitstress-isas-x86","configuration":"Checked-jitstress_isas_1_x86_nosse41","DefinitionId":"115","architecture":"x64","System.JobName":"__default","System.JobAttempt":"1","System.PhaseAttempt":"1","BuildNumber":"20240504.1","Reason":"Schedule","Project":"public"} | Schedule 2024-05-04T21:01:08.08Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_1_x86_noavx | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"AzurePipelinesTestRunId":"16512544","System.StageAttempt":"1","System.JobAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","architecture":"x64","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.PhaseName":"run_test_p1__linux_x64_checked","Project":"public","System.StageName":"Build","System.PhaseAttempt":"1","System.JobName":"__default","BuildNumber":"20240504.1","Reason":"Schedule","operatingSystem":"Ubuntu.2204.Amd64.Open","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","configuration":"Checked-jitstress_isas_1_x86_noavx","BuildId":"665757","DefinitionId":"115"} | Schedule 2024-05-04T21:01:02.971Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_2_x86_noavx | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"BuildId":"665757","System.JobAttempt":"1","Reason":"Schedule","configuration":"Checked-jitstress_isas_2_x86_noavx","AzurePipelinesTestRunId":"16512566","Project":"public","System.PhaseAttempt":"1","System.PhaseName":"run_test_p1__linux_x64_checked","DefinitionId":"115","System.StageAttempt":"1","BuildNumber":"20240504.1","operatingSystem":"Ubuntu.2204.Amd64.Open","architecture":"x64","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","CollectionUri":"https://dev.azure.com/dnceng-public/","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.StageName":"Build","System.JobName":"__default"} | Schedule 2024-05-04T21:01:01.511Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_2_x86_noavx2 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.PhaseAttempt":"1","operatingSystem":"Ubuntu.2204.Amd64.Open","System.StageName":"Build","configuration":"Checked-jitstress_isas_2_x86_noavx2","BuildNumber":"20240504.1","System.JobName":"__default","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobAttempt":"1","BuildId":"665757","System.StageAttempt":"1","Reason":"Schedule","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","AzurePipelinesTestRunId":"16512552","System.PhaseName":"run_test_p1__linux_x64_checked","architecture":"x64","DefinitionName":"runtime-coreclr jitstress-isas-x86","Project":"public","DefinitionId":"115"} | Schedule 2024-05-04T21:01:00.266Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_1_x86_nosse | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.JobName":"__default","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.JobAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","System.StageAttempt":"1","operatingSystem":"Ubuntu.2204.Amd64.Open","BuildNumber":"20240504.1","System.PhaseAttempt":"1","architecture":"x64","System.StageName":"Build","Project":"public","AzurePipelinesTestRunId":"16512560","DefinitionId":"115","System.PhaseName":"run_test_p1__linux_x64_checked","DefinitionName":"runtime-coreclr jitstress-isas-x86","BuildId":"665757","configuration":"Checked-jitstress_isas_1_x86_nosse","Reason":"Schedule"} | Schedule 2024-05-04T21:00:58.734Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_1_x86_nossse3 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"Reason":"Schedule","configuration":"Checked-jitstress_isas_1_x86_nossse3","System.PhaseAttempt":"1","System.StageName":"Build","DefinitionId":"115","System.PhaseName":"run_test_p1__linux_x64_checked","System.JobName":"__default","DefinitionName":"runtime-coreclr jitstress-isas-x86","Project":"public","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.StageAttempt":"1","operatingSystem":"Ubuntu.2204.Amd64.Open","AzurePipelinesTestRunId":"16512592","BuildNumber":"20240504.1","architecture":"x64","CollectionUri":"https://dev.azure.com/dnceng-public/","BuildId":"665757","System.JobAttempt":"1"} | Schedule 2024-05-04T21:00:57.267Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_2_x86_nosse2 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.JobName":"__default","configuration":"Checked-jitstress_isas_2_x86_nosse2","System.JobAttempt":"1","operatingSystem":"Ubuntu.2204.Amd64.Open","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","DefinitionId":"115","System.PhaseAttempt":"1","AzurePipelinesTestRunId":"16512512","System.PhaseName":"run_test_p1__linux_x64_checked","DefinitionName":"runtime-coreclr jitstress-isas-x86","CollectionUri":"https://dev.azure.com/dnceng-public/","Reason":"Schedule","System.StageAttempt":"1","Project":"public","System.StageName":"Build","BuildNumber":"20240504.1","architecture":"x64","BuildId":"665757"} | Schedule 2024-05-04T21:00:51.399Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_1_x86_nobmi1 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.JobAttempt":"1","operatingSystem":"Ubuntu.2204.Amd64.Open","BuildNumber":"20240504.1","BuildId":"665757","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","Project":"public","System.StageName":"Build","System.PhaseAttempt":"1","System.PhaseName":"run_test_p1__linux_x64_checked","System.StageAttempt":"1","System.JobName":"__default","AzurePipelinesTestRunId":"16512542","DefinitionId":"115","CollectionUri":"https://dev.azure.com/dnceng-public/","architecture":"x64","Reason":"Schedule","configuration":"Checked-jitstress_isas_1_x86_nobmi1"} | Schedule 2024-05-04T21:00:49.89Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_2_x86_nobmi1 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.PhaseName":"run_test_p1__linux_x64_checked","Project":"public","configuration":"Checked-jitstress_isas_2_x86_nobmi1","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.JobName":"__default","AzurePipelinesTestRunId":"16512516","BuildId":"665757","BuildNumber":"20240504.1","System.JobAttempt":"1","System.StageAttempt":"1","architecture":"x64","CollectionUri":"https://dev.azure.com/dnceng-public/","System.StageName":"Build","System.PhaseAttempt":"1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","Reason":"Schedule","operatingSystem":"Ubuntu.2204.Amd64.Open","DefinitionId":"115"} | Schedule 2024-05-04T21:00:48.53Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_1_x86_nosse3 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"DefinitionId":"115","System.JobAttempt":"1","Reason":"Schedule","AzurePipelinesTestRunId":"16512504","configuration":"Checked-jitstress_isas_1_x86_nosse3","System.StageName":"Build","System.StageAttempt":"1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.JobName":"__default","System.PhaseName":"run_test_p1__linux_x64_checked","System.PhaseAttempt":"1","BuildId":"665757","CollectionUri":"https://dev.azure.com/dnceng-public/","operatingSystem":"Ubuntu.2204.Amd64.Open","architecture":"x64","DefinitionName":"runtime-coreclr jitstress-isas-x86","BuildNumber":"20240504.1","Project":"public"} | Schedule 2024-05-04T21:00:46.952Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_2_x86_nolzcnt | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"CollectionUri":"https://dev.azure.com/dnceng-public/","System.StageName":"Build","DefinitionId":"115","AzurePipelinesTestRunId":"16512526","Reason":"Schedule","DefinitionName":"runtime-coreclr jitstress-isas-x86","BuildNumber":"20240504.1","configuration":"Checked-jitstress_isas_2_x86_nolzcnt","architecture":"x64","System.JobAttempt":"1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.PhaseName":"run_test_p1__linux_x64_checked","BuildId":"665757","Project":"public","System.PhaseAttempt":"1","System.JobName":"__default","operatingSystem":"Ubuntu.2204.Amd64.Open","System.StageAttempt":"1"} | Schedule 2024-05-04T21:00:45.373Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_2_x86_nohwintrinsic | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"DefinitionName":"runtime-coreclr jitstress-isas-x86","Reason":"Schedule","System.StageAttempt":"1","BuildNumber":"20240504.1","AzurePipelinesTestRunId":"16512550","architecture":"x64","System.PhaseAttempt":"1","operatingSystem":"Ubuntu.2204.Amd64.Open","BuildId":"665757","Project":"public","DefinitionId":"115","CollectionUri":"https://dev.azure.com/dnceng-public/","System.StageName":"Build","System.JobName":"__default","System.JobAttempt":"1","System.PhaseName":"run_test_p1__linux_x64_checked","configuration":"Checked-jitstress_isas_2_x86_nohwintrinsic","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5"} | Schedule 2024-05-04T21:00:42.467Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_2_x86_nosse | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobAttempt":"1","BuildId":"665757","System.PhaseName":"run_test_p1__linux_x64_checked","BuildNumber":"20240504.1","operatingSystem":"Ubuntu.2204.Amd64.Open","configuration":"Checked-jitstress_isas_2_x86_nosse","System.JobName":"__default","architecture":"x64","Reason":"Schedule","Project":"public","AzurePipelinesTestRunId":"16512530","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.PhaseAttempt":"1","DefinitionId":"115","System.StageAttempt":"1","System.StageName":"Build"} | Schedule 2024-05-04T21:00:40.919Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_1_x86_nopopcnt | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"BuildNumber":"20240504.1","System.StageAttempt":"1","System.PhaseAttempt":"1","operatingSystem":"Ubuntu.2204.Amd64.Open","BuildId":"665757","configuration":"Checked-jitstress_isas_1_x86_nopopcnt","System.JobName":"__default","Project":"public","Reason":"Schedule","AzurePipelinesTestRunId":"16512522","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.JobAttempt":"1","System.PhaseName":"run_test_p1__linux_x64_checked","architecture":"x64","DefinitionId":"115","DefinitionName":"runtime-coreclr jitstress-isas-x86","CollectionUri":"https://dev.azure.com/dnceng-public/","System.StageName":"Build"} | Schedule 2024-05-04T21:00:32.215Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_1_x86_noavx512 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"BuildId":"665757","System.PhaseName":"run_test_p1__linux_x64_checked","CollectionUri":"https://dev.azure.com/dnceng-public/","AzurePipelinesTestRunId":"16512524","System.StageAttempt":"1","BuildNumber":"20240504.1","System.JobName":"__default","operatingSystem":"Ubuntu.2204.Amd64.Open","architecture":"x64","System.JobAttempt":"1","Reason":"Schedule","DefinitionName":"runtime-coreclr jitstress-isas-x86","DefinitionId":"115","System.PhaseAttempt":"1","System.StageName":"Build","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","Project":"public","configuration":"Checked-jitstress_isas_1_x86_noavx512"} | Schedule 2024-05-04T21:00:30.733Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_1_x86_nosse42 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"architecture":"x64","configuration":"Checked-jitstress_isas_1_x86_nosse42","System.PhaseName":"run_test_p1__linux_x64_checked","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","Reason":"Schedule","CollectionUri":"https://dev.azure.com/dnceng-public/","AzurePipelinesTestRunId":"16512502","BuildId":"665757","System.JobName":"__default","Project":"public","System.StageName":"Build","operatingSystem":"Ubuntu.2204.Amd64.Open","System.PhaseAttempt":"1","System.StageAttempt":"1","BuildNumber":"20240504.1","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.JobAttempt":"1","DefinitionId":"115"} | Schedule 2024-05-04T21:00:29.379Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_1_x86_nosse2 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.JobAttempt":"1","BuildNumber":"20240504.1","System.PhaseAttempt":"1","DefinitionId":"115","configuration":"Checked-jitstress_isas_1_x86_nosse2","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","Project":"public","Reason":"Schedule","operatingSystem":"Ubuntu.2204.Amd64.Open","System.StageAttempt":"1","System.PhaseName":"run_test_p1__linux_x64_checked","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobName":"__default","System.StageName":"Build","BuildId":"665757","architecture":"x64","AzurePipelinesTestRunId":"16512506"} | Schedule 2024-05-04T21:00:26.176Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_2_x86_nopopcnt | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.StageAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","System.PhaseAttempt":"1","DefinitionId":"115","operatingSystem":"Ubuntu.2204.Amd64.Open","AzurePipelinesTestRunId":"16512508","System.JobName":"__default","System.PhaseName":"run_test_p1__linux_x64_checked","configuration":"Checked-jitstress_isas_2_x86_nopopcnt","DefinitionName":"runtime-coreclr jitstress-isas-x86","Reason":"Schedule","System.StageName":"Build","System.JobAttempt":"1","architecture":"x64","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","BuildNumber":"20240504.1","Project":"public","BuildId":"665757"} | Schedule 2024-05-04T21:00:22.863Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_2_x86_noaes | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.JobAttempt":"1","architecture":"x64","System.PhaseAttempt":"1","System.StageAttempt":"1","BuildId":"665757","configuration":"Checked-jitstress_isas_2_x86_noaes","System.StageName":"Build","CollectionUri":"https://dev.azure.com/dnceng-public/","DefinitionId":"115","BuildNumber":"20240504.1","operatingSystem":"Ubuntu.2204.Amd64.Open","AzurePipelinesTestRunId":"16512500","Project":"public","System.JobName":"__default","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.PhaseName":"run_test_p1__linux_x64_checked","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","Reason":"Schedule"} | Schedule 2024-05-04T21:00:18.816Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_2_x86_nopclmulqdq | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.StageName":"Build","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.JobAttempt":"1","operatingSystem":"Ubuntu.2204.Amd64.Open","System.StageAttempt":"1","Reason":"Schedule","DefinitionId":"115","BuildId":"665757","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","AzurePipelinesTestRunId":"16512498","architecture":"x64","System.PhaseName":"run_test_p1__linux_x64_checked","System.PhaseAttempt":"1","System.JobName":"__default","configuration":"Checked-jitstress_isas_2_x86_nopclmulqdq","Project":"public","CollectionUri":"https://dev.azure.com/dnceng-public/","BuildNumber":"20240504.1"} | Schedule 2024-05-04T21:00:17.263Z | runtime-coreclr jitstress-isas-x86 | Checked-jitstress_isas_1_x86_nofma | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"BuildNumber":"20240504.1","Project":"public","CollectionUri":"https://dev.azure.com/dnceng-public/","System.StageAttempt":"1","configuration":"Checked-jitstress_isas_1_x86_nofma","Reason":"Schedule","BuildId":"665757","System.PhaseName":"run_test_p1__linux_x64_checked","System.JobName":"__default","System.StageName":"Build","architecture":"x64","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.JobAttempt":"1","AzurePipelinesTestRunId":"16512514","operatingSystem":"Ubuntu.2204.Amd64.Open","DefinitionId":"115","System.PhaseAttempt":"1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5"} | Schedule 2024-05-04T18:24:51.244Z | runtime-coreclr jitstress2-jitstressregs | Checked-jitstress2_jitstressregs0x80 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"BuildId":"665686","Reason":"Schedule","System.StageName":"Build","System.PhaseName":"run_test_p1__linux_x64_checked","System.JobAttempt":"1","BuildNumber":"20240504.1","Project":"public","operatingSystem":"Ubuntu.2204.Amd64.Open","System.PhaseAttempt":"1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","architecture":"x64","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobName":"__default","System.StageAttempt":"1","AzurePipelinesTestRunId":"16511542","DefinitionId":"111","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","configuration":"Checked-jitstress2_jitstressregs0x80"} | Schedule 2024-05-04T18:24:49.807Z | runtime-coreclr jitstress2-jitstressregs | Checked-jitstress2_jitstressregs8 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.PhaseAttempt":"1","System.JobAttempt":"1","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","System.StageAttempt":"1","DefinitionId":"111","System.PhaseName":"run_test_p1__linux_x64_checked","System.JobName":"__default","CollectionUri":"https://dev.azure.com/dnceng-public/","BuildNumber":"20240504.1","architecture":"x64","System.StageName":"Build","configuration":"Checked-jitstress2_jitstressregs8","operatingSystem":"Ubuntu.2204.Amd64.Open","BuildId":"665686","AzurePipelinesTestRunId":"16511550","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","Reason":"Schedule","Project":"public"} | Schedule 2024-05-04T18:24:48.244Z | runtime-coreclr jitstress2-jitstressregs | Checked-jitstress2_jitstressregs0x1000 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"Reason":"Schedule","configuration":"Checked-jitstress2_jitstressregs0x1000","CollectionUri":"https://dev.azure.com/dnceng-public/","AzurePipelinesTestRunId":"16511540","System.PhaseName":"run_test_p1__linux_x64_checked","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","System.StageAttempt":"1","System.StageName":"Build","architecture":"x64","BuildId":"665686","Project":"public","operatingSystem":"Ubuntu.2204.Amd64.Open","System.PhaseAttempt":"1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.JobName":"__default","DefinitionId":"111","System.JobAttempt":"1","BuildNumber":"20240504.1"} | Schedule 2024-05-04T18:24:46.915Z | runtime-coreclr jitstress2-jitstressregs | Checked-jitstress2_jitstressregs0x10 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.JobAttempt":"1","operatingSystem":"Ubuntu.2204.Amd64.Open","AzurePipelinesTestRunId":"16511554","DefinitionId":"111","Reason":"Schedule","System.PhaseName":"run_test_p1__linux_x64_checked","architecture":"x64","configuration":"Checked-jitstress2_jitstressregs0x10","Project":"public","System.StageAttempt":"1","System.JobName":"__default","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","BuildNumber":"20240504.1","System.PhaseAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","BuildId":"665686","System.StageName":"Build"} | Schedule 2024-05-04T18:24:45.479Z | runtime-coreclr jitstress2-jitstressregs | Checked-jitstress2_jitstressregs2 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"Reason":"Schedule","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","Project":"public","System.PhaseName":"run_test_p1__linux_x64_checked","System.StageAttempt":"1","DefinitionId":"111","System.PhaseAttempt":"1","AzurePipelinesTestRunId":"16511544","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobAttempt":"1","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","BuildId":"665686","operatingSystem":"Ubuntu.2204.Amd64.Open","System.StageName":"Build","BuildNumber":"20240504.1","System.JobName":"__default","configuration":"Checked-jitstress2_jitstressregs2","architecture":"x64"} | Schedule 2024-05-04T18:24:43.947Z | runtime-coreclr jitstress2-jitstressregs | Checked-jitstress2_jitstressregs4 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"AzurePipelinesTestRunId":"16511552","Project":"public","operatingSystem":"Ubuntu.2204.Amd64.Open","System.StageAttempt":"1","System.PhaseAttempt":"1","System.PhaseName":"run_test_p1__linux_x64_checked","CollectionUri":"https://dev.azure.com/dnceng-public/","DefinitionId":"111","System.StageName":"Build","System.JobAttempt":"1","configuration":"Checked-jitstress2_jitstressregs4","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","Reason":"Schedule","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","System.JobName":"__default","BuildNumber":"20240504.1","architecture":"x64","BuildId":"665686"} | Schedule 2024-05-04T18:24:42.243Z | runtime-coreclr jitstress2-jitstressregs | Checked-jitstress2_jitstressregs1 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"configuration":"Checked-jitstress2_jitstressregs1","System.JobAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","operatingSystem":"Ubuntu.2204.Amd64.Open","System.PhaseName":"run_test_p1__linux_x64_checked","System.StageName":"Build","System.JobName":"__default","AzurePipelinesTestRunId":"16511538","BuildId":"665686","BuildNumber":"20240504.1","Reason":"Schedule","System.StageAttempt":"1","Project":"public","DefinitionId":"111","architecture":"x64","System.PhaseAttempt":"1","DefinitionName":"runtime-coreclr jitstress2-jitstressregs"} | Schedule 2024-05-04T18:24:40.774Z | runtime-coreclr jitstress2-jitstressregs | Checked-jitstress2_jitstressregs3 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.StageName":"Build","configuration":"Checked-jitstress2_jitstressregs3","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","BuildNumber":"20240504.1","System.JobName":"__default","System.JobAttempt":"1","BuildId":"665686","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","System.StageAttempt":"1","DefinitionId":"111","CollectionUri":"https://dev.azure.com/dnceng-public/","AzurePipelinesTestRunId":"16511548","architecture":"x64","operatingSystem":"Ubuntu.2204.Amd64.Open","System.PhaseAttempt":"1","Project":"public","Reason":"Schedule","System.PhaseName":"run_test_p1__linux_x64_checked"} | Schedule 2024-05-04T18:24:39.166Z | runtime-coreclr jitstress2-jitstressregs | Checked-jitstress2_jitstressregs0x2000 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"AzurePipelinesTestRunId":"16511546","architecture":"x64","System.PhaseAttempt":"1","System.PhaseName":"run_test_p1__linux_x64_checked","System.StageName":"Build","System.JobName":"__default","Project":"public","operatingSystem":"Ubuntu.2204.Amd64.Open","BuildNumber":"20240504.1","BuildId":"665686","DefinitionId":"111","configuration":"Checked-jitstress2_jitstressregs0x2000","System.JobAttempt":"1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","CollectionUri":"https://dev.azure.com/dnceng-public/","System.StageAttempt":"1","Reason":"Schedule","DefinitionName":"runtime-coreclr jitstress2-jitstressregs"} | Schedule 2024-05-04T05:26:23.627Z | runtime-coreclr jitstress | Checked-jitstress2 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"CollectionUri":"https://dev.azure.com/dnceng-public/","architecture":"x64","Project":"public","DefinitionId":"109","System.JobAttempt":"1","System.StageAttempt":"1","DefinitionName":"runtime-coreclr jitstress","BuildNumber":"20240503.1","System.PhaseAttempt":"1","Reason":"Schedule","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.StageName":"Build","operatingSystem":"Ubuntu.2204.Amd64.Open","System.PhaseName":"run_test_p1__linux_x64_checked","BuildId":"665438","configuration":"Checked-jitstress2","System.JobName":"__default","AzurePipelinesTestRunId":"16503820"} | Schedule 2024-05-04T05:26:21.923Z | runtime-coreclr jitstress | Checked-jitstress1_tiered | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"architecture":"x64","System.PhaseName":"run_test_p1__linux_x64_checked","AzurePipelinesTestRunId":"16503818","System.PhaseAttempt":"1","BuildId":"665438","DefinitionId":"109","System.JobName":"__default","Reason":"Schedule","operatingSystem":"Ubuntu.2204.Amd64.Open","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","Project":"public","DefinitionName":"runtime-coreclr jitstress","System.JobAttempt":"1","System.StageAttempt":"1","configuration":"Checked-jitstress1_tiered","BuildNumber":"20240503.1","System.StageName":"Build","CollectionUri":"https://dev.azure.com/dnceng-public/"} | Schedule 2024-05-04T05:26:18.658Z | runtime-coreclr jitstress | Checked-jitstress1 | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.JobName":"__default","AzurePipelinesTestRunId":"16503822","operatingSystem":"Ubuntu.2204.Amd64.Open","System.JobAttempt":"1","System.PhaseName":"run_test_p1__linux_x64_checked","System.StageAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","Project":"public","DefinitionId":"109","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","BuildId":"665438","System.StageName":"Build","DefinitionName":"runtime-coreclr jitstress","BuildNumber":"20240503.1","System.PhaseAttempt":"1","Reason":"Schedule","architecture":"x64","configuration":"Checked-jitstress1"} | Schedule 2024-05-04T05:26:13.779Z | runtime-coreclr jitstress | Checked-jitstress2_tiered | ubuntu.2204.amd64.open.rt | x64 | GC/Scenarios/FinalizeTimeout/FinalizeTimeout/FinalizeTimeout.sh | Failed | {"System.StageName":"Build","System.PhaseName":"run_test_p1__linux_x64_checked","DefinitionId":"109","DefinitionName":"runtime-coreclr jitstress","operatingSystem":"Ubuntu.2204.Amd64.Open","architecture":"x64","CollectionUri":"https://dev.azure.com/dnceng-public/","BuildId":"665438","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","AzurePipelinesTestRunId":"16503824","System.PhaseAttempt":"1","configuration":"Checked-jitstress2_tiered","System.JobAttempt":"1","System.StageAttempt":"1","Project":"public","System.JobName":"__default","Reason":"Schedule","BuildNumber":"20240503.1"} | Schedule
v-wenyuxu commented 3 months ago

Failed in: runtime-coreclr outerloop 20240627.5

Failed tests:

R2R-CG2 osx x64 Checked no_tiered_compilation @ OSX.1200.Amd64.Open
    - tracing/eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.cmd

Error message:

 /private/tmp/helix/working/D0570AF0/w/ADEA0966/e/tracing/tracing/../eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.sh: line 341: -r:/private/tmp/helix/working/D0570AF0/w/ADEA0966/e/tracing/eventpipe/eventsourceerror/eventsourceerror/IL-CG2/*.dll: No such file or directory
waitpid() returned successfully (wstatus 00000000) WEXITSTATUS 0 WTERMSIG 0
/private/tmp/helix/working/D0570AF0/w/ADEA0966/e/tracing/tracing/../eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.sh: line 467: 35895 Segmentation fault: 11  (core dumped) $LAUNCHER $ExePath "${CLRTestExecutionArguments[@]}"

Return code:      1
Raw output file:      /tmp/helix/working/D0570AF0/w/ADEA0966/uploads/eventpipe/eventsourceerror/eventsourceerror/output.txt
Raw output:
BEGIN EXECUTION
in takeLock
/private/tmp/helix/working/D0570AF0/w/ADEA0966/e/tracing/eventpipe/eventsourceerror/eventsourceerror/IL-CG2/Microsoft.Diagnostics.NETCore.Client.dll
19:50:46
Response file: /private/tmp/helix/working/D0570AF0/w/ADEA0966/e/tracing/eventpipe/eventsourceerror/eventsourceerror/Microsoft.Diagnostics.NETCore.Client.dll.rsp
/private/tmp/helix/working/D0570AF0/w/ADEA0966/e/tracing/eventpipe/eventsourceerror/eventsourceerror/IL-CG2/Microsoft.Diagnostics.NETCore.Client.dll
-o:/private/tmp/helix/working/D0570AF0/w/ADEA0966/e/tracing/eventpipe/eventsourceerror/eventsourceerror/Microsoft.Diagnostics.NETCore.Client.dll
-r:/tmp/helix/working/D0570AF0/p/System.*.dll
-r:/tmp/helix/working/D0570AF0/p/Microsoft.*.dll
-r:/tmp/helix/working/D0570AF0/p/xunit.*.dll
-r:/tmp/helix/working/D0570AF0/p/mscorlib.dll
--verify-type-and-field-layout
--method-layout:random
--targetarch:x64
--targetos:osx
Running CrossGen2:  dotnet /tmp/helix/working/D0570AF0/p/crossgen2/crossgen2.dll @/private/tmp/helix/working/D0570AF0/w/ADEA0966/e/tracing/eventpipe/eventsourceerror/eventsourceerror/Microsoft.Diagnostics.NETCore.Client.dll.rsp  
Emitting R2R PE file: /private/tmp/helix/working/D0570AF0/w/ADEA0966/e/tracing/eventpipe/eventsourceerror/eventsourceerror/Microsoft.Diagnostics.NETCore.Client.dll
Running R2RDump:  dotnet /tmp/helix/working/D0570AF0/p/R2RDump/R2RDump.dll --header --sc --in /private/tmp/helix/working/D0570AF0/w/ADEA0966/e/tracing/eventpipe/eventsourceerror/eventsourceerror/Microsoft.Diagnostics.NETCore.Client.dll --out /private/tmp/helix/working/D0570AF0/w/ADEA0966/e/tracing/eventpipe/eventsourceerror/eventsourceerror/Microsoft.Diagnostics.NETCore.Client.dll.r2rdump --val
19:50:49
/private/tmp/helix/working/D0570AF0/w/ADEA0966/e/tracing/eventpipe/eventsourceerror/eventsourceerror/IL-CG2/TestLibrary.dll
19:50:49
Response file: /private/tmp/helix/working/D0570AF0/w/ADEA0966/e/tracing/eventpipe/eventsourceerror/eventsourceerror/TestLibrary.dll.rsp
/private/tmp/helix/working/D0570AF0/w/ADEA0966/e/tracing/eventpipe/eventsourceerror/eventsourceerror/IL-CG2/TestLibrary.dll
-o:/private/tmp/helix/working/D0570AF0/w/ADEA0966/e/tracing/eventpipe/eventsourceerror/eventsourceerror/TestLibrary.dll
-r:/tmp/helix/working/D0570AF0/p/System.*.dll
-r:/tmp/helix/working/D0570AF0/p/Microsoft.*.dll
-r:/tmp/helix/working/D0570AF0/p/xunit.*.dll
-r:/tmp/helix/working/D0570AF0/p/mscorlib.dll
--verify-type-and-field-layout
--method-layout:random
--targetarch:x64
--targetos:osx
Running CrossGen2:  dotnet /tmp/helix/working/D0570AF0/p/crossgen2/crossgen2.dll @/private/tmp/helix/working/D0570AF0/w/ADEA0966/e/tracing/eventpipe/eventsourceerror/eventsourceerror/TestLibrary.dll.rsp  
Emitting R2R PE file: /private/tmp/helix/working/D0570AF0/w/ADEA0966/e/tracing/eventpipe/eventsourceerror/eventsourceerror/TestLibrary.dll
Running R2RDump:  dotnet /tmp/helix/working/D0570AF0/p/R2RDump/R2RDump.dll --header --sc --in /private/tmp/helix/working/D0570AF0/w/ADEA0966/e/tracing/eventpipe/eventsourceerror/eventsourceerror/TestLibrary.dll --out /private/tmp/helix/working/D0570AF0/w/ADEA0966/e/tracing/eventpipe/eventsourceerror/eventsourceerror/TestLibrary.dll.r2rdump --val
19:50:53
/private/tmp/helix/working/D0570AF0/w/AD

Stack trace:

   at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 146
   at Xunit.Assert.True(Boolean condition, String userMessage) in /_/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 128
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
   at Program.<<Main>$>g__TestExecutor19|0_20(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)
Queued Pipeline Pipeline_Configuration OS Arch Test Outcome Properties BuildReason
2024-06-28T02:45:21.083Z runtime-coreclr outerloop Checked-no_tiered_compilation osx.1200.amd64.open x64 tracing/eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.cmd Failed {"System.JobName":"__default","architecture":"x64","System.JobId":"2bb87d59-31ba-55f9-0713-03158c3fd52f","configuration":"Checked-no_tiered_compilation","System.JobAttempt":"1","DefinitionId":"108","AzurePipelinesTestRunId":"18157254","BuildId":"723534","CollectionUri":"https://dev.azure.com/dnceng-public/","System.PhaseAttempt":"1","System.StageName":"Build","DefinitionName":"runtime-coreclr outerloop","Reason":"Schedule","Project":"public","System.PhaseName":"run_test_p1_R2R_CG2_osx_x64_checked","System.StageAttempt":"1","operatingSystem":"OSX.1200.Amd64.Open","BuildNumber":"20240627.5"} Schedule
v-wenyuxu commented 2 months ago

Failed in: runtime-coreclr outerloop 20240721.3

Failed tests:

coreclr osx x64 Checked no_tiered_compilation @ OSX.1200.Amd64.Open
    - tracing/eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.cmd

Error message:

 waitpid() returned successfully (wstatus 00000000) WEXITSTATUS 0 WTERMSIG 0
/private/tmp/helix/working/9AB208BE/w/B5CC09E7/e/tracing/tracing/../eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.sh: line 467: 28654 Segmentation fault: 11  (core dumped) $LAUNCHER $ExePath "${CLRTestExecutionArguments[@]}"

Return code:      1
Raw output file:      /tmp/helix/working/9AB208BE/w/B5CC09E7/uploads/eventpipe/eventsourceerror/eventsourceerror/output.txt
Raw output:
BEGIN EXECUTION
/tmp/helix/working/9AB208BE/p/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false -p System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true eventsourceerror.dll ''
  0.0s: ==TEST STARTING==
  1.2s: Started sending sentinel events...
  1.2s: Connecting to EventPipe...
  1.9s: Creating EventPipeEventSource...
  2.0s: EventPipeEventSource created
  2.0s: Dynamic.All callback registered
  2.0s: Running optional trace validator
  2.0s: Finished running optional trace validator
  2.0s: Starting stream processing...
  2.6s: Saw sentinel event
  2.6s: Stopped sending sentinel events
  2.6s: Starting event generating action...
  2.6s: Stopping event generating action
  2.6s: Sending StopTracing command...
  2.6s: Saw new provider 'IllegalTypesEventSource'
  2.8s: Saw new provider 'Microsoft-DotNETCore-EventPipe'
  2.8s: Saw new provider 'Microsoft-Windows-DotNETRuntimeRundown'
[createdump] Gathering state for process 28654 
[createdump] Crashing thread 58b25 signal 11 (000b)
[createdump] Writing crash report to file /cores/coredump.28654.dmp.crashreport.json
[createdump] Crash report successfully written
[createdump] Writing minidump with heap to file /cores/coredump.28654.dmp
[createdump] Written 401678584 bytes (98066 pages) to core file
[createdump] Target process is alive
  8.4s: Stopping stream processing
  8.4s: Dropped 0 events
[createdump] Dump successfully written in 5740ms
Expected: 100
Actual: 139
END EXECUTION - FAILED
Test failed. Trying to see if dump file was created in /cores since 7/21/2024 7:20:39 PM
Processing /cores/coredump.28654.dmp.crashreport.json
Printing stacktrace from '/cores/coredump.28654.dmp.crashreport.json'
Invoking llvm-symbolizer --pretty-print
Errors while running llvm-symbolizer --pretty-print
System.ComponentModel.Win32Exception (2): An error occurred trying to start process 'llvm-symbolizer' with working directory '/private/tmp/helix/working/9AB208BE/w/B5CC09E7/e/tracing/tracing'. No such file or directory
   at System.Diagnostics.Process.ForkAndExecProcess(ProcessStartInfo startInfo, String resolvedFilename, String[] argv, String[] envp, String cwd, Boolean setCredentials, UInt32 userId, UInt32 groupId, UInt32[] groups, Int32& stdinFd, Int32& stdoutFd, Int32& stderrFd, Boolean usesTerminal, Boolean throwOnNoExec) in /_/src/libraries/System.Diagnostics.Process/src/System/Diagnostics/Process.Unix.cs:line 496
   at System.Diagnostics.Process.StartCore(ProcessStartInfo startInfo) in /_/src/libraries/System.Diagnostics.Process/src/System/Diagnostics/Process.Unix.cs:line 456
   at CoreclrTestLib.CoreclrTestWrapperLib.TryPrintStackTraceFromCrashReport(String crashReportJsonFile, TextWriter outputWriter)
Test Harness Exitcode is : 1
To run the test:
Set up CORE_ROOT and run.
> /private/tmp/helix/working/9AB208BE/w/B5CC09E7/e/tracing/tracing/../eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.sh

Stack trace:

   at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 146
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
   at Program.<<Main>$>g__TestExecutor19|0_20(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)
Queued Pipeline Pipeline_Configuration OS Arch Test Outcome Properties BuildReason
2024-07-22T06:25:17.554Z runtime-coreclr crossgen2 outerloop Checked-no_tiered_compilation osx.1200.amd64.open x64 tracing/eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.cmd Failed {"System.StageName":"Build","Project":"public","BuildId":"749562","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobAttempt":"1","DefinitionId":"134","operatingSystem":"OSX.1200.Amd64.Open","BuildNumber":"20240721.1","AzurePipelinesTestRunId":"18968848","DefinitionName":"runtime-coreclr crossgen2 outerloop","System.JobId":"30d857d6-2812-5c31-5c67-e52c43389e0f","architecture":"x64","System.StageAttempt":"1","System.PhaseName":"run_test_p1_R2R_Composite_osx_x64_checked","configuration":"Checked-no_tiered_compilation","System.JobName":"__default","Reason":"Schedule","System.PhaseAttempt":"1"} Schedule
2024-07-22T06:22:18.344Z runtime-coreclr crossgen2 outerloop Checked-no_tiered_compilation osx.1200.amd64.open x64 tracing/eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.cmd Failed {"configuration":"Checked-no_tiered_compilation","DefinitionId":"134","BuildId":"749562","System.StageAttempt":"1","Reason":"Schedule","BuildNumber":"20240721.1","AzurePipelinesTestRunId":"18968836","operatingSystem":"OSX.1200.Amd64.Open","Project":"public","System.PhaseAttempt":"1","System.StageName":"Build","System.JobId":"94bcf053-7b40-5111-f380-056c9b4b6421","System.PhaseName":"run_test_p1_R2R_osx_x64_checked","DefinitionName":"runtime-coreclr crossgen2 outerloop","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobName":"__default","System.JobAttempt":"1","architecture":"x64"} Schedule
2024-07-22T06:21:29.617Z runtime-coreclr crossgen2 outerloop Checked-no_tiered_compilation osx.1200.arm64.open arm64 tracing/eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.cmd Failed {"AzurePipelinesTestRunId":"18968832","BuildNumber":"20240721.1","System.JobName":"__default","configuration":"Checked-no_tiered_compilation","DefinitionName":"runtime-coreclr crossgen2 outerloop","System.JobAttempt":"1","System.JobId":"b98d1326-0c22-5cb0-0518-a01616fe181e","operatingSystem":"OSX.1200.ARM64.Open","DefinitionId":"134","CollectionUri":"https://dev.azure.com/dnceng-public/","System.PhaseName":"run_test_p1_R2R_Composite_osx_arm64_checked","System.PhaseAttempt":"1","System.StageAttempt":"1","architecture":"arm64","BuildId":"749562","Reason":"Schedule","Project":"public","System.StageName":"Build"} Schedule
2024-07-22T02:19:49.496Z runtime-coreclr outerloop Checked-no_tiered_compilation osx.1200.amd64.open x64 tracing/eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.cmd Failed {"configuration":"Checked-no_tiered_compilation","BuildId":"749526","System.JobAttempt":"1","DefinitionName":"runtime-coreclr outerloop","Reason":"Schedule","System.JobName":"__default","AzurePipelinesTestRunId":"18967148","System.StageAttempt":"1","System.PhaseName":"run_test_p1_R2R_CG2_osx_x64_checked","Project":"public","System.PhaseAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","DefinitionId":"108","architecture":"x64","BuildNumber":"20240721.3","System.JobId":"2bb87d59-31ba-55f9-0713-03158c3fd52f","System.StageName":"Build","operatingSystem":"OSX.1200.Amd64.Open"} Schedule
2024-07-22T02:18:08.057Z runtime-coreclr outerloop Checked-no_tiered_compilation osx.1200.amd64.open x64 tracing/eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.cmd Failed {"configuration":"Checked-no_tiered_compilation","System.PhaseName":"run_test_p1osx_x64_checked","DefinitionName":"runtime-coreclr outerloop","System.PhaseAttempt":"1","System.StageName":"Build","System.JobId":"bf644a0b-2dbe-5a03-d8c6-a86fdd97c823","AzurePipelinesTestRunId":"18967128","operatingSystem":"OSX.1200.Amd64.Open","DefinitionId":"108","architecture":"x64","CollectionUri":"https://dev.azure.com/dnceng-public/","Reason":"Schedule","System.JobAttempt":"1","BuildNumber":"20240721.3","System.StageAttempt":"1","BuildId":"749526","Project":"public","System.JobName":"default"} Schedule
More failures Queued | Pipeline | Pipeline_Configuration | OS | Arch | Test | Outcome | Properties | BuildReason -- | -- | -- | -- | -- | -- | -- | -- | -- 2024-07-21T10:18:54.968Z | runtime-coreclr outerloop | Checked-no_tiered_compilation | osx.1200.amd64.open | x64 | tracing/eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.cmd | Failed | {"BuildNumber":"20240721.1","System.JobName":"__default","BuildId":"749181","System.JobAttempt":"1","Reason":"Schedule","System.StageName":"Build","CollectionUri":"https://dev.azure.com/dnceng-public/","System.PhaseName":"run_test_p1_R2R_CG2_osx_x64_checked","AzurePipelinesTestRunId":"18953760","configuration":"Checked-no_tiered_compilation","System.StageAttempt":"1","Project":"public","System.PhaseAttempt":"1","System.JobId":"2bb87d59-31ba-55f9-0713-03158c3fd52f","architecture":"x64","DefinitionId":"108","operatingSystem":"OSX.1200.Amd64.Open","DefinitionName":"runtime-coreclr outerloop"} | Schedule 2024-07-21T07:26:21.238Z | coreclr-release-outerloop-nightly | Release-no_tiered_compilation | osx.1200.amd64.open | x64 | tracing/eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.cmd | Failed | {"CollectionUri":"https://dev.azure.com/dnceng-public/","DefinitionId":"135","System.JobAttempt":"1","operatingSystem":"OSX.1200.Amd64.Open","Reason":"Schedule","System.JobName":"__default","System.PhaseAttempt":"1","Project":"public","System.JobId":"ed94b4c4-ff55-5657-ff29-58e87100eb6d","BuildNumber":"20240720.1","DefinitionName":"coreclr-release-outerloop-nightly","System.StageAttempt":"1","System.StageName":"Build","architecture":"x64","AzurePipelinesTestRunId":"18952430","BuildId":"749114","System.PhaseName":"run_test_p1_R2R_osx_x64_release","configuration":"Release-no_tiered_compilation"} | Schedule 2024-07-21T07:17:28.489Z | runtime-coreclr crossgen2-composite gcstress | Checked-heapverify1 | osx.1200.arm64.open | arm64 | tracing/eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.cmd | Failed | {"System.StageAttempt":"1","System.JobName":"__default","AzurePipelinesTestRunId":"18952284","DefinitionId":"141","DefinitionName":"runtime-coreclr crossgen2-composite gcstress","CollectionUri":"https://dev.azure.com/dnceng-public/","System.PhaseName":"run_test_p1_Composite_osx_arm64_checked","BuildId":"749113","Reason":"Schedule","System.JobId":"4b5575ba-4f05-5198-bc88-a075c735caa5","configuration":"Checked-heapverify1","System.StageName":"Build","architecture":"arm64","Project":"public","operatingSystem":"OSX.1200.ARM64.Open","BuildNumber":"20240720.1","System.PhaseAttempt":"1","System.JobAttempt":"1"} | Schedule 2024-07-21T06:18:18.543Z | runtime-coreclr crossgen2 outerloop | Checked-no_tiered_compilation | osx.1200.arm64.open | arm64 | tracing/eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.cmd | Failed | {"Reason":"Schedule","DefinitionId":"134","configuration":"Checked-no_tiered_compilation","System.StageName":"Build","DefinitionName":"runtime-coreclr crossgen2 outerloop","System.JobAttempt":"1","System.JobId":"b98d1326-0c22-5cb0-0518-a01616fe181e","Project":"public","System.JobName":"__default","System.StageAttempt":"1","AzurePipelinesTestRunId":"18951998","BuildId":"749107","BuildNumber":"20240720.1","System.PhaseAttempt":"1","operatingSystem":"OSX.1200.ARM64.Open","architecture":"arm64","CollectionUri":"https://dev.azure.com/dnceng-public/","System.PhaseName":"run_test_p1_R2R_Composite_osx_arm64_checked"} | Schedule 2024-07-21T06:17:36.66Z | runtime-coreclr crossgen2 outerloop | Checked-no_tiered_compilation | osx.1200.amd64.open | x64 | tracing/eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.cmd | Failed | {"DefinitionName":"runtime-coreclr crossgen2 outerloop","CollectionUri":"https://dev.azure.com/dnceng-public/","Project":"public","System.PhaseAttempt":"1","configuration":"Checked-no_tiered_compilation","System.StageName":"Build","AzurePipelinesTestRunId":"18951994","BuildId":"749107","DefinitionId":"134","System.JobName":"__default","System.JobId":"30d857d6-2812-5c31-5c67-e52c43389e0f","System.PhaseName":"run_test_p1_R2R_Composite_osx_x64_checked","BuildNumber":"20240720.1","operatingSystem":"OSX.1200.Amd64.Open","System.StageAttempt":"1","Reason":"Schedule","architecture":"x64","System.JobAttempt":"1"} | Schedule 2024-07-20T19:22:45.652Z | runtime-coreclr outerloop | Checked-no_tiered_compilation | osx.1200.amd64.open | x64 | tracing/eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.cmd | Failed | {"BuildNumber":"20240720.2","System.StageAttempt":"1","Project":"public","Reason":"Schedule","System.JobName":"__default","System.JobId":"bf644a0b-2dbe-5a03-d8c6-a86fdd97c823","architecture":"x64","configuration":"Checked-no_tiered_compilation","AzurePipelinesTestRunId":"18946692","System.PhaseAttempt":"1","System.JobAttempt":"1","DefinitionName":"runtime-coreclr outerloop","BuildId":"748944","System.PhaseName":"run_test_p1__osx_x64_checked","operatingSystem":"OSX.1200.Amd64.Open","System.StageName":"Build","DefinitionId":"108","CollectionUri":"https://dev.azure.com/dnceng-public/"} | Schedule 2024-07-20T07:27:15.343Z | coreclr-release-outerloop-nightly | Release-no_tiered_compilation | osx.1200.amd64.open | x64 | tracing/eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.cmd | Failed | {"Project":"public","AzurePipelinesTestRunId":"18933762","configuration":"Release-no_tiered_compilation","System.PhaseAttempt":"1","System.JobAttempt":"1","Reason":"Schedule","BuildId":"748560","System.JobId":"ed94b4c4-ff55-5657-ff29-58e87100eb6d","System.StageAttempt":"1","DefinitionName":"coreclr-release-outerloop-nightly","operatingSystem":"OSX.1200.Amd64.Open","DefinitionId":"135","System.JobName":"__default","BuildNumber":"20240719.1","CollectionUri":"https://dev.azure.com/dnceng-public/","architecture":"x64","System.StageName":"Build","System.PhaseName":"run_test_p1_R2R_osx_x64_release"} | Schedule 2024-07-20T07:00:46.822Z | runtime-coreclr crossgen2 | Checked-no_tiered_compilation | osx.1200.amd64.open | x64 | tracing/eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.cmd | Failed | {"System.JobName":"__default","operatingSystem":"OSX.1200.Amd64.Open","Reason":"Schedule","System.JobAttempt":"1","System.JobId":"29eafa29-58bb-5a4a-b8d7-ac7ba8f4fdef","DefinitionId":"124","AzurePipelinesTestRunId":"18933468","System.StageAttempt":"1","System.PhaseName":"run_test_p0_coreclr_R2R_CG2_HotColdSplitting_osx_x64_checked","System.StageName":"Build","CollectionUri":"https://dev.azure.com/dnceng-public/","configuration":"Checked-no_tiered_compilation","BuildNumber":"20240719.1","System.PhaseAttempt":"1","architecture":"x64","BuildId":"748563","DefinitionName":"runtime-coreclr crossgen2","Project":"public"} | Schedule 2024-07-20T06:24:55.525Z | runtime-coreclr crossgen2 outerloop | Checked-no_tiered_compilation | osx.1200.amd64.open | x64 | tracing/eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.cmd | Failed | {"System.JobName":"__default","System.JobAttempt":"1","configuration":"Checked-no_tiered_compilation","DefinitionName":"runtime-coreclr crossgen2 outerloop","Reason":"Schedule","System.StageAttempt":"1","System.JobId":"30d857d6-2812-5c31-5c67-e52c43389e0f","System.PhaseName":"run_test_p1_R2R_Composite_osx_x64_checked","System.PhaseAttempt":"1","operatingSystem":"OSX.1200.Amd64.Open","AzurePipelinesTestRunId":"18932828","Project":"public","architecture":"x64","BuildNumber":"20240719.1","DefinitionId":"134","System.StageName":"Build","BuildId":"748543","CollectionUri":"https://dev.azure.com/dnceng-public/"} | Schedule 2024-07-20T02:31:34.366Z | runtime-coreclr outerloop | Checked-no_tiered_compilation | osx.1200.amd64.open | x64 | tracing/eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.cmd | Failed | {"architecture":"x64","System.PhaseName":"run_test_p1_R2R_CG2_osx_x64_checked","Project":"public","System.PhaseAttempt":"1","DefinitionId":"108","System.JobId":"2bb87d59-31ba-55f9-0713-03158c3fd52f","System.StageAttempt":"1","configuration":"Checked-no_tiered_compilation","System.JobName":"__default","System.StageName":"Build","AzurePipelinesTestRunId":"18931014","BuildId":"748490","DefinitionName":"runtime-coreclr outerloop","System.JobAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","Reason":"Schedule","operatingSystem":"OSX.1200.Amd64.Open","BuildNumber":"20240719.3"} | Schedule 2024-07-19T07:26:42.813Z | coreclr-release-outerloop-nightly | Release-no_tiered_compilation | osx.1200.amd64.open | x64 | tracing/eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.cmd | Failed | {"Project":"public","DefinitionId":"135","System.StageAttempt":"1","configuration":"Release-no_tiered_compilation","architecture":"x64","System.JobAttempt":"1","AzurePipelinesTestRunId":"18892276","BuildId":"747260","Reason":"Schedule","System.JobName":"__default","BuildNumber":"20240718.1","System.PhaseName":"run_test_p1_R2R_osx_x64_release","System.PhaseAttempt":"1","System.JobId":"ed94b4c4-ff55-5657-ff29-58e87100eb6d","DefinitionName":"coreclr-release-outerloop-nightly","CollectionUri":"https://dev.azure.com/dnceng-public/","System.StageName":"Build","operatingSystem":"OSX.1200.Amd64.Open"} | Schedule 2024-07-19T07:08:24.08Z | runtime-coreclr crossgen2 | Checked-no_tiered_compilation | osx.1200.amd64.open | x64 | tracing/eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.cmd | Failed | {"System.PhaseName":"run_test_p0_coreclr_R2R_CG2_HotColdSplitting_osx_x64_checked","System.PhaseAttempt":"1","System.StageName":"Build","DefinitionId":"124","operatingSystem":"OSX.1200.Amd64.Open","configuration":"Checked-no_tiered_compilation","BuildId":"747262","System.JobId":"29eafa29-58bb-5a4a-b8d7-ac7ba8f4fdef","System.JobName":"__default","System.StageAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobAttempt":"1","DefinitionName":"runtime-coreclr crossgen2","Reason":"Schedule","AzurePipelinesTestRunId":"18891800","architecture":"x64","Project":"public","BuildNumber":"20240718.1"} | Schedule 2024-07-19T06:25:10.367Z | runtime-coreclr crossgen2 outerloop | Checked-no_tiered_compilation | osx.1200.amd64.open | x64 | tracing/eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.cmd | Failed | {"System.StageAttempt":"1","System.JobId":"30d857d6-2812-5c31-5c67-e52c43389e0f","architecture":"x64","BuildId":"747218","System.StageName":"Build","Project":"public","DefinitionName":"runtime-coreclr crossgen2 outerloop","BuildNumber":"20240718.1","configuration":"Checked-no_tiered_compilation","CollectionUri":"https://dev.azure.com/dnceng-public/","DefinitionId":"134","System.PhaseAttempt":"1","System.JobName":"__default","AzurePipelinesTestRunId":"18890578","System.PhaseName":"run_test_p1_R2R_Composite_osx_x64_checked","Reason":"Schedule","System.JobAttempt":"1","operatingSystem":"OSX.1200.Amd64.Open"} | Schedule 2024-07-19T06:22:53.83Z | runtime-coreclr crossgen2 outerloop | Checked-no_tiered_compilation | osx.1200.arm64.open | arm64 | tracing/eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.cmd | Failed | {"System.JobName":"__default","CollectionUri":"https://dev.azure.com/dnceng-public/","DefinitionId":"134","System.PhaseName":"run_test_p1_R2R_Composite_osx_arm64_checked","configuration":"Checked-no_tiered_compilation","System.JobId":"b98d1326-0c22-5cb0-0518-a01616fe181e","architecture":"arm64","System.StageName":"Build","System.PhaseAttempt":"1","BuildNumber":"20240718.1","System.JobAttempt":"1","operatingSystem":"OSX.1200.ARM64.Open","System.StageAttempt":"1","Reason":"Schedule","DefinitionName":"runtime-coreclr crossgen2 outerloop","AzurePipelinesTestRunId":"18890536","Project":"public","BuildId":"747218"} | Schedule 2024-06-28T02:45:21.083Z | runtime-coreclr outerloop | Checked-no_tiered_compilation | osx.1200.amd64.open | x64 | tracing/eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.cmd | Failed | {"System.JobName":"__default","architecture":"x64","System.JobId":"2bb87d59-31ba-55f9-0713-03158c3fd52f","configuration":"Checked-no_tiered_compilation","System.JobAttempt":"1","DefinitionId":"108","AzurePipelinesTestRunId":"18157254","BuildId":"723534","CollectionUri":"https://dev.azure.com/dnceng-public/","System.PhaseAttempt":"1","System.StageName":"Build","DefinitionName":"runtime-coreclr outerloop","Reason":"Schedule","Project":"public","System.PhaseName":"run_test_p1_R2R_CG2_osx_x64_checked","System.StageAttempt":"1","operatingSystem":"OSX.1200.Amd64.Open","BuildNumber":"20240627.5"} | Schedule
v-wenyuxu commented 2 months ago

Failed in: runtime-coreclr crossgen2 20240722.1

Failed tests:

R2R-CG2 osx x64 Checked no_tiered_compilation @ OSX.1200.Amd64.Open
    - tracing/eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.cmd

Error message:

 /private/tmp/helix/working/B35D098B/w/A41F08F3/e/tracing/tracing/../eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.sh: line 341: -r:/private/tmp/helix/working/B35D098B/w/A41F08F3/e/tracing/eventpipe/eventsourceerror/eventsourceerror/IL-CG2/*.dll: No such file or directory
waitpid() returned successfully (wstatus 00000000) WEXITSTATUS 0 WTERMSIG 0
/private/tmp/helix/working/B35D098B/w/A41F08F3/e/tracing/tracing/../eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.sh: line 467: 63462 Segmentation fault: 11  (core dumped) $LAUNCHER $ExePath "${CLRTestExecutionArguments[@]}"

Return code:      1
Raw output file:      /tmp/helix/working/B35D098B/w/A41F08F3/uploads/eventpipe/eventsourceerror/eventsourceerror/output.txt
Raw output:
BEGIN EXECUTION
in takeLock
/private/tmp/helix/working/B35D098B/w/A41F08F3/e/tracing/eventpipe/eventsourceerror/eventsourceerror/IL-CG2/Microsoft.Diagnostics.NETCore.Client.dll
03:13:54
Response file: /private/tmp/helix/working/B35D098B/w/A41F08F3/e/tracing/eventpipe/eventsourceerror/eventsourceerror/Microsoft.Diagnostics.NETCore.Client.dll.rsp
/private/tmp/helix/working/B35D098B/w/A41F08F3/e/tracing/eventpipe/eventsourceerror/eventsourceerror/IL-CG2/Microsoft.Diagnostics.NETCore.Client.dll
-o:/private/tmp/helix/working/B35D098B/w/A41F08F3/e/tracing/eventpipe/eventsourceerror/eventsourceerror/Microsoft.Diagnostics.NETCore.Client.dll
-r:/tmp/helix/working/B35D098B/p/System.*.dll
-r:/tmp/helix/working/B35D098B/p/Microsoft.*.dll
-r:/tmp/helix/working/B35D098B/p/xunit.*.dll
-r:/tmp/helix/working/B35D098B/p/mscorlib.dll
--verify-type-and-field-layout
--method-layout:random
--hot-cold-splitting
--targetarch:x64
--targetos:osx
Running CrossGen2:  dotnet /tmp/helix/working/B35D098B/p/crossgen2/crossgen2.dll @/private/tmp/helix/working/B35D098B/w/A41F08F3/e/tracing/eventpipe/eventsourceerror/eventsourceerror/Microsoft.Diagnostics.NETCore.Client.dll.rsp  
Emitting R2R PE file: /private/tmp/helix/working/B35D098B/w/A41F08F3/e/tracing/eventpipe/eventsourceerror/eventsourceerror/Microsoft.Diagnostics.NETCore.Client.dll
Running R2RDump:  dotnet /tmp/helix/working/B35D098B/p/R2RDump/R2RDump.dll --header --sc --in /private/tmp/helix/working/B35D098B/w/A41F08F3/e/tracing/eventpipe/eventsourceerror/eventsourceerror/Microsoft.Diagnostics.NETCore.Client.dll --out /private/tmp/helix/working/B35D098B/w/A41F08F3/e/tracing/eventpipe/eventsourceerror/eventsourceerror/Microsoft.Diagnostics.NETCore.Client.dll.r2rdump --val
03:13:56
/private/tmp/helix/working/B35D098B/w/A41F08F3/e/tracing/eventpipe/eventsourceerror/eventsourceerror/IL-CG2/TestLibrary.dll
03:13:56
Response file: /private/tmp/helix/working/B35D098B/w/A41F08F3/e/tracing/eventpipe/eventsourceerror/eventsourceerror/TestLibrary.dll.rsp
/private/tmp/helix/working/B35D098B/w/A41F08F3/e/tracing/eventpipe/eventsourceerror/eventsourceerror/IL-CG2/TestLibrary.dll
-o:/private/tmp/helix/working/B35D098B/w/A41F08F3/e/tracing/eventpipe/eventsourceerror/eventsourceerror/TestLibrary.dll
-r:/tmp/helix/working/B35D098B/p/System.*.dll
-r:/tmp/helix/working/B35D098B/p/Microsoft.*.dll
-r:/tmp/helix/working/B35D098B/p/xunit.*.dll
-r:/tmp/helix/working/B35D098B/p/mscorlib.dll
--verify-type-and-field-layout
--method-layout:random
--hot-cold-splitting
--targetarch:x64
--targetos:osx
Running CrossGen2:  dotnet /tmp/helix/working/B35D098B/p/crossgen2/crossgen2.dll @/private/tmp/helix/working/B35D098B/w/A41F08F3/e/tracing/eventpipe/eventsourceerror/eventsourceerror/TestLibrary.dll.rsp  
Emitting R2R PE file: /private/tmp/helix/working/B35D098B/w/A41F08F3/e/tracing/eventpipe/eventsourceerror/eventsourceerror/TestLibrary.dll
Running R2RDump:  dotnet /tmp/helix/working/B35D098B/p/R2RDump/R2RDump.dll --header --sc --in /private/tmp/helix/working/B35D098B/w/A41F08F3/e/tracing/eventpipe/eventsourceerror/eventsourceerror/TestLibrary.dll --out /private/tmp/helix/working/B35D098B/w/A41F08F3/e/tracing/eventpipe/eventsourceerror/eventsourceerror/TestLibrary.dll.r2rdump --val
03:13:5

Stack trace:

   at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 146
   at Xunit.Assert.True(Boolean condition, String userMessage) in /_/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 128
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
   at Program.<<Main>$>g__TestExecutor19|0_20(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)
Queued Pipeline Pipeline_Configuration OS Arch Test Outcome Properties BuildReason
2024-07-22T06:25:17.554Z runtime-coreclr crossgen2 outerloop Checked-no_tiered_compilation osx.1200.amd64.open x64 tracing/eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.cmd Failed {"System.StageName":"Build","Project":"public","BuildId":"749562","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobAttempt":"1","DefinitionId":"134","operatingSystem":"OSX.1200.Amd64.Open","BuildNumber":"20240721.1","AzurePipelinesTestRunId":"18968848","DefinitionName":"runtime-coreclr crossgen2 outerloop","System.JobId":"30d857d6-2812-5c31-5c67-e52c43389e0f","architecture":"x64","System.StageAttempt":"1","System.PhaseName":"run_test_p1_R2R_Composite_osx_x64_checked","configuration":"Checked-no_tiered_compilation","System.JobName":"__default","Reason":"Schedule","System.PhaseAttempt":"1"} Schedule
2024-07-22T06:22:18.344Z runtime-coreclr crossgen2 outerloop Checked-no_tiered_compilation osx.1200.amd64.open x64 tracing/eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.cmd Failed {"configuration":"Checked-no_tiered_compilation","DefinitionId":"134","BuildId":"749562","System.StageAttempt":"1","Reason":"Schedule","BuildNumber":"20240721.1","AzurePipelinesTestRunId":"18968836","operatingSystem":"OSX.1200.Amd64.Open","Project":"public","System.PhaseAttempt":"1","System.StageName":"Build","System.JobId":"94bcf053-7b40-5111-f380-056c9b4b6421","System.PhaseName":"run_test_p1_R2R_osx_x64_checked","DefinitionName":"runtime-coreclr crossgen2 outerloop","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobName":"__default","System.JobAttempt":"1","architecture":"x64"} Schedule
2024-07-22T06:21:29.617Z runtime-coreclr crossgen2 outerloop Checked-no_tiered_compilation osx.1200.arm64.open arm64 tracing/eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.cmd Failed {"AzurePipelinesTestRunId":"18968832","BuildNumber":"20240721.1","System.JobName":"__default","configuration":"Checked-no_tiered_compilation","DefinitionName":"runtime-coreclr crossgen2 outerloop","System.JobAttempt":"1","System.JobId":"b98d1326-0c22-5cb0-0518-a01616fe181e","operatingSystem":"OSX.1200.ARM64.Open","DefinitionId":"134","CollectionUri":"https://dev.azure.com/dnceng-public/","System.PhaseName":"run_test_p1_R2R_Composite_osx_arm64_checked","System.PhaseAttempt":"1","System.StageAttempt":"1","architecture":"arm64","BuildId":"749562","Reason":"Schedule","Project":"public","System.StageName":"Build"} Schedule
2024-07-22T02:19:49.496Z runtime-coreclr outerloop Checked-no_tiered_compilation osx.1200.amd64.open x64 tracing/eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.cmd Failed {"configuration":"Checked-no_tiered_compilation","BuildId":"749526","System.JobAttempt":"1","DefinitionName":"runtime-coreclr outerloop","Reason":"Schedule","System.JobName":"__default","AzurePipelinesTestRunId":"18967148","System.StageAttempt":"1","System.PhaseName":"run_test_p1_R2R_CG2_osx_x64_checked","Project":"public","System.PhaseAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","DefinitionId":"108","architecture":"x64","BuildNumber":"20240721.3","System.JobId":"2bb87d59-31ba-55f9-0713-03158c3fd52f","System.StageName":"Build","operatingSystem":"OSX.1200.Amd64.Open"} Schedule
2024-07-22T02:18:08.057Z runtime-coreclr outerloop Checked-no_tiered_compilation osx.1200.amd64.open x64 tracing/eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.cmd Failed {"configuration":"Checked-no_tiered_compilation","System.PhaseName":"run_test_p1osx_x64_checked","DefinitionName":"runtime-coreclr outerloop","System.PhaseAttempt":"1","System.StageName":"Build","System.JobId":"bf644a0b-2dbe-5a03-d8c6-a86fdd97c823","AzurePipelinesTestRunId":"18967128","operatingSystem":"OSX.1200.Amd64.Open","DefinitionId":"108","architecture":"x64","CollectionUri":"https://dev.azure.com/dnceng-public/","Reason":"Schedule","System.JobAttempt":"1","BuildNumber":"20240721.3","System.StageAttempt":"1","BuildId":"749526","Project":"public","System.JobName":"default"} Schedule
More failures Queued | Pipeline | Pipeline_Configuration | OS | Arch | Test | Outcome | Properties | BuildReason -- | -- | -- | -- | -- | -- | -- | -- | -- 2024-07-21T10:18:54.968Z | runtime-coreclr outerloop | Checked-no_tiered_compilation | osx.1200.amd64.open | x64 | tracing/eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.cmd | Failed | {"BuildNumber":"20240721.1","System.JobName":"__default","BuildId":"749181","System.JobAttempt":"1","Reason":"Schedule","System.StageName":"Build","CollectionUri":"https://dev.azure.com/dnceng-public/","System.PhaseName":"run_test_p1_R2R_CG2_osx_x64_checked","AzurePipelinesTestRunId":"18953760","configuration":"Checked-no_tiered_compilation","System.StageAttempt":"1","Project":"public","System.PhaseAttempt":"1","System.JobId":"2bb87d59-31ba-55f9-0713-03158c3fd52f","architecture":"x64","DefinitionId":"108","operatingSystem":"OSX.1200.Amd64.Open","DefinitionName":"runtime-coreclr outerloop"} | Schedule 2024-07-21T07:26:21.238Z | coreclr-release-outerloop-nightly | Release-no_tiered_compilation | osx.1200.amd64.open | x64 | tracing/eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.cmd | Failed | {"CollectionUri":"https://dev.azure.com/dnceng-public/","DefinitionId":"135","System.JobAttempt":"1","operatingSystem":"OSX.1200.Amd64.Open","Reason":"Schedule","System.JobName":"__default","System.PhaseAttempt":"1","Project":"public","System.JobId":"ed94b4c4-ff55-5657-ff29-58e87100eb6d","BuildNumber":"20240720.1","DefinitionName":"coreclr-release-outerloop-nightly","System.StageAttempt":"1","System.StageName":"Build","architecture":"x64","AzurePipelinesTestRunId":"18952430","BuildId":"749114","System.PhaseName":"run_test_p1_R2R_osx_x64_release","configuration":"Release-no_tiered_compilation"} | Schedule 2024-07-21T07:17:28.489Z | runtime-coreclr crossgen2-composite gcstress | Checked-heapverify1 | osx.1200.arm64.open | arm64 | tracing/eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.cmd | Failed | {"System.StageAttempt":"1","System.JobName":"__default","AzurePipelinesTestRunId":"18952284","DefinitionId":"141","DefinitionName":"runtime-coreclr crossgen2-composite gcstress","CollectionUri":"https://dev.azure.com/dnceng-public/","System.PhaseName":"run_test_p1_Composite_osx_arm64_checked","BuildId":"749113","Reason":"Schedule","System.JobId":"4b5575ba-4f05-5198-bc88-a075c735caa5","configuration":"Checked-heapverify1","System.StageName":"Build","architecture":"arm64","Project":"public","operatingSystem":"OSX.1200.ARM64.Open","BuildNumber":"20240720.1","System.PhaseAttempt":"1","System.JobAttempt":"1"} | Schedule 2024-07-21T06:18:18.543Z | runtime-coreclr crossgen2 outerloop | Checked-no_tiered_compilation | osx.1200.arm64.open | arm64 | tracing/eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.cmd | Failed | {"Reason":"Schedule","DefinitionId":"134","configuration":"Checked-no_tiered_compilation","System.StageName":"Build","DefinitionName":"runtime-coreclr crossgen2 outerloop","System.JobAttempt":"1","System.JobId":"b98d1326-0c22-5cb0-0518-a01616fe181e","Project":"public","System.JobName":"__default","System.StageAttempt":"1","AzurePipelinesTestRunId":"18951998","BuildId":"749107","BuildNumber":"20240720.1","System.PhaseAttempt":"1","operatingSystem":"OSX.1200.ARM64.Open","architecture":"arm64","CollectionUri":"https://dev.azure.com/dnceng-public/","System.PhaseName":"run_test_p1_R2R_Composite_osx_arm64_checked"} | Schedule 2024-07-21T06:17:36.66Z | runtime-coreclr crossgen2 outerloop | Checked-no_tiered_compilation | osx.1200.amd64.open | x64 | tracing/eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.cmd | Failed | {"DefinitionName":"runtime-coreclr crossgen2 outerloop","CollectionUri":"https://dev.azure.com/dnceng-public/","Project":"public","System.PhaseAttempt":"1","configuration":"Checked-no_tiered_compilation","System.StageName":"Build","AzurePipelinesTestRunId":"18951994","BuildId":"749107","DefinitionId":"134","System.JobName":"__default","System.JobId":"30d857d6-2812-5c31-5c67-e52c43389e0f","System.PhaseName":"run_test_p1_R2R_Composite_osx_x64_checked","BuildNumber":"20240720.1","operatingSystem":"OSX.1200.Amd64.Open","System.StageAttempt":"1","Reason":"Schedule","architecture":"x64","System.JobAttempt":"1"} | Schedule 2024-07-20T19:22:45.652Z | runtime-coreclr outerloop | Checked-no_tiered_compilation | osx.1200.amd64.open | x64 | tracing/eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.cmd | Failed | {"BuildNumber":"20240720.2","System.StageAttempt":"1","Project":"public","Reason":"Schedule","System.JobName":"__default","System.JobId":"bf644a0b-2dbe-5a03-d8c6-a86fdd97c823","architecture":"x64","configuration":"Checked-no_tiered_compilation","AzurePipelinesTestRunId":"18946692","System.PhaseAttempt":"1","System.JobAttempt":"1","DefinitionName":"runtime-coreclr outerloop","BuildId":"748944","System.PhaseName":"run_test_p1__osx_x64_checked","operatingSystem":"OSX.1200.Amd64.Open","System.StageName":"Build","DefinitionId":"108","CollectionUri":"https://dev.azure.com/dnceng-public/"} | Schedule 2024-07-20T07:27:15.343Z | coreclr-release-outerloop-nightly | Release-no_tiered_compilation | osx.1200.amd64.open | x64 | tracing/eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.cmd | Failed | {"Project":"public","AzurePipelinesTestRunId":"18933762","configuration":"Release-no_tiered_compilation","System.PhaseAttempt":"1","System.JobAttempt":"1","Reason":"Schedule","BuildId":"748560","System.JobId":"ed94b4c4-ff55-5657-ff29-58e87100eb6d","System.StageAttempt":"1","DefinitionName":"coreclr-release-outerloop-nightly","operatingSystem":"OSX.1200.Amd64.Open","DefinitionId":"135","System.JobName":"__default","BuildNumber":"20240719.1","CollectionUri":"https://dev.azure.com/dnceng-public/","architecture":"x64","System.StageName":"Build","System.PhaseName":"run_test_p1_R2R_osx_x64_release"} | Schedule 2024-07-20T07:00:46.822Z | runtime-coreclr crossgen2 | Checked-no_tiered_compilation | osx.1200.amd64.open | x64 | tracing/eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.cmd | Failed | {"System.JobName":"__default","operatingSystem":"OSX.1200.Amd64.Open","Reason":"Schedule","System.JobAttempt":"1","System.JobId":"29eafa29-58bb-5a4a-b8d7-ac7ba8f4fdef","DefinitionId":"124","AzurePipelinesTestRunId":"18933468","System.StageAttempt":"1","System.PhaseName":"run_test_p0_coreclr_R2R_CG2_HotColdSplitting_osx_x64_checked","System.StageName":"Build","CollectionUri":"https://dev.azure.com/dnceng-public/","configuration":"Checked-no_tiered_compilation","BuildNumber":"20240719.1","System.PhaseAttempt":"1","architecture":"x64","BuildId":"748563","DefinitionName":"runtime-coreclr crossgen2","Project":"public"} | Schedule 2024-07-20T06:24:55.525Z | runtime-coreclr crossgen2 outerloop | Checked-no_tiered_compilation | osx.1200.amd64.open | x64 | tracing/eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.cmd | Failed | {"System.JobName":"__default","System.JobAttempt":"1","configuration":"Checked-no_tiered_compilation","DefinitionName":"runtime-coreclr crossgen2 outerloop","Reason":"Schedule","System.StageAttempt":"1","System.JobId":"30d857d6-2812-5c31-5c67-e52c43389e0f","System.PhaseName":"run_test_p1_R2R_Composite_osx_x64_checked","System.PhaseAttempt":"1","operatingSystem":"OSX.1200.Amd64.Open","AzurePipelinesTestRunId":"18932828","Project":"public","architecture":"x64","BuildNumber":"20240719.1","DefinitionId":"134","System.StageName":"Build","BuildId":"748543","CollectionUri":"https://dev.azure.com/dnceng-public/"} | Schedule 2024-07-20T02:31:34.366Z | runtime-coreclr outerloop | Checked-no_tiered_compilation | osx.1200.amd64.open | x64 | tracing/eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.cmd | Failed | {"architecture":"x64","System.PhaseName":"run_test_p1_R2R_CG2_osx_x64_checked","Project":"public","System.PhaseAttempt":"1","DefinitionId":"108","System.JobId":"2bb87d59-31ba-55f9-0713-03158c3fd52f","System.StageAttempt":"1","configuration":"Checked-no_tiered_compilation","System.JobName":"__default","System.StageName":"Build","AzurePipelinesTestRunId":"18931014","BuildId":"748490","DefinitionName":"runtime-coreclr outerloop","System.JobAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","Reason":"Schedule","operatingSystem":"OSX.1200.Amd64.Open","BuildNumber":"20240719.3"} | Schedule 2024-07-19T07:26:42.813Z | coreclr-release-outerloop-nightly | Release-no_tiered_compilation | osx.1200.amd64.open | x64 | tracing/eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.cmd | Failed | {"Project":"public","DefinitionId":"135","System.StageAttempt":"1","configuration":"Release-no_tiered_compilation","architecture":"x64","System.JobAttempt":"1","AzurePipelinesTestRunId":"18892276","BuildId":"747260","Reason":"Schedule","System.JobName":"__default","BuildNumber":"20240718.1","System.PhaseName":"run_test_p1_R2R_osx_x64_release","System.PhaseAttempt":"1","System.JobId":"ed94b4c4-ff55-5657-ff29-58e87100eb6d","DefinitionName":"coreclr-release-outerloop-nightly","CollectionUri":"https://dev.azure.com/dnceng-public/","System.StageName":"Build","operatingSystem":"OSX.1200.Amd64.Open"} | Schedule 2024-07-19T07:08:24.08Z | runtime-coreclr crossgen2 | Checked-no_tiered_compilation | osx.1200.amd64.open | x64 | tracing/eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.cmd | Failed | {"System.PhaseName":"run_test_p0_coreclr_R2R_CG2_HotColdSplitting_osx_x64_checked","System.PhaseAttempt":"1","System.StageName":"Build","DefinitionId":"124","operatingSystem":"OSX.1200.Amd64.Open","configuration":"Checked-no_tiered_compilation","BuildId":"747262","System.JobId":"29eafa29-58bb-5a4a-b8d7-ac7ba8f4fdef","System.JobName":"__default","System.StageAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobAttempt":"1","DefinitionName":"runtime-coreclr crossgen2","Reason":"Schedule","AzurePipelinesTestRunId":"18891800","architecture":"x64","Project":"public","BuildNumber":"20240718.1"} | Schedule 2024-07-19T06:25:10.367Z | runtime-coreclr crossgen2 outerloop | Checked-no_tiered_compilation | osx.1200.amd64.open | x64 | tracing/eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.cmd | Failed | {"System.StageAttempt":"1","System.JobId":"30d857d6-2812-5c31-5c67-e52c43389e0f","architecture":"x64","BuildId":"747218","System.StageName":"Build","Project":"public","DefinitionName":"runtime-coreclr crossgen2 outerloop","BuildNumber":"20240718.1","configuration":"Checked-no_tiered_compilation","CollectionUri":"https://dev.azure.com/dnceng-public/","DefinitionId":"134","System.PhaseAttempt":"1","System.JobName":"__default","AzurePipelinesTestRunId":"18890578","System.PhaseName":"run_test_p1_R2R_Composite_osx_x64_checked","Reason":"Schedule","System.JobAttempt":"1","operatingSystem":"OSX.1200.Amd64.Open"} | Schedule 2024-07-19T06:22:53.83Z | runtime-coreclr crossgen2 outerloop | Checked-no_tiered_compilation | osx.1200.arm64.open | arm64 | tracing/eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.cmd | Failed | {"System.JobName":"__default","CollectionUri":"https://dev.azure.com/dnceng-public/","DefinitionId":"134","System.PhaseName":"run_test_p1_R2R_Composite_osx_arm64_checked","configuration":"Checked-no_tiered_compilation","System.JobId":"b98d1326-0c22-5cb0-0518-a01616fe181e","architecture":"arm64","System.StageName":"Build","System.PhaseAttempt":"1","BuildNumber":"20240718.1","System.JobAttempt":"1","operatingSystem":"OSX.1200.ARM64.Open","System.StageAttempt":"1","Reason":"Schedule","DefinitionName":"runtime-coreclr crossgen2 outerloop","AzurePipelinesTestRunId":"18890536","Project":"public","BuildId":"747218"} | Schedule 2024-06-28T02:45:21.083Z | runtime-coreclr outerloop | Checked-no_tiered_compilation | osx.1200.amd64.open | x64 | tracing/eventpipe/eventsourceerror/eventsourceerror/eventsourceerror.cmd | Failed | {"System.JobName":"__default","architecture":"x64","System.JobId":"2bb87d59-31ba-55f9-0713-03158c3fd52f","configuration":"Checked-no_tiered_compilation","System.JobAttempt":"1","DefinitionId":"108","AzurePipelinesTestRunId":"18157254","BuildId":"723534","CollectionUri":"https://dev.azure.com/dnceng-public/","System.PhaseAttempt":"1","System.StageName":"Build","DefinitionName":"runtime-coreclr outerloop","Reason":"Schedule","Project":"public","System.PhaseName":"run_test_p1_R2R_CG2_osx_x64_checked","System.StageAttempt":"1","operatingSystem":"OSX.1200.Amd64.Open","BuildNumber":"20240627.5"} | Schedule
mangod9 commented 4 weeks ago

Closing since this hasn't reproed in a few months

SzpejnaDawid commented 4 weeks ago

dotnet/runtime: ce8f49e658d I checked this tests on RISC-V and x64 with debian and I still get this error.

/runtime/artifacts/tests/coreclr/linux.x64.Checked/GC/Features/SustainedLowLatency/scenario# ./scenario.sh 
BEGIN EXECUTION
/runtime/artifacts/tests/coreclr/linux.x64.Checked/Tests/Core_Root/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false -p System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true scenario.dll ''
TID 3847b: TraceGC is not turned on Cleaning up-------gen0: 1102, gen1: 627; gen2: 176, heap size: 32,812,912 bytes
 Cleaning up-------gen0: 2205, gen1: 1256; gen2: 353, heap size: 7,753,896 bytes
 Cleaning up-------gen0: 3308, gen1: 1884; gen2: 529, heap size: -10,903,992 bytes
 Cleaning up-------gen0: 4410, gen1: 2512; gen2: 703, heap size: 42,269,328 bytes
 Cleaning up-------gen0: 5513, gen1: 3140; gen2: 880, heap size: 34,975,312 bytes
 Cleaning up-------gen0: 6615, gen1: 3768; gen2: 1055, heap size: 40,667,016 bytes
 Cleaning up-------gen0: 7720, gen1: 4398; gen2: 1234, heap size: -1,186,208 bytes
./scenario.sh: line 449: 230523 Segmentation fault      (core dumped) $LAUNCHER $ExePath "${CLRTestExecutionArguments[@]}"
Expected: 100
Actual: 139
END EXECUTION - FAILED
SzpejnaDawid commented 3 weeks ago

@mangod9 I was able to reproduce the error on x64. Could you check whether this issue should really be closed?

mangod9 commented 3 weeks ago

Ok thanks for the info, reopening the issue now. The original one was for macOS, are you able to repro this consistently?

SzpejnaDawid commented 2 weeks ago

When it comes to operating system, I checked it on Ubuntu.

cshung commented 2 weeks ago

When it comes to operating system, I checked it on Ubuntu.

I don't have access to RISC-V hardware, is there something we can do to work on this together?

SzpejnaDawid commented 2 weeks ago

When it comes to operating system, I checked it on Ubuntu.

I don't have access to RISC-V hardware, is there something we can do to work on this together?

@cshung, Fortunately (or not), I reproduced this error on x64 so RISC-V hardware is not required.

cshung commented 2 weeks ago

@cshung, Fortunately (or not), I reproduced this error on x64 so RISC-V hardware is not required.

I tried to repro this on Ubuntu x64 as well, but I can't. Can you share more details on how did you get it to reproduce?