dotnet / runtime

.NET is a cross-platform runtime for cloud, mobile, desktop, and IoT apps.
https://docs.microsoft.com/dotnet/core/
MIT License
14.92k stars 4.64k forks source link

Test failure: JIT/Regression/JitBlue/Runtime_55107/Runtime_55107/Runtime_55107.cmd #102976

Closed v-wenyuxu closed 3 months ago

v-wenyuxu commented 3 months ago

Failed in: runtime-coreclr jitstress-isas-x86 20240601.1

Failed tests:

coreclr osx x64 Checked jitstress_isas_1_x86_nosse @ OSX.1200.Amd64.Open
    - JIT/Regression/JitBlue/Runtime_55107/Runtime_55107/Runtime_55107.cmd
coreclr osx x64 Checked jitstress_isas_1_x86_nosse2 @ OSX.1200.Amd64.Open
    - JIT/Regression/JitBlue/Runtime_55107/Runtime_55107/Runtime_55107.cmd
coreclr osx x64 Checked jitstress_isas_1_x86_nohwintrinsic @ OSX.1200.Amd64.Open
    - JIT/Regression/JitBlue/Runtime_55107/Runtime_55107/Runtime_55107.cmd

Error message:

 waitpid() returned successfully (wstatus 00000000) WEXITSTATUS 0 WTERMSIG 0
/private/tmp/helix/working/B729096F/w/B81B09BF/e/JIT/Regression/Regression_2/../JitBlue/Runtime_55107/Runtime_55107/Runtime_55107.sh: line 441: 22053 Segmentation fault: 11  (core dumped) $LAUNCHER $ExePath "${CLRTestExecutionArguments[@]}"

Return code:      1
Raw output file:      /tmp/helix/working/B729096F/w/B81B09BF/uploads/JitBlue/Runtime_55107/Runtime_55107/output.txt
Raw output:
BEGIN EXECUTION
/tmp/helix/working/B729096F/p/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false -p System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true Runtime_55107.dll ''
[createdump] Gathering state for process 22053 
[createdump] Crashing thread 1317bc signal 11 (000b)
[createdump] Writing crash report to file /cores/coredump.22053.dmp.crashreport.json
[createdump] Crash report successfully written
[createdump] Writing minidump with heap to file /cores/coredump.22053.dmp
[createdump] Written 350888072 bytes (85666 pages) to core file
[createdump] Target process is alive
[createdump] Dump successfully written in 6951ms
Expected: 100
Actual: 139
END EXECUTION - FAILED
Test failed. Trying to see if dump file was created in /cores since 6/1/2024 5:20:09 PM
Processing /cores/coredump.22053.dmp.crashreport.json
Printing stacktrace from '/cores/coredump.22053.dmp.crashreport.json'
Invoking llvm-symbolizer --pretty-print
Errors while running llvm-symbolizer --pretty-print
System.ComponentModel.Win32Exception (2): An error occurred trying to start process 'llvm-symbolizer' with working directory '/private/tmp/helix/working/B729096F/w/B81B09BF/e/JIT/Regression/Regression_2'. No such file or directory
   at System.Diagnostics.Process.ForkAndExecProcess(ProcessStartInfo startInfo, String resolvedFilename, String[] argv, String[] envp, String cwd, Boolean setCredentials, UInt32 userId, UInt32 groupId, UInt32[] groups, Int32& stdinFd, Int32& stdoutFd, Int32& stderrFd, Boolean usesTerminal, Boolean throwOnNoExec) in /_/src/libraries/System.Diagnostics.Process/src/System/Diagnostics/Process.Unix.cs:line 499
   at System.Diagnostics.Process.StartCore(ProcessStartInfo startInfo) in /_/src/libraries/System.Diagnostics.Process/src/System/Diagnostics/Process.Unix.cs:line 456
   at System.Diagnostics.Process.Start() in /_/src/libraries/System.Diagnostics.Process/src/System/Diagnostics/Process.cs:line 1282
   at CoreclrTestLib.CoreclrTestWrapperLib.TryPrintStackTraceFromCrashReport(String crashReportJsonFile, TextWriter outputWriter)
Test Harness Exitcode is : 1
To run the test:
Set up CORE_ROOT and run.
> /private/tmp/helix/working/B729096F/w/B81B09BF/e/JIT/Regression/Regression_2/../JitBlue/Runtime_55107/Runtime_55107/Runtime_55107.sh

Stack trace:

   at Xunit.Assert.True(Boolean condition, String userMessage) in /_/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 128
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
   at Program.<<Main>$>g__TestExecutor446|0_447(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)
Queued Pipeline Pipeline_Configuration OS Arch Test Outcome Properties BuildReason
2024-06-02T07:17:36.017Z runtime-coreclr crossgen2-composite gcstress Checked-gcstress0xc_disabler2r_jitstress2 osx.1200.arm64.open arm64 JIT/Regression/JitBlue/Runtime_55107/Runtime_55107/Runtime_55107.cmd Failed {"System.PhaseName":"run_test_p1_Composite_osx_arm64_checked","DefinitionName":"runtime-coreclr crossgen2-composite gcstress","System.StageName":"Build","System.JobAttempt":"1","System.JobName":"__default","configuration":"Checked-gcstress0xc_disabler2r_jitstress2","operatingSystem":"OSX.1200.ARM64.Open","BuildNumber":"20240601.1","architecture":"arm64","BuildId":"695081","Project":"public","Reason":"Schedule","System.StageAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","AzurePipelinesTestRunId":"17270084","System.PhaseAttempt":"1","System.JobId":"4b5575ba-4f05-5198-bc88-a075c735caa5","DefinitionId":"141"} Schedule
2024-06-01T22:13:05.597Z runtime-coreclr gcstress-extra Checked-gcstress0xc_disabler2r_jitstress2 osx.1200.arm64.open arm64 JIT/Regression/JitBlue/Runtime_55107/Runtime_55107/Runtime_55107.cmd Failed {"System.StageName":"Build","DefinitionId":"113","System.PhaseName":"run_test_p1osx_arm64_checked","Project":"public","DefinitionName":"runtime-coreclr gcstress-extra","BuildNumber":"20240601.1","System.JobId":"765fd5e9-e47f-5cb0-4cbf-499eaaaee93e","System.PhaseAttempt":"1","Reason":"Schedule","AzurePipelinesTestRunId":"17268424","CollectionUri":"https://dev.azure.com/dnceng-public/","System.StageAttempt":"1","configuration":"Checked-gcstress0xc_disabler2r_jitstress2","operatingSystem":"OSX.1200.ARM64.Open","System.JobName":"default","BuildId":"695019","architecture":"arm64","System.JobAttempt":"1"} Schedule
dotnet-policy-service[bot] commented 3 months ago

Tagging subscribers to this area: @JulieLeeMSFT, @jakobbotsch See info in area-owners.md if you want to be subscribed.

v-wenyuxu commented 3 months ago

Failed in: runtime-coreclr gcstress-extra 20240602.1

Failed tests:

coreclr linux arm Checked gcstress0xc_disabler2r_jitstress2 @ (Debian.12.Arm32.Open)Ubuntu.2004.ArmArch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:debian-12-helix-arm32v7
    - JIT/Regression/JitBlue/Runtime_55107/Runtime_55107/Runtime_55107.cmd

Error message:

 waitpid() returned successfully (wstatus 00000000) WEXITSTATUS 0 WTERMSIG 0
/root/helix/work/workitem/e/JIT/Regression/Regression_2/../JitBlue/Runtime_55107/Runtime_55107/Runtime_55107.sh: line 441:   130 Segmentation fault      (core dumped) $LAUNCHER $ExePath "${CLRTestExecutionArguments[@]}"

Return code:      1
Raw output file:      /root/helix/work/workitem/uploads/JitBlue/Runtime_55107/Runtime_55107/output.txt
Raw output:
BEGIN EXECUTION
/root/helix/work/correlation/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false -p System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true Runtime_55107.dll ''
[createdump] Gathering state for process 130 corerun
[createdump] Crashing thread 0082 signal 11 (000b)
[createdump] Writing crash report to file /home/helixbot/dotnetbuild/dumps/coredump.130.dmp.crashreport.json
[createdump] Crash report successfully written
[createdump] Writing minidump with heap to file /home/helixbot/dotnetbuild/dumps/coredump.130.dmp
[createdump] Written 55717888 bytes (13603 pages) to core file
[createdump] Target process is alive
[createdump] Dump successfully written in 83ms
Expected: 100
Actual: 139
END EXECUTION - FAILED
Test failed. Trying to see if dump file was created in /home/helixbot/dotnetbuild/dumps since 6/2/2024 10:37:36 PM
Processing /home/helixbot/dotnetbuild/dumps/coredump.130.dmp.crashreport.json
Printing stacktrace from '/home/helixbot/dotnetbuild/dumps/coredump.130.dmp.crashreport.json'
Invoking llvm-symbolizer --pretty-print
Stack trace:
----------------------------------
Thread Id: 0x82
      Child SP               IP Call Site
 0xf7cdfb20 0xf79e7614 libc.so.6!
 0xf7cdfb28 0xf7a519c0 libc.so.6!__wait4_time64
 0xf7cdfb90 0xf78ed05c libcoreclr.so!PROCCreateCrashDump(std::vector<char const*, std::allocator<char const*> >&, char*, int, bool) at /__w/1/s/src/coreclr/pal/src/thread/process.cpp:2308:22
 0xf7cdfbd8 0xf78ede5c libcoreclr.so!PROCCreateCrashDumpIfEnabled at /__w/1/s/src/coreclr/pal/src/thread/process.cpp:2526:9
 0xf7cdfc28 0xf78a28fe libcoreclr.so!invoke_previous_action(sigaction*, int, siginfo_t*, void*, bool) at /__w/1/s/src/coreclr/pal/src/exception/signal.cpp:397:13
 0xf7cdfc60 0xf78a1ee0 libcoreclr.so!sigsegv_handler(int, siginfo_t*, void*) at /__w/1/s/src/coreclr/pal/src/exception/signal.cpp:0:5
 0xf7cdfc90 0xf79f71b0 libc.so.6!
 0xffb72bb8 0xee7f47a2 libclrjit.so!BitVecTraits::GetSize(BitVecTraits*) at /__w/1/s/src/coreclr/jit/compilerbitsettraits.hpp:156:15
 (inlined by) Compiler::optReachable(BasicBlock*, BasicBlock*, BasicBlock*) at /__w/1/s/src/coreclr/jit/redundantbranchopts.cpp:2204:9
 0xffb72c38 0xee7faf50 libclrjit.so!ScalarEvolutionContext::EvaluateRelop(unsigned int) at /__w/1/s/src/coreclr/jit/scev.cpp:1370:37
 0xffb72c80 0xee7fb8b2 libclrjit.so!ScalarEvolutionContext::ComputeExitNotTakenCount(BasicBlock*) at /__w/1/s/src/coreclr/jit/scev.cpp:1733:36
 0xffb72cc0 0xee738792 libclrjit.so!Compiler::optMakeLoopDownwardsCounted(ScalarEvolutionContext&, FlowGraphNaturalLoop*, LoopLocalOccurrences*) at /__w/1/s/src/coreclr/jit/inductionvariableopts.cpp:1059:39
 0xffb72d68 0xee738c58 libclrjit.so!Compiler::optInductionVariables() at /__w/1/s/src/coreclr/jit/inductionvariableopts.cpp:1195:13
 0xffb72de8 0xee7e0aa4 libclrjit.so!Phase::Run() at /__w/1/s/src/coreclr/jit/phase.cpp:61:26
 0xffb72e28 0xee677b42 libclrjit.so!DoPhase(Compiler*, Phases, PhaseStatus (Compiler::*)()) at /__w/1/s/src/coreclr/jit/phase.h:0:11
 (inlined by) Compiler::compCompile(void**, unsigned int*, JitFlags*) at /__w/1/s/src/coreclr/jit/compiler.cpp:5143:17
 0xffb73128 0xee67ae92 libclrjit.so!Compiler::compIsForInlining() const at /__w/1/s/src/coreclr/jit/compiler.hpp:3944:13
 (inlined by) Compiler::compCompileHelper(CORINFO_MODULE_STRUCT_*, ICorJitInfo*, CORINFO_METHOD_INFO*, void**, unsigned int*, JitFlags*) at /__w/1/s/src/coreclr/jit/compiler.cpp:7377:9
 0xffb73190 0xee67991c libclrjit.so!Compiler::compCompile(CORINFO_MODULE_STRUCT_*, void**, unsigned int*

Stack trace:

   at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 146
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
   at Program.<<Main>$>g__TestExecutor446|0_447(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)
Queued Pipeline Pipeline_Configuration OS Arch Test Outcome Properties BuildReason
2024-06-03T07:26:50.643Z runtime-coreclr crossgen2-composite gcstress Checked-gcstress0xc_disabler2r_jitstress2 osx.1200.arm64.open arm64 JIT/Regression/JitBlue/Runtime_55107/Runtime_55107/Runtime_55107.cmd Failed {"System.JobName":"__default","CollectionUri":"https://dev.azure.com/dnceng-public/","DefinitionName":"runtime-coreclr crossgen2-composite gcstress","System.StageName":"Build","architecture":"arm64","BuildId":"695416","AzurePipelinesTestRunId":"17282404","System.PhaseName":"run_test_p1_Composite_osx_arm64_checked","System.PhaseAttempt":"1","BuildNumber":"20240602.1","DefinitionId":"141","System.JobAttempt":"1","System.StageAttempt":"1","Reason":"Schedule","Project":"public","System.JobId":"4b5575ba-4f05-5198-bc88-a075c735caa5","configuration":"Checked-gcstress0xc_disabler2r_jitstress2","operatingSystem":"OSX.1200.ARM64.Open"} Schedule
2024-06-02T22:20:05.962Z runtime-coreclr gcstress-extra Checked-gcstress0xc_disabler2r_jitstress2 osx.1200.arm64.open arm64 JIT/Regression/JitBlue/Runtime_55107/Runtime_55107/Runtime_55107.cmd Failed {"Reason":"Schedule","System.StageName":"Build","CollectionUri":"https://dev.azure.com/dnceng-public/","BuildNumber":"20240602.1","AzurePipelinesTestRunId":"17278540","System.JobAttempt":"1","System.JobId":"765fd5e9-e47f-5cb0-4cbf-499eaaaee93e","operatingSystem":"OSX.1200.ARM64.Open","BuildId":"695307","System.PhaseAttempt":"1","configuration":"Checked-gcstress0xc_disabler2r_jitstress2","System.JobName":"__default","Project":"public","DefinitionName":"runtime-coreclr gcstress-extra","System.StageAttempt":"1","architecture":"arm64","System.PhaseName":"run_test_p1__osx_arm64_checked","DefinitionId":"113"} Schedule
2024-06-02T07:17:36.017Z runtime-coreclr crossgen2-composite gcstress Checked-gcstress0xc_disabler2r_jitstress2 osx.1200.arm64.open arm64 JIT/Regression/JitBlue/Runtime_55107/Runtime_55107/Runtime_55107.cmd Failed {"System.PhaseName":"run_test_p1_Composite_osx_arm64_checked","DefinitionName":"runtime-coreclr crossgen2-composite gcstress","System.StageName":"Build","System.JobAttempt":"1","System.JobName":"__default","configuration":"Checked-gcstress0xc_disabler2r_jitstress2","operatingSystem":"OSX.1200.ARM64.Open","BuildNumber":"20240601.1","architecture":"arm64","BuildId":"695081","Project":"public","Reason":"Schedule","System.StageAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","AzurePipelinesTestRunId":"17270084","System.PhaseAttempt":"1","System.JobId":"4b5575ba-4f05-5198-bc88-a075c735caa5","DefinitionId":"141"} Schedule
2024-06-01T22:13:05.597Z runtime-coreclr gcstress-extra Checked-gcstress0xc_disabler2r_jitstress2 osx.1200.arm64.open arm64 JIT/Regression/JitBlue/Runtime_55107/Runtime_55107/Runtime_55107.cmd Failed {"System.StageName":"Build","DefinitionId":"113","System.PhaseName":"run_test_p1osx_arm64_checked","Project":"public","DefinitionName":"runtime-coreclr gcstress-extra","BuildNumber":"20240601.1","System.JobId":"765fd5e9-e47f-5cb0-4cbf-499eaaaee93e","System.PhaseAttempt":"1","Reason":"Schedule","AzurePipelinesTestRunId":"17268424","CollectionUri":"https://dev.azure.com/dnceng-public/","System.StageAttempt":"1","configuration":"Checked-gcstress0xc_disabler2r_jitstress2","operatingSystem":"OSX.1200.ARM64.Open","System.JobName":"default","BuildId":"695019","architecture":"arm64","System.JobAttempt":"1"} Schedule
jakobbotsch commented 3 months ago

Dup of #102978