dotnet / runtime

.NET is a cross-platform runtime for cloud, mobile, desktop, and IoT apps.
https://docs.microsoft.com/dotnet/core/
MIT License
15.14k stars 4.71k forks source link

[Perf] Linux/arm64: SciMark2.kernel Regression on 10/15/2024 8:19:02 AM #108980

Open performanceautofiler[bot] opened 1 day ago

performanceautofiler[bot] commented 1 day ago

Run Information

Name Value
Architecture arm64
OS ubuntu 22.04
Queue AmpereUbuntu
Baseline 4e2fe8d886e2ca8df51643b7aa69e7ee33cf2296
Compare 69dc5ec395749dc17434140881eb1414fc989c28
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Regressions in SciMark2.kernel

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
663.96 ms 717.40 ms 1.08 0.01 False

graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'SciMark2.kernel*'
### SciMark2.kernel.benchmarkLU #### ETL Files #### Histogram #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
LoopedBard3 commented 20 hours ago

Likely caused by https://github.com/dotnet/runtime/pull/108771. @AndyAyersMS

Compare range: https://github.com/dotnet/runtime/compare/0212c3d85023305facc19e9835518c5b717ce29c...8ef27e2a692bc311a64c078ad428e97eeb32d751

AndyAyersMS commented 14 hours ago

Going to wait for x64 results (we previewed and they looked like a mixed bag).

May want to up the limit, but before I do that I'll dig in and see what lead to the regression.