dotnet / perf-autofiling-issues

A landing place for auto-filed performance issues before they receive triage
MIT License
9 stars 4 forks source link

[Perf] Linux/arm64: 4 Regressions on 3/30/2024 12:52:26 AM #32319

Open performanceautofiler[bot] opened 5 months ago

performanceautofiler[bot] commented 5 months ago

Run Information

Name Value
Architecture arm64
OS ubuntu 22.04
Queue AmpereUbuntu
Baseline 83b0d939bedadf7d782b0b26307c2d8c1d5b76f4
Compare cc7bf831f02cad241547ebea5c56c82f12a50999
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Regressions in System.Tests.Perf_Type

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
1.71 μs 1.87 μs 1.09 0.04 False
1.76 μs 1.91 μs 1.09 0.04 False

graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Type*'
### System.Tests.Perf_Type.GetType_NonFullyQualifiedNames(input: "System.Int32*") #### ETL Files #### Histogram #### JIT Disasms ### System.Tests.Perf_Type.GetType_NonFullyQualifiedNames(input: "System.Int32[*]") #### ETL Files #### Histogram #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name Value
Architecture arm64
OS ubuntu 22.04
Queue AmpereUbuntu
Baseline 83b0d939bedadf7d782b0b26307c2d8c1d5b76f4
Compare cc7bf831f02cad241547ebea5c56c82f12a50999
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.ContainsFalse<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
23.15 μs 24.57 μs 1.06 0.02 False

graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsFalse&lt;Int32&gt;*'
### System.Collections.ContainsFalse<Int32>.ImmutableSortedSet(Size: 512) #### ETL Files #### Histogram #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name Value
Architecture arm64
OS ubuntu 22.04
Queue AmpereUbuntu
Baseline 83b0d939bedadf7d782b0b26307c2d8c1d5b76f4
Compare cc7bf831f02cad241547ebea5c56c82f12a50999
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Regressions in Benchstone.BenchI.Fib

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
118.23 μs 133.63 μs 1.13 0.36 False

graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Benchstone.BenchI.Fib*'
### Benchstone.BenchI.Fib.Test #### ETL Files #### Histogram #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
LoopedBard3 commented 5 months ago

Matching regressions: Windows Arm64: https://github.com/dotnet/perf-autofiling-issues/issues/32309

LoopedBard3 commented 5 months ago

Diff: https://github.com/dotnet/runtime/compare/032399502609e6ece320eab4c0e84ceb01ff88b6...b7d91f230846587d959fdeb711a4c24eeeca9349 Likely either: https://github.com/dotnet/runtime/pull/100376 or https://github.com/dotnet/runtime/pull/100449

AndyAyersMS commented 5 months ago

Neither of the above seems likely. Let's keep an eye on these.