search

dotnet / perf-autofiling-issues

A landing place for auto-filed performance issues before they receive triage
MIT License
9 stars 4 forks source link

[Perf] Linux/x64: 146 Regressions on 10/7/2023 7:48:19 AM #22801

Open performanceautofiler[bot] opened 1 year ago

performanceautofiler[bot] commented 1 year ago

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 64862501b238512db10eff9ed4b05ba94412974d
Compare aea8f731b05343dd732d22d73093ed79022501b1
Diff Diff
Configs CompilationMode:wasm, RunKind:blazor_scenarios

Regressions in SOD - New Blazor Template - Publish

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
9.06 KB 8.91 KB 0.98 0.00 True
1.32 KB 1.21 KB 0.91 0.00 True
8.68 KB 8.58 KB 0.99 0.00 True
6.93 KB 6.82 KB 0.98 0.00 True
12.27 KB 11.77 KB 0.96 0.00 True
8.36 KB 8.28 KB 0.99 0.00 True
1.93 KB 1.83 KB 0.95 0.00 True
5.90 KB 5.79 KB 0.98 0.00 True
7.77 KB 7.67 KB 0.99 0.00 True
14.76 KB 14.50 KB 0.98 0.00 True
5.29 KB 5.19 KB 0.98 0.00 True
7.84 KB 7.74 KB 0.99 0.00 True
2.81 KB 2.70 KB 0.96 0.00 True
17.77 KB 17.27 KB 0.97 0.00 True
10.20 KB 10.10 KB 0.99 0.00 True
2.44 KB 2.34 KB 0.96 0.00 True
3.63 KB 3.52 KB 0.97 0.00 True
7.47 KB 7.39 KB 0.99 0.00 True
1.47 KB 1.37 KB 0.93 0.00 True
3.98 KB 3.88 KB 0.97 0.00 True
7.19 KB 7.09 KB 0.99 0.00 True
1.72 KB 1.58 KB 0.92 0.00 True
11.19 KB 11.36 KB 1.02 0.00 True
57.61 KB 59.04 KB 1.02 0.00 True
3.21 KB 3.25 KB 1.01 0.00 True
6.57 KB 6.78 KB 1.03 0.00 True
126.53 KB 127.88 KB 1.01 0.00 True
13.27 KB 13.77 KB 1.04 0.00 True
35.00 KB 35.67 KB 1.02 0.00 True
50.15 KB 51.50 KB 1.03 0.00 True
6.51 KB 6.58 KB 1.01 0.00 True
4.83 KB 4.88 KB 1.01 0.00 True
129.77 KB 134.77 KB 1.04 0.00 True
5.86 KB 6.04 KB 1.03 0.00 True
10.03 KB 10.16 KB 1.01 0.00 True
460.91 KB 465.62 KB 1.01 0.00 True

graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'SOD - New Blazor Template - Publish*'
### Payloads [Baseline]() [Compare]() ### SOD - New Blazor Template - Publish #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small. ``` #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 1 year ago

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 64862501b238512db10eff9ed4b05ba94412974d
Compare aea8f731b05343dd732d22d73093ed79022501b1
Diff Diff
Configs CompilationMode:wasm, RunKind:blazor_scenarios

Regressions in SOD - Pizza App - Publish

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
2.03 KB 1.92 KB 0.95 0.00 True
2.87 KB 2.80 KB 0.97 0.00 True
2.81 KB 2.70 KB 0.96 0.00 True
6.29 KB 6.19 KB 0.98 0.00 True
4.23 KB 4.12 KB 0.97 0.00 True
7.43 KB 7.33 KB 0.99 0.00 True
1.50 KB 1.40 KB 0.93 0.00 True
2.23 KB 2.12 KB 0.95 0.00 True
1.69 KB 1.59 KB 0.94 0.00 True
3.47 KB 3.40 KB 0.98 0.00 True
7.68 KB 7.60 KB 0.99 0.00 True
5.52 KB 5.40 KB 0.98 0.00 True
3.89 KB 3.78 KB 0.97 0.00 True
4.66 KB 4.56 KB 0.98 0.00 True
3.22 KB 3.12 KB 0.97 0.00 True
1.22 KB 1.10 KB 0.90 0.00 True
4.94 KB 4.84 KB 0.98 0.00 True
14.94 KB 14.77 KB 0.99 0.00 True
1.95 KB 1.84 KB 0.94 0.00 True
6.25 KB 6.15 KB 0.98 0.00 True
10.21 KB 10.10 KB 0.99 0.00 True
1.48 KB 1.37 KB 0.93 0.00 True
8.38 KB 8.28 KB 0.99 0.00 True
5.63 KB 5.56 KB 0.99 0.00 True
3.77 KB 3.27 KB 0.87 0.00 True
8.29 KB 8.17 KB 0.99 0.00 True
1.67 KB 1.57 KB 0.94 0.00 True
1.48 KB 1.36 KB 0.92 0.00 True
10.23 KB 10.10 KB 0.99 0.00 True
9.03 KB 8.91 KB 0.99 0.00 True
13.27 KB 12.77 KB 0.96 0.00 True
8.06 KB 7.98 KB 0.99 0.00 True
2.44 KB 2.34 KB 0.96 0.00 True
9.02 KB 8.92 KB 0.99 0.00 True
1.38 KB 1.27 KB 0.92 0.00 True
4.54 KB 4.44 KB 0.98 0.00 True
1.78 KB 1.69 KB 0.95 0.00 True
25.27 KB 24.77 KB 0.98 0.00 True
10.17 KB 10.01 KB 0.98 0.00 True
1.32 KB 1.21 KB 0.92 0.00 True
58.61 KB 60.09 KB 1.03 0.00 True
35.00 KB 35.67 KB 1.02 0.00 True
10.03 KB 10.16 KB 1.01 0.00 True
6.10 KB 6.31 KB 1.03 0.00 True
5.77 KB 5.84 KB 1.01 0.00 True
132.77 KB 137.77 KB 1.04 0.00 True
15.36 KB 16.17 KB 1.05 0.00 True
54.57 KB 57.56 KB 1.05 0.00 True
116.00 KB 117.20 KB 1.01 0.00 True
11.19 KB 11.36 KB 1.02 0.00 True
17.29 KB 18.22 KB 1.05 0.00 True
13.77 KB 14.27 KB 1.04 0.00 True
7.45 KB 7.53 KB 1.01 0.00 True
6.83 KB 7.03 KB 1.03 0.00 True
51.29 KB 52.42 KB 1.02 0.00 True

graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'SOD - Pizza App - Publish*'
### Payloads [Baseline]() [Compare]() ### SOD - Pizza App - Publish #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small. ``` #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 1 year ago

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 64862501b238512db10eff9ed4b05ba94412974d
Compare aea8f731b05343dd732d22d73093ed79022501b1
Diff Diff
Configs CompilationMode:wasm, RunKind:blazor_scenarios

Regressions in SOD - New Blazor Template - Publish - AOT

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
11.16 KB 11.36 KB 1.02 0.00 True
126.55 KB 127.88 KB 1.01 0.00 True
13.27 KB 13.77 KB 1.04 0.00 True
248.60 KB 251.70 KB 1.01 0.00 True
53.19 KB 53.76 KB 1.01 0.00 True
34.87 KB 35.67 KB 1.02 0.00 True
6.46 KB 6.78 KB 1.05 0.00 True
5.76 KB 6.04 KB 1.05 0.00 True
9.98 KB 10.16 KB 1.02 0.00 True

graph graph graph graph graph graph graph graph graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'SOD - New Blazor Template - Publish - AOT*'
### Payloads [Baseline](<>) [Compare](<>) ### SOD - New Blazor Template - Publish - AOT #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 1% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 1% less than the baseline, or the value was too small. ``` #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 64862501b238512db10eff9ed4b05ba94412974d
Compare aea8f731b05343dd732d22d73093ed79022501b1
Diff Diff
Configs CompilationMode:wasm, RunKind:blazor_scenarios

Regressions in SOD - Pizza App - Publish - AOT

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
3.07 KB 3.04 KB 0.99 0.00 True
5.46 KB 5.40 KB 0.99 0.00 True
256.97 KB 260.06 KB 1.01 0.00 True
6.72 KB 7.03 KB 1.05 0.00 True
17.29 KB 18.22 KB 1.05 0.00 True
9.98 KB 10.16 KB 1.02 0.00 True
34.87 KB 35.67 KB 1.02 0.00 True
13.77 KB 14.27 KB 1.04 0.00 True
11.16 KB 11.36 KB 1.02 0.00 True
53.67 KB 54.23 KB 1.01 0.00 True
15.36 KB 16.17 KB 1.05 0.00 True
6.04 KB 6.31 KB 1.04 0.00 True
54.57 KB 57.56 KB 1.05 0.00 True

graph graph graph graph graph graph graph graph graph graph graph graph graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'SOD - Pizza App - Publish - AOT*'
### Payloads [Baseline]() [Compare]() ### SOD - Pizza App - Publish - AOT #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small. ``` #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 1 year ago

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 64862501b238512db10eff9ed4b05ba94412974d
Compare aea8f731b05343dd732d22d73093ed79022501b1
Diff Diff
Configs CompilationMode:wasm, RunKind:blazor_scenarios

Regressions in SOD - Minimum Blazor Template - Publish

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
384.47 KB 402.24 KB 1.05 0.00 True
52.41 KB 52.97 KB 1.01 0.00 True
459.38 KB 479.56 KB 1.04 0.00 True
9.98 KB 10.16 KB 1.02 0.00 True
1.12 MB 1.18 MB 1.05 0.00 True
126.55 KB 127.88 KB 1.01 0.00 True
6.46 KB 6.78 KB 1.05 0.00 True
11.16 KB 11.36 KB 1.02 0.00 True
1.61 MB 1.63 MB 1.01 0.00 True
4.13 MB 4.19 MB 1.02 0.00 True
43.39 KB 43.85 KB 1.01 0.00 True
8.23 MB 8.33 MB 1.01 0.00 True
236.93 KB 240.03 KB 1.01 0.00 True
8.23 MB 8.33 MB 1.01 0.00 True
5.76 KB 6.04 KB 1.05 0.00 True
1.35 MB 1.37 MB 1.01 0.00 True
1.35 MB 1.37 MB 1.01 0.00 True
1.61 MB 1.63 MB 1.01 0.00 True
13.27 KB 13.77 KB 1.04 0.00 True
3.59 MB 3.65 MB 1.02 0.00 True
34.87 KB 35.67 KB 1.02 0.00 True

graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'SOD - Minimum Blazor Template - Publish*'
### Payloads [Baseline](<>) [Compare](<>) ### SOD - Minimum Blazor Template - Publish #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 1% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 1% less than the baseline, or the value was too small. ``` #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 1 year ago

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 64862501b238512db10eff9ed4b05ba94412974d
Compare aea8f731b05343dd732d22d73093ed79022501b1
Diff Diff
Configs CompilationMode:wasm, RunKind:blazor_scenarios

Regressions in SOD - Minimum Blazor Template - Publish - AOT

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
13.27 KB 13.77 KB 1.04 0.00 True
248.35 KB 251.45 KB 1.01 0.00 True
44.06 KB 44.54 KB 1.01 0.00 True
53.16 KB 53.72 KB 1.01 0.00 True
6.46 KB 6.78 KB 1.05 0.00 True
2.21 MB 2.23 MB 1.01 0.00 True
9.68 MB 9.79 MB 1.01 0.00 True
9.98 KB 10.16 KB 1.02 0.00 True
11.16 KB 11.36 KB 1.02 0.00 True
5.76 KB 6.04 KB 1.05 0.00 True
34.87 KB 35.67 KB 1.02 0.00 True
126.55 KB 127.88 KB 1.01 0.00 True

graph graph graph graph graph graph graph graph graph graph graph graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'SOD - Minimum Blazor Template - Publish - AOT*'
### Payloads [Baseline](<>) [Compare](<>) ### SOD - Minimum Blazor Template - Publish - AOT #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 1% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 1% less than the baseline, or the value was too small. ``` #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
lewing commented 1 year ago

Interesting, it does look like net9.0 is materially faster than the net8.0(rc1 I think) given that this range has a change that will cause perf to run against 9 again. I expect more improvements to be logged