search

dotnet / perf-autofiling-issues

A landing place for auto-filed performance issues before they receive triage
MIT License
9 stars 4 forks source link

[Perf] Linux/x64: 48 Regressions on 7/27/2023 5:20:34 PM #20056

Open performanceautofiler[bot] opened 1 year ago

performanceautofiler[bot] commented 1 year ago

Run Information

Name Value
Architecture x64
OS ubuntu 18.04
Queue TigerUbuntu
Baseline a2ce8773521a111154e30ab0abe292d9f38d13e6
Compare 3a88b89b025bd1f5addf61ec9a30b54284d056e2
Diff Diff
Configs CompilationMode:wasm, RunKind:blazor_scenarios

Regressions in SOD - New Blazor Template - Publish - AOT

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
58.72 KB 29.68 KB 0.51 0.00 True
49.92 KB 26.00 KB 0.52 0.00 True
2.37 KB 2.33 KB 0.98 0.00 True
206.30 KB 140.73 KB 0.68 0.00 True
13.77 KB 14.77 KB 1.07 0.00 True
5.82 KB 6.16 KB 1.06 0.00 True
37.27 KB 37.77 KB 1.01 0.00 True
6.50 KB 6.82 KB 1.05 0.00 True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'SOD - New Blazor Template - Publish - AOT*'
### Payloads [Baseline](<>) [Compare](<>) ### SOD - New Blazor Template - Publish - AOT #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small. ``` #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name Value
Architecture x64
OS ubuntu 18.04
Queue TigerUbuntu
Baseline a2ce8773521a111154e30ab0abe292d9f38d13e6
Compare 3a88b89b025bd1f5addf61ec9a30b54284d056e2
Diff Diff
Configs CompilationMode:wasm, RunKind:blazor_scenarios

Regressions in SOD - New Blazor Template - Publish

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
58.72 KB 35.04 KB 0.60 0.00 True
49.92 KB 30.55 KB 0.61 0.00 True
206.30 KB 156.07 KB 0.76 0.00 True
2.37 KB 2.33 KB 0.98 0.00 True
13.77 KB 14.77 KB 1.07 0.00 True
6.50 KB 6.82 KB 1.05 0.00 True
37.27 KB 37.77 KB 1.01 0.00 True
5.82 KB 6.16 KB 1.06 0.00 True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'SOD - New Blazor Template - Publish*'
### Payloads [Baseline]() [Compare]() ### SOD - New Blazor Template - Publish #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small. ``` #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name Value
Architecture x64
OS ubuntu 18.04
Queue TigerUbuntu
Baseline a2ce8773521a111154e30ab0abe292d9f38d13e6
Compare 3a88b89b025bd1f5addf61ec9a30b54284d056e2
Diff Diff
Configs CompilationMode:wasm, RunKind:blazor_scenarios

Regressions in SOD - Pizza App - Publish

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
2.37 KB 2.33 KB 0.98 0.00 True
58.72 KB 35.04 KB 0.60 0.00 True
206.30 KB 156.07 KB 0.76 0.00 True
49.92 KB 30.55 KB 0.61 0.00 True
8.52 KB 8.80 KB 1.03 0.00 True
18.27 KB 18.77 KB 1.03 0.00 True
6.85 KB 6.96 KB 1.02 0.00 True
7.59 KB 7.85 KB 1.03 0.00 True
2.79 KB 2.82 KB 1.01 0.00 True
37.77 KB 38.27 KB 1.01 0.00 True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'SOD - Pizza App - Publish*'
### Payloads [Baseline]() [Compare]() ### SOD - Pizza App - Publish #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small. ``` #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 1 year ago

Run Information

Name Value
Architecture x64
OS ubuntu 18.04
Queue TigerUbuntu
Baseline a2ce8773521a111154e30ab0abe292d9f38d13e6
Compare 3a88b89b025bd1f5addf61ec9a30b54284d056e2
Diff Diff
Configs CompilationMode:wasm, RunKind:blazor_scenarios

Regressions in SOD - Minimum Blazor Template - Publish

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
49.92 KB 25.34 KB 0.51 0.00 True
2.37 KB 2.33 KB 0.98 0.00 True
206.30 KB 130.96 KB 0.63 0.00 True
58.72 KB 28.99 KB 0.49 0.00 True
37.27 KB 37.77 KB 1.01 0.00 True
13.77 KB 14.77 KB 1.07 0.00 True
5.82 KB 6.16 KB 1.06 0.00 True
6.50 KB 6.82 KB 1.05 0.00 True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'SOD - Minimum Blazor Template - Publish*'
### Payloads [Baseline](<>) [Compare](<>) ### SOD - Minimum Blazor Template - Publish #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small. ``` #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name Value
Architecture x64
OS ubuntu 18.04
Queue TigerUbuntu
Baseline a2ce8773521a111154e30ab0abe292d9f38d13e6
Compare 3a88b89b025bd1f5addf61ec9a30b54284d056e2
Diff Diff
Configs CompilationMode:wasm, RunKind:blazor_scenarios

Regressions in SOD - Pizza App - Publish - AOT

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
2.37 KB 2.33 KB 0.98 0.00 True
7.59 KB 7.85 KB 1.03 0.00 True
18.27 KB 18.77 KB 1.03 0.00 True
8.52 KB 8.80 KB 1.03 0.00 True
37.77 KB 38.27 KB 1.01 0.00 True
2.79 KB 2.82 KB 1.01 0.00 True
6.85 KB 6.96 KB 1.02 0.00 True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'SOD - Pizza App - Publish - AOT*'
### Payloads [Baseline]() [Compare]() ### SOD - Pizza App - Publish - AOT #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small. ``` #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name Value
Architecture x64
OS ubuntu 18.04
Queue TigerUbuntu
Baseline a2ce8773521a111154e30ab0abe292d9f38d13e6
Compare 3a88b89b025bd1f5addf61ec9a30b54284d056e2
Diff Diff
Configs CompilationMode:wasm, RunKind:blazor_scenarios

Regressions in SOD - Minimum Blazor Template - Publish - AOT

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
2.37 KB 2.33 KB 0.98 0.00 True
5.82 KB 6.16 KB 1.06 0.00 True
49.92 KB 50.54 KB 1.01 0.00 True
37.27 KB 37.77 KB 1.01 0.00 True
6.50 KB 6.82 KB 1.05 0.00 True
58.72 KB 59.36 KB 1.01 0.00 True
13.77 KB 14.77 KB 1.07 0.00 True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'SOD - Minimum Blazor Template - Publish - AOT*'
### Payloads [Baseline](<>) [Compare](<>) ### SOD - Minimum Blazor Template - Publish - AOT #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small. ``` #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)