search

dotnet / perf-autofiling-issues

A landing place for auto-filed performance issues before they receive triage
MIT License
9 stars 4 forks source link

[Perf] Linux/x64: 31 Regressions on 7/27/2023 7:42:54 AM #20011

Open performanceautofiler[bot] opened 1 year ago

performanceautofiler[bot] commented 1 year ago

Run Information

Name Value
Architecture x64
OS ubuntu 18.04
Queue TigerUbuntu
Baseline 3a88b89b025bd1f5addf61ec9a30b54284d056e2
Compare 08acbb7ad7154e9d18227e4b00e4c9f41af1fffa
Diff Diff
Configs CompilationMode:wasm, RunKind:blazor_scenarios

Regressions in SOD - Pizza App - Publish

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
5.53 KB 5.47 KB 0.99 0.00 True
10.67 KB 10.84 KB 1.02 0.00 True
33.20 KB 33.71 KB 1.02 0.00 True
1.84 KB 1.87 KB 1.01 0.00 True
9.50 KB 9.66 KB 1.02 0.00 True
1.43 KB 1.48 KB 1.03 0.00 True
7.47 KB 7.55 KB 1.01 0.00 True

graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'SOD - Pizza App - Publish*'
### Payloads [Baseline]() [Compare]() ### SOD - Pizza App - Publish #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small. ``` #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name Value
Architecture x64
OS ubuntu 18.04
Queue TigerUbuntu
Baseline 3a88b89b025bd1f5addf61ec9a30b54284d056e2
Compare 08acbb7ad7154e9d18227e4b00e4c9f41af1fffa
Diff Diff
Configs CompilationMode:wasm, RunKind:blazor_scenarios

Regressions in SOD - Pizza App - Publish - AOT

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
5.53 KB 5.47 KB 0.99 0.00 True
10.67 KB 10.84 KB 1.02 0.00 True
9.50 KB 9.66 KB 1.02 0.00 True
1.84 KB 1.87 KB 1.01 0.00 True
1.43 KB 1.48 KB 1.03 0.00 True
33.20 KB 33.71 KB 1.02 0.00 True
7.47 KB 7.55 KB 1.01 0.00 True

graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'SOD - Pizza App - Publish - AOT*'
### Payloads [Baseline]() [Compare]() ### SOD - Pizza App - Publish - AOT #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small. ``` #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name Value
Architecture x64
OS ubuntu 18.04
Queue TigerUbuntu
Baseline 3a88b89b025bd1f5addf61ec9a30b54284d056e2
Compare 08acbb7ad7154e9d18227e4b00e4c9f41af1fffa
Diff Diff
Configs CompilationMode:wasm, RunKind:blazor_scenarios

Regressions in SOD - Minimum Blazor Template - Publish

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
56.38 KB 55.50 KB 0.98 0.00 True
10.67 KB 10.84 KB 1.02 0.00 True
9.50 KB 9.66 KB 1.02 0.00 True
33.20 KB 33.71 KB 1.02 0.00 True

graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'SOD - Minimum Blazor Template - Publish*'
### Payloads [Baseline](<>) [Compare](<>) ### SOD - Minimum Blazor Template - Publish #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small. ``` #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name Value
Architecture x64
OS ubuntu 18.04
Queue TigerUbuntu
Baseline 3a88b89b025bd1f5addf61ec9a30b54284d056e2
Compare 08acbb7ad7154e9d18227e4b00e4c9f41af1fffa
Diff Diff
Configs CompilationMode:wasm, RunKind:blazor_scenarios

Regressions in SOD - Minimum Blazor Template - Publish - AOT

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
56.38 KB 55.50 KB 0.98 0.00 True
10.67 KB 10.84 KB 1.02 0.00 True
9.50 KB 9.66 KB 1.02 0.00 True
33.20 KB 33.71 KB 1.02 0.00 True

graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'SOD - Minimum Blazor Template - Publish - AOT*'
### Payloads [Baseline](<>) [Compare](<>) ### SOD - Minimum Blazor Template - Publish - AOT #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small. ``` #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name Value
Architecture x64
OS ubuntu 18.04
Queue TigerUbuntu
Baseline 3a88b89b025bd1f5addf61ec9a30b54284d056e2
Compare 08acbb7ad7154e9d18227e4b00e4c9f41af1fffa
Diff Diff
Configs CompilationMode:wasm, RunKind:blazor_scenarios

Regressions in SOD - New Blazor Template - Publish - AOT

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
56.38 KB 55.50 KB 0.98 0.00 True
9.50 KB 9.66 KB 1.02 0.00 True
33.20 KB 33.71 KB 1.02 0.00 True
10.67 KB 10.84 KB 1.02 0.00 True

graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'SOD - New Blazor Template - Publish - AOT*'
### Payloads [Baseline](<>) [Compare](<>) ### SOD - New Blazor Template - Publish - AOT #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small. ``` #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 1 year ago

Run Information

Name Value
Architecture x64
OS ubuntu 18.04
Queue TigerUbuntu
Baseline 3a88b89b025bd1f5addf61ec9a30b54284d056e2
Compare 08acbb7ad7154e9d18227e4b00e4c9f41af1fffa
Diff Diff
Configs CompilationMode:wasm, RunKind:blazor_scenarios

Regressions in SOD - New Blazor Template - Publish

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
1.95 KB 1.92 KB 0.99 0.00 True
56.38 KB 55.50 KB 0.98 0.00 True
10.67 KB 10.84 KB 1.02 0.00 True
9.50 KB 9.66 KB 1.02 0.00 True
33.20 KB 33.71 KB 1.02 0.00 True

graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'SOD - New Blazor Template - Publish*'
### Payloads [Baseline]() [Compare]() ### SOD - New Blazor Template - Publish #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small. ``` #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)