dotnet / perf-autofiling-issues

A landing place for auto-filed performance issues before they receive triage
MIT License
9 stars 4 forks source link

[Perf] Linux/x64: 7 Regressions on 2/7/2023 5:16:10 PM #12701

Closed performanceautofiler[bot] closed 1 year ago

performanceautofiler[bot] commented 1 year ago

Run Information

Architecture x64
OS ubuntu 18.04
Baseline f8daacff9d5ac3cad277fba8a97aefe72865ae45
Compare b39d6a6eb44860746e91e5ce4f585beff33d1f63
Diff Diff

Regressions in SOD - Minimum Blazor Template - Publish

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[SOD - Minimum Blazor Template - Publish - pub/wwwroot/_framework/System.Net.Primitives.dll.br](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Minimum%20Blazor%20Template%20-%20Publish.html>) 2.41 KB 2.35 KB 0.98 0.00 True

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'SOD - Minimum Blazor Template - Publish*'
### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### SOD - Minimum Blazor Template - Publish ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 1% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small. IsRegressionBase: Marked as not a regression because the compare was not 1% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline f8daacff9d5ac3cad277fba8a97aefe72865ae45
Compare b39d6a6eb44860746e91e5ce4f585beff33d1f63
Diff Diff

Improvements in SOD - New Blazor Template - Publish

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[SOD - New Blazor Template - Publish - pub/wwwroot/_framework/dotnet.timezones.blat.gz](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish.html>) 74.19 KB 70.18 KB 0.95 0.00 True
[SOD - New Blazor Template - Publish - pub/wwwroot/_framework/System.Net.Primitives.dll.br](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish.html>) 2.41 KB 2.35 KB 0.98 0.00 True

graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'SOD - New Blazor Template - Publish*'
### Payloads [Baseline]() [Compare]() ### Histogram #### SOD - New Blazor Template - Publish ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 1% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small. IsRegressionBase: Marked as not a regression because the compare was not 1% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline f8daacff9d5ac3cad277fba8a97aefe72865ae45
Compare b39d6a6eb44860746e91e5ce4f585beff33d1f63
Diff Diff

Improvements in SOD - New Blazor Template - Publish - AOT

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[SOD - New Blazor Template - Publish - AOT - pub/wwwroot/_framework/dotnet.wasm.br](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish%20-%20AOT.html>) 2.26 MB 2.22 MB 0.98 0.00 True
[SOD - New Blazor Template - Publish - AOT - pub/wwwroot/_framework/dotnet.timezones.blat.gz](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish%20-%20AOT.html>) 74.19 KB 70.18 KB 0.95 0.00 True
[SOD - New Blazor Template - Publish - AOT - pub/wwwroot/_framework/System.Net.Primitives.dll.br](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish%20-%20AOT.html>) 2.41 KB 2.35 KB 0.98 0.00 True

graph graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'SOD - New Blazor Template - Publish - AOT*'
### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### SOD - New Blazor Template - Publish - AOT ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 1% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small. IsRegressionBase: Marked as not a regression because the compare was not 1% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline f8daacff9d5ac3cad277fba8a97aefe72865ae45
Compare b39d6a6eb44860746e91e5ce4f585beff33d1f63
Diff Diff

Regressions in SOD - Minimum Blazor Template - Publish - AOT

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[SOD - Minimum Blazor Template - Publish - AOT - pub/wwwroot/_framework/System.Net.Primitives.dll.br](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Minimum%20Blazor%20Template%20-%20Publish%20-%20AOT.html>) 2.41 KB 2.35 KB 0.98 0.00 True

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'SOD - Minimum Blazor Template - Publish - AOT*'
### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### SOD - Minimum Blazor Template - Publish - AOT ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 1% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small. IsRegressionBase: Marked as not a regression because the compare was not 1% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
radekdoulik commented 1 year ago

Noise