search

dotnet / perf-autofiling-issues

A landing place for auto-filed performance issues before they receive triage
MIT License
9 stars 4 forks source link

[Perf] Linux/x64: 36 Regressions on 3/7/2023 11:57:19 AM #13649

Open performanceautofiler[bot] opened 1 year ago

performanceautofiler[bot] commented 1 year ago

Run Information

Architecture x64
OS ubuntu 18.04
Baseline a64420c79cb63c485138f4f1352b8730f27d7b19
Compare 2d5a9162f6bd9583981d54363d077a04e4efc868
Diff Diff

Regressions in SOD - Pizza App - Publish

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[SOD - Pizza App - Publish - pub/wwwroot/_framework/blazor.webassembly.js](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish.html>) 59.93 KB 59.01 KB 0.98 0.00 True
[SOD - Pizza App - Publish - pub/wwwroot/_framework/System.Net.Primitives.dll.br](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish.html>) 2.41 KB 2.31 KB 0.96 0.00 True
[SOD - Pizza App - Publish - pub/wwwroot/_framework/Microsoft.JSInterop.WebAssembly.dll](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish.html>) 8.50 KB 8.00 KB 0.94 0.00 True
[SOD - Pizza App - Publish - pub/wwwroot/_framework/Microsoft.JSInterop.WebAssembly.dll.gz](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish.html>) 3.77 KB 3.68 KB 0.98 0.00 True
[SOD - Pizza App - Publish - pub/wwwroot/_framework/System.Runtime.dll.br](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish.html>) 1.88 KB 1.86 KB 0.99 0.00 True
[SOD - Pizza App - Publish - pub/wwwroot/_framework/Microsoft.JSInterop.WebAssembly.dll.br](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish.html>) 3.37 KB 3.27 KB 0.97 0.00 True
[SOD - Pizza App - Publish - pub/wwwroot/_framework/Microsoft.AspNetCore.Metadata.dll.br](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish.html>) 1.49 KB 1.51 KB 1.02 0.00 True
[SOD - Pizza App - Publish - pub/wwwroot/_framework/Microsoft.AspNetCore.Components.WebAssembly.dll](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish.html>) 48.00 KB 55.50 KB 1.16 0.00 True
[SOD - Pizza App - Publish - pub/wwwroot/_framework/Microsoft.AspNetCore.Components.WebAssembly.dll.gz](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish.html>) 21.41 KB 23.32 KB 1.09 0.00 True
[SOD - Pizza App - Publish - pub/wwwroot/_framework/Microsoft.JSInterop.dll](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish.html>) 37.00 KB 37.50 KB 1.01 0.00 True
[SOD - Pizza App - Publish - pub/wwwroot/_framework/Microsoft.Extensions.DependencyInjection.Abstractions.dll.br](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish.html>) 7.03 KB 7.11 KB 1.01 0.00 True
[SOD - Pizza App - Publish - pub/wwwroot/_framework/Microsoft.AspNetCore.Components.WebAssembly.dll.br](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish.html>) 18.88 KB 20.53 KB 1.09 0.00 True
[SOD - Pizza App - Publish - pub/wwwroot/_framework/System.Runtime.InteropServices.JavaScript.dll.br](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish.html>) 14.08 KB 14.32 KB 1.02 0.00 True
[SOD - Pizza App - Publish - pub/wwwroot/_framework/Microsoft.JSInterop.dll.gz](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish.html>) 16.39 KB 16.76 KB 1.02 0.00 True
[SOD - Pizza App - Publish - pub/wwwroot/_framework/Microsoft.JSInterop.dll.br](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish.html>) 14.63 KB 14.85 KB 1.01 0.00 True
[SOD - Pizza App - Publish - pub/wwwroot/_framework/System.Runtime.InteropServices.JavaScript.dll](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish.html>) 37.00 KB 37.50 KB 1.01 0.00 True
[SOD - Pizza App - Publish - pub/wwwroot/_framework/System.Runtime.InteropServices.JavaScript.dll.gz](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish.html>) 16.25 KB 16.44 KB 1.01 0.00 True
[SOD - Pizza App - Publish - pub/wwwroot/_framework/Microsoft.Extensions.Configuration.Json.dll.br](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish.html>) 3.08 KB 3.12 KB 1.01 0.00 True

graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'SOD - Pizza App - Publish*'
### Payloads [Baseline]() [Compare]() ### Histogram #### SOD - Pizza App - Publish ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline a64420c79cb63c485138f4f1352b8730f27d7b19
Compare 2d5a9162f6bd9583981d54363d077a04e4efc868
Diff Diff

Regressions in SOD - Pizza App - Publish - AOT

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[SOD - Pizza App - Publish - AOT - pub/wwwroot/_framework/Microsoft.JSInterop.WebAssembly.dll.br](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish%20-%20AOT.html>) 3.37 KB 3.27 KB 0.97 0.00 True
[SOD - Pizza App - Publish - AOT - pub/wwwroot/_framework/Microsoft.JSInterop.WebAssembly.dll](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish%20-%20AOT.html>) 8.50 KB 8.00 KB 0.94 0.00 True
[SOD - Pizza App - Publish - AOT - pub/wwwroot/_framework/System.Runtime.dll.br](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish%20-%20AOT.html>) 1.88 KB 1.86 KB 0.99 0.00 True
[SOD - Pizza App - Publish - AOT - pub/wwwroot/_framework/System.Net.Primitives.dll.br](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish%20-%20AOT.html>) 2.41 KB 2.31 KB 0.96 0.00 True
[SOD - Pizza App - Publish - AOT - pub/wwwroot/_framework/blazor.webassembly.js](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish%20-%20AOT.html>) 59.93 KB 59.01 KB 0.98 0.00 True
[SOD - Pizza App - Publish - AOT - pub/wwwroot/_framework/Microsoft.JSInterop.WebAssembly.dll.gz](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish%20-%20AOT.html>) 3.77 KB 3.68 KB 0.98 0.00 True
[SOD - Pizza App - Publish - AOT - pub/wwwroot/_framework/System.Runtime.InteropServices.JavaScript.dll](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish%20-%20AOT.html>) 37.00 KB 37.50 KB 1.01 0.00 True
[SOD - Pizza App - Publish - AOT - pub/wwwroot/_framework/Microsoft.JSInterop.dll](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish%20-%20AOT.html>) 37.00 KB 37.50 KB 1.01 0.00 True
[SOD - Pizza App - Publish - AOT - pub/wwwroot/_framework/Microsoft.JSInterop.dll.gz](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish%20-%20AOT.html>) 16.39 KB 16.76 KB 1.02 0.00 True
[SOD - Pizza App - Publish - AOT - pub/wwwroot/_framework/System.Runtime.InteropServices.JavaScript.dll.gz](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish%20-%20AOT.html>) 16.25 KB 16.44 KB 1.01 0.00 True
[SOD - Pizza App - Publish - AOT - pub/wwwroot/_framework/Microsoft.AspNetCore.Components.WebAssembly.dll.gz](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish%20-%20AOT.html>) 21.41 KB 23.32 KB 1.09 0.00 True
[SOD - Pizza App - Publish - AOT - pub/wwwroot/_framework/Microsoft.Extensions.DependencyInjection.Abstractions.dll.br](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish%20-%20AOT.html>) 7.03 KB 7.11 KB 1.01 0.00 True
[SOD - Pizza App - Publish - AOT - pub/wwwroot/_framework/Microsoft.AspNetCore.Metadata.dll.br](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish%20-%20AOT.html>) 1.49 KB 1.51 KB 1.02 0.00 True
[SOD - Pizza App - Publish - AOT - pub/wwwroot/_framework/Microsoft.AspNetCore.Components.WebAssembly.dll.br](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish%20-%20AOT.html>) 18.88 KB 20.53 KB 1.09 0.00 True
[SOD - Pizza App - Publish - AOT - pub/wwwroot/_framework/System.Runtime.InteropServices.JavaScript.dll.br](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish%20-%20AOT.html>) 14.08 KB 14.32 KB 1.02 0.00 True
[SOD - Pizza App - Publish - AOT - pub/wwwroot/_framework/Microsoft.Extensions.Configuration.Json.dll.br](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish%20-%20AOT.html>) 3.08 KB 3.12 KB 1.01 0.00 True
[SOD - Pizza App - Publish - AOT - pub/wwwroot/_framework/Microsoft.AspNetCore.Components.WebAssembly.dll](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish%20-%20AOT.html>) 48.00 KB 55.50 KB 1.16 0.00 True
[SOD - Pizza App - Publish - AOT - pub/wwwroot/_framework/Microsoft.JSInterop.dll.br](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish%20-%20AOT.html>) 14.63 KB 14.85 KB 1.01 0.00 True

graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'SOD - Pizza App - Publish - AOT*'
### Payloads [Baseline]() [Compare]() ### Histogram #### SOD - Pizza App - Publish - AOT ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
radekdoulik commented 1 year ago

mostly noise, plus increase in Microsoft.AspNetCore.Components.WebAssembly.dll. hard to tell from the diff range as the links are wrong (https://github.com/dotnet/performance/issues/2920)