search

dotnet / runtime

.NET is a cross-platform runtime for cloud, mobile, desktop, and IoT apps.
https://docs.microsoft.com/dotnet/core/
MIT License
14.57k stars 4.55k forks source link

[Perf] WASM SoD - 6% regression in dotnet.wasm.br file #57749

Open performanceautofiler[bot] opened 2 years ago

performanceautofiler[bot] commented 2 years ago

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 61075fbe0d25668b4fa98aa80c2d6c004cf70afd
Compare b75e55beb1628df8f704a3014b9acd1b98d4f445
Diff Diff

Regressions in SOD - Pizza App - Publish

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[SOD - Pizza App - Publish - pub/wwwroot/_framework/System.Collections.Concurrent.dll.br](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish.html>) 7.27 KB 7.17 KB 0.99 0.00 True
[SOD - Pizza App - Publish - pub/wwwroot/_framework/dotnet.wasm.gz](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish.html>) 954.30 KB 1015.19 KB 1.06 0.00 True
[SOD - Pizza App - Publish - pub/wwwroot/_framework/dotnet.wasm.br](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish.html>) 781.10 KB 830.17 KB 1.06 0.00 True
[SOD - Pizza App - Publish - pub/wwwroot/_framework/dotnet.wasm](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish.html>) 2.18 MB 2.32 MB 1.06 0.00 True
[SOD - Pizza App - Publish - pub/wwwroot](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish.html>) 18.50 MB 18.75 MB 1.01 0.00 True
[SOD - Pizza App - Publish - pub/wwwroot/_framework/System.Runtime.CompilerServices.Unsafe.dll.br](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish.html>) 1.11 KB 1.12 KB 1.01 0.00 True
[SOD - Pizza App - Publish - Aggregate - .br](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish.html>) 2.83 MB 2.88 MB 1.02 0.00 True
[SOD - Pizza App - Publish - Aggregate - .wasm](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish.html>) 2.18 MB 2.32 MB 1.06 0.00 True
[SOD - Pizza App - Publish - SOD - Pizza App - Publish](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish.html>) 18.50 MB 18.75 MB 1.01 0.00 True
[SOD - Pizza App - Publish - Aggregate - .gz](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish.html>) 3.64 MB 3.70 MB 1.02 0.00 True
[SOD - Pizza App - Publish - pub/wwwroot/_framework/System.Runtime.dll.br](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish.html>) 2.18 KB 2.21 KB 1.01 0.00 True

graph graph graph graph graph graph graph graph graph graph graph Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'SOD - Pizza App - Publish*'
### Payloads [Baseline]() [Compare]() ### Histogram #### SOD - Pizza App - Publish ```log ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 61075fbe0d25668b4fa98aa80c2d6c004cf70afd
Compare b75e55beb1628df8f704a3014b9acd1b98d4f445
Diff Diff

Regressions in SOD - New Blazor Template - Publish

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[SOD - New Blazor Template - Publish - pub/wwwroot/_framework/System.Collections.Concurrent.dll.br](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish.html>) 6.70 KB 6.55 KB 0.98 0.00 True
[SOD - New Blazor Template - Publish - pub/wwwroot/_framework/blazor.webassembly.js](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish.html>) 57.20 KB 58.07 KB 1.02 0.00 True
[SOD - New Blazor Template - Publish - pub/wwwroot/_framework/blazor.webassembly.js.br](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish.html>) 15.96 KB 16.19 KB 1.01 0.00 True
[SOD - New Blazor Template - Publish - pub](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish.html>) 15.47 MB 15.72 MB 1.02 0.00 True
[SOD - New Blazor Template - Publish - pub/wwwroot/_framework/System.Private.Runtime.InteropServices.JavaScript.dll.br](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish.html>) 7.84 KB 7.94 KB 1.01 0.00 True
[SOD - New Blazor Template - Publish - pub/wwwroot/_framework/blazor.webassembly.js.gz](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish.html>) 18.01 KB 18.26 KB 1.01 0.00 True
[SOD - New Blazor Template - Publish - Aggregate - .gz](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish.html>) 3.22 MB 3.28 MB 1.02 0.00 True
[SOD - New Blazor Template - Publish - Synthetic Wire Size - .gz](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish.html>) 3.22 MB 3.28 MB 1.02 0.00 True
[SOD - New Blazor Template - Publish - Aggregate - .wasm](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish.html>) 2.18 MB 2.32 MB 1.06 0.00 True
[SOD - New Blazor Template - Publish - pub/wwwroot/_framework/dotnet.wasm.gz](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish.html>) 954.30 KB 1015.19 KB 1.06 0.00 True
[SOD - New Blazor Template - Publish - pub/wwwroot/_framework/dotnet.wasm](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish.html>) 2.18 MB 2.32 MB 1.06 0.00 True
[SOD - New Blazor Template - Publish - pub/wwwroot/_framework/Microsoft.AspNetCore.Components.WebAssembly.dll.br](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish.html>) 16.52 KB 16.72 KB 1.01 0.00 True
[SOD - New Blazor Template - Publish - Total Uncompressed _framework](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish.html>) 8.97 MB 9.11 MB 1.02 0.00 True
[SOD - New Blazor Template - Publish - pub/wwwroot/_framework/System.Net.Primitives.dll.br](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish.html>) 2.46 KB 2.51 KB 1.02 0.00 True
[SOD - New Blazor Template - Publish - pub/wwwroot/_framework/dotnet.wasm.br](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish.html>) 781.10 KB 830.17 KB 1.06 0.00 True
[SOD - New Blazor Template - Publish - Aggregate - .br](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish.html>) 2.52 MB 2.56 MB 1.02 0.00 True
[SOD - New Blazor Template - Publish - pub/wwwroot/_framework/System.Runtime.CompilerServices.Unsafe.dll.br](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish.html>) 1.11 KB 1.13 KB 1.02 0.00 True
[SOD - New Blazor Template - Publish - SOD - New Blazor Template - Publish](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish.html>) 15.47 MB 15.72 MB 1.02 0.00 True
[SOD - New Blazor Template - Publish - Synthetic Wire Size - .br](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish.html>) 2.52 MB 2.56 MB 1.02 0.00 True

graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'SOD - New Blazor Template - Publish*'
### Payloads [Baseline]() [Compare]() ### Histogram #### SOD - New Blazor Template - Publish ```log ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
dotnet-issue-labeler[bot] commented 2 years ago

I couldn't figure out the best area label to add to this issue. If you have write-permissions please help me learn by adding exactly one area label.

ghost commented 2 years ago

Tagging subscribers to 'arch-wasm': @lewing See info in area-owners.md if you want to be subscribed.

Issue Details
### Run Information Architecture | x64 -- | -- OS | ubuntu 18.04 Baseline | [61075fbe0d25668b4fa98aa80c2d6c004cf70afd](https://github.com/dotnet/runtime/commit/61075fbe0d25668b4fa98aa80c2d6c004cf70afd) Compare | [b75e55beb1628df8f704a3014b9acd1b98d4f445](https://github.com/dotnet/runtime/commit/b75e55beb1628df8f704a3014b9acd1b98d4f445) Diff | [Diff](https://github.com/dotnet/runtime/compare/61075fbe0d25668b4fa98aa80c2d6c004cf70afd...b75e55beb1628df8f704a3014b9acd1b98d4f445) ### Regressions in SOD - Pizza App - Publish Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- [SOD - Pizza App - Publish - pub/wwwroot/_framework/System.Collections.Concurrent.dll.br]() | 7.27 KB | 7.17 KB | 0.99 | 0.00 | True | | | [SOD - Pizza App - Publish - pub/wwwroot/_framework/dotnet.wasm.gz]() | 954.30 KB | 1015.19 KB | 1.06 | 0.00 | True | | | [SOD - Pizza App - Publish - pub/wwwroot/_framework/dotnet.wasm.br]() | 781.10 KB | 830.17 KB | 1.06 | 0.00 | True | | | [SOD - Pizza App - Publish - pub/wwwroot/_framework/dotnet.wasm]() | 2.18 MB | 2.32 MB | 1.06 | 0.00 | True | | | [SOD - Pizza App - Publish - pub/wwwroot]() | 18.50 MB | 18.75 MB | 1.01 | 0.00 | True | | | [SOD - Pizza App - Publish - pub/wwwroot/_framework/System.Runtime.CompilerServices.Unsafe.dll.br]() | 1.11 KB | 1.12 KB | 1.01 | 0.00 | True | | | [SOD - Pizza App - Publish - Aggregate - .br]() | 2.83 MB | 2.88 MB | 1.02 | 0.00 | True | | | [SOD - Pizza App - Publish - Aggregate - .wasm]() | 2.18 MB | 2.32 MB | 1.06 | 0.00 | True | | | [SOD - Pizza App - Publish - SOD - Pizza App - Publish]() | 18.50 MB | 18.75 MB | 1.01 | 0.00 | True | | | [SOD - Pizza App - Publish - Aggregate - .gz]() | 3.64 MB | 3.70 MB | 1.02 | 0.00 | True | | | [SOD - Pizza App - Publish - pub/wwwroot/_framework/System.Runtime.dll.br]() | 2.18 KB | 2.21 KB | 1.01 | 0.00 | True | | | ![graph]() ![graph]() ![graph]() ![graph]() ![graph]() ![graph]() ![graph]() ![graph]() ![graph]() ![graph]() ![graph]() [Historical Data in Reporting System]() ### Repro ```cmd git clone https://github.com/dotnet/performance.git python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'SOD - Pizza App - Publish*' ```
### Payloads [Baseline]() [Compare]() ### Histogram #### SOD - Pizza App - Publish ```log ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
### Run Information Architecture | x64 -- | -- OS | ubuntu 18.04 Baseline | [61075fbe0d25668b4fa98aa80c2d6c004cf70afd](https://github.com/dotnet/runtime/commit/61075fbe0d25668b4fa98aa80c2d6c004cf70afd) Compare | [b75e55beb1628df8f704a3014b9acd1b98d4f445](https://github.com/dotnet/runtime/commit/b75e55beb1628df8f704a3014b9acd1b98d4f445) Diff | [Diff](https://github.com/dotnet/runtime/compare/61075fbe0d25668b4fa98aa80c2d6c004cf70afd...b75e55beb1628df8f704a3014b9acd1b98d4f445) ### Regressions in SOD - New Blazor Template - Publish Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- [SOD - New Blazor Template - Publish - pub/wwwroot/_framework/System.Collections.Concurrent.dll.br]() | 6.70 KB | 6.55 KB | 0.98 | 0.00 | True | | | [SOD - New Blazor Template - Publish - pub/wwwroot/_framework/blazor.webassembly.js]() | 57.20 KB | 58.07 KB | 1.02 | 0.00 | True | | | [SOD - New Blazor Template - Publish - pub/wwwroot/_framework/blazor.webassembly.js.br]() | 15.96 KB | 16.19 KB | 1.01 | 0.00 | True | | | [SOD - New Blazor Template - Publish - pub]() | 15.47 MB | 15.72 MB | 1.02 | 0.00 | True | | | [SOD - New Blazor Template - Publish - pub/wwwroot/_framework/System.Private.Runtime.InteropServices.JavaScript.dll.br]() | 7.84 KB | 7.94 KB | 1.01 | 0.00 | True | | | [SOD - New Blazor Template - Publish - pub/wwwroot/_framework/blazor.webassembly.js.gz]() | 18.01 KB | 18.26 KB | 1.01 | 0.00 | True | | | [SOD - New Blazor Template - Publish - Aggregate - .gz]() | 3.22 MB | 3.28 MB | 1.02 | 0.00 | True | | | [SOD - New Blazor Template - Publish - Synthetic Wire Size - .gz]() | 3.22 MB | 3.28 MB | 1.02 | 0.00 | True | | | [SOD - New Blazor Template - Publish - Aggregate - .wasm]() | 2.18 MB | 2.32 MB | 1.06 | 0.00 | True | | | [SOD - New Blazor Template - Publish - pub/wwwroot/_framework/dotnet.wasm.gz]() | 954.30 KB | 1015.19 KB | 1.06 | 0.00 | True | | | [SOD - New Blazor Template - Publish - pub/wwwroot/_framework/dotnet.wasm]() | 2.18 MB | 2.32 MB | 1.06 | 0.00 | True | | | [SOD - New Blazor Template - Publish - pub/wwwroot/_framework/Microsoft.AspNetCore.Components.WebAssembly.dll.br]() | 16.52 KB | 16.72 KB | 1.01 | 0.00 | True | | | [SOD - New Blazor Template - Publish - Total Uncompressed _framework]() | 8.97 MB | 9.11 MB | 1.02 | 0.00 | True | | | [SOD - New Blazor Template - Publish - pub/wwwroot/_framework/System.Net.Primitives.dll.br]() | 2.46 KB | 2.51 KB | 1.02 | 0.00 | True | | | [SOD - New Blazor Template - Publish - pub/wwwroot/_framework/dotnet.wasm.br]() | 781.10 KB | 830.17 KB | 1.06 | 0.00 | True | | | [SOD - New Blazor Template - Publish - Aggregate - .br]() | 2.52 MB | 2.56 MB | 1.02 | 0.00 | True | | | [SOD - New Blazor Template - Publish - pub/wwwroot/_framework/System.Runtime.CompilerServices.Unsafe.dll.br]() | 1.11 KB | 1.13 KB | 1.02 | 0.00 | True | | | [SOD - New Blazor Template - Publish - SOD - New Blazor Template - Publish]() | 15.47 MB | 15.72 MB | 1.02 | 0.00 | True | | | [SOD - New Blazor Template - Publish - Synthetic Wire Size - .br]() | 2.52 MB | 2.56 MB | 1.02 | 0.00 | True | | | ![graph]() ![graph]() ![graph]() ![graph]() ![graph]() ![graph]() ![graph]() ![graph]() ![graph]() ![graph]() ![graph]() ![graph]() ![graph]() ![graph]() ![graph]() ![graph]() ![graph]() ![graph]() ![graph]() [Historical Data in Reporting System]() ### Repro ```cmd git clone https://github.com/dotnet/performance.git python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'SOD - New Blazor Template - Publish*' ```
### Payloads [Baseline]() [Compare]() ### Histogram #### SOD - New Blazor Template - Publish ```log ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Author: performanceautofiler[bot]
Assignees: lewing
Labels: `arch-wasm`, `tenet-performance`, `untriaged`
Milestone: -
SamMonoRT commented 2 years ago

/ cc @radical

ghost commented 2 years ago

Tagging subscribers to 'size-reduction': @eerhardt, @SamMonoRT, @marek-safar See info in area-owners.md if you want to be subscribed.

Issue Details
### Run Information Architecture | x64 -- | -- OS | ubuntu 18.04 Baseline | [61075fbe0d25668b4fa98aa80c2d6c004cf70afd](https://github.com/dotnet/runtime/commit/61075fbe0d25668b4fa98aa80c2d6c004cf70afd) Compare | [b75e55beb1628df8f704a3014b9acd1b98d4f445](https://github.com/dotnet/runtime/commit/b75e55beb1628df8f704a3014b9acd1b98d4f445) Diff | [Diff](https://github.com/dotnet/runtime/compare/61075fbe0d25668b4fa98aa80c2d6c004cf70afd...b75e55beb1628df8f704a3014b9acd1b98d4f445) ### Regressions in SOD - Pizza App - Publish Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- [SOD - Pizza App - Publish - pub/wwwroot/_framework/System.Collections.Concurrent.dll.br]() | 7.27 KB | 7.17 KB | 0.99 | 0.00 | True | | | [SOD - Pizza App - Publish - pub/wwwroot/_framework/dotnet.wasm.gz]() | 954.30 KB | 1015.19 KB | 1.06 | 0.00 | True | | | [SOD - Pizza App - Publish - pub/wwwroot/_framework/dotnet.wasm.br]() | 781.10 KB | 830.17 KB | 1.06 | 0.00 | True | | | [SOD - Pizza App - Publish - pub/wwwroot/_framework/dotnet.wasm]() | 2.18 MB | 2.32 MB | 1.06 | 0.00 | True | | | [SOD - Pizza App - Publish - pub/wwwroot]() | 18.50 MB | 18.75 MB | 1.01 | 0.00 | True | | | [SOD - Pizza App - Publish - pub/wwwroot/_framework/System.Runtime.CompilerServices.Unsafe.dll.br]() | 1.11 KB | 1.12 KB | 1.01 | 0.00 | True | | | [SOD - Pizza App - Publish - Aggregate - .br]() | 2.83 MB | 2.88 MB | 1.02 | 0.00 | True | | | [SOD - Pizza App - Publish - Aggregate - .wasm]() | 2.18 MB | 2.32 MB | 1.06 | 0.00 | True | | | [SOD - Pizza App - Publish - SOD - Pizza App - Publish]() | 18.50 MB | 18.75 MB | 1.01 | 0.00 | True | | | [SOD - Pizza App - Publish - Aggregate - .gz]() | 3.64 MB | 3.70 MB | 1.02 | 0.00 | True | | | [SOD - Pizza App - Publish - pub/wwwroot/_framework/System.Runtime.dll.br]() | 2.18 KB | 2.21 KB | 1.01 | 0.00 | True | | | ![graph]() ![graph]() ![graph]() ![graph]() ![graph]() ![graph]() ![graph]() ![graph]() ![graph]() ![graph]() ![graph]() [Historical Data in Reporting System]() ### Repro ```cmd git clone https://github.com/dotnet/performance.git python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'SOD - Pizza App - Publish*' ```
### Payloads [Baseline]() [Compare]() ### Histogram #### SOD - Pizza App - Publish ```log ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
### Run Information Architecture | x64 -- | -- OS | ubuntu 18.04 Baseline | [61075fbe0d25668b4fa98aa80c2d6c004cf70afd](https://github.com/dotnet/runtime/commit/61075fbe0d25668b4fa98aa80c2d6c004cf70afd) Compare | [b75e55beb1628df8f704a3014b9acd1b98d4f445](https://github.com/dotnet/runtime/commit/b75e55beb1628df8f704a3014b9acd1b98d4f445) Diff | [Diff](https://github.com/dotnet/runtime/compare/61075fbe0d25668b4fa98aa80c2d6c004cf70afd...b75e55beb1628df8f704a3014b9acd1b98d4f445) ### Regressions in SOD - New Blazor Template - Publish Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- [SOD - New Blazor Template - Publish - pub/wwwroot/_framework/System.Collections.Concurrent.dll.br]() | 6.70 KB | 6.55 KB | 0.98 | 0.00 | True | | | [SOD - New Blazor Template - Publish - pub/wwwroot/_framework/blazor.webassembly.js]() | 57.20 KB | 58.07 KB | 1.02 | 0.00 | True | | | [SOD - New Blazor Template - Publish - pub/wwwroot/_framework/blazor.webassembly.js.br]() | 15.96 KB | 16.19 KB | 1.01 | 0.00 | True | | | [SOD - New Blazor Template - Publish - pub]() | 15.47 MB | 15.72 MB | 1.02 | 0.00 | True | | | [SOD - New Blazor Template - Publish - pub/wwwroot/_framework/System.Private.Runtime.InteropServices.JavaScript.dll.br]() | 7.84 KB | 7.94 KB | 1.01 | 0.00 | True | | | [SOD - New Blazor Template - Publish - pub/wwwroot/_framework/blazor.webassembly.js.gz]() | 18.01 KB | 18.26 KB | 1.01 | 0.00 | True | | | [SOD - New Blazor Template - Publish - Aggregate - .gz]() | 3.22 MB | 3.28 MB | 1.02 | 0.00 | True | | | [SOD - New Blazor Template - Publish - Synthetic Wire Size - .gz]() | 3.22 MB | 3.28 MB | 1.02 | 0.00 | True | | | [SOD - New Blazor Template - Publish - Aggregate - .wasm]() | 2.18 MB | 2.32 MB | 1.06 | 0.00 | True | | | [SOD - New Blazor Template - Publish - pub/wwwroot/_framework/dotnet.wasm.gz]() | 954.30 KB | 1015.19 KB | 1.06 | 0.00 | True | | | [SOD - New Blazor Template - Publish - pub/wwwroot/_framework/dotnet.wasm]() | 2.18 MB | 2.32 MB | 1.06 | 0.00 | True | | | [SOD - New Blazor Template - Publish - pub/wwwroot/_framework/Microsoft.AspNetCore.Components.WebAssembly.dll.br]() | 16.52 KB | 16.72 KB | 1.01 | 0.00 | True | | | [SOD - New Blazor Template - Publish - Total Uncompressed _framework]() | 8.97 MB | 9.11 MB | 1.02 | 0.00 | True | | | [SOD - New Blazor Template - Publish - pub/wwwroot/_framework/System.Net.Primitives.dll.br]() | 2.46 KB | 2.51 KB | 1.02 | 0.00 | True | | | [SOD - New Blazor Template - Publish - pub/wwwroot/_framework/dotnet.wasm.br]() | 781.10 KB | 830.17 KB | 1.06 | 0.00 | True | | | [SOD - New Blazor Template - Publish - Aggregate - .br]() | 2.52 MB | 2.56 MB | 1.02 | 0.00 | True | | | [SOD - New Blazor Template - Publish - pub/wwwroot/_framework/System.Runtime.CompilerServices.Unsafe.dll.br]() | 1.11 KB | 1.13 KB | 1.02 | 0.00 | True | | | [SOD - New Blazor Template - Publish - SOD - New Blazor Template - Publish]() | 15.47 MB | 15.72 MB | 1.02 | 0.00 | True | | | [SOD - New Blazor Template - Publish - Synthetic Wire Size - .br]() | 2.52 MB | 2.56 MB | 1.02 | 0.00 | True | | | ![graph]() ![graph]() ![graph]() ![graph]() ![graph]() ![graph]() ![graph]() ![graph]() ![graph]() ![graph]() ![graph]() ![graph]() ![graph]() ![graph]() ![graph]() ![graph]() ![graph]() ![graph]() ![graph]() [Historical Data in Reporting System]() ### Repro ```cmd git clone https://github.com/dotnet/performance.git python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'SOD - New Blazor Template - Publish*' ```
### Payloads [Baseline]() [Compare]() ### Histogram #### SOD - New Blazor Template - Publish ```log ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Author: performanceautofiler[bot]
Assignees: lewing
Labels: `arch-wasm`, `tenet-performance`, `area-Codegen-AOT-mono`, `size-reduction`
Milestone: 6.0.0
SamMonoRT commented 2 years ago

cc @tarekgh - seems like your change https://github.com/dotnet/runtime/pull/57078 is in the diff range for when the size regression was observed.
@radical is looking into this other PR https://github.com/dotnet/runtime/pull/57113 ruling out any build issue.

tarekgh commented 2 years ago

My change is just depending on a couple of ICU APIs which we didn't use before. I am not sure why using such ICU APIs cause that big regression. @lewing can we get more info about that. The new ICU APIs I used shouldn't be that big to cause such regression.

lewing commented 2 years ago

@tarekgh referencing new symbols tends to pull in a surprising amount of new code. What sort of information would be helpful?

tarekgh commented 2 years ago

Talked offline with @lewing and will wait his reply about the size increase investigation to decide about the next step here.