search

dotnet / perf-autofiling-issues

A landing place for auto-filed performance issues before they receive triage
MIT License
9 stars 4 forks source link

[Perf] Linux/x64: 72 Regressions on 6/9/2023 9:39:04 AM #18648

Open performanceautofiler[bot] opened 1 year ago

performanceautofiler[bot] commented 1 year ago

Run Information

Name Value
Architecture x64
OS ubuntu 18.04
Queue TigerUbuntu
Baseline 53af66a48215f0b7833dce499343eccae1dc9dff
Compare 0eb712188042ed065ee1e57aa35dbf468f32ed0d
Diff Diff
Configs CompilationMode:wasm, RunKind:blazor_scenarios

Regressions in SOD - Pizza App - Publish

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[SOD - Pizza App - Publish - Aggregate - .wasm - Count](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish.html>) 1.00 count 49.00 count 49.00 0.00 True
[SOD - Pizza App - Publish - pub/wwwroot](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish.html>) 12.96 MB 20.65 MB 1.59 0.00 True
[SOD - Pizza App - Publish - Aggregate - .js - Count](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish.html>) 12.00 count 14.00 count 1.17 0.00 True
[SOD - Pizza App - Publish - Aggregate - .wasm](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish.html>) 2.75 MB 6.07 MB 2.21 0.00 True
[SOD - Pizza App - Publish - Aggregate - .json](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish.html>) 5.96 KB 6.36 KB 1.07 0.00 True
[SOD - Pizza App - Publish - SOD - Pizza App - Publish - Count](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish.html>) 106.00 count 230.00 count 2.17 0.00 True
[SOD - Pizza App - Publish - SOD - Pizza App - Publish](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish.html>) 12.96 MB 20.65 MB 1.59 0.00 True
[SOD - Pizza App - Publish - pub/wwwroot/_framework/blazor.boot.json](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish.html>) 5.66 KB 6.06 KB 1.07 0.00 True
[SOD - Pizza App - Publish - Aggregate - .js](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish.html>) 656.32 KB 1011.62 KB 1.54 0.00 True
[SOD - Pizza App - Publish - pub/wwwroot - Count](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish.html>) 106.00 count 230.00 count 2.17 0.00 True

graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'SOD - Pizza App - Publish*'
### Payloads [Baseline]() [Compare]() ### Histogram #### SOD - Pizza App - Publish ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 1% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 1% less than the baseline, or the value was too small. ``` ### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name Value
Architecture x64
OS ubuntu 18.04
Queue TigerUbuntu
Baseline 53af66a48215f0b7833dce499343eccae1dc9dff
Compare 0eb712188042ed065ee1e57aa35dbf468f32ed0d
Diff Diff
Configs CompilationMode:wasm, RunKind:blazor_scenarios

Regressions in SOD - New Blazor Template - Publish - AOT

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[SOD - New Blazor Template - Publish - AOT - Total Uncompressed _framework](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish%20-%20AOT.html>) 9.88 MB 17.26 MB 1.75 0.00 True
[SOD - New Blazor Template - Publish - AOT - SOD - New Blazor Template - Publish - AOT](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish%20-%20AOT.html>) 10.64 MB 31.39 MB 2.95 0.00 True
[SOD - New Blazor Template - Publish - AOT - Aggregate - .wasm - Count](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish%20-%20AOT.html>) 1.00 count 31.00 count 31.00 0.00 True
[SOD - New Blazor Template - Publish - AOT - Aggregate - .js - Count](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish%20-%20AOT.html>) 2.00 count 4.00 count 2.00 0.00 True
[SOD - New Blazor Template - Publish - AOT - pub/wwwroot/_framework/dotnet.native.wasm](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish%20-%20AOT.html>) 2.75 MB 9.80 MB 3.57 0.00 True
[SOD - New Blazor Template - Publish - AOT - pub - Count](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish%20-%20AOT.html>) 56.00 count 140.00 count 2.50 0.00 True
[SOD - New Blazor Template - Publish - AOT - Aggregate - .js](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish%20-%20AOT.html>) 85.06 KB 424.66 KB 4.99 0.00 True
[SOD - New Blazor Template - Publish - AOT - pub](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish%20-%20AOT.html>) 10.64 MB 31.39 MB 2.95 0.00 True
[SOD - New Blazor Template - Publish - AOT - SOD - New Blazor Template - Publish - AOT - Count](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish%20-%20AOT.html>) 56.00 count 140.00 count 2.50 0.00 True
[SOD - New Blazor Template - Publish - AOT - pub/wwwroot/_framework/blazor.boot.json](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish%20-%20AOT.html>) 3.84 KB 4.21 KB 1.10 0.00 True
[SOD - New Blazor Template - Publish - AOT - Aggregate - .wasm](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish%20-%20AOT.html>) 2.75 MB 14.86 MB 5.41 0.00 True
[SOD - New Blazor Template - Publish - AOT - Total Uncompressed _framework - Count](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish%20-%20AOT.html>) 38.00 count 40.00 count 1.05 0.00 True
[SOD - New Blazor Template - Publish - AOT - Aggregate - .json](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish%20-%20AOT.html>) 4.28 KB 4.66 KB 1.09 0.00 True

graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'SOD - New Blazor Template - Publish - AOT*'
### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### SOD - New Blazor Template - Publish - AOT ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 1% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 1% less than the baseline, or the value was too small. ``` ### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 1 year ago

Run Information

Name Value
Architecture x64
OS ubuntu 18.04
Queue TigerUbuntu
Baseline 53af66a48215f0b7833dce499343eccae1dc9dff
Compare 0eb712188042ed065ee1e57aa35dbf468f32ed0d
Diff Diff
Configs CompilationMode:wasm, RunKind:blazor_scenarios

Regressions in SOD - Minimum Blazor Template - Publish - AOT

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[SOD - Minimum Blazor Template - Publish - AOT - pub](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Minimum%20Blazor%20Template%20-%20Publish%20-%20AOT.html>) 5.86 MB 21.51 MB 3.67 0.00 True
[SOD - Minimum Blazor Template - Publish - AOT - Total Uncompressed _framework](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Minimum%20Blazor%20Template%20-%20Publish%20-%20AOT.html>) 5.10 MB 11.07 MB 2.17 0.00 True
[SOD - Minimum Blazor Template - Publish - AOT - pub - Count](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Minimum%20Blazor%20Template%20-%20Publish%20-%20AOT.html>) 51.00 count 125.00 count 2.45 0.00 True
[SOD - Minimum Blazor Template - Publish - AOT - Aggregate - .js - Count](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Minimum%20Blazor%20Template%20-%20Publish%20-%20AOT.html>) 2.00 count 4.00 count 2.00 0.00 True
[SOD - Minimum Blazor Template - Publish - AOT - pub/wwwroot/_framework/dotnet.native.wasm](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Minimum%20Blazor%20Template%20-%20Publish%20-%20AOT.html>) 2.75 MB 8.38 MB 3.05 0.00 True
[SOD - Minimum Blazor Template - Publish - AOT - Total Uncompressed _framework - Count](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Minimum%20Blazor%20Template%20-%20Publish%20-%20AOT.html>) 33.00 count 35.00 count 1.06 0.00 True
[SOD - Minimum Blazor Template - Publish - AOT - pub/wwwroot/_framework/blazor.boot.json](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Minimum%20Blazor%20Template%20-%20Publish%20-%20AOT.html>) 3.45 KB 3.82 KB 1.11 0.00 True
[SOD - Minimum Blazor Template - Publish - AOT - Aggregate - .wasm - Count](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Minimum%20Blazor%20Template%20-%20Publish%20-%20AOT.html>) 1.00 count 31.00 count 31.00 0.00 True
[SOD - Minimum Blazor Template - Publish - AOT - Aggregate - .json](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Minimum%20Blazor%20Template%20-%20Publish%20-%20AOT.html>) 3.89 KB 4.27 KB 1.10 0.00 True
[SOD - Minimum Blazor Template - Publish - AOT - Aggregate - .wasm](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Minimum%20Blazor%20Template%20-%20Publish%20-%20AOT.html>) 2.75 MB 13.39 MB 4.88 0.00 True
[SOD - Minimum Blazor Template - Publish - AOT - Aggregate - .js](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Minimum%20Blazor%20Template%20-%20Publish%20-%20AOT.html>) 85.06 KB 424.46 KB 4.99 0.00 True
[SOD - Minimum Blazor Template - Publish - AOT - SOD - Minimum Blazor Template - Publish - AOT - Count](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Minimum%20Blazor%20Template%20-%20Publish%20-%20AOT.html>) 51.00 count 125.00 count 2.45 0.00 True
[SOD - Minimum Blazor Template - Publish - AOT - SOD - Minimum Blazor Template - Publish - AOT](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Minimum%20Blazor%20Template%20-%20Publish%20-%20AOT.html>) 5.86 MB 21.51 MB 3.67 0.00 True

graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'SOD - Minimum Blazor Template - Publish - AOT*'
### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### SOD - Minimum Blazor Template - Publish - AOT ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 1% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 1% less than the baseline, or the value was too small. ``` ### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name Value
Architecture x64
OS ubuntu 18.04
Queue TigerUbuntu
Baseline 53af66a48215f0b7833dce499343eccae1dc9dff
Compare 0eb712188042ed065ee1e57aa35dbf468f32ed0d
Diff Diff
Configs CompilationMode:wasm, RunKind:blazor_scenarios

Regressions in SOD - New Blazor Template - Publish

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[SOD - New Blazor Template - Publish - Aggregate - .js - Count](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish.html>) 2.00 count 4.00 count 2.00 0.00 True
[SOD - New Blazor Template - Publish - Aggregate - .json](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish.html>) 4.28 KB 4.66 KB 1.09 0.00 True
[SOD - New Blazor Template - Publish - Aggregate - .wasm](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish.html>) 2.75 MB 7.81 MB 2.85 0.00 True
[SOD - New Blazor Template - Publish - pub](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish.html>) 10.64 MB 20.31 MB 1.91 0.00 True
[SOD - New Blazor Template - Publish - Aggregate - .wasm - Count](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish.html>) 1.00 count 31.00 count 31.00 0.00 True
[SOD - New Blazor Template - Publish - Aggregate - .js](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish.html>) 85.06 KB 440.36 KB 5.18 0.00 True
[SOD - New Blazor Template - Publish - Total Uncompressed _framework](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish.html>) 9.89 MB 10.23 MB 1.03 0.00 True
[SOD - New Blazor Template - Publish - SOD - New Blazor Template - Publish - Count](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish.html>) 56.00 count 140.00 count 2.50 0.00 True
[SOD - New Blazor Template - Publish - SOD - New Blazor Template - Publish](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish.html>) 10.64 MB 20.31 MB 1.91 0.00 True
[SOD - New Blazor Template - Publish - Total Uncompressed _framework - Count](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish.html>) 38.00 count 40.00 count 1.05 0.00 True
[SOD - New Blazor Template - Publish - pub/wwwroot/_framework/blazor.boot.json](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish.html>) 3.84 KB 4.21 KB 1.10 0.00 True
[SOD - New Blazor Template - Publish - pub - Count](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20New%20Blazor%20Template%20-%20Publish.html>) 56.00 count 140.00 count 2.50 0.00 True

graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'SOD - New Blazor Template - Publish*'
### Payloads [Baseline]() [Compare]() ### Histogram #### SOD - New Blazor Template - Publish ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 1% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 1% less than the baseline, or the value was too small. ``` ### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 1 year ago

Run Information

Name Value
Architecture x64
OS ubuntu 18.04
Queue TigerUbuntu
Baseline 53af66a48215f0b7833dce499343eccae1dc9dff
Compare 0eb712188042ed065ee1e57aa35dbf468f32ed0d
Diff Diff
Configs CompilationMode:wasm, RunKind:blazor_scenarios

Regressions in SOD - Pizza App - Publish - AOT

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[SOD - Pizza App - Publish - AOT - Aggregate - .json](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish%20-%20AOT.html>) 5.96 KB 6.36 KB 1.07 0.00 True
[SOD - Pizza App - Publish - AOT - Aggregate - .wasm - Count](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish%20-%20AOT.html>) 1.00 count 49.00 count 49.00 0.00 True
[SOD - Pizza App - Publish - AOT - Aggregate - .js](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish%20-%20AOT.html>) 656.32 KB 1002.08 KB 1.53 0.00 True
[SOD - Pizza App - Publish - AOT - SOD - Pizza App - Publish - AOT - Count](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish%20-%20AOT.html>) 106.00 count 230.00 count 2.17 0.00 True
[SOD - Pizza App - Publish - AOT - pub/wwwroot - Count](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish%20-%20AOT.html>) 106.00 count 230.00 count 2.17 0.00 True
[SOD - Pizza App - Publish - AOT - SOD - Pizza App - Publish - AOT](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish%20-%20AOT.html>) 12.95 MB 38.21 MB 2.95 0.00 True
[SOD - Pizza App - Publish - AOT - pub/wwwroot/_framework/dotnet.native.wasm](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish%20-%20AOT.html>) 2.75 MB 14.12 MB 5.14 0.00 True
[SOD - Pizza App - Publish - AOT - pub/wwwroot/_framework/blazor.boot.json](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish%20-%20AOT.html>) 5.66 KB 6.07 KB 1.07 0.00 True
[SOD - Pizza App - Publish - AOT - pub/wwwroot](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish%20-%20AOT.html>) 12.95 MB 38.21 MB 2.95 0.00 True
[SOD - Pizza App - Publish - AOT - Aggregate - .js - Count](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish%20-%20AOT.html>) 12.00 count 14.00 count 1.17 0.00 True
[SOD - Pizza App - Publish - AOT - Aggregate - .wasm](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish%20-%20AOT.html>) 2.75 MB 17.44 MB 6.35 0.00 True

graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'SOD - Pizza App - Publish - AOT*'
### Payloads [Baseline]() [Compare]() ### Histogram #### SOD - Pizza App - Publish - AOT ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 1% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 1% less than the baseline, or the value was too small. ``` ### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name Value
Architecture x64
OS ubuntu 18.04
Queue TigerUbuntu
Baseline 53af66a48215f0b7833dce499343eccae1dc9dff
Compare 0eb712188042ed065ee1e57aa35dbf468f32ed0d
Diff Diff
Configs CompilationMode:wasm, RunKind:blazor_scenarios

Regressions in SOD - Minimum Blazor Template - Publish

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[SOD - Minimum Blazor Template - Publish - Total Uncompressed _framework](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Minimum%20Blazor%20Template%20-%20Publish.html>) 5.11 MB 3.97 MB 0.78 0.00 True
[SOD - Minimum Blazor Template - Publish - pub/wwwroot/_framework/dotnet.native.wasm](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Minimum%20Blazor%20Template%20-%20Publish.html>) 2.75 MB 1.29 MB 0.47 0.00 True
[SOD - Minimum Blazor Template - Publish - Aggregate - .json](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Minimum%20Blazor%20Template%20-%20Publish.html>) 3.89 KB 4.27 KB 1.10 0.00 True
[SOD - Minimum Blazor Template - Publish - Total Uncompressed _framework - Count](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Minimum%20Blazor%20Template%20-%20Publish.html>) 33.00 count 35.00 count 1.06 0.00 True
[SOD - Minimum Blazor Template - Publish - pub](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Minimum%20Blazor%20Template%20-%20Publish.html>) 5.86 MB 10.31 MB 1.76 0.00 True
[SOD - Minimum Blazor Template - Publish - Aggregate - .js](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Minimum%20Blazor%20Template%20-%20Publish.html>) 85.06 KB 415.25 KB 4.88 0.00 True
[SOD - Minimum Blazor Template - Publish - pub/wwwroot/_framework/blazor.boot.json](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Minimum%20Blazor%20Template%20-%20Publish.html>) 3.45 KB 3.83 KB 1.11 0.00 True
[SOD - Minimum Blazor Template - Publish - Aggregate - .js - Count](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Minimum%20Blazor%20Template%20-%20Publish.html>) 2.00 count 4.00 count 2.00 0.00 True
[SOD - Minimum Blazor Template - Publish - SOD - Minimum Blazor Template - Publish](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Minimum%20Blazor%20Template%20-%20Publish.html>) 5.86 MB 10.31 MB 1.76 0.00 True
[SOD - Minimum Blazor Template - Publish - SOD - Minimum Blazor Template - Publish - Count](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Minimum%20Blazor%20Template%20-%20Publish.html>) 51.00 count 125.00 count 2.45 0.00 True
[SOD - Minimum Blazor Template - Publish - Aggregate - .wasm - Count](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Minimum%20Blazor%20Template%20-%20Publish.html>) 1.00 count 31.00 count 31.00 0.00 True
[SOD - Minimum Blazor Template - Publish - pub - Count](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Minimum%20Blazor%20Template%20-%20Publish.html>) 51.00 count 125.00 count 2.45 0.00 True
[SOD - Minimum Blazor Template - Publish - Aggregate - .wasm](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Minimum%20Blazor%20Template%20-%20Publish.html>) 2.75 MB 6.30 MB 2.30 0.00 True

graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'SOD - Minimum Blazor Template - Publish*'
### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### SOD - Minimum Blazor Template - Publish ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small. ``` ### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
radekdoulik commented 1 year ago

This looks similar to https://github.com/dotnet/perf-autofiling-issues/issues/17715 where some measurements also doubled.

@LoopedBard3, the links to the benchmark graphs are still broken here. They refer to https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu%2018.04_CompilationMode=wasm_RunKind=blazor_scenarios/SOD%20-%20Pizza%20App%20-%20Publish.html graph, which is seemingly overall package size and not the graph of the benchmark.

Also the graph ends on 6/5/23. I opened https://github.com/dotnet/performance/issues/2920 some time ago for that. Without it I am kind of blind while triaging the size regressions.

LoopedBard3 commented 1 year ago

When referencing the benchmarks, do you mean all the individual file size results? On the link you posted, it seems like the benchmark can be expanded by clicking next to the top-level name, and then expanding the non-top counters shows the general counters. Are those the benchmark values you are looking for or something different?

For the graph ending early, I have made an issue: https://github.com/dotnet/performance/issues/3093

radekdoulik commented 1 year ago

Ah, I never noticed the non-top counters could be expanded. This shows the data I am looking for, the graphs are broken though. I am unable to choose "baseline" and "compare" values to get the link to the commits range. So it is still unusable.

This is what I get on non-top counters graph:

obrazek

and this what I get on other graphs:

obrazek

It would be also nice, if the links pointed to the expanded non-top counters.

LoopedBard3 commented 1 year ago

FYI @DrewScoggins