dotnet / perf-autofiling-issues

A landing place for auto-filed performance issues before they receive triage
MIT License
9 stars 4 forks source link

[Perf] Changes at 2/3/2022 9:00:42 AM #3304

Closed performanceautofiler[bot] closed 1 year ago

performanceautofiler[bot] commented 2 years ago

Run Information

Architecture x64
OS Windows 10.0.18362
Baseline 542bf3308bce888207de8fd095ddcdefcedf8291
Compare 6b77f292d5ae2ed8f5aba53a313f3771bd1d82b4
Diff Diff

Regressions in SDK .NET 2

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'SDK .NET 2*'
### Histogram #### SDK .NET 2.0 Library Template Clean Build ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS Windows 10.0.18362
Baseline 542bf3308bce888207de8fd095ddcdefcedf8291
Compare 6b77f292d5ae2ed8f5aba53a313f3771bd1d82b4
Diff Diff

Regressions in SDK ASP

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[NET Core Web App - Process Time](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/7.0.1xx_x64_Windows 10.0.18362_RunKind=sdk_scenarios/SDK%20ASP.NET%20Core%20Web%20App%20(Model-View-Controller)%20Template%20Clean%20Build.html>) 4232.78 ms 4334.03 ms 1.02 0.00 True
[NET Core Web API Template Build - Process Time](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/7.0.1xx_x64_Windows 10.0.18362_RunKind=sdk_scenarios/SDK%20ASP.NET%20Core%20Web%20API%20Template%20Build(No%20Change).html>) 1288.34 ms 1320.95 ms 1.03 0.00 True

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'SDK ASP*'
### Histogram #### SDK ASP.NET Core Web App Template Build(No Change) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. ```#### SDK ASP.NET Core Web App (Model-View-Controller) Template Clean Build ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 2% less than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 2% less than the baseline, and the value was not too small. ```#### SDK ASP.NET Core Web API Template Build(No Change) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS Windows 10.0.18362
Baseline 542bf3308bce888207de8fd095ddcdefcedf8291
Compare 6b77f292d5ae2ed8f5aba53a313f3771bd1d82b4
Diff Diff

Improvements in Inner Loop Blazor Server

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[Inner Loop Blazor Server - Generic Startup Diff](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/7.0.1xx_x64_Windows 10.0.18362_RunKind=sdk_scenarios/Inner%20Loop%20Blazor%20Server.html>) 509.77 ms 379.00 ms 0.74 0.00 True

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Inner Loop Blazor Server*'
### Histogram #### Inner Loop Blazor Server ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 2% less than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 2% less than the baseline, and the value was not too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS Windows 10.0.18362
Baseline 542bf3308bce888207de8fd095ddcdefcedf8291
Compare 6b77f292d5ae2ed8f5aba53a313f3771bd1d82b4
Diff Diff

Regressions in SDK Console Template Build(No Change)

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[SDK Console Template Build - Process Time](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/7.0.1xx_x64_Windows 10.0.18362_RunKind=sdk_scenarios/SDK%20Console%20Template%20Build(No%20Change).html>) 1102.15 ms 1128.96 ms 1.02 0.00 True

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'SDK Console Template Build(No Change)*'
### Histogram #### SDK Console Template Build(No Change) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS Windows 10.0.18362
Baseline 542bf3308bce888207de8fd095ddcdefcedf8291
Compare 6b77f292d5ae2ed8f5aba53a313f3771bd1d82b4
Diff Diff

Improvements in Inner Loop MVC

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[Inner Loop MVC - Generic Startup Diff](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/7.0.1xx_x64_Windows 10.0.18362_RunKind=sdk_scenarios/Inner%20Loop%20MVC.html>) 536.58 ms 409.16 ms 0.76 0.00 True

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Inner Loop MVC*'
### Histogram #### Inner Loop MVC ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 2% less than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 2% less than the baseline, and the value was not too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS Windows 10.0.18362
Baseline 542bf3308bce888207de8fd095ddcdefcedf8291
Compare 6b77f292d5ae2ed8f5aba53a313f3771bd1d82b4
Diff Diff

Regressions in SDK ASP.NET MVC App Template net6

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[0 Clean Build - Process Time](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/7.0.1xx_x64_Windows 10.0.18362_RunKind=sdk_scenarios/SDK%20ASP.NET%20MVC%20App%20Template%20net6.0%20Clean%20Build.html>) 4480.83 ms 4597.69 ms 1.03 0.00 True

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'SDK ASP.NET MVC App Template net6*'
### Histogram #### SDK ASP.NET MVC App Template net6.0 Clean Build ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 1 year ago

Closing because it's stale.