search

dotnet / perf-autofiling-issues

A landing place for auto-filed performance issues before they receive triage
MIT License
9 stars 4 forks source link

[Perf] Changes at 2/8/2022 9:01:02 AM #3421

Closed performanceautofiler[bot] closed 1 year ago

performanceautofiler[bot] commented 2 years ago

Run Information

Architecture x64
OS Windows 10.0.18362
Baseline f4df05d03ce613d978f2dcfb478de10bd39ac854
Compare 73839039d6f3c2476a542b7f04216936e7cea698
Diff Diff

Regressions in SDK NUnit 3 Test Project Template Clean Build

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[SDK NUnit 3 Test Project Template Clean Build - Process Time](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/7.0.1xx_x64_Windows 10.0.18362_RunKind=sdk_scenarios/SDK%20NUnit%203%20Test%20Project%20Template%20Clean%20Build.html>) 2806.69 ms 2899.60 ms 1.03 0.00 True

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'SDK NUnit 3 Test Project Template Clean Build*'
### Histogram #### SDK NUnit 3 Test Project Template Clean Build ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS Windows 10.0.18362
Baseline f4df05d03ce613d978f2dcfb478de10bd39ac854
Compare 73839039d6f3c2476a542b7f04216936e7cea698
Diff Diff

Regressions in SDK ASP

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[NET Core gRPC Service Template Build - Process Time](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/7.0.1xx_x64_Windows 10.0.18362_RunKind=sdk_scenarios/SDK%20ASP.NET%20Core%20gRPC%20Service%20Template%20Build(No%20Change).html>) 1323.11 ms 1352.99 ms 1.02 0.00 True
[NET Core Web API Template Build - Process Time](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/7.0.1xx_x64_Windows 10.0.18362_RunKind=sdk_scenarios/SDK%20ASP.NET%20Core%20Web%20API%20Template%20Build(No%20Change).html>) 1285.81 ms 1313.94 ms 1.02 0.00 True

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'SDK ASP*'
### Histogram #### SDK ASP.NET Core gRPC Service Template Build(No Change) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. ```#### SDK ASP.Net Core Empty Template Clean Build ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. ```#### SDK ASP.NET Core Web API Template Build(No Change) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS Windows 10.0.18362
Baseline f4df05d03ce613d978f2dcfb478de10bd39ac854
Compare 73839039d6f3c2476a542b7f04216936e7cea698
Diff Diff

Regressions in SDK Blazor Server App Template Build(No Change)

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'SDK Blazor Server App Template Build(No Change)*'
### Histogram #### SDK Blazor Server App Template Build(No Change) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS Windows 10.0.18362
Baseline f4df05d03ce613d978f2dcfb478de10bd39ac854
Compare 73839039d6f3c2476a542b7f04216936e7cea698
Diff Diff

Regressions in SDK .NET 2

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[0 Library Template Build - Process Time](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/7.0.1xx_x64_Windows 10.0.18362_RunKind=sdk_scenarios/SDK%20.NET%202.0%20Library%20Template%20Build(No%20Change).html>) 923.05 ms 953.24 ms 1.03 0.00 True

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'SDK .NET 2*'
### Histogram #### SDK .NET 2.0 Library Template Build(No Change) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS Windows 10.0.18362
Baseline f4df05d03ce613d978f2dcfb478de10bd39ac854
Compare 73839039d6f3c2476a542b7f04216936e7cea698
Diff Diff

Regressions in SDK Blazor Server App Template Clean Build

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[SDK Blazor Server App Template Clean Build - Process Time](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/7.0.1xx_x64_Windows 10.0.18362_RunKind=sdk_scenarios/SDK%20Blazor%20Server%20App%20Template%20Clean%20Build.html>) 4357.05 ms 4476.78 ms 1.03 0.00 True

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'SDK Blazor Server App Template Clean Build*'
### Histogram #### SDK Blazor Server App Template Clean Build ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS Windows 10.0.18362
Baseline f4df05d03ce613d978f2dcfb478de10bd39ac854
Compare 73839039d6f3c2476a542b7f04216936e7cea698
Diff Diff

Regressions in SDK NUnit 3 Test Project Template Build(No Change)

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[SDK NUnit 3 Test Project Template Build - Process Time](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/7.0.1xx_x64_Windows 10.0.18362_RunKind=sdk_scenarios/SDK%20NUnit%203%20Test%20Project%20Template%20Build(No%20Change).html>) 1112.25 ms 1140.40 ms 1.03 0.00 True

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'SDK NUnit 3 Test Project Template Build(No Change)*'
### Histogram #### SDK NUnit 3 Test Project Template Build(No Change) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS Windows 10.0.18362
Baseline f4df05d03ce613d978f2dcfb478de10bd39ac854
Compare 73839039d6f3c2476a542b7f04216936e7cea698
Diff Diff

Regressions in SDK F# Console Template Build(No Change)

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[SDK F# Console Template Build - Process Time](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/7.0.1xx_x64_Windows 10.0.18362_RunKind=sdk_scenarios/SDK%20F%23%20Console%20Template%20Build(No%20Change).html>) 1092.41 ms 1114.38 ms 1.02 0.00 True

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'SDK F# Console Template Build(No Change)*'
### Histogram #### SDK F# Console Template Build(No Change) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS Windows 10.0.18362
Baseline f4df05d03ce613d978f2dcfb478de10bd39ac854
Compare 73839039d6f3c2476a542b7f04216936e7cea698
Diff Diff

Regressions in SDK xUnit Test Project Template Clean Build

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'SDK xUnit Test Project Template Clean Build*'
### Histogram #### SDK xUnit Test Project Template Clean Build ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS Windows 10.0.18362
Baseline f4df05d03ce613d978f2dcfb478de10bd39ac854
Compare 73839039d6f3c2476a542b7f04216936e7cea698
Diff Diff

Improvements in Inner Loop Blazor Server

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[Inner Loop Blazor Server - Generic Startup Diff](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/7.0.1xx_x64_Windows 10.0.18362_RunKind=sdk_scenarios/Inner%20Loop%20Blazor%20Server.html>) 495.66 ms 439.13 ms 0.89 0.00 True

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Inner Loop Blazor Server*'
### Histogram #### Inner Loop Blazor Server ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 2% less than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 2% less than the baseline, and the value was not too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS Windows 10.0.18362
Baseline f4df05d03ce613d978f2dcfb478de10bd39ac854
Compare 73839039d6f3c2476a542b7f04216936e7cea698
Diff Diff

Regressions in SDK ASP.NET MVC App Template net6

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'SDK ASP.NET MVC App Template net6*'
### Histogram #### SDK ASP.NET MVC App Template net6.0 Build(No Change) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS Windows 10.0.18362
Baseline f4df05d03ce613d978f2dcfb478de10bd39ac854
Compare 73839039d6f3c2476a542b7f04216936e7cea698
Diff Diff

Improvements in Inner Loop MVC

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[Inner Loop MVC - Generic Startup Diff](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/7.0.1xx_x64_Windows 10.0.18362_RunKind=sdk_scenarios/Inner%20Loop%20MVC.html>) 527.26 ms 449.38 ms 0.85 0.00 True

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Inner Loop MVC*'
### Histogram #### Inner Loop MVC ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 2% less than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 2% less than the baseline, and the value was not too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS Windows 10.0.18362
Baseline f4df05d03ce613d978f2dcfb478de10bd39ac854
Compare 73839039d6f3c2476a542b7f04216936e7cea698
Diff Diff

Regressions in Inner Loop Blazor Client

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[Inner Loop Blazor Client - Generic Startup Diff](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/7.0.1xx_x64_Windows 10.0.18362_RunKind=sdk_scenarios/Inner%20Loop%20Blazor%20Client.html>) 732.88 ms 760.71 ms 1.04 0.00 True

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Inner Loop Blazor Client*'
### Histogram #### Inner Loop Blazor Client ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 1 year ago

Closing because it's stale.