dotnet / perf-autofiling-issues

A landing place for auto-filed performance issues before they receive triage
MIT License
9 stars 4 forks source link

[Perf] Changes at 2/12/2022 8:55:58 AM #3461

Closed performanceautofiler[bot] closed 1 year ago

performanceautofiler[bot] commented 2 years ago

Run Information

Architecture x86
OS Windows 10.0.18362
Baseline 615224c46bb9d2113c040bb6824429fd42b60bd4
Compare 20e8f905d05f2d8f390d0e2ef10f1a4a1289967c
Diff Diff

Regressions in Crossgen2 Throughput - Single Threaded - Single - System.Net.Sockets

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Crossgen2 Throughput - Single Threaded - Single - System.Net.Sockets*'
### Histogram #### Crossgen2 Throughput - Single Threaded - Single - System.Net.Sockets ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 2% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 2% less than the baseline, and the value was not too small. IsRegressionBase: Marked as not a regression because the compare was not 2% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 2% less than the baseline, and the value was not too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x86
OS Windows 10.0.18362
Baseline 615224c46bb9d2113c040bb6824429fd42b60bd4
Compare 20e8f905d05f2d8f390d0e2ef10f1a4a1289967c
Diff Diff

Regressions in Crossgen2 Throughput - Single Threaded - Single - System.Drawing.Primitives

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Crossgen2 Throughput - Single Threaded - Single - System.Drawing.Primitives*'
### Histogram #### Crossgen2 Throughput - Single Threaded - Single - System.Drawing.Primitives ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 2% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 2% less than the baseline, and the value was not too small. IsRegressionBase: Marked as not a regression because the compare was not 2% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 2% less than the baseline, and the value was not too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x86
OS Windows 10.0.18362
Baseline 615224c46bb9d2113c040bb6824429fd42b60bd4
Compare 20e8f905d05f2d8f390d0e2ef10f1a4a1289967c
Diff Diff

Improvements in Crossgen2 Throughput - Single - Microsoft.CodeAnalysis.VisualBasic

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Crossgen2 Throughput - Single - Microsoft.CodeAnalysis.VisualBasic*'
### Histogram #### Crossgen2 Throughput - Single - Microsoft.CodeAnalysis.VisualBasic ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 2% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 2% less than the baseline, and the value was not too small. IsRegressionBase: Marked as not a regression because the compare was not 2% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 2% less than the baseline, and the value was not too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x86
OS Windows 10.0.18362
Baseline 615224c46bb9d2113c040bb6824429fd42b60bd4
Compare 20e8f905d05f2d8f390d0e2ef10f1a4a1289967c
Diff Diff

Improvements in Crossgen2 Throughput - Single Threaded - Single - System.Net.WebProxy

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Crossgen2 Throughput - Single Threaded - Single - System.Net.WebProxy*'
### Histogram #### Crossgen2 Throughput - Single Threaded - Single - System.Net.WebProxy ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 2% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 2% less than the baseline, and the value was not too small. IsRegressionBase: Marked as not a regression because the compare was not 2% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 2% less than the baseline, and the value was not too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x86
OS Windows 10.0.18362
Baseline 615224c46bb9d2113c040bb6824429fd42b60bd4
Compare 20e8f905d05f2d8f390d0e2ef10f1a4a1289967c
Diff Diff

Improvements in Crossgen2 Throughput - Composite - framework-r2r

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Crossgen2 Throughput - Composite - framework-r2r*'
### Histogram #### Crossgen2 Throughput - Composite - framework-r2r ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 2% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 2% less than the baseline, and the value was not too small. IsRegressionBase: Marked as not a regression because the compare was not 2% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 2% less than the baseline, and the value was not too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x86
OS Windows 10.0.18362
Baseline 615224c46bb9d2113c040bb6824429fd42b60bd4
Compare 20e8f905d05f2d8f390d0e2ef10f1a4a1289967c
Diff Diff

Improvements in Crossgen2 Throughput - Single - System.Drawing.Primitives

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Crossgen2 Throughput - Single - System.Drawing.Primitives*'
### Histogram #### Crossgen2 Throughput - Single - System.Drawing.Primitives ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 2% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 2% less than the baseline, and the value was not too small. IsRegressionBase: Marked as not a regression because the compare was not 2% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 2% less than the baseline, and the value was not too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x86
OS Windows 10.0.18362
Baseline 615224c46bb9d2113c040bb6824429fd42b60bd4
Compare 20e8f905d05f2d8f390d0e2ef10f1a4a1289967c
Diff Diff

Regressions in Crossgen2 Throughput - Single Threaded - Single - System.ServiceModel.Syndication

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Crossgen2 Throughput - Single Threaded - Single - System.ServiceModel.Syndication*'
### Histogram #### Crossgen2 Throughput - Single Threaded - Single - System.ServiceModel.Syndication ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 2% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 2% less than the baseline, and the value was not too small. IsRegressionBase: Marked as not a regression because the compare was not 2% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 2% less than the baseline, and the value was not too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x86
OS Windows 10.0.18362
Baseline 615224c46bb9d2113c040bb6824429fd42b60bd4
Compare 20e8f905d05f2d8f390d0e2ef10f1a4a1289967c
Diff Diff

Regressions in Crossgen2 Throughput - Single - System.Net.WebProxy

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Crossgen2 Throughput - Single - System.Net.WebProxy*'
### Histogram #### Crossgen2 Throughput - Single - System.Net.WebProxy ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 2% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 2% less than the baseline, and the value was not too small. IsRegressionBase: Marked as not a regression because the compare was not 2% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 2% less than the baseline, and the value was not too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x86
OS Windows 10.0.18362
Baseline 615224c46bb9d2113c040bb6824429fd42b60bd4
Compare 20e8f905d05f2d8f390d0e2ef10f1a4a1289967c
Diff Diff

Improvements in Crossgen2 Throughput - Single - System.Data.Common

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Crossgen2 Throughput - Single - System.Data.Common*'
### Histogram #### Crossgen2 Throughput - Single - System.Data.Common ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 2% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 2% less than the baseline, and the value was not too small. IsRegressionBase: Marked as not a regression because the compare was not 2% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 2% less than the baseline, and the value was not too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 1 year ago

Closing because it's stale.