search

dotnet / perf-autofiling-issues

A landing place for auto-filed performance issues before they receive triage
MIT License
9 stars 4 forks source link

[Perf] Changes at 3/5/2022 9:03:43 AM #3883

Closed performanceautofiler[bot] closed 1 year ago

performanceautofiler[bot] commented 2 years ago

Run Information

Architecture x64
OS ubuntu 18.04
Baseline a0635832f1c4cf02423b4cb40cb8611a4163a78d
Compare 17662fc30cfd4cc6e7dbba978a3fb512380c0b70
Diff Diff

Regressions in Crossgen2 Throughput - Single - System.Drawing.Primitives

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[Primitives - Process Time](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_RunKind=crossgen_scenarios/Crossgen2%20Throughput%20-%20Single%20-%20System.Drawing.Primitives.html>) 797.48 ms 817.57 ms 1.03 0.00 True

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Crossgen2 Throughput - Single - System.Drawing.Primitives*'
### Histogram #### Crossgen2 Throughput - Single - System.Drawing.Primitives ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline a0635832f1c4cf02423b4cb40cb8611a4163a78d
Compare 17662fc30cfd4cc6e7dbba978a3fb512380c0b70
Diff Diff

Regressions in Crossgen2 Throughput - Single Threaded - Single - System.Net.Http.Json

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[Json - Process Time](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_RunKind=crossgen_scenarios/Crossgen2%20Throughput%20-%20Single%20Threaded%20-%20Single%20-%20System.Net.Http.Json.html>) 822.19 ms 869.61 ms 1.06 0.00 True

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Crossgen2 Throughput - Single Threaded - Single - System.Net.Http.Json*'
### Histogram #### Crossgen2 Throughput - Single Threaded - Single - System.Net.Http.Json ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline a0635832f1c4cf02423b4cb40cb8611a4163a78d
Compare 17662fc30cfd4cc6e7dbba978a3fb512380c0b70
Diff Diff

Regressions in Crossgen2 Throughput - Single Threaded - Single - System.Drawing.Primitives

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[Primitives - Process Time](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_RunKind=crossgen_scenarios/Crossgen2%20Throughput%20-%20Single%20Threaded%20-%20Single%20-%20System.Drawing.Primitives.html>) 877.09 ms 932.49 ms 1.06 0.00 True

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Crossgen2 Throughput - Single Threaded - Single - System.Drawing.Primitives*'
### Histogram #### Crossgen2 Throughput - Single Threaded - Single - System.Drawing.Primitives ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline a0635832f1c4cf02423b4cb40cb8611a4163a78d
Compare 17662fc30cfd4cc6e7dbba978a3fb512380c0b70
Diff Diff

Improvements in Crossgen2 Throughput - Single - System.Net.WebProxy

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Crossgen2 Throughput - Single - System.Net.WebProxy*'
### Histogram #### Crossgen2 Throughput - Single - System.Net.WebProxy ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 2% less than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 2% less than the baseline, and the value was not too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline a0635832f1c4cf02423b4cb40cb8611a4163a78d
Compare 17662fc30cfd4cc6e7dbba978a3fb512380c0b70
Diff Diff

Regressions in Crossgen2 Throughput - Single - System.Data.Common

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[Common - Process Time](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_RunKind=crossgen_scenarios/Crossgen2%20Throughput%20-%20Single%20-%20System.Data.Common.html>) 1356.89 ms 1414.31 ms 1.04 0.00 True

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Crossgen2 Throughput - Single - System.Data.Common*'
### Histogram #### Crossgen2 Throughput - Single - System.Data.Common ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline a0635832f1c4cf02423b4cb40cb8611a4163a78d
Compare 17662fc30cfd4cc6e7dbba978a3fb512380c0b70
Diff Diff

Regressions in Crossgen2 Throughput - Single Threaded - Single - System.Net.WebProxy

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[WebProxy - Process Time](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_RunKind=crossgen_scenarios/Crossgen2%20Throughput%20-%20Single%20Threaded%20-%20Single%20-%20System.Net.WebProxy.html>) 753.88 ms 808.73 ms 1.07 0.00 True

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Crossgen2 Throughput - Single Threaded - Single - System.Net.WebProxy*'
### Histogram #### Crossgen2 Throughput - Single Threaded - Single - System.Net.WebProxy ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline a0635832f1c4cf02423b4cb40cb8611a4163a78d
Compare 17662fc30cfd4cc6e7dbba978a3fb512380c0b70
Diff Diff

Regressions in Crossgen2 Throughput - Single - System.Net.Sockets

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[Sockets - Process Time](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_RunKind=crossgen_scenarios/Crossgen2%20Throughput%20-%20Single%20-%20System.Net.Sockets.html>) 856.37 ms 914.66 ms 1.07 0.00 True

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Crossgen2 Throughput - Single - System.Net.Sockets*'
### Histogram #### Crossgen2 Throughput - Single - System.Net.Sockets ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 1 year ago

Closing because it's stale.