dotnet / perf-autofiling-issues

A landing place for auto-filed performance issues before they receive triage
MIT License
9 stars 4 forks source link

[Perf] Changes at 1/29/2022 8:59:13 AM #3154

Closed performanceautofiler[bot] closed 1 year ago

performanceautofiler[bot] commented 2 years ago

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 953fd351ae1c5c8c11ba865b3613b63f8f774624
Compare 77f4d7a3f28b4c5e225dff1e7f90173a322fb48e
Diff Diff

Regressions in Crossgen2 Throughput - Single Threaded - Single - System.Drawing.Primitives

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Crossgen2 Throughput - Single Threaded - Single - System.Drawing.Primitives*'
### Histogram #### Crossgen2 Throughput - Single Threaded - Single - System.Drawing.Primitives ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 953fd351ae1c5c8c11ba865b3613b63f8f774624
Compare 77f4d7a3f28b4c5e225dff1e7f90173a322fb48e
Diff Diff

Improvements in Crossgen2 Throughput - Single - System.Net.Http.Json

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Crossgen2 Throughput - Single - System.Net.Http.Json*'
### Histogram #### Crossgen2 Throughput - Single - System.Net.Http.Json ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 953fd351ae1c5c8c11ba865b3613b63f8f774624
Compare 77f4d7a3f28b4c5e225dff1e7f90173a322fb48e
Diff Diff

Regressions in Crossgen2 Throughput - Single - System.Net.WebProxy

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[WebProxy - Process Time](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_RunKind=crossgen_scenarios/Crossgen2%20Throughput%20-%20Single%20-%20System.Net.WebProxy.html>) 700.87 ms 738.39 ms 1.05 0.00 True

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Crossgen2 Throughput - Single - System.Net.WebProxy*'
### Histogram #### Crossgen2 Throughput - Single - System.Net.WebProxy ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 2% less than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 2% less than the baseline, and the value was not too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 953fd351ae1c5c8c11ba865b3613b63f8f774624
Compare 77f4d7a3f28b4c5e225dff1e7f90173a322fb48e
Diff Diff

Regressions in Crossgen2 Throughput - Single - System.ServiceModel.Syndication

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[Syndication - Process Time](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_RunKind=crossgen_scenarios/Crossgen2%20Throughput%20-%20Single%20-%20System.ServiceModel.Syndication.html>) 817.72 ms 854.20 ms 1.04 0.00 True

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Crossgen2 Throughput - Single - System.ServiceModel.Syndication*'
### Histogram #### Crossgen2 Throughput - Single - System.ServiceModel.Syndication ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 2% less than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 2% less than the baseline, and the value was not too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 1 year ago

Closing because it's stale.