search

dotnet / perf-autofiling-issues

A landing place for auto-filed performance issues before they receive triage
MIT License
9 stars 4 forks source link

[Perf] Changes at 1/11/2022 8:59:31 AM #2831

Closed performanceautofiler[bot] closed 1 year ago

performanceautofiler[bot] commented 2 years ago

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cf5b231fcbea483df3b081939b422adfb6fd486a
Compare fe8422cdff450941bc3ba4b120576e8822459df4
Diff Diff

Regressions in Crossgen2 Throughput - Single Threaded - Single - System.Net.Http.Json

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[Json - Process Time](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_RunKind=crossgen_scenarios/Crossgen2%20Throughput%20-%20Single%20Threaded%20-%20Single%20-%20System.Net.Http.Json.html>) 852.07 ms 870.67 ms 1.02 0.00 True

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Crossgen2 Throughput - Single Threaded - Single - System.Net.Http.Json*'
### Histogram #### Crossgen2 Throughput - Single Threaded - Single - System.Net.Http.Json ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cf5b231fcbea483df3b081939b422adfb6fd486a
Compare fe8422cdff450941bc3ba4b120576e8822459df4
Diff Diff

Regressions in Crossgen2 Throughput - Single Threaded - Single - System.Net.WebProxy

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[WebProxy - Process Time](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_RunKind=crossgen_scenarios/Crossgen2%20Throughput%20-%20Single%20Threaded%20-%20Single%20-%20System.Net.WebProxy.html>) 745.31 ms 795.39 ms 1.07 0.00 True

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Crossgen2 Throughput - Single Threaded - Single - System.Net.WebProxy*'
### Histogram #### Crossgen2 Throughput - Single Threaded - Single - System.Net.WebProxy ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cf5b231fcbea483df3b081939b422adfb6fd486a
Compare fe8422cdff450941bc3ba4b120576e8822459df4
Diff Diff

Regressions in Crossgen2 Throughput - Single - System.ServiceModel.Syndication

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Crossgen2 Throughput - Single - System.ServiceModel.Syndication*'
### Histogram #### Crossgen2 Throughput - Single - System.ServiceModel.Syndication ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cf5b231fcbea483df3b081939b422adfb6fd486a
Compare fe8422cdff450941bc3ba4b120576e8822459df4
Diff Diff

Improvements in Crossgen2 Throughput - Single - System.Net.Http.Json

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[Json - Process Time](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_RunKind=crossgen_scenarios/Crossgen2%20Throughput%20-%20Single%20-%20System.Net.Http.Json.html>) 792.12 ms 752.74 ms 0.95 0.00 True

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Crossgen2 Throughput - Single - System.Net.Http.Json*'
### Histogram #### Crossgen2 Throughput - Single - System.Net.Http.Json ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 2% less than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 2% less than the baseline, and the value was not too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cf5b231fcbea483df3b081939b422adfb6fd486a
Compare fe8422cdff450941bc3ba4b120576e8822459df4
Diff Diff

Regressions in Crossgen2 Throughput - Single - Microsoft.CodeAnalysis

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Crossgen2 Throughput - Single - Microsoft.CodeAnalysis*'
### Histogram #### Crossgen2 Throughput - Single - Microsoft.CodeAnalysis ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 2% less than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as improvement because the compare was 2% less than the baseline, and the value was not too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 1 year ago

Closing because it's stale.