dotnet / perf-autofiling-issues

A landing place for auto-filed performance issues before they receive triage
MIT License
9 stars 4 forks source link

[Perf] Changes at 2/19/2022 9:03:39 AM #3591

Closed performanceautofiler[bot] closed 1 year ago

performanceautofiler[bot] commented 2 years ago

Run Information

Architecture x64
OS Windows 10.0.18362
Baseline 3deadcfc767074093899765821172edcac10f76b
Compare 79d478ae01d9a3e7548bf41a76d047158ed8a62b
Diff Diff

Improvements in Crossgen2 Throughput - Composite - framework-r2r

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Crossgen2 Throughput - Composite - framework-r2r*'
### Histogram #### Crossgen2 Throughput - Composite - framework-r2r ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS Windows 10.0.18362
Baseline 3deadcfc767074093899765821172edcac10f76b
Compare 79d478ae01d9a3e7548bf41a76d047158ed8a62b
Diff Diff

Regressions in Crossgen2 Throughput - Single Threaded - Single - System.Private.CoreLib

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Crossgen2 Throughput - Single Threaded - Single - System.Private.CoreLib*'
### Histogram #### Crossgen2 Throughput - Single Threaded - Single - System.Private.CoreLib ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 1 year ago

Closing because it's stale.