dotnet / perf-autofiling-issues

A landing place for auto-filed performance issues before they receive triage
MIT License
9 stars 4 forks source link

[Perf] Windows/arm64: 1 Regression on 10/27/2022 9:10:51 AM #9263

Open performanceautofiler[bot] opened 1 year ago

performanceautofiler[bot] commented 1 year ago

Run Information

Architecture arm64
OS Windows 10.0.14393
Baseline c6c8bb8b73ff4f7a686ca5a350fbb0093b3b708b
Compare f389dd342a331d97513d7600d6c302fae26e291a
Diff Diff

Regressions in Device Startup - Android Maui DefaultTesting NoAnimation

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[Device Startup - Android Maui DefaultTesting NoAnimation - Generic Startup](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.14393_RunKind=android_scenarios/Device%20Startup%20-%20Android%20Maui%20DefaultTesting%20NoAnimation.html>) 640.60 ms 655.60 ms 1.02 0.00 True

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Device Startup - Android Maui DefaultTesting NoAnimation*'

Related Issues

Regressions

Improvements

### Histogram ### Edge Detector Info [Collection Data]() #### Device Startup - Android Maui DefaultTesting NoAnimation ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 2% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 2% less than the baseline, or the value was too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
dakersnar commented 1 year ago

Most likely noise, but I can't find the historical data to confirm