[Perf] Windows/arm64: 1 Regression on 9/30/2022 1:24:23 AM

Run Information

Architecture	arm64
OS	Windows 10.0.25094
Baseline	60986693ea08b865dad65ff6896d7c20f8a04b82
Compare	062fb4562f0c366e5d911b4bca22dbd3cb25a89a
Diff	Diff

Regressions in System.Numerics.Tests.Perf_BigInteger

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Subtract - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.25094/System.Numerics.Tests.Perf_BigInteger.Subtract(arguments%3a%2065536%2c65536%20bits).html>)	4.46 μs	5.98 μs	1.34	0.63	False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_BigInteger*'

### Related Issues #### Regressions * [[Perf] Linux/arm64: 1 Regression on 9/30/2022 1:24:23 AM]() #### Improvements * [[Perf] Linux/arm64: 1 Improvement on 9/30/2022 1:24:23 AM]() ### Payloads [Baseline]() [Compare]() ### Histogram ### Edge Detector Info [Collection Data]() #### System.Numerics.Tests.Perf_BigInteger.Subtract(arguments: 65536,65536 bits) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionWindowed: Marked as regression because 5.976931384952766 > 4.890526134441379. IsChangePoint: Marked as a change because one of 9/29/2022 6:03:53 PM, 10/6/2022 12:41:43 AM falls between 9/27/2022 9:53:04 AM and 10/6/2022 12:41:43 AM. IsRegressionStdDev: Marked as regression because -9.42584619881022 (T) = (0 -5632.430761933109) / Math.Sqrt((102688.16068267588 / (23)) + (157823.7163655221 / (29))) is less than -2.0085591120996775 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (23) + (29) - 2, .025) and -0.19985893096661556 = (4694.244145347637 - 5632.430761933109) / 4694.244145347637 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

DrewScoggins / performance-2