search

dotnet / perf-autofiling-issues

A landing place for auto-filed performance issues before they receive triage
MIT License
9 stars 4 forks source link

[Perf] Windows/arm64: 56 Improvements on 1/7/2023 2:04:07 AM #11599

Open performanceautofiler[bot] opened 1 year ago

performanceautofiler[bot] commented 1 year ago

Run Information

Architecture arm64
OS Windows 10.0.19041
Baseline 87312f7d6ff270519a4d13d31fbcaa99748654f8
Compare f08d13f7f912dd3d89508b3ccd48f47c85c56ddd
Diff Diff

Improvements in System.Numerics.Tests.Perf_Matrix4x4

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[CreateRotationYBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix4x4.CreateRotationYBenchmark.html>) 8.63 ns 1.61 ns 0.19 0.46 False
[CreateScaleFromScalarWithCenterBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix4x4.CreateScaleFromScalarWithCenterBenchmark.html>) 7.64 ns 1.46 ns 0.19 0.30 False
[IsIdentityBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix4x4.IsIdentityBenchmark.html>) 9.01 ns 0.31 ns 0.03 0.25 False
[CreateRotationZWithCenterBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix4x4.CreateRotationZWithCenterBenchmark.html>) 10.29 ns 1.52 ns 0.15 0.39 False
[CreateTranslationFromScalarXYZ - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix4x4.CreateTranslationFromScalarXYZ.html>) 8.69 ns 1.28 ns 0.15 0.21 False
[InequalityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix4x4.InequalityOperatorBenchmark.html>) 13.38 ns 2.65 ns 0.20 0.06 False
[CreateScaleFromScalarBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix4x4.CreateScaleFromScalarBenchmark.html>) 7.79 ns 1.17 ns 0.15 0.42 False
[CreateFromMatrix3x2 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix4x4.CreateFromMatrix3x2.html>) 13.67 ns 4.61 ns 0.34 0.02 False
[MultiplyByMatrixOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix4x4.MultiplyByMatrixOperatorBenchmark.html>) 18.08 ns 12.93 ns 0.72 0.13 False
[LerpBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix4x4.LerpBenchmark.html>) 13.97 ns 3.11 ns 0.22 0.18 False
[IdentityBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix4x4.IdentityBenchmark.html>) 3.92 ns 1.32 ns 0.34 0.31 False
[CreateScaleFromScalarXYZWithCenterBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix4x4.CreateScaleFromScalarXYZWithCenterBenchmark.html>) 8.50 ns 1.73 ns 0.20 0.34 False
[CreateRotationXWithCenterBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix4x4.CreateRotationXWithCenterBenchmark.html>) 10.26 ns 1.66 ns 0.16 0.26 False
[CreateScaleFromScalarXYZBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix4x4.CreateScaleFromScalarXYZBenchmark.html>) 8.67 ns 1.73 ns 0.20 0.36 False
[CreateBillboardBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix4x4.CreateBillboardBenchmark.html>) 43.22 ns 27.21 ns 0.63 0.00 False
[MultiplyByScalarOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix4x4.MultiplyByScalarOperatorBenchmark.html>) 10.99 ns 1.35 ns 0.12 0.12 False
[CreateShadowBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix4x4.CreateShadowBenchmark.html>) 34.61 ns 17.51 ns 0.51 0.06 False
[CreateConstrainedBillboardBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix4x4.CreateConstrainedBillboardBenchmark.html>) 55.01 ns 33.04 ns 0.60 0.01 False
[AddBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix4x4.AddBenchmark.html>) 15.12 ns 2.70 ns 0.18 0.19 False
[CreateFromYawPitchRollBenchmarkBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix4x4.CreateFromYawPitchRollBenchmarkBenchmark.html>) 73.74 ns 67.89 ns 0.92 0.05 False
[AddOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix4x4.AddOperatorBenchmark.html>) 14.95 ns 2.97 ns 0.20 0.18 False
[CreateRotationYWithCenterBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix4x4.CreateRotationYWithCenterBenchmark.html>) 12.93 ns 1.65 ns 0.13 0.42 False
[NegationOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix4x4.NegationOperatorBenchmark.html>) 10.66 ns 1.41 ns 0.13 0.19 False
[SubtractOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix4x4.SubtractOperatorBenchmark.html>) 15.12 ns 2.59 ns 0.17 0.25 False
[EqualityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix4x4.EqualityOperatorBenchmark.html>) 12.88 ns 2.16 ns 0.17 0.07 False
[MultiplyByScalarBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix4x4.MultiplyByScalarBenchmark.html>) 10.81 ns 1.64 ns 0.15 0.15 False
[CreateFromAxisAngleBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix4x4.CreateFromAxisAngleBenchmark.html>) 35.41 ns 4.74 ns 0.13 0.13 False
[CreateScaleFromVectorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix4x4.CreateScaleFromVectorBenchmark.html>) 7.61 ns 1.92 ns 0.25 0.33 False
[CreateRotationZBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix4x4.CreateRotationZBenchmark.html>) 10.73 ns 1.30 ns 0.12 0.49 False
[EqualsBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix4x4.EqualsBenchmark.html>) 13.49 ns 6.32 ns 0.47 0.04 False
[CreateTranslationFromVectorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix4x4.CreateTranslationFromVectorBenchmark.html>) 8.36 ns 1.77 ns 0.21 0.45 False
[CreateWorldBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix4x4.CreateWorldBenchmark.html>) 42.65 ns 26.17 ns 0.61 0.01 False

graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_Matrix4x4*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_Matrix4x4.CreateRotationYBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.6109575879487201 < 8.980081475924331. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 148.85303084965412 (T) = (0 -1.4937371615831951) / Math.Sqrt((0.3851566847988055 / (299)) + (0.026797711997099145 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.8400325504744985 = (9.337756937514147 - 1.4937371615831951) / 9.337756937514147 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix4x4.CreateScaleFromScalarWithCenterBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.4636883601630954 < 7.357679542753271. IsChangePoint: Marked as a change because one of 12/5/2022 11:02:29 AM, 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 63.19504384536889 (T) = (0 -1.532444171567969) / Math.Sqrt((1.481217780291267 / (299)) + (0.18593132954262376 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.8360146029006872 = (9.34500387641157 - 1.532444171567969) / 9.34500387641157 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix4x4.IsIdentityBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 0.31355649659865226 < 8.616090622509429. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 149.75531577403092 (T) = (0 -0.3489606538115583) / Math.Sqrt((0.333216008753177 / (299)) + (0.040082501445619034 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.9612495715375774 = (9.005336654534164 - 0.3489606538115583) / 9.005336654534164 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix4x4.CreateRotationZWithCenterBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.5217732284758265 < 9.711302242595833. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 162.42734654629402 (T) = (0 -1.6241240741408705) / Math.Sqrt((0.2603586703510198 / (299)) + (0.03451474754919428 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.8407865061562992 = (10.200919752036013 - 1.6241240741408705) / 10.200919752036013 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix4x4.CreateTranslationFromScalarXYZ ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.2785703573901974 < 8.327685860495329. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 89.66758071072947 (T) = (0 -1.2988939630563665) / Math.Sqrt((0.22745836207050824 / (299)) + (0.11116139282686588 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.8518401766932532 = (8.766843359195734 - 1.2988939630563665) / 8.766843359195734 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix4x4.InequalityOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.6503343143885885 < 12.7408911780902. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 229.59254152986557 (T) = (0 -2.4876117231173893) / Math.Sqrt((0.045676258830289564 / (299)) + (0.036990437879703505 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.8126163419139819 = (13.275499840949076 - 2.4876117231173893) / 13.275499840949076 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix4x4.CreateScaleFromScalarBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.166850016459301 < 7.396865936358639. IsChangePoint: Marked as a change because one of 12/5/2022 11:02:29 AM, 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 106.65033719401283 (T) = (0 -1.3923833306380615) / Math.Sqrt((1.0416772588962153 / (299)) + (0.02726660886040945 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.8441252658262196 = (8.932707010013129 - 1.3923833306380615) / 8.932707010013129 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix4x4.CreateFromMatrix3x2 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 4.607754959540426 < 13.01079875005938. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 336.35221696147676 (T) = (0 -4.602876735894758) / Math.Sqrt((0.16302921282359858 / (299)) + (0.0033081833437678637 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.6636457956562456 = (13.684611865860946 - 4.602876735894758) / 13.684611865860946 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix4x4.MultiplyByMatrixOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 12.9289569401734 < 17.317119120823904. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 58.800613858476446 (T) = (0 -12.905174400811967) / Math.Sqrt((2.168001929316546 / (299)) + (0.0351075673305775 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.3041351438315302 = (18.54551826610368 - 12.905174400811967) / 18.54551826610368 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix4x4.LerpBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.1109718251309975 < 13.200994511701357. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 99.92941696993016 (T) = (0 -3.304510008014934) / Math.Sqrt((3.455139549812608 / (299)) + (0.008863763424504706 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.7684804847800504 = (14.273138075965484 - 3.304510008014934) / 14.273138075965484 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix4x4.IdentityBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.3216945551572106 < 3.453986005942855. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/7/2023 8:48:01 PM, 1/9/2023 12:42:28 AM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 37.42736368280703 (T) = (0 -1.4040243858302963) / Math.Sqrt((0.20095007269312748 / (299)) + (0.03142529489346378 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.6129376772668685 = (3.62738583263846 - 1.4040243858302963) / 3.62738583263846 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix4x4.CreateScaleFromScalarXYZWithCenterBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.7304745170002545 < 8.018205312816693. IsChangePoint: Marked as a change because one of 12/5/2022 11:02:29 AM, 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 70.59069502906193 (T) = (0 -1.5594238738299633) / Math.Sqrt((1.0576993333124065 / (299)) + (0.17093881596410432 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.8378730736711989 = (9.618537211193274 - 1.5594238738299633) / 9.618537211193274 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix4x4.CreateRotationXWithCenterBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.656864616028945 < 10.039524372498732. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 89.10598798436997 (T) = (0 -1.5409046118149508) / Math.Sqrt((0.4178997052860026 / (299)) + (0.1625579917598458 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.8551846604857742 = (10.640479226743663 - 1.5409046118149508) / 10.640479226743663 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix4x4.CreateScaleFromScalarXYZBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.73367172360618 < 7.916000285506858. IsChangePoint: Marked as a change because one of 12/5/2022 11:02:29 AM, 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 132.31220988021653 (T) = (0 -1.6046756345820292) / Math.Sqrt((0.9040331533939651 / (299)) + (0.010569122945808048 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.8320624506191925 = (9.555192632609756 - 1.6046756345820292) / 9.555192632609756 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix4x4.CreateBillboardBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 27.2128879839108 < 41.337047170416525. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 284.76022907474356 (T) = (0 -27.15689877455622) / Math.Sqrt((0.6152087905685194 / (299)) + (0.030700776756261313 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.39144730052915705 = (44.625385440192865 - 27.15689877455622) / 44.625385440192865 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix4x4.MultiplyByScalarOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.3486845511946723 < 10.22386597119275. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 144.90757396917715 (T) = (0 -1.4281811561501305) / Math.Sqrt((1.0018653699832747 / (299)) + (0.01762601685435655 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.8697323119727334 = (10.963433663236538 - 1.4281811561501305) / 10.963433663236538 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix4x4.CreateShadowBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.508811964462563 < 32.80391418958728. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 359.1066251890049 (T) = (0 -17.3878927734227) / Math.Sqrt((0.5731669550186895 / (299)) + (0.008007832504975002 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.5009212670329924 = (34.839979395740265 - 17.3878927734227) / 34.839979395740265 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix4x4.CreateConstrainedBillboardBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 33.03719507926507 < 52.21247356146197. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 252.53805273754983 (T) = (0 -32.55427370173663) / Math.Sqrt((0.5261060777738595 / (299)) + (0.1028628584046011 / (17))) is greater than 1.9675476980854363 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (17) - 2, .975) and 0.4067294952650791 = (54.8725639348651 - 32.55427370173663) / 54.8725639348651 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix4x4.AddBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.7008235026650165 < 14.328465500853982. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 126.21930571500697 (T) = (0 -2.861239127085336) / Math.Sqrt((2.3595481165553545 / (299)) + (0.0367797578736087 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.8147099324867422 = (15.44194551540443 - 2.861239127085336) / 15.44194551540443 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix4x4.CreateFromYawPitchRollBenchmarkBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 67.88990273117342 < 69.83844433221856. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 7.922894079866136 (T) = (0 -69.56351633914716) / Math.Sqrt((1.1749821469062038 / (299)) + (4.932495331229296 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.056645600554278905 = (73.74059672591765 - 69.56351633914716) / 73.74059672591765 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix4x4.AddOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.97007796789078 < 14.429679897515783. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 129.22163152823703 (T) = (0 -2.803333301700584) / Math.Sqrt((2.535329242991687 / (299)) + (0.018415363526045503 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.8179643753425673 = (15.399915851504849 - 2.803333301700584) / 15.399915851504849 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix4x4.CreateRotationYWithCenterBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.6465026281848427 < 9.689026847024863. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 173.39652193427747 (T) = (0 -1.586990414776585) / Math.Sqrt((0.5760373288945436 / (299)) + (0.009901541434686374 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.8446594504476588 = (10.216201882573207 - 1.586990414776585) / 10.216201882573207 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix4x4.NegationOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.4137225510174423 < 14.77603353750171. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 99.06292494982057 (T) = (0 -1.6397682362265542) / Math.Sqrt((2.4468833944381214 / (299)) + (0.017066703587781017 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.8523558361363833 = (11.106217769239144 - 1.6397682362265542) / 11.106217769239144 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix4x4.SubtractOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.590232138581563 < 14.356451328488061. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 67.70807734009504 (T) = (0 -2.641847785021854) / Math.Sqrt((2.2192374413482265 / (299)) + (0.502352351054619 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.8281005488364658 = (15.368564397035616 - 2.641847785021854) / 15.368564397035616 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix4x4.EqualityOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.1636128880117744 < 12.698787920829234. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 160.1115043116562 (T) = (0 -2.4525403554533556) / Math.Sqrt((0.05806483311204927 / (299)) + (0.07859551645180779 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.8151152923985234 = (13.26524182162142 - 2.4525403554533556) / 13.26524182162142 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix4x4.MultiplyByScalarBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.643916212739703 < 10.249097057551584. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 141.1577242391563 (T) = (0 -1.4637569620459943) / Math.Sqrt((1.1647308710660944 / (299)) + (0.012707432895016694 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.8674011328569725 = (11.038985427131262 - 1.4637569620459943) / 11.038985427131262 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix4x4.CreateFromAxisAngleBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 4.737558894760987 < 33.19499815916365. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 158.36240712715994 (T) = (0 -4.707350490287398) / Math.Sqrt((0.6213718849415166 / (299)) + (0.633473584640531 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.8665731297142627 = (35.28037853399751 - 4.707350490287398) / 35.28037853399751 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix4x4.CreateScaleFromVectorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.9194216770517896 < 7.52599114242911. IsChangePoint: Marked as a change because one of 12/5/2022 11:02:29 AM, 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 101.93961481993574 (T) = (0 -1.8378553802830397) / Math.Sqrt((1.472917834390886 / (299)) + (0.009012210948717705 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.8033840875153386 = (9.34743967086803 - 1.8378553802830397) / 9.34743967086803 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix4x4.CreateRotationZBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.3014597427873318 < 8.989685603692463. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 134.4451131406332 (T) = (0 -1.4785142066773065) / Math.Sqrt((0.4110932021912078 / (299)) + (0.03713343991485715 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.8420639407655376 = (9.36147333195387 - 1.4785142066773065) / 9.36147333195387 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix4x4.EqualsBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.3246768928122234 < 12.821779075402068. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 63.019833946248156 (T) = (0 -6.084151865738365) / Math.Sqrt((0.0656852488103217 / (299)) + (0.26976687661142673 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.5608847725698309 = (13.85547912183461 - 6.084151865738365) / 13.85547912183461 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix4x4.CreateTranslationFromVectorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.772150201791584 < 7.79587081068637. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 120.26621233686352 (T) = (0 -1.596989961729198) / Math.Sqrt((0.2909546443067262 / (299)) + (0.03990095401049296 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.8096427465192753 = (8.38943582410379 - 1.596989961729198) / 8.38943582410379 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix4x4.CreateWorldBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 26.17406889236368 < 40.39435725849319. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 237.2718575851205 (T) = (0 -26.444848063071763) / Math.Sqrt((0.5098895659854006 / (299)) + (0.05465468582459725 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.38188951709296903 = (42.78336768970361 - 26.444848063071763) / 42.78336768970361 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 1 year ago

Run Information

Architecture arm64
OS Windows 10.0.19041
Baseline 87312f7d6ff270519a4d13d31fbcaa99748654f8
Compare f08d13f7f912dd3d89508b3ccd48f47c85c56ddd
Diff Diff

Improvements in System.Numerics.Tests.Perf_Matrix3x2

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[CreateScaleFromScalarWithCenterBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix3x2.CreateScaleFromScalarWithCenterBenchmark.html>) 9.06 ns 1.10 ns 0.12 0.16 False
[IdentityBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix3x2.IdentityBenchmark.html>) 3.29 ns 1.11 ns 0.34 0.31 False
[IsIdentityBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix3x2.IsIdentityBenchmark.html>) 9.51 ns 0.00 ns 0.00 0.56 False
[CreateRotationBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix3x2.CreateRotationBenchmark.html>) 38.79 ns 24.67 ns 0.64 0.48 False
[CreateScaleFromVectorWithCenterBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix3x2.CreateScaleFromVectorWithCenterBenchmark.html>) 7.65 ns 1.21 ns 0.16 0.09 False
[MultiplyByMatrixOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix3x2.MultiplyByMatrixOperatorBenchmark.html>) 15.08 ns 5.56 ns 0.37 0.36 False
[MultiplyByMatrixBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix3x2.MultiplyByMatrixBenchmark.html>) 14.92 ns 5.52 ns 0.37 0.35 False
[InequalityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix3x2.InequalityOperatorBenchmark.html>) 7.46 ns 0.28 ns 0.04 0.55 False
[SubtractOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix3x2.SubtractOperatorBenchmark.html>) 11.81 ns 1.94 ns 0.16 0.10 False
[MultiplyByScalarBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix3x2.MultiplyByScalarBenchmark.html>) 9.49 ns 1.32 ns 0.14 0.11 False
[NegateBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix3x2.NegateBenchmark.html>) 9.67 ns 1.07 ns 0.11 0.11 False
[SubtractBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix3x2.SubtractBenchmark.html>) 10.95 ns 1.94 ns 0.18 0.11 False
[EqualityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix3x2.EqualityOperatorBenchmark.html>) 7.51 ns 0.70 ns 0.09 0.57 False
[CreateScaleFromScalarBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix3x2.CreateScaleFromScalarBenchmark.html>) 7.58 ns 1.14 ns 0.15 0.22 False
[CreateFromScalars - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix3x2.CreateFromScalars.html>) 6.88 ns 2.81 ns 0.41 0.37 False
[NegationOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix3x2.NegationOperatorBenchmark.html>) 9.39 ns 1.15 ns 0.12 0.10 False
[CreateScaleFromScalarXYWithCenterBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix3x2.CreateScaleFromScalarXYWithCenterBenchmark.html>) 7.74 ns 1.13 ns 0.15 0.09 False
[AddOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix3x2.AddOperatorBenchmark.html>) 11.35 ns 1.75 ns 0.15 0.11 False
[CreateScaleFromScalarXYBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix3x2.CreateScaleFromScalarXYBenchmark.html>) 7.72 ns 1.12 ns 0.15 0.18 False
[MultiplyByScalarOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix3x2.MultiplyByScalarOperatorBenchmark.html>) 9.42 ns 1.13 ns 0.12 0.12 False
[AddBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Matrix3x2.AddBenchmark.html>) 11.57 ns 1.73 ns 0.15 0.12 False

graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_Matrix3x2*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_Matrix3x2.CreateScaleFromScalarWithCenterBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.1049781483176184 < 7.293043607636386. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 258.59283350936903 (T) = (0 -1.1308244861007197) / Math.Sqrt((0.08992170995319677 / (299)) + (0.00589825772658124 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.8514676617909658 = (7.613321783901862 - 1.1308244861007197) / 7.613321783901862 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix3x2.IdentityBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.1125874219742458 < 2.9997075322234945. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 60.60883188028559 (T) = (0 -1.0719508163166849) / Math.Sqrt((0.230028708344809 / (299)) + (0.006189113954980942 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.653551488526068 = (3.094112922454691 - 1.0719508163166849) / 3.094112922454691 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix3x2.IsIdentityBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 0 < 9.043134867101799. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 194.45231006750362 (T) = (0 -0.15544318169558102) / Math.Sqrt((0.39028879508864395 / (299)) + (0.015116517465162 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.9830331617219145 = (9.161587984035446 - 0.15544318169558102) / 9.161587984035446 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix3x2.CreateRotationBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 24.666739124043055 < 35.063566938446066. IsChangePoint: Marked as a change because one of 12/28/2022 5:18:18 AM, 1/6/2023 2:21:07 AM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 7.191054675010755 (T) = (0 -24.480954667833867) / Math.Sqrt((14.629695499375307 / (299)) + (10.409166332658836 / (21))) is greater than 1.967451947860886 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (21) - 2, .975) and 0.1781537495799093 = (29.78775489371681 - 24.480954667833867) / 29.78775489371681 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix3x2.CreateScaleFromVectorWithCenterBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.2078318287741279 < 7.259953735635973. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 235.1612768166252 (T) = (0 -1.2113446933531609) / Math.Sqrt((0.17510140687838072 / (299)) + (0.0034808868224447667 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.8441971487098946 = (7.774855744440988 - 1.2113446933531609) / 7.774855744440988 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix3x2.MultiplyByMatrixOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.5564824860501245 < 14.176241057250557. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 214.77122836694076 (T) = (0 -5.51011275278175) / Math.Sqrt((0.43900816760530925 / (299)) + (0.010698469869386018 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.6390164435975388 = (15.264165514061581 - 5.51011275278175) / 15.264165514061581 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix3x2.MultiplyByMatrixBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.52034685684464 < 14.248047433245208. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 228.1966294911908 (T) = (0 -5.478962754320168) / Math.Sqrt((0.38989330813708645 / (299)) + (0.010167407957503163 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.6429233517723353 = (15.343940247884522 - 5.478962754320168) / 15.343940247884522 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix3x2.InequalityOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 0.27610849291997386 < 7.168169183493753. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 102.12067039579175 (T) = (0 -0.557254653027407) / Math.Sqrt((0.5790852748911404 / (299)) + (0.057200231630448795 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.9291070714660122 = (7.860511119388246 - 0.557254653027407) / 7.860511119388246 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix3x2.SubtractOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.9392728198972966 < 10.652051063215092. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 327.21833677612085 (T) = (0 -1.8917722369040864) / Math.Sqrt((0.07867839960032022 / (299)) + (0.009832678402322026 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.8311085055666045 = (11.201110175800665 - 1.8917722369040864) / 11.201110175800665 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix3x2.MultiplyByScalarBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.3203065068621742 < 9.063541929708649. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 290.40745095912854 (T) = (0 -1.0913623693089738) / Math.Sqrt((0.11117458436408277 / (299)) + (0.008729573157732392 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.8862205323612785 = (9.591909612148346 - 1.0913623693089738) / 9.591909612148346 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix3x2.NegateBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.069054483712643 < 8.890618532815063. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 264.1535809528928 (T) = (0 -1.0341518188488315) / Math.Sqrt((0.19593631075053863 / (299)) + (0.006181607953301659 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.8897740367730732 = (9.382107341804586 - 1.0341518188488315) / 9.382107341804586 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix3x2.SubtractBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.9350919706022138 < 10.798439005772686. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 312.03124071517954 (T) = (0 -1.8781000958173593) / Math.Sqrt((0.05265453608648813 / (299)) + (0.01309847924787245 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.8331875820327111 = (11.258754706053397 - 1.8781000958173593) / 11.258754706053397 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix3x2.EqualityOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 0.6958540103483914 < 7.1393332360176345. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 115.65216950291062 (T) = (0 -0.6362617279261074) / Math.Sqrt((0.7313912665151101 / (299)) + (0.028125242727519754 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.9200539713875148 = (7.9586408351839255 - 0.6362617279261074) / 7.9586408351839255 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix3x2.CreateScaleFromScalarBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.1417180283160797 < 7.199956324083859. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 249.58333866360354 (T) = (0 -1.0828782376064943) / Math.Sqrt((0.10649182670125988 / (299)) + (0.005291168780675099 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.8545805907230183 = (7.44658669011594 - 1.0828782376064943) / 7.44658669011594 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix3x2.CreateFromScalars ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.813594304065421 < 6.460381724438069. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 69.16731952936304 (T) = (0 -2.8297236186157066) / Math.Sqrt((0.1280465618535045 / (299)) + (0.052230673531078145 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.5851499399548664 = (6.821075591281937 - 2.8297236186157066) / 6.821075591281937 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix3x2.NegationOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.151736139115354 < 8.87147078705686. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 301.568613930785 (T) = (0 -1.0622790658769103) / Math.Sqrt((0.09930977530493858 / (299)) + (0.007742558581615581 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.8868522406316527 = (9.388423348435126 - 1.0622790658769103) / 9.388423348435126 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix3x2.CreateScaleFromScalarXYWithCenterBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.1296811097726007 < 7.3532903299933245. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 177.56539090719983 (T) = (0 -1.109576508090863) / Math.Sqrt((0.16222137920339683 / (299)) + (0.01358650311992395 / (17))) is greater than 1.9675476980854363 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (17) - 2, .975) and 0.8542674436686213 = (7.613786075143134 - 1.109576508090863) / 7.613786075143134 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix3x2.AddOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.7504853587380393 < 10.636329266818553. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 252.8519089149378 (T) = (0 -1.9201909432293496) / Math.Sqrt((0.20279660125608467 / (299)) + (0.01199613388357094 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.828436636852478 = (11.192313486989867 - 1.9201909432293496) / 11.192313486989867 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix3x2.CreateScaleFromScalarXYBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.1209079884880255 < 7.107006606674415. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 96.42428269081006 (T) = (0 -1.0175338174576973) / Math.Sqrt((0.15189148326758772 / (299)) + (0.06986900825876034 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.862607587779735 = (7.406040850541336 - 1.0175338174576973) / 7.406040850541336 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix3x2.MultiplyByScalarOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.1278298039032542 < 8.996167533259271. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 275.2976344502775 (T) = (0 -1.0896518263293005) / Math.Sqrt((0.19725593166562566 / (299)) + (0.005107705952100132 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.88584927069653 = (9.545728117360142 - 1.0896518263293005) / 9.545728117360142 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix3x2.AddBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.7289036929593766 < 10.64428404402612. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 347.5295698876916 (T) = (0 -1.9046946860086456) / Math.Sqrt((0.05201436325489554 / (299)) + (0.009844253748116982 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.8304750879706134 = (11.235485470586605 - 1.9046946860086456) / 11.235485470586605 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture arm64
OS Windows 10.0.19041
Baseline 87312f7d6ff270519a4d13d31fbcaa99748654f8
Compare f08d13f7f912dd3d89508b3ccd48f47c85c56ddd
Diff Diff

Improvements in System.Numerics.Tests.Perf_Vector2

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[TransformByMatrix3x2Benchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Vector2.TransformByMatrix3x2Benchmark.html>) 5.36 ns 1.62 ns 0.30 0.17 False
[TransformNormalByMatrix3x2Benchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Vector2.TransformNormalByMatrix3x2Benchmark.html>) 4.76 ns 0.96 ns 0.20 0.09 False
[TransformByMatrix4x4Benchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_Vector2.TransformByMatrix4x4Benchmark.html>) 6.75 ns 5.58 ns 0.83 0.21 False

graph graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_Vector2*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_Vector2.TransformByMatrix3x2Benchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.6220021238616078 < 5.0238338786402705. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 118.30654359355506 (T) = (0 -1.2692450454261668) / Math.Sqrt((0.17884606349853827 / (299)) + (0.01681699844654941 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.7848918336994656 = (5.900496793101123 - 1.2692450454261668) / 5.900496793101123 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector2.TransformNormalByMatrix3x2Benchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 0.9600059550870178 < 4.520211109897602. IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 138.55416210893324 (T) = (0 -0.9173834719866709) / Math.Sqrt((0.08644580039773211 / (299)) + (0.011712952233207013 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.8223847152013065 = (5.165002961464829 - 0.9173834719866709) / 5.165002961464829 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector2.TransformByMatrix4x4Benchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.581248791473168 < 6.285457313678075. IsChangePoint: Marked as a change because one of 12/28/2022 5:18:18 AM, 1/6/2023 8:18:17 PM, 1/12/2023 6:14:36 AM falls between 1/3/2023 3:01:43 PM and 1/12/2023 6:14:36 AM. IsImprovementStdDev: Marked as improvement because 37.42790556283349 (T) = (0 -5.726171266024378) / Math.Sqrt((0.12449187818318094 / (299)) + (0.017232204176571272 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.1950141962532658 = (7.113381676263641 - 5.726171266024378) / 7.113381676263641 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)