performanceautofiler[bot]
commented
1 year ago Run Information
| Architecture | x64 |
|---|---|
| OS | Windows 10.0.18362 |
| Baseline | 067e43a1363f6d1748acc679f1804cd48299ba89 |
| Compare | 776a87d9f0c9105c2729d1ab781d74bffa2a182b |
| Diff | Diff |
Improvements in System.Numerics.Tests.Perf_VectorOf<SByte>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [DotBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Numerics.Tests.Perf_VectorOf(SByte).DotBenchmark.html>) | 105.89 ns | 31.33 ns | 0.30 | 0.00 | False | |||||
| [MultiplyBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Numerics.Tests.Perf_VectorOf(SByte).MultiplyBenchmark.html>) | 51.08 ns | 34.51 ns | 0.68 | 0.03 | False | |||||
| [DivideBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Numerics.Tests.Perf_VectorOf(SByte).DivideBenchmark.html>) | 116.07 ns | 89.64 ns | 0.77 | 0.01 | False | |||||
| [SquareRootBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Numerics.Tests.Perf_VectorOf(SByte).SquareRootBenchmark.html>) | 67.56 ns | 41.45 ns | 0.61 | 0.02 | False | |||||
| [MultiplyOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Numerics.Tests.Perf_VectorOf(SByte).MultiplyOperatorBenchmark.html>) | 51.53 ns | 34.65 ns | 0.67 | 0.05 | False | |||||
| [DivisionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Numerics.Tests.Perf_VectorOf(SByte).DivisionOperatorBenchmark.html>) | 109.74 ns | 89.71 ns | 0.82 | 0.01 | False |
_1.png>)
_2.png>)
_3.png>)
_4.png>)
_5.png>)
_6.png>)
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf<SByte>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Numerics.Tests.Perf_VectorOf<SByte>.DotBenchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 31.3265407071442 < 100.12337031365782.
IsChangePoint: Marked as a change because one of 12/1/2022 8:17:56 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 1085.0526397113963 (T) = (0 -31.312890275611668) / Math.Sqrt((0.32216112706339195 / (299)) + (0.08027403222336625 / (22))) is greater than 1.9674283869023508 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (22) - 2, .975) and 0.704338882148665 = (105.90804263737002 - 31.312890275611668) / 105.90804263737002 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_VectorOf<SByte>.MultiplyBenchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 34.51406599046631 < 48.68608977717164.
IsChangePoint: Marked as a change because one of 11/7/2022 4:10:19 PM, 11/18/2022 8:48:12 PM, 12/1/2022 8:17:56 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 84.59789353580807 (T) = (0 -34.580877579957736) / Math.Sqrt((14.570066707965843 / (299)) + (0.04289664791406006 / (22))) is greater than 1.9674283869023508 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (22) - 2, .975) and 0.35514217499906336 = (53.62558418192027 - 34.580877579957736) / 53.62558418192027 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_VectorOf<SByte>.DivideBenchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 89.64376121662619 < 109.90455427986426.
IsChangePoint: Marked as a change because one of 11/16/2022 6:51:59 PM, 12/1/2022 8:17:56 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 145.21360707162327 (T) = (0 -89.51341246249252) / Math.Sqrt((6.161059588613052 / (299)) + (0.07906935374741886 / (22))) is greater than 1.9674283869023508 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (22) - 2, .975) and 0.20150862158002308 = (112.1031671495541 - 89.51341246249252) / 112.1031671495541 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_VectorOf<SByte>.SquareRootBenchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 41.45361666571716 < 64.04298298900657.
IsChangePoint: Marked as a change because one of 12/1/2022 8:17:56 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 169.68077089960343 (T) = (0 -40.56104681789318) / Math.Sqrt((5.004474147677063 / (299)) + (0.3332743003346826 / (22))) is greater than 1.9674283869023508 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (22) - 2, .975) and 0.427592566103051 = (70.86044732465061 - 40.56104681789318) / 70.86044732465061 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_VectorOf<SByte>.MultiplyOperatorBenchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 34.65430671091146 < 48.85763337572924.
IsChangePoint: Marked as a change because one of 11/2/2022 9:35:40 AM, 12/1/2022 8:17:56 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 73.85400285515958 (T) = (0 -34.65658417276337) / Math.Sqrt((33.56406918413135 / (299)) + (0.038199224385840384 / (22))) is greater than 1.9674283869023508 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (22) - 2, .975) and 0.4184312617017768 = (59.59155279593413 - 34.65658417276337) / 59.59155279593413 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_VectorOf<SByte>.DivisionOperatorBenchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 89.70954630250158 < 104.25619572919246.
IsChangePoint: Marked as a change because one of 11/2/2022 9:35:40 AM, 12/1/2022 8:17:56 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 121.9097993675861 (T) = (0 -89.46011877545934) / Math.Sqrt((10.48658602610499 / (299)) + (0.08877675895123194 / (22))) is greater than 1.9674283869023508 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (22) - 2, .975) and 0.21228075986920533 = (113.56853332743933 - 89.46011877545934) / 113.56853332743933 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x64 |
|---|---|
| OS | Windows 10.0.18362 |
| Baseline | 067e43a1363f6d1748acc679f1804cd48299ba89 |
| Compare | 776a87d9f0c9105c2729d1ab781d74bffa2a182b |
| Diff | Diff |
Improvements in System.Numerics.Tests.Perf_VectorOf<Int16>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [SquareRootBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Numerics.Tests.Perf_VectorOf(Int16).SquareRootBenchmark.html>) | 36.36 ns | 22.56 ns | 0.62 | 0.03 | False | |||||
| [DivideBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Numerics.Tests.Perf_VectorOf(Int16).DivideBenchmark.html>) | 55.47 ns | 44.68 ns | 0.81 | 0.00 | False | |||||
| [DivisionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Numerics.Tests.Perf_VectorOf(Int16).DivisionOperatorBenchmark.html>) | 55.12 ns | 44.34 ns | 0.80 | 0.01 | False |
_1.png>)
_2.png>)
_3.png>)
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf<Int16>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Numerics.Tests.Perf_VectorOf<Int16>.SquareRootBenchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 22.555607424999494 < 34.26661059629469.
IsChangePoint: Marked as a change because one of 12/1/2022 8:17:56 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 191.11064240578725 (T) = (0 -22.212435847433287) / Math.Sqrt((0.2726470990055057 / (299)) + (0.10233282158482251 / (22))) is greater than 1.9674283869023508 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (22) - 2, .975) and 0.39088903822459165 = (36.46697767955039 - 22.212435847433287) / 36.46697767955039 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_VectorOf<Int16>.DivideBenchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 44.678868163161546 < 52.79790160332212.
IsChangePoint: Marked as a change because one of 12/1/2022 8:17:56 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 252.32570132697506 (T) = (0 -44.65230904742141) / Math.Sqrt((0.1351950397251506 / (299)) + (0.03075230845616504 / (22))) is greater than 1.9674283869023508 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (22) - 2, .975) and 0.19552951278739603 = (55.50521710515004 - 44.65230904742141) / 55.50521710515004 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_VectorOf<Int16>.DivisionOperatorBenchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 44.34150867893306 < 52.357397831888754.
IsChangePoint: Marked as a change because one of 12/1/2022 8:17:56 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 243.86336665100674 (T) = (0 -44.30886760425995) / Math.Sqrt((0.23463352898220718 / (299)) + (0.02752516908165895 / (22))) is greater than 1.9674283869023508 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (22) - 2, .975) and 0.19893047269744304 = (55.31213720419661 - 44.30886760425995) / 55.31213720419661 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x64 |
|---|---|
| OS | Windows 10.0.18362 |
| Baseline | 067e43a1363f6d1748acc679f1804cd48299ba89 |
| Compare | 776a87d9f0c9105c2729d1ab781d74bffa2a182b |
| Diff | Diff |
Improvements in System.Numerics.Tests.Perf_VectorOf<UInt64>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [DivisionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Numerics.Tests.Perf_VectorOf(UInt64).DivisionOperatorBenchmark.html>) | 34.70 ns | 29.99 ns | 0.86 | 0.00 | False | |||||
| [DivideBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Numerics.Tests.Perf_VectorOf(UInt64).DivideBenchmark.html>) | 34.71 ns | 30.01 ns | 0.86 | 0.00 | False | |||||
| [SquareRootBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Numerics.Tests.Perf_VectorOf(UInt64).SquareRootBenchmark.html>) | 16.26 ns | 11.40 ns | 0.70 | 0.17 | False | |||||
| [MultiplyBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Numerics.Tests.Perf_VectorOf(UInt64).MultiplyBenchmark.html>) | 9.92 ns | 7.39 ns | 0.74 | 0.13 | False | |||||
| [DotBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Numerics.Tests.Perf_VectorOf(UInt64).DotBenchmark.html>) | 10.97 ns | 2.31 ns | 0.21 | 0.10 | False | |||||
| [MultiplyOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Numerics.Tests.Perf_VectorOf(UInt64).MultiplyOperatorBenchmark.html>) | 9.88 ns | 7.39 ns | 0.75 | 0.02 | False |
_1.png>)
_2.png>)
_3.png>)
_4.png>)
_5.png>)
_6.png>)
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf<UInt64>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Numerics.Tests.Perf_VectorOf<UInt64>.DivisionOperatorBenchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 29.98861645272408 < 32.9850518824407.
IsChangePoint: Marked as a change because one of 11/2/2022 9:35:40 AM, 12/1/2022 8:17:56 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 99.39968232512885 (T) = (0 -29.87620643598275) / Math.Sqrt((0.31759741767564426 / (299)) + (0.024099787160271453 / (22))) is greater than 1.9674283869023508 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (22) - 2, .975) and 0.1338564423743734 = (34.493365647009924 - 29.87620643598275) / 34.493365647009924 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_VectorOf<UInt64>.DivideBenchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 30.01392564289959 < 33.034243580650134.
IsChangePoint: Marked as a change because one of 11/2/2022 9:35:40 AM, 12/1/2022 8:17:56 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 73.67500344709262 (T) = (0 -29.87030059433154) / Math.Sqrt((0.4542500996180683 / (299)) + (0.049824580812185326 / (22))) is greater than 1.9674283869023508 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (22) - 2, .975) and 0.1317366805963583 = (34.402352289680586 - 29.87030059433154) / 34.402352289680586 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_VectorOf<UInt64>.SquareRootBenchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 11.40031883951683 < 15.238950648038164.
IsChangePoint: Marked as a change because one of 12/1/2022 8:17:56 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 94.35978588217851 (T) = (0 -11.261620028110485) / Math.Sqrt((0.257337628417535 / (299)) + (0.03122459143744514 / (22))) is greater than 1.9674283869023508 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (22) - 2, .975) and 0.2857564644088426 = (15.767199095179194 - 11.261620028110485) / 15.767199095179194 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_VectorOf<UInt64>.MultiplyBenchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 7.386231375407587 < 9.397993230730139.
IsChangePoint: Marked as a change because one of 11/2/2022 9:35:40 AM, 12/1/2022 8:17:56 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 35.463247378272946 (T) = (0 -7.46360030707518) / Math.Sqrt((0.5097042982643697 / (299)) + (0.016199771494401178 / (22))) is greater than 1.9674283869023508 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (22) - 2, .975) and 0.19012401513286906 = (9.215732342402603 - 7.46360030707518) / 9.215732342402603 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_VectorOf<UInt64>.DotBenchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 2.3093583886637936 < 10.419192139707482.
IsChangePoint: Marked as a change because one of 12/1/2022 8:17:56 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 261.0998353612349 (T) = (0 -2.342228134489903) / Math.Sqrt((0.22239733684900276 / (299)) + (0.010487812515580508 / (22))) is greater than 1.9674283869023508 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (22) - 2, .975) and 0.7956885149658588 = (11.464006216285428 - 2.342228134489903) / 11.464006216285428 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_VectorOf<UInt64>.MultiplyOperatorBenchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 7.386000278293859 < 9.406078899053593.
IsChangePoint: Marked as a change because one of 11/2/2022 9:35:40 AM, 12/1/2022 8:17:56 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 29.59766643540251 (T) = (0 -7.459725722955901) / Math.Sqrt((0.612320193387051 / (299)) + (0.017557774051810568 / (22))) is greater than 1.9674283869023508 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (22) - 2, .975) and 0.1746897205585497 = (9.038692366711414 - 7.459725722955901) / 9.038692366711414 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x64 |
|---|---|
| OS | Windows 10.0.18362 |
| Baseline | 067e43a1363f6d1748acc679f1804cd48299ba89 |
| Compare | 776a87d9f0c9105c2729d1ab781d74bffa2a182b |
| Diff | Diff |
Improvements in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [DotBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).DotBenchmark.html>) | 8.63 ns | 3.02 ns | 0.35 | 0.08 | False | |||||
| [DivisionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).DivisionOperatorBenchmark.html>) | 20.09 ns | 18.36 ns | 0.91 | 0.01 | False | |||||
| [MultiplyOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).MultiplyOperatorBenchmark.html>) | 10.51 ns | 8.99 ns | 0.86 | 0.01 | False | |||||
| [SumBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).SumBenchmark.html>) | 2.79 ns | 0.31 ns | 0.11 | 0.11 | False | |||||
| [MultiplyBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).MultiplyBenchmark.html>) | 10.53 ns | 8.99 ns | 0.85 | 0.01 | False | |||||
| [SquareRootBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).SquareRootBenchmark.html>) | 18.13 ns | 11.49 ns | 0.63 | 0.02 | False | |||||
| [DivideBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).DivideBenchmark.html>) | 20.55 ns | 18.60 ns | 0.91 | 0.01 | False |
_1.png>)
_2.png>)
_3.png>)
_4.png>)
_5.png>)
_6.png>)
_7.png>)
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.DotBenchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 3.023520833553826 < 8.210826204460815.
IsChangePoint: Marked as a change because one of 12/1/2022 8:17:56 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 203.25360714354616 (T) = (0 -3.026843153472559) / Math.Sqrt((0.09021525587083201 / (107)) + (4.158646056759655E-05 / (22))) is greater than 1.9788195347025928 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (107) + (22) - 2, .975) and 0.6612481244638334 = (8.935280870937643 - 3.026843153472559) / 8.935280870937643 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.DivisionOperatorBenchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 18.35875468409849 < 19.699586540906004.
IsChangePoint: Marked as a change because one of 12/1/2022 8:17:56 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 41.39637768732087 (T) = (0 -18.50245457485711) / Math.Sqrt((0.083065131868243 / (107)) + (0.027510130246578873 / (22))) is greater than 1.9788195347025928 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (107) + (22) - 2, .975) and 0.09150747994336886 = (20.366105572012586 - 18.50245457485711) / 20.366105572012586 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.MultiplyOperatorBenchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 8.985872368495766 < 9.980310569087742.
IsChangePoint: Marked as a change because one of 12/1/2022 8:17:56 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 269.3678673334769 (T) = (0 -8.974914354380838) / Math.Sqrt((0.0022871888203621453 / (107)) + (0.00024575053913175886 / (22))) is greater than 1.9788195347025928 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (107) + (22) - 2, .975) and 0.14619240264127806 = (10.511635621590848 - 8.974914354380838) / 10.511635621590848 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.SumBenchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.31470817748769003 < 2.649868922919597.
IsChangePoint: Marked as a change because one of 12/1/2022 8:17:56 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 308.5719954129174 (T) = (0 -0.3149064564120256) / Math.Sqrt((0.007012050124862154 / (107)) + (1.0874332479537331E-07 / (22))) is greater than 1.9788195347025928 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (107) + (22) - 2, .975) and 0.8880519728549459 = (2.812970129469031 - 0.3149064564120256) / 2.812970129469031 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.MultiplyBenchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 8.9917693159386 < 9.999512364327119.
IsChangePoint: Marked as a change because one of 12/1/2022 8:17:56 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 280.129616198516 (T) = (0 -8.995061339447277) / Math.Sqrt((0.002427770640970396 / (107)) + (0.000158679539593754 / (22))) is greater than 1.9788195347025928 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (107) + (22) - 2, .975) and 0.14551580053471663 = (10.5268901930266 - 8.995061339447277) / 10.5268901930266 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.SquareRootBenchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 11.489423804892436 < 17.176061996162915.
IsChangePoint: Marked as a change because one of 12/1/2022 8:17:56 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 300.6031336352912 (T) = (0 -11.45325230507319) / Math.Sqrt((0.05071917494302467 / (107)) + (0.0003327702956256717 / (22))) is greater than 1.9788195347025928 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (107) + (22) - 2, .975) and 0.3672768821953052 = (18.1015233722004 - 11.45325230507319) / 18.1015233722004 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.DivideBenchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 18.596311034465796 < 19.580019441450524.
IsChangePoint: Marked as a change because one of 12/1/2022 8:17:56 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 39.586099426415004 (T) = (0 -18.48219815280927) / Math.Sqrt((0.0726637419685429 / (107)) + (0.03431220022304583 / (22))) is greater than 1.9788195347025928 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (107) + (22) - 2, .975) and 0.09201721814996987 = (20.35522977115434 - 18.48219815280927) / 20.35522977115434 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x64 |
|---|---|
| OS | Windows 10.0.18362 |
| Baseline | 067e43a1363f6d1748acc679f1804cd48299ba89 |
| Compare | 776a87d9f0c9105c2729d1ab781d74bffa2a182b |
| Diff | Diff |
Improvements in System.Numerics.Tests.Perf_VectorOf<UInt16>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [SquareRootBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Numerics.Tests.Perf_VectorOf(UInt16).SquareRootBenchmark.html>) | 36.31 ns | 21.96 ns | 0.60 | 0.01 | False | |||||
| [DivisionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Numerics.Tests.Perf_VectorOf(UInt16).DivisionOperatorBenchmark.html>) | 54.90 ns | 44.49 ns | 0.81 | 0.01 | False | |||||
| [DivideBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Numerics.Tests.Perf_VectorOf(UInt16).DivideBenchmark.html>) | 54.92 ns | 44.35 ns | 0.81 | 0.00 | False |
_1.png>)
_2.png>)
_3.png>)
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf<UInt16>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Numerics.Tests.Perf_VectorOf<UInt16>.SquareRootBenchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 21.957202165093754 < 34.32094752324251.
IsChangePoint: Marked as a change because one of 12/1/2022 8:17:56 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 222.79032296820301 (T) = (0 -22.360309326586858) / Math.Sqrt((0.1428357307534969 / (299)) + (0.07672376534716431 / (22))) is greater than 1.9674283869023508 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (22) - 2, .975) and 0.3855251593132489 = (36.389300010390116 - 22.360309326586858) / 36.389300010390116 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_VectorOf<UInt16>.DivisionOperatorBenchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 44.493757751926296 < 52.167639895069684.
IsChangePoint: Marked as a change because one of 12/1/2022 8:17:56 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 220.28829050280402 (T) = (0 -44.26608687851916) / Math.Sqrt((0.30686908086642056 / (299)) + (0.03425243279943859 / (22))) is greater than 1.9674283869023508 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (22) - 2, .975) and 0.20187188448385737 = (55.46238256485008 - 44.26608687851916) / 55.46238256485008 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_VectorOf<UInt16>.DivideBenchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 44.347380749936654 < 52.172861575544935.
IsChangePoint: Marked as a change because one of 12/1/2022 8:17:56 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 290.91705381433053 (T) = (0 -44.26422455386193) / Math.Sqrt((0.1498712817095242 / (299)) + (0.022175514948953874 / (22))) is greater than 1.9674283869023508 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (22) - 2, .975) and 0.20339324953797325 = (55.56596718291549 - 44.26422455386193) / 55.56596718291549 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
_1.png>)
_2.png>)
_3.png>)
_1.png>)
_2.png>)
_3.png>)
_1.png>)
_2.png>)
_3.png>)
_4.png>)
_5.png>)
_6.png>)
_7.png>)
_1.png>)
_2.png>)
_3.png>)
_1.png>)
_2.png>)
_3.png>)
_4.png>)
_5.png>)
_6.png>)
_1.png>)
_2.png>)
_1.png>)
_2.png>)
_3.png>)
_4.png>)
_5.png>)
_6.png>)
_7.png>)
Run Information
Improvements in System.Numerics.Tests.Perf_VectorOf<UInt32>
Repro
Run Information
Improvements in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>
Repro
Run Information
Improvements in System.Numerics.Tests.Perf_VectorOf<Int64>
Repro
Run Information
Improvements in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>
Repro