performanceautofiler[bot]
commented
2 years ago Run Information
| Architecture | x64 |
|---|---|
| OS | ubuntu 18.04 |
| Baseline | f745eb9faee1bd67886bf7f7b684821424aa014d |
| Compare | 2b07c8c46523b816b1eac5c8af092e52b20a69d2 |
| Diff | Diff |
Regressions in System.Numerics.Tests.Perf_Quaternion
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [CreateFromRotationMatrixBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_Quaternion.CreateFromRotationMatrixBenchmark.html>) | 125.39 ns | 152.91 ns | 1.22 | 0.14 | False | |||||
| [NegationOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_Quaternion.NegationOperatorBenchmark.html>) | 122.34 ns | 142.07 ns | 1.16 | 0.12 | False | |||||
| [CreateFromYawPitchRollBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_Quaternion.CreateFromYawPitchRollBenchmark.html>) | 175.79 ns | 205.10 ns | 1.17 | 0.16 | False | |||||
| [NormalizeBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_Quaternion.NormalizeBenchmark.html>) | 159.10 ns | 175.30 ns | 1.10 | 0.12 | False | |||||
| [MultiplyByScalarBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_Quaternion.MultiplyByScalarBenchmark.html>) | 136.74 ns | 155.89 ns | 1.14 | 0.10 | False | |||||
| [CreateFromAxisAngleBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_Quaternion.CreateFromAxisAngleBenchmark.html>) | 139.39 ns | 156.23 ns | 1.12 | 0.16 | False | |||||
| [InverseBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_Quaternion.InverseBenchmark.html>) | 156.67 ns | 188.35 ns | 1.20 | 0.12 | False | |||||
| [ConcatenateBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_Quaternion.ConcatenateBenchmark.html>) | 233.07 ns | 259.41 ns | 1.11 | 0.14 | False | |||||
| [MultiplyByScalarOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_Quaternion.MultiplyByScalarOperatorBenchmark.html>) | 125.46 ns | 143.14 ns | 1.14 | 0.13 | False | |||||
| [ConjugateBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_Quaternion.ConjugateBenchmark.html>) | 118.95 ns | 149.62 ns | 1.26 | 0.14 | False | |||||
| [MultiplyByQuaternionBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_Quaternion.MultiplyByQuaternionBenchmark.html>) | 269.28 ns | 300.14 ns | 1.11 | 0.07 | False | |||||
| [MultiplyByQuaternionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_Quaternion.MultiplyByQuaternionOperatorBenchmark.html>) | 236.73 ns | 264.54 ns | 1.12 | 0.17 | False |
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_Quaternion*'Related Issues
Regressions
Improvements
- [Perf] Windows/x64: 1 Improvement on 10/11/2022 10:51:47 AM
- [Perf] Windows/x86: 1 Improvement on 10/11/2022 10:51:47 AM
### Payloads
[Baseline]()
[Compare]()
### Histogram
### Edge Detector Info
[Collection Data]()
#### System.Numerics.Tests.Perf_Quaternion.CreateFromRotationMatrixBenchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 152.90988273012604 > 131.419026912988.
IsChangePoint: Marked as a change because one of 10/11/2022 6:23:40 AM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsRegressionStdDev: Marked as regression because -12.276061899892563 (T) = (0 -157.00862477633922) / Math.Sqrt((6.156447806743617 / (20)) + (25.203267019023883 / (4))) is less than -2.073873067894501 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (20) + (4) - 2, .025) and -0.25156120903759877 = (125.45021661151728 - 157.00862477633922) / 125.45021661151728 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Quaternion.NegationOperatorBenchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 142.07089593057177 > 127.90752965027916.
IsChangePoint: Marked as a change because one of 7/19/2022 10:33:10 AM, 10/11/2022 6:23:40 AM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsRegressionStdDev: Marked as regression because -26.976449554195906 (T) = (0 -140.73739450852557) / Math.Sqrt((2.950986089014227 / (16)) + (7.294513769245356 / (26))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (16) + (26) - 2, .025) and -0.15036032319375434 = (122.34201029969049 - 140.73739450852557) / 122.34201029969049 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Quaternion.CreateFromYawPitchRollBenchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 205.09616318884855 > 184.74256709760377.
IsChangePoint: Marked as a change because one of 7/19/2022 5:42:31 PM, 9/23/2022 2:49:56 PM, 10/11/2022 6:23:40 AM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsRegressionStdDev: Marked as regression because -4.985649532311814 (T) = (0 -201.3921984936399) / Math.Sqrt((110.9754047617291 / (18)) + (154.2100504930996 / (4))) is less than -2.0859634472534285 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (18) + (4) - 2, .025) and -0.1983887845055949 = (168.0524727012744 - 201.3921984936399) / 168.0524727012744 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Quaternion.NormalizeBenchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 175.29550660106278 > 165.86239097441103.
IsChangePoint: Marked as a change because one of 10/11/2022 6:23:40 AM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsRegressionStdDev: Marked as regression because -31.386403714489333 (T) = (0 -173.0635100696496) / Math.Sqrt((3.15966737722625 / (18)) + (2.8691360005616846 / (30))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (18) + (30) - 2, .025) and -0.10429034465535005 = (156.71920967819642 - 173.0635100696496) / 156.71920967819642 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Quaternion.MultiplyByScalarBenchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 155.88969729579483 > 145.04405490025064.
IsChangePoint: Marked as a change because one of 7/19/2022 10:33:10 AM, 10/11/2022 6:23:40 AM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsRegressionStdDev: Marked as regression because -23.92746490206352 (T) = (0 -155.41807331692246) / Math.Sqrt((5.353556616302134 / (19)) + (6.239217175190184 / (30))) is less than -2.011740513728388 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (30) - 2, .025) and -0.12074987003420888 = (138.6732914028164 - 155.41807331692246) / 138.6732914028164 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Quaternion.CreateFromAxisAngleBenchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 156.23044928457549 > 146.76816169940645.
IsChangePoint: Marked as a change because one of 7/20/2022 9:49:36 AM, 10/11/2022 6:23:40 AM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsRegressionStdDev: Marked as regression because -5.222876364577877 (T) = (0 -158.70717012048843) / Math.Sqrt((21.297203572713723 / (19)) + (46.417765581360555 / (4))) is less than -2.079613844716807 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (4) - 2, .025) and -0.13300911904741666 = (140.07581002871567 - 158.70717012048843) / 140.07581002871567 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Quaternion.InverseBenchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 188.35173443012084 > 166.1469699664517.
IsChangePoint: Marked as a change because one of 10/11/2022 6:23:40 AM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsRegressionStdDev: Marked as regression because -23.190524879344885 (T) = (0 -185.02275283409992) / Math.Sqrt((16.971543508364523 / (19)) + (7.048093007413185 / (28))) is less than -2.0141033888794695 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (28) - 2, .025) and -0.1548888549702693 = (160.20827635302015 - 185.02275283409992) / 160.20827635302015 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Quaternion.ConcatenateBenchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 259.4084274629835 > 244.81102414781375.
IsChangePoint: Marked as a change because one of 9/7/2022 8:46:47 AM, 9/23/2022 4:51:48 AM, 10/11/2022 6:23:40 AM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsRegressionStdDev: Marked as regression because -9.933624318590065 (T) = (0 -258.9788682559691) / Math.Sqrt((18.360960870826705 / (20)) + (18.16308418780311 / (4))) is less than -2.073873067894501 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (20) + (4) - 2, .025) and -0.0984393745504236 = (235.76983332554482 - 258.9788682559691) / 235.76983332554482 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Quaternion.MultiplyByScalarOperatorBenchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 143.13776974071442 > 131.481376803693.
IsChangePoint: Marked as a change because one of 7/19/2022 10:33:10 AM, 10/11/2022 6:23:40 AM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsRegressionStdDev: Marked as regression because -16.275516462902747 (T) = (0 -143.37574924277294) / Math.Sqrt((10.146719320575514 / (20)) + (20.68116581014655 / (30))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (20) + (30) - 2, .025) and -0.14178770259194348 = (125.57128520240607 - 143.37574924277294) / 125.57128520240607 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Quaternion.ConjugateBenchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 149.62201115462622 > 125.46632708663859.
IsChangePoint: Marked as a change because one of 7/19/2022 10:33:10 AM, 10/11/2022 6:23:40 AM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsRegressionStdDev: Marked as regression because -16.13231162453555 (T) = (0 -148.73763837322426) / Math.Sqrt((29.084720603528087 / (18)) + (3.883047557071334 / (4))) is less than -2.0859634472534285 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (18) + (4) - 2, .025) and -0.21129462154905287 = (122.79228828987328 - 148.73763837322426) / 122.79228828987328 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Quaternion.MultiplyByQuaternionBenchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 300.1395098060353 > 283.6012450923734.
IsChangePoint: Marked as a change because one of 7/19/2022 10:33:10 AM, 9/7/2022 8:46:47 AM, 9/23/2022 4:51:48 AM, 10/11/2022 6:23:40 AM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsRegressionStdDev: Marked as regression because -21.416068182615206 (T) = (0 -301.47614541299305) / Math.Sqrt((21.362007116800715 / (18)) + (20.730552419361906 / (30))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (18) + (30) - 2, .025) and -0.10784226190011656 = (272.12912503980124 - 301.47614541299305) / 272.12912503980124 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Quaternion.MultiplyByQuaternionOperatorBenchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 264.5442097818664 > 248.80508819415672.
IsChangePoint: Marked as a change because one of 9/7/2022 8:46:47 AM, 9/23/2022 4:51:48 AM, 10/11/2022 6:23:40 AM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsRegressionStdDev: Marked as regression because -16.454777053997688 (T) = (0 -265.30667614064237) / Math.Sqrt((19.064026620809155 / (20)) + (54.365147578728035 / (30))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (20) + (30) - 2, .025) and -0.11499932193347724 = (237.94335200185083 - 265.30667614064237) / 237.94335200185083 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x64 |
|---|---|
| OS | ubuntu 18.04 |
| Baseline | f745eb9faee1bd67886bf7f7b684821424aa014d |
| Compare | 2b07c8c46523b816b1eac5c8af092e52b20a69d2 |
| Diff | Diff |
Regressions in System.Memory.ReadOnlySequence
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [Slice_Repeat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/System.Memory.ReadOnlySequence.Slice_Repeat(Segment%3a%20Single).html>) | 991.92 ns | 1.10 μs | 1.11 | 0.09 | False |
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Memory.ReadOnlySequence*'Related Issues
Regressions
Improvements
- [Perf] Windows/x64: 1 Improvement on 10/11/2022 10:51:47 AM
- [Perf] Windows/x86: 1 Improvement on 10/11/2022 10:51:47 AM
### Payloads
[Baseline]()
[Compare]()
### Histogram
### Edge Detector Info
[Collection Data]()
#### System.Memory.ReadOnlySequence.Slice_Repeat(Segment: Single)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 1.099906840894385 > 1048.1654207258528.
IsChangePoint: Marked as a change because one of 7/19/2022 10:33:10 AM, 10/11/2022 6:23:40 AM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsRegressionStdDev: Marked as regression because -5.919889415931911 (T) = (0 -1081.797584325869) / Math.Sqrt((761.4957932349139 / (19)) + (2407.303438762993 / (30))) is less than -2.011740513728388 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (30) - 2, .025) and -0.06385937235657961 = (1016.8614503339421 - 1081.797584325869) / 1016.8614503339421 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
lewing
Run Information
Regressions in System.Numerics.Tests.Perf_Matrix4x4
Repro
Related Issues
Regressions
Improvements