performanceautofiler[bot]
commented
1 year ago Run Information
| Name | Value |
|---|---|
| Architecture | x64 |
| OS | ubuntu 18.04 |
| Queue | TigerUbuntu |
| Baseline | aef327f3b418bf5dd4f25083aff160c9cdf4b159 |
| Compare | 2f49fcff6df15a200ef01eea16b3ce7930f75c5c |
| Diff | Diff |
| Configs | CompilationMode:wasm, RunKind:micro |
Improvements in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [BitwiseOrBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).BitwiseOrBenchmark.html>) | 23.27 ns | 13.48 ns | 0.58 | 0.49 | False | |||||
| [ExclusiveOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).ExclusiveOrOperatorBenchmark.html>) | 25.81 ns | 13.89 ns | 0.54 | 0.46 | False | |||||
| [OnesComplementBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).OnesComplementBenchmark.html>) | 20.92 ns | 12.34 ns | 0.59 | 0.51 | False | |||||
| [BitwiseAndOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).BitwiseAndOperatorBenchmark.html>) | 24.57 ns | 14.46 ns | 0.59 | 0.54 | False | |||||
| [XorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).XorBenchmark.html>) | 24.67 ns | 12.94 ns | 0.52 | 0.54 | False | |||||
| [AndNotBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).AndNotBenchmark.html>) | 24.63 ns | 12.67 ns | 0.51 | 0.41 | False | |||||
| [AllBitsSetBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).AllBitsSetBenchmark.html>) | 17.71 ns | 11.25 ns | 0.64 | 0.46 | False | |||||
| [BitwiseAndBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).BitwiseAndBenchmark.html>) | 24.40 ns | 13.62 ns | 0.56 | 0.50 | False | |||||
| [EqualsAllBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).EqualsAllBenchmark.html>) | 13.81 ns | 8.10 ns | 0.59 | 0.63 | False | |||||
| [EqualsBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).EqualsBenchmark.html>) | 75.90 ns | 9.58 ns | 0.13 | 0.25 | False | |||||
| [ConditionalSelectBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).ConditionalSelectBenchmark.html>) | 30.12 ns | 15.58 ns | 0.52 | 0.38 | False | |||||
| [BitwiseOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).BitwiseOrOperatorBenchmark.html>) | 24.28 ns | 14.41 ns | 0.59 | 0.52 | False | |||||
| [OnesComplementOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).OnesComplementOperatorBenchmark.html>) | 23.69 ns | 14.72 ns | 0.62 | 0.52 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.BitwiseOrBenchmark
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 13.475267944211046 < 23.503927092055907.
IsChangePoint: Marked as a change because one of 5/18/2023 7:10:13 PM, 5/23/2023 2:36:40 AM falls between 5/14/2023 5:56:01 AM and 5/23/2023 2:36:40 AM.
IsImprovementStdDev: Marked as improvement because 40.984113679109754 (T) = (0 -13.311261088079986) / Math.Sqrt((17.880375076534005 / (299)) + (0.6065628443956359 / (19))) is greater than 1.9674995188240387 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (19) - 2, .975) and 0.4825305374688149 = (25.723761597386606 - 13.311261088079986) / 25.723761597386606 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.ExclusiveOrOperatorBenchmark
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 13.893286289871364 < 23.26880625739945.
IsChangePoint: Marked as a change because one of 5/18/2023 7:10:13 PM, 5/23/2023 2:36:40 AM falls between 5/14/2023 5:56:01 AM and 5/23/2023 2:36:40 AM.
IsImprovementStdDev: Marked as improvement because 30.962422520730083 (T) = (0 -13.505548456336257) / Math.Sqrt((15.301846407524591 / (299)) + (1.8800125781723571 / (19))) is greater than 1.9674995188240387 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (19) - 2, .975) and 0.4704169533133779 = (25.50222961409883 - 13.505548456336257) / 25.50222961409883 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.OnesComplementBenchmark
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 12.338092420179343 < 21.958733790070998.
IsChangePoint: Marked as a change because one of 5/18/2023 7:10:13 PM, 5/23/2023 2:36:40 AM falls between 5/14/2023 5:56:01 AM and 5/23/2023 2:36:40 AM.
IsImprovementStdDev: Marked as improvement because 38.374407245541214 (T) = (0 -12.616735357134294) / Math.Sqrt((18.30910529215189 / (299)) + (0.4137283559287262 / (19))) is greater than 1.9674995188240387 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (19) - 2, .975) and 0.46703971112172327 = (23.672937028176673 - 12.616735357134294) / 23.672937028176673 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.BitwiseAndOperatorBenchmark
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 14.461884476761728 < 22.756388966796987.
IsChangePoint: Marked as a change because one of 5/18/2023 7:10:13 PM, 5/23/2023 2:36:40 AM falls between 5/14/2023 5:56:01 AM and 5/23/2023 2:36:40 AM.
IsImprovementStdDev: Marked as improvement because 8.406817056327375 (T) = (0 -15.215680519455326) / Math.Sqrt((32.11073751882635 / (299)) + (31.884061041743653 / (19))) is greater than 1.9674995188240387 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (19) - 2, .975) and 0.42471830080028933 = (26.44909535732191 - 15.215680519455326) / 26.44909535732191 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.XorBenchmark
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 12.942804837969918 < 22.97748505231694.
IsChangePoint: Marked as a change because one of 3/23/2023 12:23:24 PM, 3/24/2023 11:37:29 AM, 5/18/2023 7:10:13 PM, 5/23/2023 2:36:40 AM falls between 5/14/2023 5:56:01 AM and 5/23/2023 2:36:40 AM.
IsImprovementStdDev: Marked as improvement because 37.369666002996695 (T) = (0 -13.349656406141733) / Math.Sqrt((17.95654961118411 / (299)) + (0.9236668120290287 / (19))) is greater than 1.9674995188240387 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (19) - 2, .975) and 0.47992232890560205 = (25.6685821139948 - 13.349656406141733) / 25.6685821139948 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.AndNotBenchmark
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 12.66857521678199 < 23.261330083965973.
IsChangePoint: Marked as a change because one of 4/8/2023 6:29:53 PM, 4/9/2023 11:24:15 AM, 5/18/2023 7:10:13 PM, 5/23/2023 2:36:40 AM falls between 5/14/2023 5:56:01 AM and 5/23/2023 2:36:40 AM.
IsImprovementStdDev: Marked as improvement because 44.98405418416429 (T) = (0 -13.213014388482959) / Math.Sqrt((14.293567462399666 / (299)) + (0.5413443795069417 / (19))) is greater than 1.9674995188240387 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (19) - 2, .975) and 0.48464006428150774 = (25.638419816359907 - 13.213014388482959) / 25.638419816359907 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.AllBitsSetBenchmark
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 11.251421366014089 < 17.20949240649502.
IsChangePoint: Marked as a change because one of 5/19/2023 12:51:11 AM, 5/23/2023 2:36:40 AM falls between 5/14/2023 5:56:01 AM and 5/23/2023 2:36:40 AM.
IsImprovementStdDev: Marked as improvement because 10.917254920946917 (T) = (0 -12.453456773146284) / Math.Sqrt((18.832964323594748 / (299)) + (5.087237808663448 / (17))) is greater than 1.9675476980854363 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (17) - 2, .975) and 0.3453858799287827 = (19.024118776709916 - 12.453456773146284) / 19.024118776709916 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.BitwiseAndBenchmark
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 13.621660164496154 < 23.441202852144972.
IsChangePoint: Marked as a change because one of 3/22/2023 7:51:01 PM, 3/23/2023 10:59:44 AM, 5/18/2023 7:10:13 PM, 5/23/2023 2:36:40 AM falls between 5/14/2023 5:56:01 AM and 5/23/2023 2:36:40 AM.
IsImprovementStdDev: Marked as improvement because 38.75059353889753 (T) = (0 -13.53856188159145) / Math.Sqrt((23.96533016505759 / (299)) + (0.42899076673118824 / (19))) is greater than 1.9674995188240387 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (19) - 2, .975) and 0.4784580450791091 = (25.958720585853964 - 13.53856188159145) / 25.958720585853964 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.EqualsAllBenchmark
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 8.095117081162936 < 13.242107648452473.
IsChangePoint: Marked as a change because one of 5/18/2023 7:10:13 PM, 5/23/2023 2:36:40 AM falls between 5/14/2023 5:56:01 AM and 5/23/2023 2:36:40 AM.
IsImprovementStdDev: Marked as improvement because 30.040011785157684 (T) = (0 -7.378580131970042) / Math.Sqrt((21.30122769387328 / (299)) + (0.24519897668237897 / (19))) is greater than 1.9674995188240387 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (19) - 2, .975) and 0.5414925188108904 = (16.092605758218323 - 7.378580131970042) / 16.092605758218323 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.EqualsBenchmark
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 9.582810318852168 < 69.5116509457504.
IsChangePoint: Marked as a change because one of 3/16/2023 8:14:39 PM, 3/17/2023 8:17:18 AM, 3/26/2023 1:36:36 AM, 3/26/2023 1:21:26 PM, 5/18/2023 7:10:13 PM, 5/23/2023 2:36:40 AM falls between 5/14/2023 5:56:01 AM and 5/23/2023 2:36:40 AM.
IsImprovementStdDev: Marked as improvement because 28.36405241552259 (T) = (0 -8.137329009130095) / Math.Sqrt((2576.724276541287 / (299)) + (0.481738414489745 / (19))) is greater than 1.9674995188240387 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (19) - 2, .975) and 0.9110922476053366 = (91.5255283139801 - 8.137329009130095) / 91.5255283139801 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.ConditionalSelectBenchmark
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 15.576695552103027 < 28.110983242791765.
IsChangePoint: Marked as a change because one of 4/5/2023 6:15:03 PM, 4/6/2023 6:23:49 AM, 5/18/2023 7:10:13 PM, 5/23/2023 2:36:40 AM falls between 5/14/2023 5:56:01 AM and 5/23/2023 2:36:40 AM.
IsImprovementStdDev: Marked as improvement because 41.60336802067222 (T) = (0 -15.080600974732214) / Math.Sqrt((14.558546419346508 / (299)) + (1.3700650366269465 / (19))) is greater than 1.9674995188240387 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (19) - 2, .975) and 0.48949161002673547 = (29.54035873048431 - 15.080600974732214) / 29.54035873048431 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.BitwiseOrOperatorBenchmark
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 14.409501060321245 < 22.996870869822207.
IsChangePoint: Marked as a change because one of 3/21/2023 4:52:34 PM, 3/22/2023 4:29:55 AM, 5/18/2023 7:10:13 PM, 5/23/2023 2:36:40 AM falls between 5/14/2023 5:56:01 AM and 5/23/2023 2:36:40 AM.
IsImprovementStdDev: Marked as improvement because 36.22207662313378 (T) = (0 -13.857603291364596) / Math.Sqrt((24.702782342508904 / (299)) + (0.6206330366109756 / (19))) is greater than 1.9674995188240387 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (19) - 2, .975) and 0.4701982746024083 = (26.156206420364345 - 13.857603291364596) / 26.156206420364345 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.OnesComplementOperatorBenchmark
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 14.717066539116225 < 22.62629298741693.
IsChangePoint: Marked as a change because one of 3/16/2023 8:14:39 PM, 5/18/2023 7:10:13 PM, 5/23/2023 2:36:40 AM falls between 5/14/2023 5:56:01 AM and 5/23/2023 2:36:40 AM.
IsImprovementStdDev: Marked as improvement because 33.42325043289329 (T) = (0 -12.750389071128192) / Math.Sqrt((24.52107954623129 / (299)) + (0.6356978334046288 / (19))) is greater than 1.9674995188240387 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (19) - 2, .975) and 0.4711095703790756 = (24.107808266197733 - 12.750389071128192) / 24.107808266197733 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Name | Value |
|---|---|
| Architecture | x64 |
| OS | ubuntu 18.04 |
| Queue | TigerUbuntu |
| Baseline | aef327f3b418bf5dd4f25083aff160c9cdf4b159 |
| Compare | 2f49fcff6df15a200ef01eea16b3ce7930f75c5c |
| Diff | Diff |
| Configs | CompilationMode:wasm, RunKind:micro |
Improvements in System.IO.Tests.Perf_File
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [WriteAllText - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.IO.Tests.Perf_File.WriteAllText(size%3a%20100000).html>) | 495.17 μs | 249.45 μs | 0.50 | 0.22 | False | |||||
| [AppendAllText - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.IO.Tests.Perf_File.AppendAllText(size%3a%2010000).html>) | 80.82 μs | 63.57 μs | 0.79 | 0.12 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.IO.Tests.Perf_File*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.IO.Tests.Perf_File.WriteAllText(size: 100000)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 249.44660918522268 < 470.55840613882214.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 3/2/2023 11:15:04 AM, 5/18/2023 7:10:13 PM, 5/23/2023 2:36:40 AM falls between 5/14/2023 5:56:01 AM and 5/23/2023 2:36:40 AM.
IsImprovementStdDev: Marked as improvement because 31.69905668078621 (T) = (0 -256460.14697763594) / Math.Sqrt((21610609578.12741 / (299)) + (212939893.91879886 / (19))) is greater than 1.9674995188240387 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (19) - 2, .975) and 0.5303723197897874 = (546092.4851423587 - 256460.14697763594) / 546092.4851423587 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.IO.Tests.Perf_File.AppendAllText(size: 10000)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 63.57065001666667 < 77.03727700301282.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 3/2/2023 11:15:04 AM, 5/18/2023 7:10:13 PM, 5/23/2023 2:36:40 AM falls between 5/14/2023 5:56:01 AM and 5/23/2023 2:36:40 AM.
IsImprovementStdDev: Marked as improvement because 35.29418257014325 (T) = (0 -64159.34433821091) / Math.Sqrt((21274838.77876115 / (299)) + (3336441.8429480093 / (19))) is greater than 1.9674995188240387 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (19) - 2, .975) and 0.21461467765068687 = (81691.55001049915 - 64159.34433821091) / 81691.55001049915 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
radekdoulik
Run Information
Improvements in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
Baseline Compare