performanceautofiler[bot]
commented
2 years ago Run Information
| Architecture | arm64 |
|---|---|
| OS | ubuntu 18.04 |
| Baseline | f865423523c394cc6015e06f285442a6f909f3a5 |
| Compare | 4479fa685e6305db0b35a10793018c9a12203f8a |
| Diff | Diff |
Improvements in System.Memory.Constructors_ValueTypesOnly<Int32>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [SpanFromPointerLength - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 18.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Memory.Constructors_ValueTypesOnly(Int32).SpanFromPointerLength.html>) | 32.54 ns | 1.15 ns | 0.04 | 0.42 | False | |||||
| [ReadOnlyFromPointerLength - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 18.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Memory.Constructors_ValueTypesOnly(Int32).ReadOnlyFromPointerLength.html>) | 32.15 ns | 1.15 ns | 0.04 | 0.53 | False |
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Memory.Constructors_ValueTypesOnly<Int32>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Memory.Constructors_ValueTypesOnly<Int32>.SpanFromPointerLength
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.151803718165261 < 34.723767895006425.
IsChangePoint: Marked as a change because one of 3/22/2022 12:26:23 PM, 4/18/2022 5:19:34 PM, 4/25/2022 9:58:40 PM falls between 4/17/2022 3:50:42 AM and 4/25/2022 9:58:40 PM.
IsImprovementStdDev: Marked as improvement because 30.553070497327855 (T) = (0 -1.1967168717498464) / Math.Sqrt((84.93461969124408 / (299)) + (0.04801680131156021 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.9317553838497724 = (17.535696429378397 - 1.1967168717498464) / 17.535696429378397 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Memory.Constructors_ValueTypesOnly<Int32>.ReadOnlyFromPointerLength
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.1541634577033775 < 30.4638104467497.
IsChangePoint: Marked as a change because one of 3/22/2022 12:26:23 PM, 4/18/2022 5:19:34 PM, 4/25/2022 9:58:40 PM falls between 4/17/2022 3:50:42 AM and 4/25/2022 9:58:40 PM.
IsImprovementStdDev: Marked as improvement because 28.011255367120683 (T) = (0 -1.25763631376429) / Math.Sqrt((91.94841458811541 / (299)) + (0.23638522367475379 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.9261435912404737 = (17.028127076407262 - 1.25763631376429) / 17.028127076407262 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | arm64 |
|---|---|
| OS | ubuntu 18.04 |
| Baseline | f865423523c394cc6015e06f285442a6f909f3a5 |
| Compare | 4479fa685e6305db0b35a10793018c9a12203f8a |
| Diff | Diff |
Improvements in System.Tests.Perf_UInt16
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [TryParse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 18.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Tests.Perf_UInt16.TryParse(value%3a%20%220%22).html>) | 83.05 ns | 70.07 ns | 0.84 | 0.33 | False | |||||
| [TryParse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 18.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Tests.Perf_UInt16.TryParse(value%3a%20%2265535%22).html>) | 105.15 ns | 64.90 ns | 0.62 | 0.44 | False | |||||
| [ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 18.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Tests.Perf_UInt16.ToString(value%3a%2065535).html>) | 138.13 ns | 105.30 ns | 0.76 | 0.41 | False | |||||
| [ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 18.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Tests.Perf_UInt16.ToString(value%3a%2012345).html>) | 146.00 ns | 105.27 ns | 0.72 | 0.46 | False | |||||
| [Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 18.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Tests.Perf_UInt16.Parse(value%3a%20%2265535%22).html>) | 86.63 ns | 59.55 ns | 0.69 | 0.47 | False | |||||
| [Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 18.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Tests.Perf_UInt16.Parse(value%3a%20%220%22).html>) | 95.89 ns | 58.97 ns | 0.61 | 0.45 | False |
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_UInt16*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Tests.Perf_UInt16.TryParse(value: "0")
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 70.0728226141839 < 79.31020226166198.
IsChangePoint: Marked as a change because one of 3/22/2022 12:26:23 PM, 4/18/2022 5:19:34 PM, 4/25/2022 9:58:40 PM falls between 4/17/2022 3:50:42 AM and 4/25/2022 9:58:40 PM.
IsImprovementStdDev: Marked as improvement because 29.813590411552653 (T) = (0 -61.25271108477241) / Math.Sqrt((98.82065361167047 / (268)) + (28.43082050211159 / (25))) is greater than 1.9681495542477299 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (268) + (25) - 2, .975) and 0.3739457509762206 = (97.83930255291 - 61.25271108477241) / 97.83930255291 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_UInt16.TryParse(value: "65535")
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 64.90093503147928 < 86.55623552255649.
IsChangePoint: Marked as a change because one of 3/22/2022 12:26:23 PM, 4/18/2022 5:19:34 PM, 4/25/2022 9:58:40 PM falls between 4/17/2022 3:50:42 AM and 4/25/2022 9:58:40 PM.
IsImprovementStdDev: Marked as improvement because 47.41468608883769 (T) = (0 -63.421871973922094) / Math.Sqrt((156.19443085949948 / (228)) + (15.20112809934208 / (25))) is greater than 1.9694602272243544 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (228) + (25) - 2, .975) and 0.45950084346546155 = (117.33944670803454 - 63.421871973922094) / 117.33944670803454 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_UInt16.ToString(value: 65535)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 105.29830900792663 < 140.25269270957534.
IsChangePoint: Marked as a change because one of 4/14/2022 3:36:10 AM, 4/18/2022 5:19:34 PM, 4/25/2022 9:58:40 PM falls between 4/17/2022 3:50:42 AM and 4/25/2022 9:58:40 PM.
IsImprovementStdDev: Marked as improvement because 30.752095837870133 (T) = (0 -103.70113929925614) / Math.Sqrt((63.56301195589405 / (299)) + (22.889285597593517 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.23952919725989302 = (136.3643928545358 - 103.70113929925614) / 136.3643928545358 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_UInt16.ToString(value: 12345)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 105.26666955199713 < 139.02514723443701.
IsChangePoint: Marked as a change because one of 4/12/2022 3:59:36 PM, 4/18/2022 5:19:34 PM, 4/25/2022 9:58:40 PM falls between 4/17/2022 3:50:42 AM and 4/25/2022 9:58:40 PM.
IsImprovementStdDev: Marked as improvement because 28.3667830354832 (T) = (0 -105.10449914269115) / Math.Sqrt((56.34291811034973 / (299)) + (24.82624719282234 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.22682107222811673 = (135.93813199950648 - 105.10449914269115) / 135.93813199950648 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_UInt16.Parse(value: "65535")
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 59.54818866820377 < 86.70526863839329.
IsChangePoint: Marked as a change because one of 3/22/2022 12:26:23 PM, 4/18/2022 5:19:34 PM, 4/25/2022 9:58:40 PM falls between 4/17/2022 3:50:42 AM and 4/25/2022 9:58:40 PM.
IsImprovementStdDev: Marked as improvement because 34.322899454998044 (T) = (0 -64.63963878964961) / Math.Sqrt((199.58299730494363 / (272)) + (35.96080494680553 / (25))) is greater than 1.9680381148904758 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (272) + (25) - 2, .975) and 0.439018495264036 = (115.22597134476548 - 64.63963878964961) / 115.22597134476548 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_UInt16.Parse(value: "0")
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 58.966299015175494 < 76.35997178533759.
IsChangePoint: Marked as a change because one of 3/30/2022 8:03:41 PM, 4/18/2022 5:19:34 PM, 4/25/2022 9:58:40 PM falls between 4/17/2022 3:50:42 AM and 4/25/2022 9:58:40 PM.
IsImprovementStdDev: Marked as improvement because 23.851639402547363 (T) = (0 -59.97124567798699) / Math.Sqrt((111.0998898584688 / (277)) + (50.389144443822595 / (25))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (277) + (25) - 2, .975) and 0.38205817237821665 = (97.04998593280679 - 59.97124567798699) / 97.04998593280679 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | arm64 |
|---|---|
| OS | ubuntu 18.04 |
| Baseline | f865423523c394cc6015e06f285442a6f909f3a5 |
| Compare | 4479fa685e6305db0b35a10793018c9a12203f8a |
| Diff | Diff |
Improvements in System.Collections.Sort<IntStruct>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [Array - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 18.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Collections.Sort(IntStruct).Array(Size%3a%20512).html>) | 116.43 μs | 31.19 μs | 0.27 | 0.35 | False | |||||
| [Array_ComparerClass - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 18.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Collections.Sort(IntStruct).Array_ComparerClass(Size%3a%20512).html>) | 141.67 μs | 31.23 μs | 0.22 | 0.35 | False | |||||
| [LinqQuery - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 18.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Collections.Sort(IntStruct).LinqQuery(Size%3a%20512).html>) | 1.02 ms | 75.35 μs | 0.07 | 0.39 | False | |||||
| [LinqOrderByExtension - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 18.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Collections.Sort(IntStruct).LinqOrderByExtension(Size%3a%20512).html>) | 973.82 μs | 75.13 μs | 0.08 | 0.33 | False | |||||
| [List - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 18.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Collections.Sort(IntStruct).List(Size%3a%20512).html>) | 124.08 μs | 30.94 μs | 0.25 | 0.41 | False | |||||
| [Array_ComparerStruct - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 18.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Collections.Sort(IntStruct).Array_ComparerStruct(Size%3a%20512).html>) | 233.64 μs | 38.37 μs | 0.16 | 0.21 | False |
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.Sort<IntStruct>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Collections.Sort<IntStruct>.Array(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 31.188578999999994 < 86.83408580116667.
IsChangePoint: Marked as a change because one of 4/6/2022 12:51:22 AM, 4/18/2022 5:19:34 PM, 4/25/2022 9:58:40 PM falls between 4/17/2022 3:50:42 AM and 4/25/2022 9:58:40 PM.
IsImprovementStdDev: Marked as improvement because 91.07588986641775 (T) = (0 -31185.342556386724) / Math.Sqrt((232198199.70448452 / (299)) + (210735.30844934797 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.7212593083164388 = (111879.40435976857 - 31185.342556386724) / 111879.40435976857 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Collections.Sort<IntStruct>.Array_ComparerClass(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 31.226125586666665 < 139.56275309371796.
IsChangePoint: Marked as a change because one of 4/18/2022 5:19:34 PM, 4/25/2022 9:58:40 PM falls between 4/17/2022 3:50:42 AM and 4/25/2022 9:58:40 PM.
IsImprovementStdDev: Marked as improvement because 58.84343134934982 (T) = (0 -30793.041393944688) / Math.Sqrt((625938146.816252 / (299)) + (147006.83850986228 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.7346604225596208 = (116051.44506142802 - 30793.041393944688) / 116051.44506142802 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Collections.Sort<IntStruct>.LinqQuery(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 75.35032132000002 < 0.9683181853241482.
IsChangePoint: Marked as a change because one of 4/7/2022 6:53:49 PM, 4/18/2022 5:19:34 PM, 4/25/2022 9:58:40 PM falls between 4/17/2022 3:50:42 AM and 4/25/2022 9:58:40 PM.
IsImprovementStdDev: Marked as improvement because 11.468759630215226 (T) = (0 -83729.92725795752) / Math.Sqrt((95418238082.17555 / (299)) + (227194953.2348062 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.7127669714603021 = (291505.2202862714 - 83729.92725795752) / 291505.2202862714 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Collections.Sort<IntStruct>.LinqOrderByExtension(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 75.13227353333335 < 0.9893996684906665.
IsChangePoint: Marked as a change because one of 3/22/2022 12:26:23 PM, 4/18/2022 5:19:34 PM, 4/25/2022 9:58:40 PM falls between 4/17/2022 3:50:42 AM and 4/25/2022 9:58:40 PM.
IsImprovementStdDev: Marked as improvement because 13.819449851161565 (T) = (0 -83503.6173701773) / Math.Sqrt((165157983042.56577 / (299)) + (226838259.11301365 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.7968044911921917 = (410952.0818649533 - 83503.6173701773) / 410952.0818649533 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Collections.Sort<IntStruct>.List(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 30.940943338461533 < 106.0273891046978.
IsChangePoint: Marked as a change because one of 4/1/2022 9:47:46 AM, 4/18/2022 5:19:34 PM, 4/25/2022 9:58:40 PM falls between 4/17/2022 3:50:42 AM and 4/25/2022 9:58:40 PM.
IsImprovementStdDev: Marked as improvement because 74.45916467065432 (T) = (0 -30896.76948791528) / Math.Sqrt((342747184.3625517 / (299)) + (89990.28970400333 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.7210028670200591 = (110742.24726938923 - 30896.76948791528) / 110742.24726938923 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Collections.Sort<IntStruct>.Array_ComparerStruct(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 38.36739843076923 < 139.08181956349998.
IsChangePoint: Marked as a change because one of 4/18/2022 5:19:34 PM, 4/25/2022 9:58:40 PM falls between 4/17/2022 3:50:42 AM and 4/25/2022 9:58:40 PM.
IsImprovementStdDev: Marked as improvement because 48.322776558641365 (T) = (0 -38919.71218041208) / Math.Sqrt((920247866.8041788 / (299)) + (4948963.723991461 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.6920390861091941 = (126378.73971958626 - 38919.71218041208) / 126378.73971958626 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | arm64 |
|---|---|
| OS | ubuntu 18.04 |
| Baseline | f865423523c394cc6015e06f285442a6f909f3a5 |
| Compare | 4479fa685e6305db0b35a10793018c9a12203f8a |
| Diff | Diff |
Improvements in System.Buffers.Binary.Tests.BinaryReadAndWriteTests
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [ReadStructFieldByFieldBE - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 18.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Buffers.Binary.Tests.BinaryReadAndWriteTests.ReadStructFieldByFieldBE.html>) | 811.89 ns | 16.10 ns | 0.02 | 0.13 | False | |||||
| [ReadStructFieldByFieldLE - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 18.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Buffers.Binary.Tests.BinaryReadAndWriteTests.ReadStructFieldByFieldLE.html>) | 799.31 ns | 11.51 ns | 0.01 | 0.18 | False |
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Buffers.Binary.Tests.BinaryReadAndWriteTests*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Buffers.Binary.Tests.BinaryReadAndWriteTests.ReadStructFieldByFieldBE
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 16.10023012200587 < 565.0863740671168.
IsChangePoint: Marked as a change because one of 4/18/2022 5:19:34 PM, 4/25/2022 9:58:40 PM falls between 4/17/2022 3:50:42 AM and 4/25/2022 9:58:40 PM.
IsImprovementStdDev: Marked as improvement because 91.00452570070847 (T) = (0 -14.71284263995946) / Math.Sqrt((12479.469815718801 / (299)) + (1.343784695984873 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.9756014459764184 = (603.0210899276766 - 14.71284263995946) / 603.0210899276766 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Buffers.Binary.Tests.BinaryReadAndWriteTests.ReadStructFieldByFieldLE
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 11.511359885376086 < 579.5127204387139.
IsChangePoint: Marked as a change because one of 3/22/2022 12:26:23 PM, 4/18/2022 5:19:34 PM, 4/25/2022 9:58:40 PM falls between 4/17/2022 3:50:42 AM and 4/25/2022 9:58:40 PM.
IsImprovementStdDev: Marked as improvement because 90.05491486540419 (T) = (0 -11.934167516472527) / Math.Sqrt((11820.456139866457 / (299)) + (1.1421829907194194 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.9793700023482916 = (578.4861306314423 - 11.934167516472527) / 578.4861306314423 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
Improvements in System.Collections.Tests.DictionarySequentialKeys
Test Report
Repro
Run Information
Improvements in System.Collections.Tests.Perf_BitArray
Test Report
Repro