performanceautofiler[bot]
commented
2 years ago Run Information
| Architecture | x64 |
|---|---|
| OS | Windows 10.0.19042 |
| Baseline | 5ecaae992806a2d422157a095a63efb467365f54 |
| Compare | 1e41844947bc68735ddbf3e6aec724f78f03bc2a |
| Diff | Diff |
Improvements in System.Tests.Perf_GC<Char>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [AllocateArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.19042/amd/System.Tests.Perf_GC(Char).AllocateArray(length%3a%201000%2c%20pinned%3a%20True).html>) | 211.92 ns | 194.36 ns | 0.92 | 0.02 | False | |||||
| [AllocateArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.19042/amd/System.Tests.Perf_GC(Char).AllocateArray(length%3a%2010000%2c%20pinned%3a%20True).html>) | 899.01 ns | 770.96 ns | 0.86 | 0.03 | False | |||||
| [NewOperator_Array - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.19042/amd/System.Tests.Perf_GC(Char).NewOperator_Array(length%3a%201000).html>) | 62.31 ns | 50.56 ns | 0.81 | 0.01 | True | |||||
| [AllocateArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.19042/amd/System.Tests.Perf_GC(Char).AllocateArray(length%3a%201000%2c%20pinned%3a%20False).html>) | 85.46 ns | 72.64 ns | 0.85 | 0.02 | True | |||||
| [AllocateArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.19042/amd/System.Tests.Perf_GC(Char).AllocateArray(length%3a%2010000%2c%20pinned%3a%20False).html>) | 535.05 ns | 438.81 ns | 0.82 | 0.01 | True | |||||
| [NewOperator_Array - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.19042/amd/System.Tests.Perf_GC(Char).NewOperator_Array(length%3a%2010000).html>) | 534.20 ns | 428.74 ns | 0.80 | 0.00 | True | |||||
| [AllocateUninitializedArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.19042/amd/System.Tests.Perf_GC(Char).AllocateUninitializedArray(length%3a%201000%2c%20pinned%3a%20False).html>) | 62.49 ns | 51.26 ns | 0.82 | 0.02 | True |
_1.png>)
_2.png>)
_3.png>)
_4.png>)
_5.png>)
_6.png>)
_7.png>)
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_GC<Char>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Tests.Perf_GC<Char>.AllocateArray(length: 1000, pinned: True)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 194.36070129066965 < 203.07664216805665.
IsChangePoint: Marked as a change because one of 4/9/2022 5:43:54 AM, 5/9/2022 6:32:22 AM, 5/17/2022 3:30:02 AM falls between 5/8/2022 12:35:08 PM and 5/17/2022 3:30:02 AM.
IsImprovementStdDev: Marked as improvement because 27.194520278194243 (T) = (0 -193.52655599526622) / Math.Sqrt((27.805342037001203 / (299)) + (33.23481283584832 / (50))) is greater than 1.9668240032621265 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (50) - 2, .975) and 0.10898614094117529 = (217.19814347185098 - 193.52655599526622) / 217.19814347185098 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_GC<Char>.AllocateArray(length: 10000, pinned: True)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 770.961458953032 < 867.5364627644362.
IsChangePoint: Marked as a change because one of 3/11/2022 8:42:43 PM, 4/8/2022 10:19:59 AM, 5/9/2022 6:32:22 AM, 5/17/2022 3:30:02 AM falls between 5/8/2022 12:35:08 PM and 5/17/2022 3:30:02 AM.
IsImprovementStdDev: Marked as improvement because 47.374276732603576 (T) = (0 -796.8067788436639) / Math.Sqrt((2087.9178051295626 / (299)) + (119.54637874364145 / (49))) is greater than 1.9668438982061167 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (49) - 2, .975) and 0.15433853246094797 = (942.2290235860462 - 796.8067788436639) / 942.2290235860462 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_GC<Char>.NewOperator_Array(length: 1000)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 50.55626350227424 < 59.0144405761739.
IsChangePoint: Marked as a change because one of 5/9/2022 6:32:22 AM, 5/17/2022 3:30:02 AM falls between 5/8/2022 12:35:08 PM and 5/17/2022 3:30:02 AM.
IsImprovementStdDev: Marked as improvement because 80.32591085406072 (T) = (0 -49.585381601612035) / Math.Sqrt((1.5010643260693066 / (299)) + (0.8981952195259965 / (50))) is greater than 1.9668240032621265 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (50) - 2, .975) and 0.19716975328146596 = (61.76322056161429 - 49.585381601612035) / 61.76322056161429 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
```#### System.Tests.Perf_GC<Char>.AllocateArray(length: 1000, pinned: False)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 72.63524542364121 < 80.200804391325.
IsChangePoint: Marked as a change because one of 4/16/2022 2:55:52 PM, 5/9/2022 6:32:22 AM, 5/17/2022 3:30:02 AM falls between 5/8/2022 12:35:08 PM and 5/17/2022 3:30:02 AM.
IsImprovementStdDev: Marked as improvement because 63.70138976114882 (T) = (0 -71.47672658251348) / Math.Sqrt((6.18833880660269 / (299)) + (1.6807201398381917 / (50))) is greater than 1.9668240032621265 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (50) - 2, .975) and 0.1719773068266703 = (86.32218316213621 - 71.47672658251348) / 86.32218316213621 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
```#### System.Tests.Perf_GC<Char>.AllocateArray(length: 10000, pinned: False)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 438.81383595406317 < 509.22971633192094.
IsChangePoint: Marked as a change because one of 5/9/2022 6:32:22 AM, 5/17/2022 3:30:02 AM falls between 5/8/2022 12:35:08 PM and 5/17/2022 3:30:02 AM.
IsImprovementStdDev: Marked as improvement because 187.3605014084859 (T) = (0 -433.7164490320365) / Math.Sqrt((27.417083483271707 / (299)) + (10.7344628193146 / (49))) is greater than 1.9668438982061167 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (49) - 2, .975) and 0.19408016766335887 = (538.1632659101366 - 433.7164490320365) / 538.1632659101366 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
```#### System.Tests.Perf_GC<Char>.NewOperator_Array(length: 10000)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 428.7436703635413 < 503.9307775603163.
IsChangePoint: Marked as a change because one of 5/9/2022 6:32:22 AM, 5/17/2022 3:30:02 AM falls between 5/8/2022 12:35:08 PM and 5/17/2022 3:30:02 AM.
IsImprovementStdDev: Marked as improvement because 220.22299174172193 (T) = (0 -426.55389682873925) / Math.Sqrt((29.522504420916285 / (299)) + (6.533026536968097 / (50))) is greater than 1.9668240032621265 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (50) - 2, .975) and 0.1982534162105972 = (532.0308255167863 - 426.55389682873925) / 532.0308255167863 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
```#### System.Tests.Perf_GC<Char>.AllocateUninitializedArray(length: 1000, pinned: False)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 51.261512924839586 < 58.81835275524437.
IsChangePoint: Marked as a change because one of 5/9/2022 6:32:22 AM, 5/17/2022 3:30:02 AM falls between 5/8/2022 12:35:08 PM and 5/17/2022 3:30:02 AM.
IsImprovementStdDev: Marked as improvement because 93.10750050566095 (T) = (0 -50.139497148241325) / Math.Sqrt((1.4402515529922113 / (299)) + (0.6095742367870377 / (50))) is greater than 1.9668240032621265 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (50) - 2, .975) and 0.19496292983022073 = (62.28222153504943 - 50.139497148241325) / 62.28222153504943 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x64 |
|---|---|
| OS | Windows 10.0.19042 |
| Baseline | 5ecaae992806a2d422157a095a63efb467365f54 |
| Compare | 1e41844947bc68735ddbf3e6aec724f78f03bc2a |
| Diff | Diff |
Improvements in System.Text.Tests.Perf_Encoding
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [GetChars - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.19042/amd/System.Text.Tests.Perf_Encoding.GetChars(size%3a%20512%2c%20encName%3a%20%22ascii%22).html>) | 79.05 ns | 72.65 ns | 0.92 | 0.05 | False | |||||
| [GetBytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.19042/amd/System.Text.Tests.Perf_Encoding.GetBytes(size%3a%20512%2c%20encName%3a%20%22ascii%22).html>) | 55.96 ns | 51.90 ns | 0.93 | 0.04 | False | |||||
| [GetByteCount - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.19042/amd/System.Text.Tests.Perf_Encoding.GetByteCount(size%3a%20512%2c%20encName%3a%20%22utf-8%22).html>) | 29.97 ns | 26.75 ns | 0.89 | 0.06 | False | |||||
| [GetString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.19042/amd/System.Text.Tests.Perf_Encoding.GetString(size%3a%20512%2c%20encName%3a%20%22ascii%22).html>) | 82.10 ns | 75.92 ns | 0.92 | 0.01 | False | |||||
| [GetBytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.19042/amd/System.Text.Tests.Perf_Encoding.GetBytes(size%3a%20512%2c%20encName%3a%20%22utf-8%22).html>) | 81.62 ns | 73.20 ns | 0.90 | 0.11 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Tests.Perf_Encoding*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Text.Tests.Perf_Encoding.GetChars(size: 512, encName: "ascii")
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 72.64837296713745 < 74.93679698326301.
IsChangePoint: Marked as a change because one of 3/17/2022 6:54:53 PM, 3/23/2022 6:35:24 PM, 5/9/2022 6:32:22 AM, 5/17/2022 3:30:02 AM falls between 5/8/2022 12:35:08 PM and 5/17/2022 3:30:02 AM.
IsImprovementStdDev: Marked as improvement because 35.085664396723566 (T) = (0 -73.30010694507195) / Math.Sqrt((6.3746025143525635 / (299)) + (0.7782559896318916 / (49))) is greater than 1.9668438982061167 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (49) - 2, .975) and 0.08452011155825935 = (80.06741368162412 - 73.30010694507195) / 80.06741368162412 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Tests.Perf_Encoding.GetBytes(size: 512, encName: "ascii")
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 51.89929801878225 < 52.632030567042946.
IsChangePoint: Marked as a change because one of 3/17/2022 6:54:53 PM, 3/20/2022 10:41:02 AM, 5/9/2022 6:32:22 AM, 5/17/2022 3:30:02 AM falls between 5/8/2022 12:35:08 PM and 5/17/2022 3:30:02 AM.
IsImprovementStdDev: Marked as improvement because 38.852055679710894 (T) = (0 -52.16235317402896) / Math.Sqrt((1.9670704004616915 / (299)) + (0.1792618295456541 / (50))) is greater than 1.9668240032621265 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (50) - 2, .975) and 0.06984658534919232 = (56.07930084695912 - 52.16235317402896) / 56.07930084695912 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Tests.Perf_Encoding.GetByteCount(size: 512, encName: "utf-8")
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 26.751268622780557 < 28.442442488203596.
IsChangePoint: Marked as a change because one of 3/7/2022 10:45:01 PM, 3/17/2022 6:54:53 PM, 4/25/2022 11:05:49 AM, 5/11/2022 7:02:26 PM, 5/17/2022 3:30:02 AM falls between 5/8/2022 12:35:08 PM and 5/17/2022 3:30:02 AM.
IsImprovementStdDev: Marked as improvement because 12.666716837499942 (T) = (0 -26.5386709663361) / Math.Sqrt((5.035284384264704 / (299)) + (0.07200020199402059 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.06197694841143631 = (28.29213090381121 - 26.5386709663361) / 28.29213090381121 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Tests.Perf_Encoding.GetString(size: 512, encName: "ascii")
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 75.92486313500984 < 77.74551939614906.
IsChangePoint: Marked as a change because one of 3/17/2022 6:54:53 PM, 3/18/2022 9:29:53 AM, 4/20/2022 2:49:46 PM, 5/9/2022 6:32:22 AM, 5/17/2022 3:30:02 AM falls between 5/8/2022 12:35:08 PM and 5/17/2022 3:30:02 AM.
IsImprovementStdDev: Marked as improvement because 25.92456980364949 (T) = (0 -76.69067046852814) / Math.Sqrt((3.4750372174740165 / (299)) + (0.9933328450185367 / (50))) is greater than 1.9668240032621265 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (50) - 2, .975) and 0.05659101287620563 = (81.29101112587215 - 76.69067046852814) / 81.29101112587215 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Tests.Perf_Encoding.GetBytes(size: 512, encName: "utf-8")
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 73.20443180180045 < 76.56207899810805.
IsChangePoint: Marked as a change because one of 3/7/2022 10:45:01 PM, 3/11/2022 8:42:43 PM, 3/17/2022 6:54:53 PM, 3/21/2022 1:28:14 PM, 3/31/2022 1:45:25 PM, 4/8/2022 7:02:49 PM, 4/16/2022 5:36:25 PM, 5/9/2022 11:56:12 AM, 5/17/2022 3:30:02 AM falls between 5/8/2022 12:35:08 PM and 5/17/2022 3:30:02 AM.
IsImprovementStdDev: Marked as improvement because 5.875417751631834 (T) = (0 -75.18712252242942) / Math.Sqrt((10.741490413544739 / (299)) + (7.369035241807973 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.059268164412186006 = (79.92407578664427 - 75.18712252242942) / 79.92407578664427 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x64 |
|---|---|
| OS | Windows 10.0.19042 |
| Baseline | 5ecaae992806a2d422157a095a63efb467365f54 |
| Compare | 1e41844947bc68735ddbf3e6aec724f78f03bc2a |
| Diff | Diff |
Improvements in System.Collections.CtorDefaultSizeNonGeneric
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [Queue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.19042/amd/System.Collections.CtorDefaultSizeNonGeneric.Queue.html>) | 17.72 ns | 16.19 ns | 0.91 | 0.03 | False | |||||
| [Stack - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.19042/amd/System.Collections.CtorDefaultSizeNonGeneric.Stack.html>) | 10.01 ns | 8.87 ns | 0.89 | 0.11 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.CtorDefaultSizeNonGeneric*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Collections.CtorDefaultSizeNonGeneric.Queue
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 16.18579697610611 < 16.94058706174723.
IsChangePoint: Marked as a change because one of 5/9/2022 6:32:22 AM, 5/17/2022 3:30:02 AM falls between 5/8/2022 12:35:08 PM and 5/17/2022 3:30:02 AM.
IsImprovementStdDev: Marked as improvement because 38.800620628707556 (T) = (0 -15.91120651275886) / Math.Sqrt((0.2096081867157061 / (299)) + (0.13294094086548544 / (49))) is greater than 1.9668438982061167 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (49) - 2, .975) and 0.1247163026857376 = (18.178342132477866 - 15.91120651275886) / 18.178342132477866 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Collections.CtorDefaultSizeNonGeneric.Stack
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 8.866495884355157 < 9.252846049148566.
IsChangePoint: Marked as a change because one of 4/8/2022 7:02:49 PM, 5/1/2022 2:35:06 PM, 5/9/2022 6:32:22 AM, 5/17/2022 3:30:02 AM falls between 5/8/2022 12:35:08 PM and 5/17/2022 3:30:02 AM.
IsImprovementStdDev: Marked as improvement because 16.966848514000493 (T) = (0 -8.449160259311308) / Math.Sqrt((0.14963229068307662 / (299)) + (0.12321956802174615 / (49))) is greater than 1.9668438982061167 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (49) - 2, .975) and 0.09931470321236643 = (9.380812909287979 - 8.449160259311308) / 9.380812909287979 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x64 |
|---|---|
| OS | Windows 10.0.19042 |
| Baseline | 5ecaae992806a2d422157a095a63efb467365f54 |
| Compare | 1e41844947bc68735ddbf3e6aec724f78f03bc2a |
| Diff | Diff |
Improvements in System.Collections.CtorFromCollection<Int32>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [Queue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.19042/amd/System.Collections.CtorFromCollection(Int32).Queue(Size%3a%20512).html>) | 124.19 ns | 113.85 ns | 0.92 | 0.04 | False | |||||
| [ImmutableArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.19042/amd/System.Collections.CtorFromCollection(Int32).ImmutableArray(Size%3a%20512).html>) | 126.72 ns | 117.88 ns | 0.93 | 0.13 | False | |||||
| [Stack - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.19042/amd/System.Collections.CtorFromCollection(Int32).Stack(Size%3a%20512).html>) | 123.34 ns | 112.37 ns | 0.91 | 0.09 | False | |||||
| [List - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.19042/amd/System.Collections.CtorFromCollection(Int32).List(Size%3a%20512).html>) | 116.53 ns | 105.50 ns | 0.91 | 0.08 | False |
_1.png>)
_2.png>)
_3.png>)
_4.png>)
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.CtorFromCollection<Int32>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Collections.CtorFromCollection<Int32>.Queue(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 113.85015855703004 < 118.06587921466695.
IsChangePoint: Marked as a change because one of 3/28/2022 7:37:41 AM, 4/16/2022 2:55:52 PM, 5/9/2022 6:32:22 AM, 5/17/2022 3:30:02 AM falls between 5/8/2022 12:35:08 PM and 5/17/2022 3:30:02 AM.
IsImprovementStdDev: Marked as improvement because 29.478945037974498 (T) = (0 -112.11687775550178) / Math.Sqrt((10.919147831311458 / (299)) + (6.1706939563924985 / (50))) is greater than 1.9668240032621265 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (50) - 2, .975) and 0.09514553318300495 = (123.90597810705971 - 112.11687775550178) / 123.90597810705971 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Collections.CtorFromCollection<Int32>.ImmutableArray(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 117.87736449232335 < 121.23573657267535.
IsChangePoint: Marked as a change because one of 4/16/2022 5:36:25 PM, 5/9/2022 6:32:22 AM, 5/17/2022 3:30:02 AM falls between 5/8/2022 12:35:08 PM and 5/17/2022 3:30:02 AM.
IsImprovementStdDev: Marked as improvement because 24.247839664259327 (T) = (0 -119.00986376867651) / Math.Sqrt((19.21075542979585 / (299)) + (6.720195717832236 / (50))) is greater than 1.9668240032621265 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (50) - 2, .975) and 0.08325094076797297 = (129.81727395321536 - 119.00986376867651) / 129.81727395321536 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Collections.CtorFromCollection<Int32>.Stack(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 112.37187999428697 < 117.07049041571015.
IsChangePoint: Marked as a change because one of 5/9/2022 6:32:22 AM, 5/17/2022 3:30:02 AM falls between 5/8/2022 12:35:08 PM and 5/17/2022 3:30:02 AM.
IsImprovementStdDev: Marked as improvement because 23.143676682531094 (T) = (0 -110.29435373053033) / Math.Sqrt((9.009757542819923 / (299)) + (16.73409477669243 / (50))) is greater than 1.9668240032621265 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (50) - 2, .975) and 0.11248417818316081 = (124.27311268067996 - 110.29435373053033) / 124.27311268067996 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Collections.CtorFromCollection<Int32>.List(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 105.49608810687097 < 110.59870678751724.
IsChangePoint: Marked as a change because one of 5/9/2022 6:32:22 AM, 5/17/2022 3:30:02 AM falls between 5/8/2022 12:35:08 PM and 5/17/2022 3:30:02 AM.
IsImprovementStdDev: Marked as improvement because 45.90206370604557 (T) = (0 -104.73757652185326) / Math.Sqrt((13.712326156430443 / (299)) + (2.5841247714684243 / (50))) is greater than 1.9668240032621265 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (50) - 2, .975) and 0.12039676689354754 = (119.07366023650981 - 104.73757652185326) / 119.07366023650981 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x64 |
|---|---|
| OS | Windows 10.0.19042 |
| Baseline | 5ecaae992806a2d422157a095a63efb467365f54 |
| Compare | 1e41844947bc68735ddbf3e6aec724f78f03bc2a |
| Diff | Diff |
Improvements in System.Memory.ReadOnlyMemory<Byte>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [ToArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.19042/amd/System.Memory.ReadOnlyMemory(Byte).ToArray(Size%3a%20512).html>) | 34.08 ns | 29.29 ns | 0.86 | 0.07 | False |
_1.png>)
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Memory.ReadOnlyMemory<Byte>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Memory.ReadOnlyMemory<Byte>.ToArray(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 29.290428570834134 < 30.409662689991116.
IsChangePoint: Marked as a change because one of 3/22/2022 2:38:09 PM, 3/30/2022 6:37:35 PM, 5/9/2022 6:32:22 AM, 5/17/2022 3:30:02 AM falls between 5/8/2022 12:35:08 PM and 5/17/2022 3:30:02 AM.
IsImprovementStdDev: Marked as improvement because 22.350452942534073 (T) = (0 -28.75719056635767) / Math.Sqrt((3.454285161967215 / (299)) + (1.4295448479676776 / (50))) is greater than 1.9668240032621265 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (50) - 2, .975) and 0.13473962510586196 = (33.23530280682971 - 28.75719056635767) / 33.23530280682971 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x64 |
|---|---|
| OS | Windows 10.0.19042 |
| Baseline | 5ecaae992806a2d422157a095a63efb467365f54 |
| Compare | 1e41844947bc68735ddbf3e6aec724f78f03bc2a |
| Diff | Diff |
Improvements in System.Text.Tests.Perf_StringBuilder
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [ToString_MultipleSegments - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.19042/amd/System.Text.Tests.Perf_StringBuilder.ToString_MultipleSegments(length%3a%20100000).html>) | 12.05 μs | 10.93 μs | 0.91 | 0.02 | False | |||||
| [Append_ValueTypes_Interpolated - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.19042/amd/System.Text.Tests.Perf_StringBuilder.Append_ValueTypes_Interpolated.html>) | 4.57 μs | 3.46 μs | 0.76 | 0.07 | True | |||||
| [ToString_SingleSegment - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.19042/amd/System.Text.Tests.Perf_StringBuilder.ToString_SingleSegment(length%3a%20100).html>) | 17.78 ns | 15.72 ns | 0.88 | 0.04 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Tests.Perf_StringBuilder*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Text.Tests.Perf_StringBuilder.ToString_MultipleSegments(length: 100000)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 10.930224137931033 < 11.526246578236144.
IsChangePoint: Marked as a change because one of 3/11/2022 8:42:43 PM, 4/8/2022 10:19:59 AM, 5/9/2022 6:32:22 AM, 5/17/2022 3:30:02 AM falls between 5/8/2022 12:35:08 PM and 5/17/2022 3:30:02 AM.
IsImprovementStdDev: Marked as improvement because 42.19648718087268 (T) = (0 -11124.505839778765) / Math.Sqrt((212199.893771888 / (299)) + (16170.85818939286 / (50))) is greater than 1.9668240032621265 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (50) - 2, .975) and 0.10866976121111446 = (12480.790346453892 - 11124.505839778765) / 12480.790346453892 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Tests.Perf_StringBuilder.Append_ValueTypes_Interpolated
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 3.4628459518036885 < 4.329405845243942.
IsChangePoint: Marked as a change because one of 4/12/2022 9:30:02 AM, 5/11/2022 6:23:22 AM, 5/17/2022 3:30:02 AM falls between 5/8/2022 12:35:08 PM and 5/17/2022 3:30:02 AM.
IsImprovementStdDev: Marked as improvement because 47.39934715898038 (T) = (0 -3464.621993989663) / Math.Sqrt((25887.547990713098 / (299)) + (11743.337790851963 / (35))) is greater than 1.9671350567190904 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (35) - 2, .975) and 0.21940723534806236 = (4438.450048322598 - 3464.621993989663) / 4438.450048322598 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
```#### System.Text.Tests.Perf_StringBuilder.ToString_SingleSegment(length: 100)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 15.721621195916367 < 16.871879076072158.
IsChangePoint: Marked as a change because one of 3/20/2022 10:41:02 AM, 3/30/2022 6:37:35 PM, 5/9/2022 6:32:22 AM, 5/17/2022 3:30:02 AM falls between 5/8/2022 12:35:08 PM and 5/17/2022 3:30:02 AM.
IsImprovementStdDev: Marked as improvement because 12.889401846357838 (T) = (0 -16.460808887566255) / Math.Sqrt((0.5742662532789455 / (299)) + (0.17323833216304815 / (50))) is greater than 1.9668240032621265 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (50) - 2, .975) and 0.05434065533756128 = (17.40670039425464 - 16.460808887566255) / 17.40670039425464 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x64 |
|---|---|
| OS | Windows 10.0.19042 |
| Baseline | 5ecaae992806a2d422157a095a63efb467365f54 |
| Compare | 1e41844947bc68735ddbf3e6aec724f78f03bc2a |
| Diff | Diff |
Improvements in System.Memory.Memory<Char>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [ToArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.19042/amd/System.Memory.Memory(Char).ToArray(Size%3a%20512).html>) | 55.75 ns | 49.63 ns | 0.89 | 0.03 | False |
_1.png>)
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Memory.Memory<Char>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Memory.Memory<Char>.ToArray(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 49.62983065286261 < 51.15922531823613.
IsChangePoint: Marked as a change because one of 4/8/2022 7:02:49 PM, 5/9/2022 6:32:22 AM, 5/17/2022 3:30:02 AM falls between 5/8/2022 12:35:08 PM and 5/17/2022 3:30:02 AM.
IsImprovementStdDev: Marked as improvement because 22.55517183026795 (T) = (0 -49.8319834833498) / Math.Sqrt((3.667922905075342 / (299)) + (1.6462311235619767 / (50))) is greater than 1.9668240032621265 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (50) - 2, .975) and 0.08777490960518941 = (54.62685033337829 - 49.8319834833498) / 54.62685033337829 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
_1.png>)
_2.png>)
_3.png>)
_4.png>)
_5.png>)
_1.png>)
_2.png>)
_3.png>)
_4.png>)
_5.png>)
_6.png>)
_7.png>)
_8.png>)
_1.png>)
_2.png>)
_3.png>)
_4.png>)
_1.png>)
_2.png>)
_1.png>)
_1.png>)
_1.png>)
_1.png>)
_2.png>)
_3.png>)
_4.png>)
_5.png>)
_6.png>)
_7.png>)
Run Information
Improvements in Microsoft.Extensions.DependencyInjection.ActivatorUtilitiesBenchmark
Repro
Run Information
Improvements in System.IO.Tests.StringReaderReadLineTests
Repro
Run Information
Improvements in System.Tests.Perf_Array
Repro
Run Information
Improvements in System.Collections.CreateAddAndClear<Int32>
Repro
Run Information
Improvements in System.Collections.CtorFromCollection<String>
Repro