performanceautofiler[bot]
commented
2 years ago Run Information
| Architecture | arm64 |
|---|---|
| OS | Windows 10.0.19041 |
| Baseline | cdb6e1d5f9075214c8a58ca75d5314b5dc64daed |
| Compare | e3ed6c1c26d7d09e10253fd8f90e06e503ae1c61 |
| Diff | Diff |
Improvements in System.Collections.CtorGivenSizeNonGeneric
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [Stack - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Collections.CtorGivenSizeNonGeneric.Stack(Size%3a%20512).html>) | 277.37 ns | 252.48 ns | 0.91 | 0.01 | False | |||||
| [Hashtable - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Collections.CtorGivenSizeNonGeneric.Hashtable(Size%3a%20512).html>) | 1.39 μs | 1.27 μs | 0.91 | 0.02 | False | |||||
| [Queue - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Collections.CtorGivenSizeNonGeneric.Queue(Size%3a%20512).html>) | 274.16 ns | 253.42 ns | 0.92 | 0.01 | False | |||||
| [ArrayList - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Collections.CtorGivenSizeNonGeneric.ArrayList(Size%3a%20512).html>) | 276.10 ns | 256.18 ns | 0.93 | 0.01 | False | |||||
| [SortedList - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Collections.CtorGivenSizeNonGeneric.SortedList(Size%3a%20512).html>) | 583.91 ns | 544.25 ns | 0.93 | 0.01 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.CtorGivenSizeNonGeneric*'
### Related Issues
#### Regressions
#### Improvements
* [[Perf] Windows/arm64: 9 Improvements on 9/28/2022 6:40:13 PM]()
### Payloads
[Baseline]()
[Compare]()
### Histogram
### Edge Detector Info
[Collection Data]()
#### System.Collections.CtorGivenSizeNonGeneric.Stack(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 252.47772910056386 < 263.95795883535123.
IsChangePoint: Marked as a change because one of 8/5/2022 7:33:33 PM, 8/25/2022 6:55:57 AM, 9/28/2022 11:19:50 AM, 10/6/2022 12:41:43 AM falls between 9/27/2022 9:53:04 AM and 10/6/2022 12:41:43 AM.
IsImprovementStdDev: Marked as improvement because 42.41321065886659 (T) = (0 -253.55472659159776) / Math.Sqrt((162.6633714763507 / (299)) + (2.0922074188503155 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.11517670181817911 = (286.5597313188008 - 253.55472659159776) / 286.5597313188008 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Collections.CtorGivenSizeNonGeneric.Hashtable(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.2686622507097847 < 1.3261859481140863.
IsChangePoint: Marked as a change because one of 8/4/2022 3:21:43 PM, 8/25/2022 6:55:57 AM, 9/28/2022 11:19:50 AM, 10/6/2022 12:41:43 AM falls between 9/27/2022 9:53:04 AM and 10/6/2022 12:41:43 AM.
IsImprovementStdDev: Marked as improvement because 33.95583287766942 (T) = (0 -1270.8269942183988) / Math.Sqrt((3751.6829478585632 / (299)) + (325.96179826175825 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.11167024702549584 = (1430.5802433872466 - 1270.8269942183988) / 1430.5802433872466 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Collections.CtorGivenSizeNonGeneric.Queue(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 253.4212858281652 < 260.6489032491582.
IsChangePoint: Marked as a change because one of 8/5/2022 12:58:40 PM, 8/25/2022 6:55:57 AM, 9/28/2022 11:19:50 AM, 10/6/2022 12:41:43 AM falls between 9/27/2022 9:53:04 AM and 10/6/2022 12:41:43 AM.
IsImprovementStdDev: Marked as improvement because 40.94216686718117 (T) = (0 -252.76440850328711) / Math.Sqrt((155.9254634196903 / (299)) + (3.4081069375957624 / (33))) is greater than 1.9671786747533526 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (33) - 2, .975) and 0.1134991680921389 = (285.12596875888585 - 252.76440850328711) / 285.12596875888585 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Collections.CtorGivenSizeNonGeneric.ArrayList(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 256.1807036393062 < 262.5507580963102.
IsChangePoint: Marked as a change because one of 8/5/2022 7:33:33 PM, 8/25/2022 6:55:57 AM, 9/28/2022 11:19:50 AM, 10/6/2022 12:41:43 AM falls between 9/27/2022 9:53:04 AM and 10/6/2022 12:41:43 AM.
IsImprovementStdDev: Marked as improvement because 39.63610619675867 (T) = (0 -254.3268544044989) / Math.Sqrt((159.6425641315987 / (299)) + (4.824528970933076 / (32))) is greater than 1.9672006833568965 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (32) - 2, .975) and 0.11422672889933173 = (287.12410128211536 - 254.3268544044989) / 287.12410128211536 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Collections.CtorGivenSizeNonGeneric.SortedList(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 544.2503408282125 < 559.4517474398284.
IsChangePoint: Marked as a change because one of 8/5/2022 7:33:33 PM, 8/25/2022 6:55:57 AM, 9/28/2022 11:19:50 AM, 10/6/2022 12:41:43 AM falls between 9/27/2022 9:53:04 AM and 10/6/2022 12:41:43 AM.
IsImprovementStdDev: Marked as improvement because 35.974162670761984 (T) = (0 -544.6830124531194) / Math.Sqrt((801.3275432020948 / (299)) + (25.82326902946456 / (33))) is greater than 1.9671786747533526 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (33) - 2, .975) and 0.1094471587250902 = (611.6234626497342 - 544.6830124531194) / 611.6234626497342 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | arm64 |
|---|---|
| OS | Windows 10.0.19041 |
| Baseline | cdb6e1d5f9075214c8a58ca75d5314b5dc64daed |
| Compare | e3ed6c1c26d7d09e10253fd8f90e06e503ae1c61 |
| Diff | Diff |
Improvements in System.Tests.Perf_GC<Byte>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [AllocateUninitializedArray - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Tests.Perf_GC(Byte).AllocateUninitializedArray(length%3a%201000%2c%20pinned%3a%20False).html>) | 64.48 ns | 59.53 ns | 0.92 | 0.02 | False | |||||
| [AllocateArray - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Tests.Perf_GC(Byte).AllocateArray(length%3a%2010000%2c%20pinned%3a%20False).html>) | 637.70 ns | 585.68 ns | 0.92 | 0.01 | False | |||||
| [AllocateUninitializedArray - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Tests.Perf_GC(Byte).AllocateUninitializedArray(length%3a%2010000%2c%20pinned%3a%20False).html>) | 249.86 ns | 216.96 ns | 0.87 | 0.07 | False |
_1.png>)
_2.png>)
_3.png>)
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_GC<Byte>*'
### Related Issues
#### Regressions
#### Improvements
* [[Perf] Windows/arm64: 9 Improvements on 9/28/2022 6:40:13 PM]()
### Payloads
[Baseline]()
[Compare]()
### Histogram
### Edge Detector Info
[Collection Data]()
#### System.Tests.Perf_GC<Byte>.AllocateUninitializedArray(length: 1000, pinned: False)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 59.52734692679394 < 61.18581164031446.
IsChangePoint: Marked as a change because one of 8/5/2022 7:33:33 PM, 8/25/2022 6:55:57 AM, 9/28/2022 11:19:50 AM, 10/6/2022 12:41:43 AM falls between 9/27/2022 9:53:04 AM and 10/6/2022 12:41:43 AM.
IsImprovementStdDev: Marked as improvement because 34.71313891221026 (T) = (0 -59.30790131852279) / Math.Sqrt((12.239012248922414 / (299)) + (0.5865730068245756 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.12371774132811486 = (67.68127590351001 - 59.30790131852279) / 67.68127590351001 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_GC<Byte>.AllocateArray(length: 10000, pinned: False)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 585.6811662040807 < 606.7116389784851.
IsChangePoint: Marked as a change because one of 8/5/2022 7:33:33 PM, 8/25/2022 6:55:57 AM, 9/28/2022 11:19:50 AM, 10/6/2022 12:41:43 AM falls between 9/27/2022 9:53:04 AM and 10/6/2022 12:41:43 AM.
IsImprovementStdDev: Marked as improvement because 41.07395630731345 (T) = (0 -582.3833688074576) / Math.Sqrt((890.0174667724228 / (299)) + (19.34318234230585 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.11723215614701317 = (659.7242671023773 - 582.3833688074576) / 659.7242671023773 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_GC<Byte>.AllocateUninitializedArray(length: 10000, pinned: False)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 216.95792569714718 < 236.69101443463822.
IsChangePoint: Marked as a change because one of 8/25/2022 6:55:57 AM, 9/28/2022 11:19:50 AM, 10/6/2022 12:41:43 AM falls between 9/27/2022 9:53:04 AM and 10/6/2022 12:41:43 AM.
IsImprovementStdDev: Marked as improvement because 31.215056196867106 (T) = (0 -215.42219153380188) / Math.Sqrt((1018.7270235211861 / (299)) + (22.201111583819436 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.22598949097811158 = (278.3194659798991 - 215.42219153380188) / 278.3194659798991 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | arm64 |
|---|---|
| OS | Windows 10.0.19041 |
| Baseline | cdb6e1d5f9075214c8a58ca75d5314b5dc64daed |
| Compare | e3ed6c1c26d7d09e10253fd8f90e06e503ae1c61 |
| Diff | Diff |
Improvements in System.IO.Tests.Perf_File
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [ReadAllBytes - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.IO.Tests.Perf_File.ReadAllBytes(size%3a%20104857600).html>) | 61.12 ms | 29.96 ms | 0.49 | 0.27 | False | |||||
| [ReadAllBytesAsync - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.IO.Tests.Perf_File.ReadAllBytesAsync(size%3a%20104857600).html>) | 57.83 ms | 27.36 ms | 0.47 | 0.36 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Tests.Perf_File*'
### Related Issues
#### Regressions
#### Improvements
* [[Perf] Windows/arm64: 9 Improvements on 9/28/2022 6:40:13 PM]()
### Payloads
[Baseline]()
[Compare]()
### Histogram
### Edge Detector Info
[Collection Data]()
#### System.IO.Tests.Perf_File.ReadAllBytes(size: 104857600)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 29.960885 < 55.51891378125.
IsChangePoint: Marked as a change because one of 9/28/2022 11:19:50 AM, 10/6/2022 12:41:43 AM falls between 9/27/2022 9:53:04 AM and 10/6/2022 12:41:43 AM.
IsImprovementStdDev: Marked as improvement because 30.78775294345641 (T) = (0 -34254709.48622127) / Math.Sqrt((74070706060195.25 / (299)) + (7274246904009.388 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.3791512132768346 = (55173997.62833931 - 34254709.48622127) / 55173997.62833931 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.IO.Tests.Perf_File.ReadAllBytesAsync(size: 104857600)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 27.357683035714288 < 56.6848339375.
IsChangePoint: Marked as a change because one of 9/28/2022 11:19:50 AM, 10/6/2022 12:41:43 AM falls between 9/27/2022 9:53:04 AM and 10/6/2022 12:41:43 AM.
IsImprovementStdDev: Marked as improvement because 30.491381338948884 (T) = (0 -34597340.04206392) / Math.Sqrt((66744927332485.31 / (299)) + (8985914592533.059 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.3809433849132195 = (55887198.68087348 - 34597340.04206392) / 55887198.68087348 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | arm64 |
|---|---|
| OS | Windows 10.0.19041 |
| Baseline | cdb6e1d5f9075214c8a58ca75d5314b5dc64daed |
| Compare | e3ed6c1c26d7d09e10253fd8f90e06e503ae1c61 |
| Diff | Diff |
Improvements in System.Collections.CtorGivenSize<String>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [HashSet - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Collections.CtorGivenSize(String).HashSet(Size%3a%20512).html>) | 784.94 ns | 722.67 ns | 0.92 | 0.01 | False | |||||
| [Queue - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Collections.CtorGivenSize(String).Queue(Size%3a%20512).html>) | 287.03 ns | 255.40 ns | 0.89 | 0.02 | False | |||||
| [List - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Collections.CtorGivenSize(String).List(Size%3a%20512).html>) | 277.31 ns | 255.69 ns | 0.92 | 0.02 | False | |||||
| [ConcurrentDictionary - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Collections.CtorGivenSize(String).ConcurrentDictionary(Size%3a%20512).html>) | 354.14 ns | 333.56 ns | 0.94 | 0.02 | False | |||||
| [Dictionary - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Collections.CtorGivenSize(String).Dictionary(Size%3a%20512).html>) | 1.13 μs | 1.04 μs | 0.92 | 0.01 | False | |||||
| [Stack - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Collections.CtorGivenSize(String).Stack(Size%3a%20512).html>) | 277.83 ns | 253.65 ns | 0.91 | 0.02 | False | |||||
| [SortedList - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Collections.CtorGivenSize(String).SortedList(Size%3a%20512).html>) | 594.91 ns | 548.87 ns | 0.92 | 0.02 | False | |||||
| [Array - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Collections.CtorGivenSize(String).Array(Size%3a%20512).html>) | 262.81 ns | 239.35 ns | 0.91 | 0.02 | False |
_1.png>)
_2.png>)
_3.png>)
_4.png>)
_5.png>)
_6.png>)
_7.png>)
_8.png>)
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.CtorGivenSize<String>*'
### Related Issues
#### Regressions
#### Improvements
* [[Perf] Windows/arm64: 9 Improvements on 9/28/2022 6:40:13 PM]()
### Payloads
[Baseline]()
[Compare]()
### Histogram
### Edge Detector Info
[Collection Data]()
#### System.Collections.CtorGivenSize<String>.HashSet(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 722.6692258962803 < 746.853558723624.
IsChangePoint: Marked as a change because one of 8/5/2022 7:33:33 PM, 8/25/2022 6:55:57 AM, 9/28/2022 11:19:50 AM, 10/6/2022 12:41:43 AM falls between 9/27/2022 9:53:04 AM and 10/6/2022 12:41:43 AM.
IsImprovementStdDev: Marked as improvement because 34.541143820463105 (T) = (0 -724.507646092397) / Math.Sqrt((1192.7064557380668 / (299)) + (26.053282680226516 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.09417292773231058 = (799.8299766848776 - 724.507646092397) / 799.8299766848776 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Collections.CtorGivenSize<String>.Queue(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 255.4005508825668 < 267.43197719984624.
IsChangePoint: Marked as a change because one of 8/5/2022 7:33:33 PM, 8/25/2022 6:55:57 AM, 9/28/2022 11:19:50 AM, 10/6/2022 12:41:43 AM falls between 9/27/2022 9:53:04 AM and 10/6/2022 12:41:43 AM.
IsImprovementStdDev: Marked as improvement because 41.09880190766358 (T) = (0 -256.3080108573959) / Math.Sqrt((175.61050661200747 / (299)) + (3.552490491615568 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.11767622637257866 = (290.4920149704898 - 256.3080108573959) / 290.4920149704898 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Collections.CtorGivenSize<String>.List(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 255.69350973406958 < 264.4850135854096.
IsChangePoint: Marked as a change because one of 8/5/2022 7:33:33 PM, 8/25/2022 6:55:57 AM, 9/28/2022 11:19:50 AM, 10/6/2022 12:41:43 AM falls between 9/27/2022 9:53:04 AM and 10/6/2022 12:41:43 AM.
IsImprovementStdDev: Marked as improvement because 41.499934726478344 (T) = (0 -254.88630876204812) / Math.Sqrt((153.99396559321715 / (299)) + (4.2344551853811305 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.11520904288826933 = (288.07517381742554 - 254.88630876204812) / 288.07517381742554 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Collections.CtorGivenSize<String>.ConcurrentDictionary(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 333.5607071877347 < 338.999350401236.
IsChangePoint: Marked as a change because one of 8/25/2022 6:55:57 AM, 9/28/2022 11:19:50 AM, 10/6/2022 12:41:43 AM falls between 9/27/2022 9:53:04 AM and 10/6/2022 12:41:43 AM.
IsImprovementStdDev: Marked as improvement because 31.311061721592658 (T) = (0 -335.2792491359905) / Math.Sqrt((338.56024285312975 / (299)) + (15.308219533477944 / (32))) is greater than 1.9672006833568965 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (32) - 2, .975) and 0.10596265024042936 = (375.0170495965919 - 335.2792491359905) / 375.0170495965919 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Collections.CtorGivenSize<String>.Dictionary(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.0364095536612377 < 1.073228255583212.
IsChangePoint: Marked as a change because one of 8/4/2022 3:21:43 PM, 8/25/2022 6:55:57 AM, 9/28/2022 11:19:50 AM, 10/6/2022 12:41:43 AM falls between 9/27/2022 9:53:04 AM and 10/6/2022 12:41:43 AM.
IsImprovementStdDev: Marked as improvement because 37.43644546491896 (T) = (0 -1031.5472311774784) / Math.Sqrt((2308.5128071896834 / (299)) + (85.51567284451487 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.10403093151141034 = (1151.3201375551898 - 1031.5472311774784) / 1151.3201375551898 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Collections.CtorGivenSize<String>.Stack(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 253.6500168078953 < 263.2933510069323.
IsChangePoint: Marked as a change because one of 8/5/2022 7:33:33 PM, 8/25/2022 6:55:57 AM, 9/28/2022 11:19:50 AM, 10/6/2022 12:41:43 AM falls between 9/27/2022 9:53:04 AM and 10/6/2022 12:41:43 AM.
IsImprovementStdDev: Marked as improvement because 40.340190175474405 (T) = (0 -255.40964413445448) / Math.Sqrt((177.81088999719057 / (299)) + (2.966178557643907 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.11537892560776357 = (288.722088505442 - 255.40964413445448) / 288.722088505442 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Collections.CtorGivenSize<String>.SortedList(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 548.8720874830552 < 564.852465260531.
IsChangePoint: Marked as a change because one of 8/5/2022 7:33:33 PM, 8/25/2022 6:55:57 AM, 9/28/2022 11:19:50 AM, 10/6/2022 12:41:43 AM falls between 9/27/2022 9:53:04 AM and 10/6/2022 12:41:43 AM.
IsImprovementStdDev: Marked as improvement because 38.2618200855504 (T) = (0 -550.9883464626538) / Math.Sqrt((810.8559200969418 / (299)) + (16.700416745187393 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.11054320664352554 = (619.466117497885 - 550.9883464626538) / 619.466117497885 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Collections.CtorGivenSize<String>.Array(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 239.34605409904387 < 247.71439867509292.
IsChangePoint: Marked as a change because one of 8/5/2022 7:33:33 PM, 8/25/2022 6:55:57 AM, 9/28/2022 11:19:50 AM, 10/6/2022 12:41:43 AM falls between 9/27/2022 9:53:04 AM and 10/6/2022 12:41:43 AM.
IsImprovementStdDev: Marked as improvement because 45.19531807898151 (T) = (0 -239.41611464363018) / Math.Sqrt((118.01796043491325 / (299)) + (1.8732119012958632 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.11237758154372693 = (269.727431017364 - 239.41611464363018) / 269.727431017364 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | arm64 |
|---|---|
| OS | Windows 10.0.19041 |
| Baseline | cdb6e1d5f9075214c8a58ca75d5314b5dc64daed |
| Compare | e3ed6c1c26d7d09e10253fd8f90e06e503ae1c61 |
| Diff | Diff |
Improvements in System.Tests.Perf_GC<Char>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [AllocateUninitializedArray - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Tests.Perf_GC(Char).AllocateUninitializedArray(length%3a%201000%2c%20pinned%3a%20False).html>) | 124.26 ns | 114.99 ns | 0.93 | 0.04 | False | |||||
| [AllocateUninitializedArray - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Tests.Perf_GC(Char).AllocateUninitializedArray(length%3a%2010000%2c%20pinned%3a%20False).html>) | 422.74 ns | 352.01 ns | 0.83 | 0.08 | False | |||||
| [AllocateArray - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Tests.Perf_GC(Char).AllocateArray(length%3a%2010000%2c%20pinned%3a%20False).html>) | 1.23 μs | 1.11 μs | 0.91 | 0.01 | False | |||||
| [NewOperator_Array - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Tests.Perf_GC(Char).NewOperator_Array(length%3a%201000).html>) | 125.57 ns | 114.75 ns | 0.91 | 0.01 | False | |||||
| [NewOperator_Array - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Tests.Perf_GC(Char).NewOperator_Array(length%3a%2010000).html>) | 1.23 μs | 1.10 μs | 0.90 | 0.02 | False |
_1.png>)
_2.png>)
_3.png>)
_4.png>)
_5.png>)
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_GC<Char>*'
### Related Issues
#### Regressions
#### Improvements
* [[Perf] Windows/arm64: 9 Improvements on 9/28/2022 6:40:13 PM]()
### Payloads
[Baseline]()
[Compare]()
### Histogram
### Edge Detector Info
[Collection Data]()
#### System.Tests.Perf_GC<Char>.AllocateUninitializedArray(length: 1000, pinned: False)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 114.98929345563936 < 118.67257131218975.
IsChangePoint: Marked as a change because one of 8/5/2022 7:33:33 PM, 8/25/2022 6:55:57 AM, 9/28/2022 11:19:50 AM, 10/6/2022 12:41:43 AM falls between 9/27/2022 9:53:04 AM and 10/6/2022 12:41:43 AM.
IsImprovementStdDev: Marked as improvement because 39.11199190674375 (T) = (0 -115.0185154339287) / Math.Sqrt((41.15749550213012 / (299)) + (1.0072178675455186 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.12209666450535735 = (131.01501131570834 - 115.0185154339287) / 131.01501131570834 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_GC<Char>.AllocateUninitializedArray(length: 10000, pinned: False)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 352.00791664432523 < 402.28649414187277.
IsChangePoint: Marked as a change because one of 8/5/2022 7:33:33 PM, 8/25/2022 6:55:57 AM, 9/28/2022 11:19:50 AM, 10/6/2022 12:41:43 AM falls between 9/27/2022 9:53:04 AM and 10/6/2022 12:41:43 AM.
IsImprovementStdDev: Marked as improvement because 35.330486997745496 (T) = (0 -354.7397915641618) / Math.Sqrt((3409.485492827355 / (299)) + (39.89473518118697 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.26100920034114533 = (480.03275782042584 - 354.7397915641618) / 480.03275782042584 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_GC<Char>.AllocateArray(length: 10000, pinned: False)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.1112626450636982 < 1.1628599278608698.
IsChangePoint: Marked as a change because one of 8/5/2022 7:33:33 PM, 8/25/2022 6:55:57 AM, 9/28/2022 11:19:50 AM, 10/6/2022 12:41:43 AM falls between 9/27/2022 9:53:04 AM and 10/6/2022 12:41:43 AM.
IsImprovementStdDev: Marked as improvement because 41.70800423125698 (T) = (0 -1110.9432207618304) / Math.Sqrt((4232.016225493941 / (299)) + (49.661457896349816 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.12918651199326145 = (1275.7533456501005 - 1110.9432207618304) / 1275.7533456501005 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_GC<Char>.NewOperator_Array(length: 1000)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 114.74657912096254 < 119.16248131727346.
IsChangePoint: Marked as a change because one of 8/5/2022 7:33:33 PM, 8/25/2022 6:55:57 AM, 9/28/2022 11:19:50 AM, 10/6/2022 12:41:43 AM falls between 9/27/2022 9:53:04 AM and 10/6/2022 12:41:43 AM.
IsImprovementStdDev: Marked as improvement because 39.2774052374307 (T) = (0 -115.07027459552694) / Math.Sqrt((37.54063956032442 / (299)) + (0.9292866366474115 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.11774860373487546 = (130.42798807988203 - 115.07027459552694) / 130.42798807988203 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_GC<Char>.NewOperator_Array(length: 10000)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.101662529291154 < 1.1607292484285088.
IsChangePoint: Marked as a change because one of 8/5/2022 7:33:33 PM, 8/25/2022 6:55:57 AM, 9/28/2022 11:19:50 AM, 10/6/2022 12:41:43 AM falls between 9/27/2022 9:53:04 AM and 10/6/2022 12:41:43 AM.
IsImprovementStdDev: Marked as improvement because 38.98450997134137 (T) = (0 -1112.7124068482754) / Math.Sqrt((3515.590578807093 / (299)) + (171.12257542152835 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.12554082125438953 = (1272.457804656397 - 1112.7124068482754) / 1272.457804656397 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
Improvements in System.Collections.CtorGivenSize<Int32>
Repro
Run Information
Improvements in System.IO.Tests.StreamReaderReadToEndTests
Repro