performanceautofiler[bot]
commented
1 year ago Run Information
| Name | Value |
|---|---|
| Architecture | arm64 |
| OS | Windows 10.0.25094 |
| Queue | AmpereWindows |
| Baseline | f73356c1f4b9b292dc4fb02f1dd47e4a61e423f5 |
| Compare | 1ec5ff876baf614275dcdc1d6ba435e94d78e4b1 |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.Collections.IterateForEach<Int32>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [Queue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.25094/System.Collections.IterateForEach(Int32).Queue(Size%3a%20512).html>) | 3.91 μs | 2.77 μs | 0.71 | 0.68 | False | |||||
| [ConcurrentQueue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.25094/System.Collections.IterateForEach(Int32).ConcurrentQueue(Size%3a%20512).html>) | 11.73 μs | 7.81 μs | 0.67 | 0.65 | False | |||||
| [SortedList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.25094/System.Collections.IterateForEach(Int32).SortedList(Size%3a%20512).html>) | 4.61 μs | 2.56 μs | 0.56 | 0.60 | False | |||||
| [ImmutableQueue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.25094/System.Collections.IterateForEach(Int32).ImmutableQueue(Size%3a%20512).html>) | 5.64 μs | 997.63 ns | 0.18 | 0.67 | False | |||||
| [ConcurrentBag - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.25094/System.Collections.IterateForEach(Int32).ConcurrentBag(Size%3a%20512).html>) | 3.92 μs | 2.58 μs | 0.66 | 0.65 | False | |||||
| [Stack - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.25094/System.Collections.IterateForEach(Int32).Stack(Size%3a%20512).html>) | 2.96 μs | 2.59 μs | 0.88 | 0.62 | False | |||||
| [ConcurrentStack - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.25094/System.Collections.IterateForEach(Int32).ConcurrentStack(Size%3a%20512).html>) | 4.47 μs | 2.64 μs | 0.59 | 0.62 | False | |||||
| [ImmutableStack - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.25094/System.Collections.IterateForEach(Int32).ImmutableStack(Size%3a%20512).html>) | 2.97 μs | 1.16 μs | 0.39 | 0.62 | False | |||||
| [ImmutableSortedDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.25094/System.Collections.IterateForEach(Int32).ImmutableSortedDictionary(Size%3a%20512).html>) | 15.71 μs | 9.68 μs | 0.62 | 0.62 | False | |||||
| [ImmutableDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.25094/System.Collections.IterateForEach(Int32).ImmutableDictionary(Size%3a%20512).html>) | 26.93 μs | 20.89 μs | 0.78 | 0.66 | False | |||||
| [SortedSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.25094/System.Collections.IterateForEach(Int32).SortedSet(Size%3a%20512).html>) | 14.33 μs | 8.35 μs | 0.58 | 0.63 | False | |||||
| [ImmutableList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.25094/System.Collections.IterateForEach(Int32).ImmutableList(Size%3a%20512).html>) | 15.71 μs | 9.89 μs | 0.63 | 0.63 | False | |||||
| [HashSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.25094/System.Collections.IterateForEach(Int32).HashSet(Size%3a%20512).html>) | 3.11 μs | 1.26 μs | 0.40 | 0.68 | False | |||||
| [SortedDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.25094/System.Collections.IterateForEach(Int32).SortedDictionary(Size%3a%20512).html>) | 16.98 μs | 12.84 μs | 0.76 | 0.65 | False | |||||
| [Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.25094/System.Collections.IterateForEach(Int32).Dictionary(Size%3a%20512).html>) | 3.15 μs | 2.01 μs | 0.64 | 0.69 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.IterateForEach<Int32>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Collections.IterateForEach<Int32>.Queue(Size: 512)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 2.7681169524813187 < 3.143963992292652.
IsChangePoint: Marked as a change because one of 4/1/2023 8:54:51 PM, 4/18/2023 2:18:01 AM, 5/19/2023 4:22:12 AM, 5/25/2023 4:37:39 AM falls between 5/16/2023 7:34:13 AM and 5/25/2023 4:37:39 AM.
IsImprovementStdDev: Marked as improvement because 14.810716845862084 (T) = (0 -2699.007462612098) / Math.Sqrt((97394.50309959521 / (299)) + (27336.106966639472 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.21875512479867087 = (3454.752214427718 - 2699.007462612098) / 3454.752214427718 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.Collections.IterateForEach<Int32>.ConcurrentQueue(Size: 512)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 7.813500156128024 < 11.847533342919185.
IsChangePoint: Marked as a change because one of 5/17/2023 10:06:24 AM, 5/25/2023 4:37:39 AM falls between 5/16/2023 7:34:13 AM and 5/25/2023 4:37:39 AM.
IsImprovementStdDev: Marked as improvement because 33.48590665717505 (T) = (0 -7032.153343929501) / Math.Sqrt((858067.5844678755 / (299)) + (142185.16850397157 / (8))) is greater than 1.967772354556772 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (8) - 2, .975) and 0.4062331853275578 = (11843.2912890372 - 7032.153343929501) / 11843.2912890372 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.Collections.IterateForEach<Int32>.SortedList(Size: 512)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 2.5604656055770203 < 4.80267533296767.
IsChangePoint: Marked as a change because one of 5/19/2023 4:22:12 AM, 5/25/2023 4:37:39 AM falls between 5/16/2023 7:34:13 AM and 5/25/2023 4:37:39 AM.
IsImprovementStdDev: Marked as improvement because 43.44624840614457 (T) = (0 -2838.3230947924358) / Math.Sqrt((157565.90762280987 / (299)) + (26014.238237649406 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.45150085001498036 = (5174.708283267084 - 2838.3230947924358) / 5174.708283267084 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.Collections.IterateForEach<Int32>.ImmutableQueue(Size: 512)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 5/17/2023 10:06:24 AM, 5/25/2023 4:37:39 AM falls between 5/16/2023 7:34:13 AM and 5/25/2023 4:37:39 AM.
IsImprovementStdDev: Marked as improvement because 102.767862159755 (T) = (0 -1035.1886468733444) / Math.Sqrt((245397.30722918242 / (299)) + (9508.173819524964 / (7))) is greater than 1.9677981407170237 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (7) - 2, .975) and 0.8225109611170565 = (5832.408882196189 - 1035.1886468733444) / 5832.408882196189 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.Collections.IterateForEach<Int32>.ConcurrentBag(Size: 512)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 5/17/2023 10:06:24 AM, 5/25/2023 4:37:39 AM falls between 5/16/2023 7:34:13 AM and 5/25/2023 4:37:39 AM.
IsImprovementStdDev: Marked as improvement because 18.37482551117909 (T) = (0 -2393.259553531265) / Math.Sqrt((78341.08809704099 / (299)) + (32931.27175228946 / (8))) is greater than 1.967772354556772 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (8) - 2, .975) and 0.3368846269955404 = (3609.1148704452817 - 2393.259553531265) / 3609.1148704452817 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.Collections.IterateForEach<Int32>.Stack(Size: 512)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 2.5884571038014235 < 2.937176923775363.
IsChangePoint: Marked as a change because one of 5/19/2023 4:22:12 AM, 5/25/2023 4:37:39 AM falls between 5/16/2023 7:34:13 AM and 5/25/2023 4:37:39 AM.
IsImprovementStdDev: Marked as improvement because 13.037750816248185 (T) = (0 -2469.392935178278) / Math.Sqrt((68120.00577263834 / (299)) + (24508.75643578521 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.20099904091582907 = (3090.6007146834218 - 2469.392935178278) / 3090.6007146834218 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.Collections.IterateForEach<Int32>.ConcurrentStack(Size: 512)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 5/17/2023 10:06:24 AM, 5/25/2023 4:37:39 AM falls between 5/16/2023 7:34:13 AM and 5/25/2023 4:37:39 AM.
IsImprovementStdDev: Marked as improvement because 45.4135103631609 (T) = (0 -2882.721388277626) / Math.Sqrt((221238.48585612891 / (299)) + (14834.785677220685 / (8))) is greater than 1.967772354556772 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (8) - 2, .975) and 0.4451839675074152 = (5195.814863760545 - 2882.721388277626) / 5195.814863760545 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.Collections.IterateForEach<Int32>.ImmutableStack(Size: 512)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 5/17/2023 10:06:24 AM, 5/25/2023 4:37:39 AM falls between 5/16/2023 7:34:13 AM and 5/25/2023 4:37:39 AM.
IsImprovementStdDev: Marked as improvement because 83.41264038733691 (T) = (0 -1118.3411387595647) / Math.Sqrt((61980.604375217976 / (299)) + (2563.531756155302 / (8))) is greater than 1.967772354556772 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (8) - 2, .975) and 0.6314621869416097 = (3034.5356680737054 - 1118.3411387595647) / 3034.5356680737054 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.Collections.IterateForEach<Int32>.ImmutableSortedDictionary(Size: 512)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 5/17/2023 10:06:24 AM, 5/25/2023 4:37:39 AM falls between 5/16/2023 7:34:13 AM and 5/25/2023 4:37:39 AM.
IsImprovementStdDev: Marked as improvement because 13.68560947367367 (T) = (0 -10160.24326188368) / Math.Sqrt((1748426.2932268057 / (299)) + (686165.8383895906 / (8))) is greater than 1.967772354556772 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (8) - 2, .975) and 0.2896263245007757 = (14302.674229508064 - 10160.24326188368) / 14302.674229508064 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.Collections.IterateForEach<Int32>.ImmutableDictionary(Size: 512)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 4/17/2023 8:43:19 PM, 5/16/2023 5:40:18 PM, 5/25/2023 4:37:39 AM falls between 5/16/2023 7:34:13 AM and 5/25/2023 4:37:39 AM.
IsImprovementStdDev: Marked as improvement because 6.01209019546183 (T) = (0 -22562.787555150502) / Math.Sqrt((7042653.6060742885 / (299)) + (4097844.17450349 / (9))) is greater than 1.9677467375895035 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (9) - 2, .975) and 0.1556847889444933 = (26723.18022903319 - 22562.787555150502) / 26723.18022903319 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.Collections.IterateForEach<Int32>.SortedSet(Size: 512)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 8.34865137067938 < 14.515280429973101.
IsChangePoint: Marked as a change because one of 5/19/2023 4:22:12 AM, 5/25/2023 4:37:39 AM falls between 5/16/2023 7:34:13 AM and 5/25/2023 4:37:39 AM.
IsImprovementStdDev: Marked as improvement because 35.568268476504535 (T) = (0 -8777.412298997197) / Math.Sqrt((1416549.426843652 / (299)) + (262974.05810259277 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.40681997811890414 = (14797.21496884237 - 8777.412298997197) / 14797.21496884237 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.Collections.IterateForEach<Int32>.ImmutableList(Size: 512)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 3/30/2023 2:02:58 PM, 4/18/2023 4:36:42 PM, 5/17/2023 10:06:24 AM, 5/25/2023 4:37:39 AM falls between 5/16/2023 7:34:13 AM and 5/25/2023 4:37:39 AM.
IsImprovementStdDev: Marked as improvement because 27.782463228285373 (T) = (0 -9580.96671138581) / Math.Sqrt((1788297.5556142405 / (299)) + (207942.69217335994 / (8))) is greater than 1.967772354556772 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (8) - 2, .975) and 0.34146032531408393 = (14548.807125334335 - 9580.96671138581) / 14548.807125334335 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.Collections.IterateForEach<Int32>.HashSet(Size: 512)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 1.2590346272298216 < 2.7232620170428388.
IsChangePoint: Marked as a change because one of 5/19/2023 4:22:12 AM, 5/25/2023 4:37:39 AM falls between 5/16/2023 7:34:13 AM and 5/25/2023 4:37:39 AM.
IsImprovementStdDev: Marked as improvement because 54.263918021740615 (T) = (0 -1166.4421389000092) / Math.Sqrt((61462.30348078506 / (299)) + (10625.572734305364 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.6057738467131414 = (2958.814703628371 - 1166.4421389000092) / 2958.814703628371 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.Collections.IterateForEach<Int32>.SortedDictionary(Size: 512)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 12.841958147321428 < 15.80420379927889.
IsChangePoint: Marked as a change because one of 5/17/2023 10:06:24 AM, 5/25/2023 4:37:39 AM falls between 5/16/2023 7:34:13 AM and 5/25/2023 4:37:39 AM.
IsImprovementStdDev: Marked as improvement because 9.291897510952392 (T) = (0 -13579.767427906265) / Math.Sqrt((1887212.5436790825 / (299)) + (424303.77706697 / (9))) is greater than 1.9677467375895035 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (9) - 2, .975) and 0.13659297685124336 = (15728.11786772622 - 13579.767427906265) / 15728.11786772622 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.Collections.IterateForEach<Int32>.Dictionary(Size: 512)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 2.007268569078947 < 2.896061896708843.
IsChangePoint: Marked as a change because one of 3/30/2023 5:15:39 PM, 5/19/2023 4:22:12 AM, 5/25/2023 4:37:39 AM falls between 5/16/2023 7:34:13 AM and 5/25/2023 4:37:39 AM.
IsImprovementStdDev: Marked as improvement because 42.25085804132676 (T) = (0 -1912.3355788979177) / Math.Sqrt((72913.3338091841 / (299)) + (6094.688200804656 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.37724570091160464 = (3070.7705778944382 - 1912.3355788979177) / 3070.7705778944382 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Name | Value |
|---|---|
| Architecture | arm64 |
| OS | Windows 10.0.25094 |
| Queue | AmpereWindows |
| Baseline | f73356c1f4b9b292dc4fb02f1dd47e4a61e423f5 |
| Compare | 1ec5ff876baf614275dcdc1d6ba435e94d78e4b1 |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in MicroBenchmarks.Serializers.Xml_ToStream<Location>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [DataContractSerializer_ - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.25094/MicroBenchmarks.Serializers.XmlToStream(Location).DataContractSerializer.html>) | 3.56 μs | 2.64 μs | 0.74 | 0.63 | False | |||||
| [DataContractSerializerBinaryXml - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.25094/MicroBenchmarks.Serializers.Xml_ToStream(Location).DataContractSerializerBinaryXml.html>) | 2.05 μs | 1.49 μs | 0.73 | 0.61 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'MicroBenchmarks.Serializers.Xml_ToStream<Location>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### MicroBenchmarks.Serializers.Xml_ToStream<Location>.DataContractSerializer_
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 2.635429626645179 < 3.2232719109402983.
IsChangePoint: Marked as a change because one of 4/1/2023 8:54:51 PM, 5/19/2023 4:22:12 AM, 5/25/2023 4:37:39 AM falls between 5/16/2023 7:34:13 AM and 5/25/2023 4:37:39 AM.
IsImprovementStdDev: Marked as improvement because 20.581805471787572 (T) = (0 -2602.9878814735016) / Math.Sqrt((89870.79938521271 / (299)) + (17622.542297766984 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.24957316489370823 = (3468.6764381297876 - 2602.9878814735016) / 3468.6764381297876 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### MicroBenchmarks.Serializers.Xml_ToStream<Location>.DataContractSerializer_BinaryXml_
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 1.490514503134772 < 2.0872569648004378.
IsChangePoint: Marked as a change because one of 4/2/2023 6:09:37 PM, 5/19/2023 4:22:12 AM, 5/25/2023 4:37:39 AM falls between 5/16/2023 7:34:13 AM and 5/25/2023 4:37:39 AM.
IsImprovementStdDev: Marked as improvement because 19.271691560773476 (T) = (0 -1593.3745373591457) / Math.Sqrt((35989.857797304816 / (223)) + (13329.170245863708 / (12))) is greater than 1.970197598972363 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (223) + (12) - 2, .975) and 0.3013791949090421 = (2280.7430379226885 - 1593.3745373591457) / 2280.7430379226885 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Name | Value |
|---|---|
| Architecture | arm64 |
| OS | Windows 10.0.25094 |
| Queue | AmpereWindows |
| Baseline | f73356c1f4b9b292dc4fb02f1dd47e4a61e423f5 |
| Compare | 1ec5ff876baf614275dcdc1d6ba435e94d78e4b1 |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.Collections.Concurrent.Count<String>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [Queue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.25094/System.Collections.Concurrent.Count(String).Queue(Size%3a%20512).html>) | 16.42 ns | 7.03 ns | 0.43 | 0.77 | False | |||||
| [Bag - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.25094/System.Collections.Concurrent.Count(String).Bag(Size%3a%20512).html>) | 84.29 ns | 63.55 ns | 0.75 | 0.74 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Concurrent.Count<String>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Collections.Concurrent.Count<String>.Queue(Size: 512)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 7.032160623973182 < 16.657517695402337.
IsChangePoint: Marked as a change because one of 5/19/2023 4:22:12 AM, 5/25/2023 4:37:39 AM falls between 5/16/2023 7:34:13 AM and 5/25/2023 4:37:39 AM.
IsImprovementStdDev: Marked as improvement because 34.00007430402293 (T) = (0 -7.587691420533847) / Math.Sqrt((5.2327858019254325 / (299)) + (0.6273044810362811 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.5502174696646592 = (16.869689035891973 - 7.587691420533847) / 16.869689035891973 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.Collections.Concurrent.Count<String>.Bag(Size: 512)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 63.5484214155219 < 79.72381579971008.
IsChangePoint: Marked as a change because one of 5/17/2023 10:06:24 AM, 5/25/2023 4:37:39 AM falls between 5/16/2023 7:34:13 AM and 5/25/2023 4:37:39 AM.
IsImprovementStdDev: Marked as improvement because 14.307212118556514 (T) = (0 -57.99057127413476) / Math.Sqrt((83.90374506456574 / (299)) + (25.774362316036353 / (8))) is greater than 1.967772354556772 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (8) - 2, .975) and 0.31587565493842623 = (84.7661272292764 - 57.99057127413476) / 84.7661272292764 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Name | Value |
|---|---|
| Architecture | arm64 |
| OS | Windows 10.0.25094 |
| Queue | AmpereWindows |
| Baseline | f73356c1f4b9b292dc4fb02f1dd47e4a61e423f5 |
| Compare | 1ec5ff876baf614275dcdc1d6ba435e94d78e4b1 |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.Text.Json.Tests.Perf_Segment
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [ReadMultiSegmentSequenceUsingSpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.25094/System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequenceUsingSpan(segmentSize%3a%204096%2c%20TestCase%3a%20Json40KB).html>) | 147.08 μs | 107.63 μs | 0.73 | 0.66 | False | |||||
| [ReadSingleSegmentSequenceByN - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.25094/System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequenceByN(numberOfBytes%3a%208192%2c%20TestCase%3a%20Json4KB).html>) | 12.72 μs | 10.11 μs | 0.79 | 0.63 | False | |||||
| [ReadSingleSegmentSequenceByN - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.25094/System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequenceByN(numberOfBytes%3a%204096%2c%20TestCase%3a%20Json40KB).html>) | 130.94 μs | 104.11 μs | 0.80 | 0.63 | False | |||||
| [ReadSingleSegmentSequenceByN - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.25094/System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequenceByN(numberOfBytes%3a%204096%2c%20TestCase%3a%20Json4KB).html>) | 14.43 μs | 11.94 μs | 0.83 | 0.65 | False | |||||
| [ReadSingleSegmentSequence - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.25094/System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequence(TestCase%3a%20Json4KB).html>) | 13.88 μs | 10.90 μs | 0.79 | 0.65 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Tests.Perf_Segment*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequenceUsingSpan(segmentSize: 4096, TestCase: Json40KB)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 107.62671740614334 < 139.55227109252.
IsChangePoint: Marked as a change because one of 2/8/2023 4:01:29 AM, 5/19/2023 4:22:12 AM, 5/25/2023 4:37:39 AM falls between 5/16/2023 7:34:13 AM and 5/25/2023 4:37:39 AM.
IsImprovementStdDev: Marked as improvement because 9.322957279084969 (T) = (0 -113159.63593377905) / Math.Sqrt((128815329.79556791 / (299)) + (66613038.481631614 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.16770926082786747 = (135961.6665281381 - 113159.63593377905) / 135961.6665281381 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequenceByN(numberOfBytes: 8192, TestCase: Json4KB)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 2/8/2023 10:48:55 AM, 5/17/2023 10:06:24 AM, 5/25/2023 4:37:39 AM falls between 5/16/2023 7:34:13 AM and 5/25/2023 4:37:39 AM.
IsImprovementStdDev: Marked as improvement because 10.24435586618028 (T) = (0 -10786.006873435352) / Math.Sqrt((1263384.1842590596 / (299)) + (489150.681522539 / (8))) is greater than 1.967772354556772 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (8) - 2, .975) and 0.19538769877459464 = (13405.222436953201 - 10786.006873435352) / 13405.222436953201 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequenceByN(numberOfBytes: 4096, TestCase: Json40KB)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 2/8/2023 10:48:55 AM, 5/17/2023 10:06:24 AM, 5/25/2023 4:37:39 AM falls between 5/16/2023 7:34:13 AM and 5/25/2023 4:37:39 AM.
IsImprovementStdDev: Marked as improvement because 7.265330245934059 (T) = (0 -110073.84313174868) / Math.Sqrt((126024870.21997626 / (299)) + (81592199.17684726 / (8))) is greater than 1.967772354556772 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (8) - 2, .975) and 0.1770236622733087 = (133750.92099950992 - 110073.84313174868) / 133750.92099950992 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequenceByN(numberOfBytes: 4096, TestCase: Json4KB)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 2/8/2023 4:01:29 AM, 5/17/2023 10:06:24 AM, 5/25/2023 4:37:39 AM falls between 5/16/2023 7:34:13 AM and 5/25/2023 4:37:39 AM.
IsImprovementStdDev: Marked as improvement because 8.843694323606682 (T) = (0 -11000.317178970772) / Math.Sqrt((1145718.0011445286 / (299)) + (604569.3305698216 / (8))) is greater than 1.967772354556772 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (8) - 2, .975) and 0.18469913852877617 = (13492.340924453973 - 11000.317178970772) / 13492.340924453973 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequence(TestCase: Json4KB)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 2/12/2023 2:35:10 PM, 5/17/2023 10:06:24 AM, 5/25/2023 4:37:39 AM falls between 5/16/2023 7:34:13 AM and 5/25/2023 4:37:39 AM.
IsImprovementStdDev: Marked as improvement because 6.940692333945782 (T) = (0 -11499.86901796298) / Math.Sqrt((1122087.7496787005 / (299)) + (595354.4120771206 / (8))) is greater than 1.967772354556772 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (8) - 2, .975) and 0.14438275591047556 = (13440.43624342818 - 11499.86901796298) / 13440.43624342818 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
Improvements in System.Collections.ContainsKeyFalse<Int32, Int32>
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
Baseline Compare
Run Information
Improvements in System.Text.Json.Serialization.Tests.ReadJson<ClassRecord>
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
Baseline Compare
Run Information
Improvements in System.Text.Json.Serialization.Tests.WriteJson<HashSet<String>>
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
Baseline Compare