performanceautofiler[bot]
commented
1 year ago Run Information
| Name | Value |
|---|---|
| Architecture | x64 |
| OS | Windows 10.0.18362 |
| Queue | TigerWindows |
| Baseline | 2e0033cf25cee5457ee326dc1eaff013b939d00d |
| Compare | 9a7db5556f4ad892c611b2e174594db17fdec3af |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Regressions in System.Tests.Perf_UInt16
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [TryParse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Tests.Perf_UInt16.TryParse(value%3a%20%220%22).html>) | 10.53 ns | 12.34 ns | 1.17 | 0.29 | False | Trace | Trace | |||
| [Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Tests.Perf_UInt16.Parse(value%3a%20%220%22).html>) | 10.22 ns | 13.92 ns | 1.36 | 0.38 | False | Trace | Trace |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_UInt16*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Tests.Perf_UInt16.TryParse(value: "0")
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 12.338259574027765 > 11.180518577137722.
IsChangePoint: Marked as a change because one of 2/15/2023 9:41:15 PM, 3/5/2023 4:40:20 PM, 3/17/2023 10:06:19 AM, 4/25/2023 6:46:56 PM, 5/2/2023 10:35:24 AM falls between 4/23/2023 8:38:14 PM and 5/2/2023 10:35:24 AM.
IsRegressionStdDev: Marked as regression because -12.576295980241177 (T) = (0 -11.969795101756981) / Math.Sqrt((0.05977757455215522 / (23)) + (0.22215377391659683 / (27))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (23) + (27) - 2, .025) and -0.12274381602912769 = (10.661198869116234 - 11.969795101756981) / 10.661198869116234 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
[Baseline](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_02_2023/System_Tests_Perf_UInt16_TryParse_value___0___baseline_47e4a730-8a81-49a8-b9af-5a1be611bb21.log)
[Compare](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_02_2023/System_Tests_Perf_UInt16_TryParse_value___0___compare_47e4a730-8a81-49a8-b9af-5a1be611bb21.log)
[Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_02_2023%2FSystem_Tests_Perf_UInt16_TryParse_value___0___baseline_47e4a730-8a81-49a8-b9af-5a1be611bb21.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_02_2023%2FSystem_Tests_Perf_UInt16_TryParse_value___0___compare_47e4a730-8a81-49a8-b9af-5a1be611bb21.log)
#### System.Tests.Perf_UInt16.Parse(value: "0")
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 13.917674378121898 > 10.77818953409713.
IsChangePoint: Marked as a change because one of 3/7/2023 4:52:41 AM, 4/25/2023 9:59:52 PM, 5/2/2023 10:35:24 AM falls between 4/23/2023 8:38:14 PM and 5/2/2023 10:35:24 AM.
IsRegressionStdDev: Marked as regression because -8.96745541086073 (T) = (0 -13.055112698853833) / Math.Sqrt((0.08032571558352085 / (23)) + (2.104730573709145 / (26))) is less than -2.011740513728388 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (23) + (26) - 2, .025) and -0.2493835119302257 = (10.449243626310095 - 13.055112698853833) / 10.449243626310095 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
[Baseline](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_02_2023/System_Tests_Perf_UInt16_Parse_value___0___baseline_86a03cde-17e6-4c84-b6c6-ae060944ed6c.log)
[Compare](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_02_2023/System_Tests_Perf_UInt16_Parse_value___0___compare_86a03cde-17e6-4c84-b6c6-ae060944ed6c.log)
[Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_02_2023%2FSystem_Tests_Perf_UInt16_Parse_value___0___baseline_86a03cde-17e6-4c84-b6c6-ae060944ed6c.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_02_2023%2FSystem_Tests_Perf_UInt16_Parse_value___0___compare_86a03cde-17e6-4c84-b6c6-ae060944ed6c.log)
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Name | Value |
|---|---|
| Architecture | x64 |
| OS | Windows 10.0.18362 |
| Queue | TigerWindows |
| Baseline | 2e0033cf25cee5457ee326dc1eaff013b939d00d |
| Compare | 9a7db5556f4ad892c611b2e174594db17fdec3af |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Regressions in System.Collections.ContainsTrue<String>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [ImmutableList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Collections.ContainsTrue(String).ImmutableList(Size%3a%20512).html>) | 1.45 ms | 1.64 ms | 1.13 | 0.01 | True | Trace | Trace | |||
| [Span - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Collections.ContainsTrue(String).Span(Size%3a%20512).html>) | 436.41 μs | 468.50 μs | 1.07 | 0.01 | False | Trace | Trace |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsTrue<String>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Collections.ContainsTrue<String>.ImmutableList(Size: 512)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.64279640625 > 1.5287053577360141.
IsChangePoint: Marked as a change because one of 3/14/2023 8:42:09 PM, 3/29/2023 12:02:44 PM, 4/25/2023 6:46:56 PM, 5/2/2023 10:35:24 AM falls between 4/23/2023 8:38:14 PM and 5/2/2023 10:35:24 AM.
IsRegressionStdDev: Marked as regression because -66.73816099578534 (T) = (0 -1620468.8206887632) / Math.Sqrt((46354232.758823074 / (23)) + (110257629.37476635 / (27))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (23) + (27) - 2, .025) and -0.11322619317568997 = (1455650.9994308227 - 1620468.8206887632) / 1455650.9994308227 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
```
### JIT Disasms
[Baseline](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_02_2023/System_Collections_ContainsTrue_String__ImmutableList_Size__512__baseline_31cdeb27-5aae-4b74-9c29-03110244ef14.log)
[Compare](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_02_2023/System_Collections_ContainsTrue_String__ImmutableList_Size__512__compare_31cdeb27-5aae-4b74-9c29-03110244ef14.log)
[Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_02_2023%2FSystem_Collections_ContainsTrue_String__ImmutableList_Size__512__baseline_31cdeb27-5aae-4b74-9c29-03110244ef14.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_02_2023%2FSystem_Collections_ContainsTrue_String__ImmutableList_Size__512__compare_31cdeb27-5aae-4b74-9c29-03110244ef14.log)
#### System.Collections.ContainsTrue<String>.Span(Size: 512)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 468.4992297979798 > 458.32882031250006.
IsChangePoint: Marked as a change because one of 3/14/2023 8:42:09 PM, 4/12/2023 8:39:35 PM, 4/25/2023 6:46:56 PM, 5/2/2023 10:35:24 AM falls between 4/23/2023 8:38:14 PM and 5/2/2023 10:35:24 AM.
IsRegressionStdDev: Marked as regression because -71.62695918365603 (T) = (0 -472617.9180639926) / Math.Sqrt((2960744.339800209 / (22)) + (3149701.041845311 / (27))) is less than -2.011740513728388 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (27) - 2, .025) and -0.08220860596155713 = (436716.0965644559 - 472617.9180639926) / 436716.0965644559 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
[Baseline](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_02_2023/System_Collections_ContainsTrue_String__Span_Size__512__baseline_9b1daa6f-caa4-47ad-b509-bc44910590d1.log)
[Compare](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_02_2023/System_Collections_ContainsTrue_String__Span_Size__512__compare_9b1daa6f-caa4-47ad-b509-bc44910590d1.log)
[Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_02_2023%2FSystem_Collections_ContainsTrue_String__Span_Size__512__baseline_9b1daa6f-caa4-47ad-b509-bc44910590d1.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_02_2023%2FSystem_Collections_ContainsTrue_String__Span_Size__512__compare_9b1daa6f-caa4-47ad-b509-bc44910590d1.log)
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Name | Value |
|---|---|
| Architecture | x64 |
| OS | Windows 10.0.18362 |
| Queue | TigerWindows |
| Baseline | 2e0033cf25cee5457ee326dc1eaff013b939d00d |
| Compare | 9a7db5556f4ad892c611b2e174594db17fdec3af |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Regressions in System.Tests.Perf_UInt64
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Tests.Perf_UInt64.Parse(value%3a%20%220%22).html>) | 11.05 ns | 12.66 ns | 1.15 | 0.39 | False | Trace | Trace | |||
| [Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Tests.Perf_UInt64.Parse(value%3a%20%2212345%22).html>) | 14.26 ns | 15.86 ns | 1.11 | 0.24 | False | Trace | Trace | |||
| [TryParse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Tests.Perf_UInt64.TryParse(value%3a%20%2212345%22).html>) | 14.46 ns | 15.70 ns | 1.09 | 0.17 | False | 194.38957492617862 | 199.5040845632751 | 1.0263106169095682) | Trace | Trace |
| [ParseSpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Tests.Perf_UInt64.ParseSpan(value%3a%20%220%22).html>) | 10.57 ns | 12.48 ns | 1.18 | 0.34 | False | Trace | Trace | |||
| [TryParseHex - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Tests.Perf_UInt64.TryParseHex(value%3a%20%22FFFFFFFFFFFFFFFF%22).html>) | 25.23 ns | 29.25 ns | 1.16 | 0.01 | True | Trace | Trace |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_UInt64*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Tests.Perf_UInt64.Parse(value: "0")
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 12.662440303856114 > 11.605611990206159.
IsChangePoint: Marked as a change because one of 2/13/2023 11:10:05 PM, 4/25/2023 6:46:56 PM, 5/2/2023 10:35:24 AM falls between 4/23/2023 8:38:14 PM and 5/2/2023 10:35:24 AM.
IsRegressionStdDev: Marked as regression because -10.200346574180939 (T) = (0 -12.693368881468158) / Math.Sqrt((0.04796687420302628 / (23)) + (0.5813567187952319 / (27))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (23) + (27) - 2, .025) and -0.1408960194270005 = (11.12578943683512 - 12.693368881468158) / 11.12578943683512 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
[Baseline](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_02_2023/System_Tests_Perf_UInt64_Parse_value___0___baseline_68bb6382-d28a-4d72-8ce0-601776d92bf8.log)
[Compare](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_02_2023/System_Tests_Perf_UInt64_Parse_value___0___compare_68bb6382-d28a-4d72-8ce0-601776d92bf8.log)
[Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_02_2023%2FSystem_Tests_Perf_UInt64_Parse_value___0___baseline_68bb6382-d28a-4d72-8ce0-601776d92bf8.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_02_2023%2FSystem_Tests_Perf_UInt64_Parse_value___0___compare_68bb6382-d28a-4d72-8ce0-601776d92bf8.log)
#### System.Tests.Perf_UInt64.Parse(value: "12345")
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 15.86313366167559 > 14.976175029610705.
IsChangePoint: Marked as a change because one of 3/25/2023 12:18:49 AM, 4/4/2023 4:23:54 PM, 4/25/2023 3:46:39 AM, 5/2/2023 10:35:24 AM falls between 4/23/2023 8:38:14 PM and 5/2/2023 10:35:24 AM.
IsRegressionStdDev: Marked as regression because -9.176086485015752 (T) = (0 -16.15472992758679) / Math.Sqrt((0.4349884941343271 / (20)) + (0.21856152481975133 / (30))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (20) + (30) - 2, .025) and -0.10715862424752201 = (14.591161170393553 - 16.15472992758679) / 14.591161170393553 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
[Baseline](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_02_2023/System_Tests_Perf_UInt64_Parse_value___12345___baseline_f23ba214-4090-4a11-87ff-ab322dd76bea.log)
[Compare](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_02_2023/System_Tests_Perf_UInt64_Parse_value___12345___compare_f23ba214-4090-4a11-87ff-ab322dd76bea.log)
[Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_02_2023%2FSystem_Tests_Perf_UInt64_Parse_value___12345___baseline_f23ba214-4090-4a11-87ff-ab322dd76bea.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_02_2023%2FSystem_Tests_Perf_UInt64_Parse_value___12345___compare_f23ba214-4090-4a11-87ff-ab322dd76bea.log)
#### System.Tests.Perf_UInt64.TryParse(value: "12345")
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 15.70316408710173 > 15.159803436090913.
IsChangePoint: Marked as a change because one of 3/25/2023 12:18:49 AM, 4/4/2023 4:23:54 PM, 4/25/2023 3:46:39 AM, 5/2/2023 10:35:24 AM falls between 4/23/2023 8:38:14 PM and 5/2/2023 10:35:24 AM.
IsRegressionStdDev: Marked as regression because -4.525946886185449 (T) = (0 -16.19893095098362) / Math.Sqrt((1.093200694007903 / (20)) + (0.7132872898405671 / (30))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (20) + (30) - 2, .025) and -0.08489228159194216 = (14.931372658688048 - 16.19893095098362) / 14.931372658688048 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
[Baseline](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_02_2023/System_Tests_Perf_UInt64_TryParse_value___12345___baseline_80c0142b-d056-414c-90fd-0715e63cf1e3.log)
[Compare](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_02_2023/System_Tests_Perf_UInt64_TryParse_value___12345___compare_80c0142b-d056-414c-90fd-0715e63cf1e3.log)
[Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_02_2023%2FSystem_Tests_Perf_UInt64_TryParse_value___12345___baseline_80c0142b-d056-414c-90fd-0715e63cf1e3.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_02_2023%2FSystem_Tests_Perf_UInt64_TryParse_value___12345___compare_80c0142b-d056-414c-90fd-0715e63cf1e3.log)
#### System.Tests.Perf_UInt64.ParseSpan(value: "0")
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 12.478870581715125 > 11.584687507663887.
IsChangePoint: Marked as a change because one of 2/14/2023 7:27:15 AM, 4/25/2023 6:46:56 PM, 5/2/2023 10:35:24 AM falls between 4/23/2023 8:38:14 PM and 5/2/2023 10:35:24 AM.
IsRegressionStdDev: Marked as regression because -10.739669276215416 (T) = (0 -12.519828573609724) / Math.Sqrt((0.2586334788962941 / (23)) + (0.3689203905599096 / (27))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (23) + (27) - 2, .025) and -0.15658293042154048 = (10.824842944073724 - 12.519828573609724) / 10.824842944073724 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
[Baseline](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_02_2023/System_Tests_Perf_UInt64_ParseSpan_value___0___baseline_3db083c2-e0a0-40ab-ae34-dc92a50d69bf.log)
[Compare](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_02_2023/System_Tests_Perf_UInt64_ParseSpan_value___0___compare_3db083c2-e0a0-40ab-ae34-dc92a50d69bf.log)
[Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_02_2023%2FSystem_Tests_Perf_UInt64_ParseSpan_value___0___baseline_3db083c2-e0a0-40ab-ae34-dc92a50d69bf.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_02_2023%2FSystem_Tests_Perf_UInt64_ParseSpan_value___0___compare_3db083c2-e0a0-40ab-ae34-dc92a50d69bf.log)
#### System.Tests.Perf_UInt64.TryParseHex(value: "FFFFFFFFFFFFFFFF")
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 29.247738419488616 > 26.468903925536598.
IsChangePoint: Marked as a change because one of 4/25/2023 6:46:56 PM, 5/2/2023 10:35:24 AM falls between 4/23/2023 8:38:14 PM and 5/2/2023 10:35:24 AM.
IsRegressionStdDev: Marked as regression because -70.84748823085754 (T) = (0 -28.821207742718254) / Math.Sqrt((0.016063053954505132 / (23)) + (0.04927179785013114 / (27))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (23) + (27) - 2, .025) and -0.14087452382542293 = (25.262381743856423 - 28.821207742718254) / 25.262381743856423 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
```
### JIT Disasms
[Baseline](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_02_2023/System_Tests_Perf_UInt64_TryParseHex_value___FFFFFFFFFFFFFFFF___baseline_d3072c07-6624-4527-8483-6adfca97ebac.log)
[Compare](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_02_2023/System_Tests_Perf_UInt64_TryParseHex_value___FFFFFFFFFFFFFFFF___compare_d3072c07-6624-4527-8483-6adfca97ebac.log)
[Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_02_2023%2FSystem_Tests_Perf_UInt64_TryParseHex_value___FFFFFFFFFFFFFFFF___baseline_d3072c07-6624-4527-8483-6adfca97ebac.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_02_2023%2FSystem_Tests_Perf_UInt64_TryParseHex_value___FFFFFFFFFFFFFFFF___compare_d3072c07-6624-4527-8483-6adfca97ebac.log)
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Name | Value |
|---|---|
| Architecture | x64 |
| OS | Windows 10.0.18362 |
| Queue | TigerWindows |
| Baseline | 2e0033cf25cee5457ee326dc1eaff013b939d00d |
| Compare | 9a7db5556f4ad892c611b2e174594db17fdec3af |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig.Count(Pattern%3a%20%22(%3fi)Tom%7cSawyer%7cHuckleberry%7cFinn%22%2c%20Options%3a%20Compiled).html>) | 31.06 ms | 34.80 ms | 1.12 | 0.01 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig.Count(Pattern: "(?i)Tom|Sawyer|Huckleberry|Finn", Options: Compiled)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 34.80371 > 32.558309.
IsChangePoint: Marked as a change because one of 4/10/2023 1:33:42 PM, 4/25/2023 6:46:56 PM, 5/2/2023 10:35:24 AM falls between 4/23/2023 8:38:14 PM and 5/2/2023 10:35:24 AM.
IsRegressionStdDev: Marked as regression because -58.38901147755665 (T) = (0 -34975259.75133841) / Math.Sqrt((42679572167.91834 / (23)) + (77286994174.17207 / (26))) is less than -2.011740513728388 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (23) + (26) - 2, .025) and -0.13122352168940662 = (30918080.362318844 - 34975259.75133841) / 30918080.362318844 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Name | Value |
|---|---|
| Architecture | x64 |
| OS | Windows 10.0.18362 |
| Queue | TigerWindows |
| Baseline | 2e0033cf25cee5457ee326dc1eaff013b939d00d |
| Compare | 9a7db5556f4ad892c611b2e174594db17fdec3af |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Regressions in System.Tests.Perf_Int64
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [TryParseSpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Tests.Perf_Int64.TryParseSpan(value%3a%20%2212345%22).html>) | 16.53 ns | 18.38 ns | 1.11 | 0.26 | False | Trace | Trace | |||
| [ParseSpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Tests.Perf_Int64.ParseSpan(value%3a%20%2212345%22).html>) | 16.01 ns | 17.62 ns | 1.10 | 0.21 | False | Trace | Trace |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Int64*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Tests.Perf_Int64.TryParseSpan(value: "12345")
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 18.375241435098065 > 17.331494275678438.
IsChangePoint: Marked as a change because one of 4/17/2023 1:54:35 PM, 4/25/2023 6:46:56 PM, 5/2/2023 10:35:24 AM falls between 4/23/2023 8:38:14 PM and 5/2/2023 10:35:24 AM.
IsRegressionStdDev: Marked as regression because -19.72387034106435 (T) = (0 -18.409545969901302) / Math.Sqrt((0.09498264990310554 / (23)) + (0.17171163430142952 / (27))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (23) + (27) - 2, .025) and -0.12325423182648389 = (16.389473948356457 - 18.409545969901302) / 16.389473948356457 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
[Baseline](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_02_2023/System_Tests_Perf_Int64_TryParseSpan_value___12345___baseline_74075835-2455-4bee-9cef-23df6c3bb10d.log)
[Compare](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_02_2023/System_Tests_Perf_Int64_TryParseSpan_value___12345___compare_74075835-2455-4bee-9cef-23df6c3bb10d.log)
[Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_02_2023%2FSystem_Tests_Perf_Int64_TryParseSpan_value___12345___baseline_74075835-2455-4bee-9cef-23df6c3bb10d.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_02_2023%2FSystem_Tests_Perf_Int64_TryParseSpan_value___12345___compare_74075835-2455-4bee-9cef-23df6c3bb10d.log)
#### System.Tests.Perf_Int64.ParseSpan(value: "12345")
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 17.620007322870467 > 16.800229952123157.
IsChangePoint: Marked as a change because one of 4/25/2023 6:46:56 PM, 5/2/2023 10:35:24 AM falls between 4/23/2023 8:38:14 PM and 5/2/2023 10:35:24 AM.
IsRegressionStdDev: Marked as regression because -15.282606967866917 (T) = (0 -18.78869885779027) / Math.Sqrt((0.2053953500617962 / (23)) + (0.5417891602984383 / (27))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (23) + (27) - 2, .025) and -0.1607763062663727 = (16.186321823042686 - 18.78869885779027) / 16.186321823042686 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
[Baseline](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_02_2023/System_Tests_Perf_Int64_ParseSpan_value___12345___baseline_70f5d6fa-a5e6-4f60-8786-a3fce273fb4b.log)
[Compare](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_02_2023/System_Tests_Perf_Int64_ParseSpan_value___12345___compare_70f5d6fa-a5e6-4f60-8786-a3fce273fb4b.log)
[Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_02_2023%2FSystem_Tests_Perf_Int64_ParseSpan_value___12345___baseline_70f5d6fa-a5e6-4f60-8786-a3fce273fb4b.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_02_2023%2FSystem_Tests_Perf_Int64_ParseSpan_value___12345___compare_70f5d6fa-a5e6-4f60-8786-a3fce273fb4b.log)
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Name | Value |
|---|---|
| Architecture | x64 |
| OS | Windows 10.0.18362 |
| Queue | TigerWindows |
| Baseline | 2e0033cf25cee5457ee326dc1eaff013b939d00d |
| Compare | 9a7db5556f4ad892c611b2e174594db17fdec3af |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Regressions in System.Collections.IndexerSet<String>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Collections.IndexerSet(String).Dictionary(Size%3a%20512).html>) | 14.14 μs | 15.30 μs | 1.08 | 0.01 | False | Trace | Trace |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.IndexerSet<String>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Collections.IndexerSet<String>.Dictionary(Size: 512)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 15.295971948818897 > 14.845891529886517.
IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/14/2023 8:42:09 PM, 3/29/2023 3:17:08 PM, 4/25/2023 6:46:56 PM, 5/2/2023 10:35:24 AM falls between 4/23/2023 8:38:14 PM and 5/2/2023 10:35:24 AM.
IsRegressionStdDev: Marked as regression because -22.628892704713408 (T) = (0 -15168.412267473315) / Math.Sqrt((33217.22759852368 / (23)) + (33976.520117277905 / (27))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (23) + (27) - 2, .025) and -0.08407665338711645 = (13992.01082329441 - 15168.412267473315) / 13992.01082329441 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
[Baseline](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_02_2023/System_Collections_IndexerSet_String__Dictionary_Size__512__baseline_39fce162-6596-4ae0-95fc-d96e8027749c.log)
[Compare](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_02_2023/System_Collections_IndexerSet_String__Dictionary_Size__512__compare_39fce162-6596-4ae0-95fc-d96e8027749c.log)
[Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_02_2023%2FSystem_Collections_IndexerSet_String__Dictionary_Size__512__baseline_39fce162-6596-4ae0-95fc-d96e8027749c.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_02_2023%2FSystem_Collections_IndexerSet_String__Dictionary_Size__512__compare_39fce162-6596-4ae0-95fc-d96e8027749c.log)
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
Regressions in System.Tests.Perf_Int16
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
Baseline Compare
Run Information
Regressions in System.Buffers.Tests.RentReturnArrayPoolTests<Byte>
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
Baseline Compare
Run Information
Regressions in System.Reflection.Invoke
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
Baseline Compare
Run Information
Regressions in System.IO.Tests.Perf_Path
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
Baseline Compare