performanceautofiler[bot]
commented
1 year ago Run Information
| Name | Value |
|---|---|
| Architecture | x86 |
| OS | Windows 10.0.18362 |
| Queue | TigerWindows |
| Baseline | 86103fd589e2f335fb1a895027220e9f7960e973 |
| Compare | ba6da78bc8f4b2f2c59babe76b8accd78ece434e |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.Tests.Perf_Int64
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [TryParseSpan - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_Int64.TryParseSpan(value%3a%20%22-9223372036854775808%22).html>) | 84.06 ns | 77.38 ns | 0.92 | 0.08 | False | |||||
| [Parse - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_Int64.Parse(value%3a%20%2212345%22).html>) | 23.80 ns | 21.00 ns | 0.88 | 0.12 | False | |||||
| [TryParse - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_Int64.TryParse(value%3a%20%229223372036854775807%22).html>) | 83.09 ns | 77.69 ns | 0.94 | 0.07 | False | |||||
| [Parse - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_Int64.Parse(value%3a%20%22-9223372036854775808%22).html>) | 82.96 ns | 77.31 ns | 0.93 | 0.06 | False | |||||
| [TryParseSpan - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_Int64.TryParseSpan(value%3a%20%229223372036854775807%22).html>) | 83.19 ns | 75.91 ns | 0.91 | 0.08 | False | |||||
| [ParseSpan - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_Int64.ParseSpan(value%3a%20%22-9223372036854775808%22).html>) | 83.35 ns | 76.91 ns | 0.92 | 0.07 | False | |||||
| [TryParseSpan - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_Int64.TryParseSpan(value%3a%20%2212345%22).html>) | 22.82 ns | 20.08 ns | 0.88 | 0.25 | False | |||||
| [TryParse - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_Int64.TryParse(value%3a%20%22-9223372036854775808%22).html>) | 83.85 ns | 77.53 ns | 0.92 | 0.09 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Int64*'
### Payloads
[Baseline](<>)
[Compare](<>)
### Histogram
#### System.Tests.Perf_Int64.TryParseSpan(value: "-9223372036854775808")
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 77.37997876308414 < 79.85488606517535.
IsChangePoint: Marked as a change because one of 4/25/2023 6:46:56 PM, 5/13/2023 1:49:08 AM, 6/22/2023 7:55:14 AM, 6/26/2023 10:42:28 PM falls between 6/17/2023 6:37:57 PM and 6/26/2023 10:42:28 PM.
IsImprovementStdDev: Marked as improvement because 36.86780345336562 (T) = (0 -77.2121118094187) / Math.Sqrt((4.140100992844686 / (299)) + (0.44140779614298703 / (15))) is greater than 1.9675964973877862 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (15) - 2, .975) and 0.0903537668074467 = (84.881472590097 - 77.2121118094187) / 84.881472590097 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.Tests.Perf_Int64.Parse(value: "12345")
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 20.999874367913566 < 22.610222982787867.
IsChangePoint: Marked as a change because one of 4/25/2023 6:46:56 PM, 5/13/2023 1:49:08 AM, 6/22/2023 7:55:14 AM, 6/26/2023 10:42:28 PM falls between 6/17/2023 6:37:57 PM and 6/26/2023 10:42:28 PM.
IsImprovementStdDev: Marked as improvement because 25.664604415711878 (T) = (0 -21.00869589747187) / Math.Sqrt((6.357500823527995 / (299)) + (0.0023881550343468057 / (15))) is greater than 1.9675964973877862 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (15) - 2, .975) and 0.15167833755542987 = (24.76501170196699 - 21.00869589747187) / 24.76501170196699 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.Tests.Perf_Int64.TryParse(value: "9223372036854775807")
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 77.68710395949536 < 78.83267415839217.
IsChangePoint: Marked as a change because one of 4/25/2023 1:57:48 PM, 5/13/2023 1:49:08 AM, 6/22/2023 7:55:14 AM, 6/26/2023 10:42:28 PM falls between 6/17/2023 6:37:57 PM and 6/26/2023 10:42:28 PM.
IsImprovementStdDev: Marked as improvement because 39.032501751203746 (T) = (0 -76.2570671008102) / Math.Sqrt((3.595439366878037 / (299)) + (0.40322982203932806 / (15))) is greater than 1.9675964973877862 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (15) - 2, .975) and 0.09170372252127656 = (83.95615945106249 - 76.2570671008102) / 83.95615945106249 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.Tests.Perf_Int64.Parse(value: "-9223372036854775808")
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 77.30647417030539 < 79.11161542116312.
IsChangePoint: Marked as a change because one of 4/25/2023 6:46:56 PM, 5/13/2023 1:49:08 AM, 6/22/2023 7:55:14 AM, 6/26/2023 10:42:28 PM falls between 6/17/2023 6:37:57 PM and 6/26/2023 10:42:28 PM.
IsImprovementStdDev: Marked as improvement because 48.98386259410038 (T) = (0 -77.14155328243365) / Math.Sqrt((2.877506193368622 / (299)) + (0.15138968124071267 / (15))) is greater than 1.9675964973877862 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (15) - 2, .975) and 0.08186272724810544 = (84.0196292774614 - 77.14155328243365) / 84.0196292774614 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.Tests.Perf_Int64.TryParseSpan(value: "9223372036854775807")
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 75.9092871386522 < 78.91966779517007.
IsChangePoint: Marked as a change because one of 5/13/2023 1:49:08 AM, 6/22/2023 7:55:14 AM, 6/26/2023 10:42:28 PM falls between 6/17/2023 6:37:57 PM and 6/26/2023 10:42:28 PM.
IsImprovementStdDev: Marked as improvement because 58.280878717676394 (T) = (0 -75.96416371629235) / Math.Sqrt((4.714183775971666 / (299)) + (0.05717531343250437 / (15))) is greater than 1.9675964973877862 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (15) - 2, .975) and 0.0969434617778096 = (84.11894549353445 - 75.96416371629235) / 84.11894549353445 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.Tests.Perf_Int64.ParseSpan(value: "-9223372036854775808")
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 76.90630084761798 < 78.98814201977379.
IsChangePoint: Marked as a change because one of 4/17/2023 1:30:24 AM, 5/13/2023 1:49:08 AM, 6/22/2023 7:55:14 AM, 6/26/2023 10:42:28 PM falls between 6/17/2023 6:37:57 PM and 6/26/2023 10:42:28 PM.
IsImprovementStdDev: Marked as improvement because 42.750316695264786 (T) = (0 -77.1089329607755) / Math.Sqrt((3.2870782951616047 / (299)) + (0.2148578988570708 / (14))) is greater than 1.9676211333067681 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (14) - 2, .975) and 0.08255218318643728 = (84.04721396426304 - 77.1089329607755) / 84.04721396426304 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.Tests.Perf_Int64.TryParseSpan(value: "12345")
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 20.076971235437185 < 21.671725244406513.
IsChangePoint: Marked as a change because one of 5/13/2023 1:49:08 AM, 6/22/2023 7:55:14 AM, 6/26/2023 10:42:28 PM falls between 6/17/2023 6:37:57 PM and 6/26/2023 10:42:28 PM.
IsImprovementStdDev: Marked as improvement because 32.29620509525103 (T) = (0 -19.982949205986777) / Math.Sqrt((4.613675118409374 / (299)) + (0.015510965755095429 / (15))) is greater than 1.9675964973877862 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (15) - 2, .975) and 0.17175975242443312 = (24.12699607931523 - 19.982949205986777) / 24.12699607931523 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.Tests.Perf_Int64.TryParse(value: "-9223372036854775808")
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 77.52665222268624 < 79.59754701807755.
IsChangePoint: Marked as a change because one of 5/13/2023 1:49:08 AM, 6/22/2023 7:55:14 AM, 6/26/2023 10:42:28 PM falls between 6/17/2023 6:37:57 PM and 6/26/2023 10:42:28 PM.
IsImprovementStdDev: Marked as improvement because 44.58412105682746 (T) = (0 -77.20607907587033) / Math.Sqrt((4.006586148667488 / (299)) + (0.24437523847818673 / (15))) is greater than 1.9675964973877862 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (15) - 2, .975) and 0.09049998138729737 = (84.88848542701066 - 77.20607907587033) / 84.88848542701066 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Name | Value |
|---|---|
| Architecture | x86 |
| OS | Windows 10.0.18362 |
| Queue | TigerWindows |
| Baseline | 86103fd589e2f335fb1a895027220e9f7960e973 |
| Compare | ba6da78bc8f4b2f2c59babe76b8accd78ece434e |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.IO.Tests.BinaryWriterExtendedTests
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [WriteAsciiCharArray - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.IO.Tests.BinaryWriterExtendedTests.WriteAsciiCharArray(StringLengthInChars%3a%208000).html>) | 535.81 ns | 452.23 ns | 0.84 | 0.03 | False | |||||
| [WriteAsciiString - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.IO.Tests.BinaryWriterExtendedTests.WriteAsciiString(StringLengthInChars%3a%208000).html>) | 548.65 ns | 463.62 ns | 0.85 | 0.13 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.IO.Tests.BinaryWriterExtendedTests*'
### Payloads
[Baseline](<>)
[Compare](<>)
### Histogram
#### System.IO.Tests.BinaryWriterExtendedTests.WriteAsciiCharArray(StringLengthInChars: 8000)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 452.23350038737163 < 508.9968664570695.
IsChangePoint: Marked as a change because one of 5/12/2023 4:02:48 AM, 6/22/2023 7:55:14 AM, 6/26/2023 10:42:28 PM falls between 6/17/2023 6:37:57 PM and 6/26/2023 10:42:28 PM.
IsImprovementStdDev: Marked as improvement because 55.70937817115046 (T) = (0 -454.2367449508635) / Math.Sqrt((183.98354676901906 / (299)) + (19.126418859138962 / (15))) is greater than 1.9675964973877862 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (15) - 2, .975) and 0.14429456403965388 = (530.8330715944091 - 454.2367449508635) / 530.8330715944091 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.IO.Tests.BinaryWriterExtendedTests.WriteAsciiString(StringLengthInChars: 8000)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 463.624963959396 < 513.0032482063338.
IsChangePoint: Marked as a change because one of 5/12/2023 4:02:48 AM, 6/22/2023 7:55:14 AM, 6/26/2023 10:42:28 PM falls between 6/17/2023 6:37:57 PM and 6/26/2023 10:42:28 PM.
IsImprovementStdDev: Marked as improvement because 35.51726527439162 (T) = (0 -455.6041461524395) / Math.Sqrt((312.83583164202577 / (299)) + (37.242490120208224 / (15))) is greater than 1.9675964973877862 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (15) - 2, .975) and 0.12774083900757985 = (522.3265819691387 - 455.6041461524395) / 522.3265819691387 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Name | Value |
|---|---|
| Architecture | x86 |
| OS | Windows 10.0.18362 |
| Queue | TigerWindows |
| Baseline | 86103fd589e2f335fb1a895027220e9f7960e973 |
| Compare | ba6da78bc8f4b2f2c59babe76b8accd78ece434e |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig.Count(Pattern%3a%20%22.%7b2%2c4%7d(Tom%7cSawyer%7cHuckleberry%7cFinn)%22%2c%20Options%3a%20Compiled).html>) | 903.21 ms | 822.27 ms | 0.91 | 0.01 | False | |||||
| [Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig.Count(Pattern%3a%20%22.%7b0%2c2%7d(Tom%7cSawyer%7cHuckleberry%7cFinn)%22%2c%20Options%3a%20Compiled).html>) | 911.99 ms | 831.90 ms | 0.91 | 0.01 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig*'
### Payloads
[Baseline](<>)
[Compare](<>)
### Histogram
#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig.Count(Pattern: ".{2,4}(Tom|Sawyer|Huckleberry|Finn)", Options: Compiled)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 822.2659733333334 < 858.0744596666665.
IsChangePoint: Marked as a change because one of 4/25/2023 6:46:56 PM, 5/15/2023 6:46:12 PM, 6/22/2023 7:55:14 AM, 6/26/2023 10:42:28 PM falls between 6/17/2023 6:37:57 PM and 6/26/2023 10:42:28 PM.
IsImprovementStdDev: Marked as improvement because 37.80243876209184 (T) = (0 -824413915.2380954) / Math.Sqrt((317187997285036.3 / (299)) + (47723302364402.734 / (15))) is greater than 1.9675964973877862 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (15) - 2, .975) and 0.08629496474181096 = (902275771.0918576 - 824413915.2380954) / 902275771.0918576 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig.Count(Pattern: ".{0,2}(Tom|Sawyer|Huckleberry|Finn)", Options: Compiled)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 831.8964933333334 < 866.4204629999999.
IsChangePoint: Marked as a change because one of 4/25/2023 6:46:56 PM, 5/15/2023 6:46:12 PM, 6/22/2023 7:55:14 AM, 6/26/2023 10:42:28 PM falls between 6/17/2023 6:37:57 PM and 6/26/2023 10:42:28 PM.
IsImprovementStdDev: Marked as improvement because 81.83677365022818 (T) = (0 -832532026.079365) / Math.Sqrt((253251888726448.44 / (299)) + (1276681402224.0737 / (15))) is greater than 1.9675964973877862 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (15) - 2, .975) and 0.08667723311201166 = (911541961.1361427 - 832532026.079365) / 911541961.1361427 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Name | Value |
|---|---|
| Architecture | x86 |
| OS | Windows 10.0.18362 |
| Queue | TigerWindows |
| Baseline | 86103fd589e2f335fb1a895027220e9f7960e973 |
| Compare | ba6da78bc8f4b2f2c59babe76b8accd78ece434e |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.Reflection.Invoke
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [Property_Get_class - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Reflection.Invoke.Property_Get_class.html>) | 19.25 ns | 14.18 ns | 0.74 | 0.13 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Reflection.Invoke*'
### Payloads
[Baseline](<>)
[Compare](<>)
### Histogram
#### System.Reflection.Invoke.Property_Get_class
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 14.180663510670275 < 18.715307279233794.
IsChangePoint: Marked as a change because one of 4/25/2023 6:46:56 PM, 5/19/2023 10:30:38 AM, 6/22/2023 7:55:14 AM, 6/26/2023 10:42:28 PM falls between 6/17/2023 6:37:57 PM and 6/26/2023 10:42:28 PM.
IsImprovementStdDev: Marked as improvement because 23.837501938579265 (T) = (0 -14.280501173582808) / Math.Sqrt((9.01845194315877 / (299)) + (0.05034315066409412 / (15))) is greater than 1.9675964973877862 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (15) - 2, .975) and 0.2340705484243272 = (18.64466909348493 - 14.280501173582808) / 18.64466909348493 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Name | Value |
|---|---|
| Architecture | x86 |
| OS | Windows 10.0.18362 |
| Queue | TigerWindows |
| Baseline | 86103fd589e2f335fb1a895027220e9f7960e973 |
| Compare | ba6da78bc8f4b2f2c59babe76b8accd78ece434e |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.Security.Cryptography.Tests.Perf_CryptoConfig
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [CreateFromName - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Security.Cryptography.Tests.Perf_CryptoConfig.CreateFromName(name%3a%20%22RSA%22).html>) | 429.20 ns | 395.17 ns | 0.92 | 0.06 | False | |||||
| [CreateFromName - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Security.Cryptography.Tests.Perf_CryptoConfig.CreateFromName(name%3a%20%22X509Chain%22).html>) | 355.67 ns | 318.22 ns | 0.89 | 0.07 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Security.Cryptography.Tests.Perf_CryptoConfig*'
### Payloads
[Baseline](<>)
[Compare](<>)
### Histogram
#### System.Security.Cryptography.Tests.Perf_CryptoConfig.CreateFromName(name: "RSA")
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 395.16877893963465 < 408.2354526126932.
IsChangePoint: Marked as a change because one of 5/19/2023 10:30:38 AM, 5/26/2023 5:44:43 PM, 6/5/2023 10:43:22 AM, 6/22/2023 7:55:14 AM, 6/26/2023 10:42:28 PM falls between 6/17/2023 6:37:57 PM and 6/26/2023 10:42:28 PM.
IsImprovementStdDev: Marked as improvement because 3.0465277210728763 (T) = (0 -406.63842849842575) / Math.Sqrt((264.11125504181456 / (299)) + (970.7704602680615 / (15))) is greater than 1.9675964973877862 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (15) - 2, .975) and 0.057209516935128844 = (431.3136755225879 - 406.63842849842575) / 431.3136755225879 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.Security.Cryptography.Tests.Perf_CryptoConfig.CreateFromName(name: "X509Chain")
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 318.2243593667115 < 337.77032053671087.
IsChangePoint: Marked as a change because one of 4/25/2023 1:57:48 PM, 5/19/2023 4:22:12 AM, 5/26/2023 5:44:43 PM, 6/4/2023 9:29:52 PM, 6/22/2023 7:55:14 AM, 6/26/2023 10:42:28 PM falls between 6/17/2023 6:37:57 PM and 6/26/2023 10:42:28 PM.
IsImprovementStdDev: Marked as improvement because 26.75781791826122 (T) = (0 -318.48353187303206) / Math.Sqrt((161.99057987117592 / (299)) + (12.468248066305744 / (15))) is greater than 1.9675964973877862 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (15) - 2, .975) and 0.08962288102312779 = (349.8369249778157 - 318.48353187303206) / 349.8369249778157 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Name | Value |
|---|---|
| Architecture | x86 |
| OS | Windows 10.0.18362 |
| Queue | TigerWindows |
| Baseline | 86103fd589e2f335fb1a895027220e9f7960e973 |
| Compare | ba6da78bc8f4b2f2c59babe76b8accd78ece434e |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.Tests.Perf_Version
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [TryParse2 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_Version.TryParse2.html>) | 33.00 ns | 28.64 ns | 0.87 | 0.02 | False | |||||
| [TryParse4 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_Version.TryParse4.html>) | 63.17 ns | 54.37 ns | 0.86 | 0.02 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Version*'
### Payloads
[Baseline](<>)
[Compare](<>)
### Histogram
#### System.Tests.Perf_Version.TryParse2
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 28.63863050443241 < 30.846706784798105.
IsChangePoint: Marked as a change because one of 4/17/2023 6:40:18 PM, 4/25/2023 6:46:56 PM, 5/19/2023 10:30:38 AM, 6/5/2023 10:43:22 AM, 6/9/2023 2:21:24 AM, 6/22/2023 7:55:14 AM, 6/26/2023 10:42:28 PM falls between 6/17/2023 6:37:57 PM and 6/26/2023 10:42:28 PM.
IsImprovementStdDev: Marked as improvement because 25.66800384741016 (T) = (0 -28.50318655935958) / Math.Sqrt((6.321982828589351 / (299)) + (0.18697704406073618 / (15))) is greater than 1.9675964973877862 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (15) - 2, .975) and 0.14169861023008185 = (33.2088318848002 - 28.50318655935958) / 33.2088318848002 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.Tests.Perf_Version.TryParse4
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 54.36974175655458 < 60.02044524380437.
IsChangePoint: Marked as a change because one of 4/25/2023 6:46:56 PM, 6/5/2023 10:43:22 AM, 6/9/2023 2:21:24 AM, 6/22/2023 7:55:14 AM, 6/26/2023 10:42:28 PM falls between 6/17/2023 6:37:57 PM and 6/26/2023 10:42:28 PM.
IsImprovementStdDev: Marked as improvement because 29.817706528254693 (T) = (0 -53.59907038026626) / Math.Sqrt((25.806040365922218 / (299)) + (0.15295932985408967 / (15))) is greater than 1.9675964973877862 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (15) - 2, .975) and 0.14735370393926417 = (62.862022186569476 - 53.59907038026626) / 62.862022186569476 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Name | Value |
|---|---|
| Architecture | x86 |
| OS | Windows 10.0.18362 |
| Queue | TigerWindows |
| Baseline | 86103fd589e2f335fb1a895027220e9f7960e973 |
| Compare | ba6da78bc8f4b2f2c59babe76b8accd78ece434e |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.Collections.Sort<Int32>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [List - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.Sort(Int32).List(Size%3a%20512).html>) | 6.91 μs | 3.71 μs | 0.54 | 0.33 | False | |||||
| [Array - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.Sort(Int32).Array(Size%3a%20512).html>) | 6.35 μs | 3.74 μs | 0.59 | 0.28 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Sort<Int32>*'
### Payloads
[Baseline](<>)
[Compare](<>)
### Histogram
#### System.Collections.Sort<Int32>.List(Size: 512)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 3.7122022222222224 < 6.5412020051282065.
IsChangePoint: Marked as a change because one of 4/25/2023 6:46:56 PM, 5/26/2023 5:44:43 PM, 6/5/2023 10:43:22 AM, 6/22/2023 7:55:14 AM, 6/26/2023 10:42:28 PM falls between 6/17/2023 6:37:57 PM and 6/26/2023 10:42:28 PM.
IsImprovementStdDev: Marked as improvement because 20.394720022643764 (T) = (0 -3779.278192795022) / Math.Sqrt((1875311.5513865908 / (299)) + (24845.173839231786 / (15))) is greater than 1.9675964973877862 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (15) - 2, .975) and 0.3245551688163931 = (5595.243339374518 - 3779.278192795022) / 5595.243339374518 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.Collections.Sort<Int32>.Array(Size: 512)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 3.743462857142857 < 6.133698169444444.
IsChangePoint: Marked as a change because one of 4/25/2023 6:46:56 PM, 5/26/2023 5:44:43 PM, 6/5/2023 10:43:22 AM, 6/22/2023 7:55:14 AM, 6/26/2023 10:42:28 PM falls between 6/17/2023 6:37:57 PM and 6/26/2023 10:42:28 PM.
IsImprovementStdDev: Marked as improvement because 18.420864824076226 (T) = (0 -3834.0880129972365) / Math.Sqrt((1819422.067548315 / (299)) + (25695.6541212284 / (15))) is greater than 1.9675964973877862 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (15) - 2, .975) and 0.2978855018515986 = (5460.77316891817 - 3834.0880129972365) / 5460.77316891817 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Name | Value |
|---|---|
| Architecture | x86 |
| OS | Windows 10.0.18362 |
| Queue | TigerWindows |
| Baseline | 86103fd589e2f335fb1a895027220e9f7960e973 |
| Compare | ba6da78bc8f4b2f2c59babe76b8accd78ece434e |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.Collections.IterateForEach<Int32>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [Dictionary - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.IterateForEach(Int32).Dictionary(Size%3a%20512).html>) | 1.88 μs | 1.65 μs | 0.88 | 0.01 | True | |||||
| [ConcurrentQueue - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.IterateForEach(Int32).ConcurrentQueue(Size%3a%20512).html>) | 3.89 μs | 3.57 μs | 0.92 | 0.05 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.IterateForEach<Int32>*'
### Payloads
[Baseline](<>)
[Compare](<>)
### Histogram
#### System.Collections.IterateForEach<Int32>.Dictionary(Size: 512)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 1.648422239299975 < 1.795525685722188.
IsChangePoint: Marked as a change because one of 6/22/2023 7:55:14 AM, 6/26/2023 10:42:28 PM falls between 6/17/2023 6:37:57 PM and 6/26/2023 10:42:28 PM.
IsImprovementStdDev: Marked as improvement because 135.8175435971266 (T) = (0 -1652.42208501451) / Math.Sqrt((383.7218185749049 / (299)) + (31.048466069863952 / (15))) is greater than 1.9675964973877862 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (15) - 2, .975) and 0.13082086849561356 = (1901.1294969248474 - 1652.42208501451) / 1901.1294969248474 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
```
### JIT Disasms
#### System.Collections.IterateForEach<Int32>.ConcurrentQueue(Size: 512)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 3.5694513267569015 < 3.6940967883382028.
IsChangePoint: Marked as a change because one of 5/5/2023 12:43:09 PM, 5/16/2023 12:30:38 AM, 6/23/2023 6:04:39 AM, 6/26/2023 10:42:28 PM falls between 6/17/2023 6:37:57 PM and 6/26/2023 10:42:28 PM.
IsImprovementStdDev: Marked as improvement because 30.077100263297623 (T) = (0 -3570.856013708701) / Math.Sqrt((30415.888426930454 / (299)) + (23.925387937421878 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.07906784498820423 = (3877.436567151859 - 3570.856013708701) / 3877.436567151859 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Name | Value |
|---|---|
| Architecture | x86 |
| OS | Windows 10.0.18362 |
| Queue | TigerWindows |
| Baseline | 86103fd589e2f335fb1a895027220e9f7960e973 |
| Compare | ba6da78bc8f4b2f2c59babe76b8accd78ece434e |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.Collections.CtorFromCollection<Int32>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [SortedSet - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.CtorFromCollection(Int32).SortedSet(Size%3a%20512).html>) | 13.13 μs | 9.94 μs | 0.76 | 0.01 | False | |||||
| [ImmutableSortedSet - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.CtorFromCollection(Int32).ImmutableSortedSet(Size%3a%20512).html>) | 16.05 μs | 13.42 μs | 0.84 | 0.06 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CtorFromCollection<Int32>*'
### Payloads
[Baseline](<>)
[Compare](<>)
### Histogram
#### System.Collections.CtorFromCollection<Int32>.SortedSet(Size: 512)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 9.944544536564626 < 12.478275917320165.
IsChangePoint: Marked as a change because one of 4/25/2023 6:46:56 PM, 5/26/2023 5:44:43 PM, 6/5/2023 10:43:22 AM, 6/22/2023 7:55:14 AM, 6/26/2023 10:42:28 PM falls between 6/17/2023 6:37:57 PM and 6/26/2023 10:42:28 PM.
IsImprovementStdDev: Marked as improvement because 18.914884208360828 (T) = (0 -9890.742580874432) / Math.Sqrt((2711246.527220651 / (299)) + (26284.05908577386 / (15))) is greater than 1.9675964973877862 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (15) - 2, .975) and 0.1659190697825073 = (11858.252865576664 - 9890.742580874432) / 11858.252865576664 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
#### System.Collections.CtorFromCollection<Int32>.ImmutableSortedSet(Size: 512)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 13.415131974248927 < 15.221659807061206.
IsChangePoint: Marked as a change because one of 4/25/2023 6:46:56 PM, 5/19/2023 10:30:38 AM, 6/22/2023 7:55:14 AM, 6/26/2023 10:42:28 PM falls between 6/17/2023 6:37:57 PM and 6/26/2023 10:42:28 PM.
IsImprovementStdDev: Marked as improvement because 36.72230608590457 (T) = (0 -13371.375006151062) / Math.Sqrt((3266381.8803073512 / (299)) + (18153.161763921955 / (15))) is greater than 1.9675964973877862 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (15) - 2, .975) and 0.23226235195357875 = (17416.594119326764 - 13371.375006151062) / 17416.594119326764 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
Improvements in System.Collections.CreateAddAndRemove<String>
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
Baseline Compare
Run Information
Improvements in System.Buffers.Text.Tests.Utf8ParserTests
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
Baseline Compare
Run Information
Improvements in System.Tests.Perf_Enum
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
Baseline Compare