performanceautofiler[bot]
commented
1 year ago Run Information
| Name | Value |
|---|---|
| Architecture | x64 |
| OS | Windows 10.0.18362 |
| Queue | TigerWindows |
| Baseline | 2f49fcff6df15a200ef01eea16b3ce7930f75c5c |
| Compare | 558345d16cf76525d0c7fdbafbfd3a2457142b39 |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.Linq.Tests.Perf_Enumerable
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [Average - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Linq.Tests.Perf_Enumerable.Average(input%3a%20IEnumerable).html>) | 522.98 ns | 219.45 ns | 0.42 | 0.06 | True | 4362.340435249253 | 2343.5934284555115 | 0.5372330434182643) | Trace | Trace |
| [LastWithPredicate_FirstElementMatches - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Linq.Tests.Perf_Enumerable.LastWithPredicate_FirstElementMatches(input%3a%20IOrderedEnumerable).html>) | 1.28 μs | 436.26 ns | 0.34 | 0.02 | True | 10433.056201203886 | 5922.606139463159 | 0.5676770090416785) | Trace | Trace |
| [Repeat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Linq.Tests.Perf_Enumerable.Repeat.html>) | 505.58 ns | 190.56 ns | 0.38 | 0.04 | True | 3430.3098851152517 | 1517.338937670458 | 0.4423329053315189) | Trace | Trace |
| [Reverse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Linq.Tests.Perf_Enumerable.Reverse(input%3a%20IEnumerable).html>) | 1.41 μs | 523.90 ns | 0.37 | 0.03 | True | Trace | Trace | |||
| [Max - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Linq.Tests.Perf_Enumerable.Max(input%3a%20IEnumerable).html>) | 490.45 ns | 224.45 ns | 0.46 | 0.02 | True | 4236.831433815683 | 2219.5806712415206 | 0.5238775027786673) | Trace | Trace |
| [FirstWithPredicate_LastElementMatches - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Linq.Tests.Perf_Enumerable.FirstWithPredicate_LastElementMatches(input%3a%20IEnumerable).html>) | 698.39 ns | 188.26 ns | 0.27 | 0.01 | True | 5088.067268636218 | 2120.9981761180734 | 0.41685733779352646) | Trace | Trace |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Linq.Tests.Perf_Enumerable*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Linq.Tests.Perf_Enumerable.Average(input: IEnumerable)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 219.45024713563424 < 496.6987438442211.
IsChangePoint: Marked as a change because one of 5/19/2023 10:30:38 AM, 5/24/2023 7:12:11 AM falls between 5/15/2023 6:46:12 PM and 5/24/2023 7:12:11 AM.
IsImprovementStdDev: Marked as improvement because 250.83868153837466 (T) = (0 -219.72433732109366) / Math.Sqrt((349.93249584689124 / (299)) + (1.3776262068333445 / (19))) is greater than 1.9674995188240387 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (19) - 2, .975) and 0.5599944714597014 = (499.3672194302209 - 219.72433732109366) / 499.3672194302209 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
```
### JIT Disasms
[Baseline](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_24_2023/System_Linq_Tests_Perf_Enumerable_Average_input__IEnumerable__baseline_7acff83c-2aa6-4e10-aee5-4ab1b07d924f.log)
[Compare](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_24_2023/System_Linq_Tests_Perf_Enumerable_Average_input__IEnumerable__compare_7acff83c-2aa6-4e10-aee5-4ab1b07d924f.log)
[Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_24_2023%2FSystem_Linq_Tests_Perf_Enumerable_Average_input__IEnumerable__baseline_7acff83c-2aa6-4e10-aee5-4ab1b07d924f.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_24_2023%2FSystem_Linq_Tests_Perf_Enumerable_Average_input__IEnumerable__compare_7acff83c-2aa6-4e10-aee5-4ab1b07d924f.log)
#### System.Linq.Tests.Perf_Enumerable.LastWithPredicate_FirstElementMatches(input: IOrderedEnumerable)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 436.25801282051293 < 1.2230805545773624.
IsChangePoint: Marked as a change because one of 5/19/2023 10:30:38 AM, 5/24/2023 7:12:11 AM falls between 5/15/2023 6:46:12 PM and 5/24/2023 7:12:11 AM.
IsImprovementStdDev: Marked as improvement because 273.2841131400368 (T) = (0 -436.77371811244694) / Math.Sqrt((2793.7396286615694 / (299)) + (0.6277130133167864 / (19))) is greater than 1.9674995188240387 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (19) - 2, .975) and 0.6570573102381468 = (1273.605564870772 - 436.77371811244694) / 1273.605564870772 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
```
### JIT Disasms
[Baseline](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_24_2023/System_Linq_Tests_Perf_Enumerable_LastWithPredicate_FirstElementMatches_input__IOrderedEnumerable__baseline_e3f8a4d0-64a7-402f-9a2d-e74900398c21.log)
[Compare](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_24_2023/System_Linq_Tests_Perf_Enumerable_LastWithPredicate_FirstElementMatches_input__IOrderedEnumerable__compare_e3f8a4d0-64a7-402f-9a2d-e74900398c21.log)
[Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_24_2023%2FSystem_Linq_Tests_Perf_Enumerable_LastWithPredicate_FirstElementMatches_input__IOrderedEnumerable__baseline_e3f8a4d0-64a7-402f-9a2d-e74900398c21.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_24_2023%2FSystem_Linq_Tests_Perf_Enumerable_LastWithPredicate_FirstElementMatches_input__IOrderedEnumerable__compare_e3f8a4d0-64a7-402f-9a2d-e74900398c21.log)
#### System.Linq.Tests.Perf_Enumerable.Repeat
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 190.56038642859798 < 480.6893372156229.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 5/19/2023 10:30:38 AM, 5/24/2023 7:12:11 AM falls between 5/15/2023 6:46:12 PM and 5/24/2023 7:12:11 AM.
IsImprovementStdDev: Marked as improvement because 152.62402280083208 (T) = (0 -188.9755477412099) / Math.Sqrt((982.131142712761 / (299)) + (1.3819627702750705 / (19))) is greater than 1.9674995188240387 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (19) - 2, .975) and 0.5967523797569921 = (468.63400614076335 - 188.9755477412099) / 468.63400614076335 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
```
### JIT Disasms
[Baseline](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_24_2023/System_Linq_Tests_Perf_Enumerable_Repeat_baseline_7843005f-c953-4867-89dc-4bee9df1b5c6.log)
[Compare](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_24_2023/System_Linq_Tests_Perf_Enumerable_Repeat_compare_7843005f-c953-4867-89dc-4bee9df1b5c6.log)
[Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_24_2023%2FSystem_Linq_Tests_Perf_Enumerable_Repeat_baseline_7843005f-c953-4867-89dc-4bee9df1b5c6.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_24_2023%2FSystem_Linq_Tests_Perf_Enumerable_Repeat_compare_7843005f-c953-4867-89dc-4bee9df1b5c6.log)
#### System.Linq.Tests.Perf_Enumerable.Reverse(input: IEnumerable)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 523.8974969993718 < 1.3325640525782356.
IsChangePoint: Marked as a change because one of 4/6/2023 1:55:21 PM, 5/19/2023 10:30:38 AM, 5/24/2023 7:12:11 AM falls between 5/15/2023 6:46:12 PM and 5/24/2023 7:12:11 AM.
IsImprovementStdDev: Marked as improvement because 180.38781318558978 (T) = (0 -524.2803012392509) / Math.Sqrt((5329.789309518478 / (299)) + (7.263896992581552 / (19))) is greater than 1.9674995188240387 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (19) - 2, .975) and 0.5948386171596578 = (1294.0036327347827 - 524.2803012392509) / 1294.0036327347827 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
```
### JIT Disasms
[Baseline](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_24_2023/System_Linq_Tests_Perf_Enumerable_Reverse_input__IEnumerable__baseline_b9b7fcb0-1079-4bb2-8ea2-1ec672f86503.log)
[Compare](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_24_2023/System_Linq_Tests_Perf_Enumerable_Reverse_input__IEnumerable__compare_b9b7fcb0-1079-4bb2-8ea2-1ec672f86503.log)
[Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_24_2023%2FSystem_Linq_Tests_Perf_Enumerable_Reverse_input__IEnumerable__baseline_b9b7fcb0-1079-4bb2-8ea2-1ec672f86503.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_24_2023%2FSystem_Linq_Tests_Perf_Enumerable_Reverse_input__IEnumerable__compare_b9b7fcb0-1079-4bb2-8ea2-1ec672f86503.log)
#### System.Linq.Tests.Perf_Enumerable.Max(input: IEnumerable)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 224.44672071600846 < 466.0316944544702.
IsChangePoint: Marked as a change because one of 5/19/2023 10:30:38 AM, 5/24/2023 7:12:11 AM falls between 5/15/2023 6:46:12 PM and 5/24/2023 7:12:11 AM.
IsImprovementStdDev: Marked as improvement because 333.84592626360563 (T) = (0 -223.79978479162105) / Math.Sqrt((168.4347784063225 / (299)) + (1.300628931988291 / (19))) is greater than 1.9674995188240387 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (19) - 2, .975) and 0.5424777760185113 = (489.1560957280973 - 223.79978479162105) / 489.1560957280973 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
```
### JIT Disasms
[Baseline](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_24_2023/System_Linq_Tests_Perf_Enumerable_Max_input__IEnumerable__baseline_041f1e22-5ab0-4c55-8a8e-0149c26b961a.log)
[Compare](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_24_2023/System_Linq_Tests_Perf_Enumerable_Max_input__IEnumerable__compare_041f1e22-5ab0-4c55-8a8e-0149c26b961a.log)
[Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_24_2023%2FSystem_Linq_Tests_Perf_Enumerable_Max_input__IEnumerable__baseline_041f1e22-5ab0-4c55-8a8e-0149c26b961a.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_24_2023%2FSystem_Linq_Tests_Perf_Enumerable_Max_input__IEnumerable__compare_041f1e22-5ab0-4c55-8a8e-0149c26b961a.log)
#### System.Linq.Tests.Perf_Enumerable.FirstWithPredicate_LastElementMatches(input: IEnumerable)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 188.26490078692723 < 664.5801030974025.
IsChangePoint: Marked as a change because one of 5/19/2023 10:30:38 AM, 5/24/2023 7:12:11 AM falls between 5/15/2023 6:46:12 PM and 5/24/2023 7:12:11 AM.
IsImprovementStdDev: Marked as improvement because 556.9572940421174 (T) = (0 -189.18273830549424) / Math.Sqrt((243.22594059007304 / (299)) + (0.9274582864327969 / (19))) is greater than 1.9674995188240387 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (19) - 2, .975) and 0.7321751486690904 = (706.3673791486605 - 189.18273830549424) / 706.3673791486605 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
```
### JIT Disasms
[Baseline](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_24_2023/System_Linq_Tests_Perf_Enumerable_FirstWithPredicate_LastElementMatches_input__IEnumerable__baseline_697baf8d-5275-4be2-8dbc-80ae2a95e818.log)
[Compare](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_24_2023/System_Linq_Tests_Perf_Enumerable_FirstWithPredicate_LastElementMatches_input__IEnumerable__compare_697baf8d-5275-4be2-8dbc-80ae2a95e818.log)
[Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_24_2023%2FSystem_Linq_Tests_Perf_Enumerable_FirstWithPredicate_LastElementMatches_input__IEnumerable__baseline_697baf8d-5275-4be2-8dbc-80ae2a95e818.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_24_2023%2FSystem_Linq_Tests_Perf_Enumerable_FirstWithPredicate_LastElementMatches_input__IEnumerable__compare_697baf8d-5275-4be2-8dbc-80ae2a95e818.log)
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Name | Value |
|---|---|
| Architecture | x64 |
| OS | Windows 10.0.18362 |
| Queue | TigerWindows |
| Baseline | 2f49fcff6df15a200ef01eea16b3ce7930f75c5c |
| Compare | 558345d16cf76525d0c7fdbafbfd3a2457142b39 |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in MicroBenchmarks.Serializers.Json_FromString<IndexViewModel>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [JsonNet_ - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/MicroBenchmarks.Serializers.JsonFromString(IndexViewModel).JsonNet.html>) | 65.28 μs | 52.94 μs | 0.81 | 0.00 | True | Trace | Trace |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'MicroBenchmarks.Serializers.Json_FromString<IndexViewModel>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### MicroBenchmarks.Serializers.Json_FromString<IndexViewModel>.JsonNet_
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 52.94248700749334 < 62.354966065092746.
IsChangePoint: Marked as a change because one of 5/19/2023 10:30:38 AM, 5/24/2023 7:12:11 AM falls between 5/15/2023 6:46:12 PM and 5/24/2023 7:12:11 AM.
IsImprovementStdDev: Marked as improvement because 88.83612398299387 (T) = (0 -52272.53552849739) / Math.Sqrt((407958.33979152376 / (299)) + (433589.46407948894 / (19))) is greater than 1.9674995188240387 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (19) - 2, .975) and 0.209045091268611 = (66087.8830783631 - 52272.53552849739) / 66087.8830783631 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
```
### JIT Disasms
[Baseline](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_24_2023/MicroBenchmarks_Serializers_Json_FromString_IndexViewModel__JsonNet__baseline_c99d204b-a4f6-489a-8fed-678f5c957236.log)
[Compare](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_24_2023/MicroBenchmarks_Serializers_Json_FromString_IndexViewModel__JsonNet__compare_c99d204b-a4f6-489a-8fed-678f5c957236.log)
[Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_24_2023%2FMicroBenchmarks_Serializers_Json_FromString_IndexViewModel__JsonNet__baseline_c99d204b-a4f6-489a-8fed-678f5c957236.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_24_2023%2FMicroBenchmarks_Serializers_Json_FromString_IndexViewModel__JsonNet__compare_c99d204b-a4f6-489a-8fed-678f5c957236.log)
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Name | Value |
|---|---|
| Architecture | x64 |
| OS | Windows 10.0.18362 |
| Queue | TigerWindows |
| Baseline | 2f49fcff6df15a200ef01eea16b3ce7930f75c5c |
| Compare | 558345d16cf76525d0c7fdbafbfd3a2457142b39 |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.Net.Primitives.Tests.CredentialCacheTests
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [ForEach - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Net.Primitives.Tests.CredentialCacheTests.ForEach(uriCount%3a%2010%2c%20hostPortCount%3a%200).html>) | 219.58 ns | 129.09 ns | 0.59 | 0.04 | True | Trace | Trace | |||
| [ForEach - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Net.Primitives.Tests.CredentialCacheTests.ForEach(uriCount%3a%200%2c%20hostPortCount%3a%2010).html>) | 212.14 ns | 132.22 ns | 0.62 | 0.05 | True | 1713.9537359793724 | 1243.5112471715693 | 0.725522061108034) | Trace | Trace |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Net.Primitives.Tests.CredentialCacheTests*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Net.Primitives.Tests.CredentialCacheTests.ForEach(uriCount: 10, hostPortCount: 0)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 129.09049240256317 < 209.0695638962489.
IsChangePoint: Marked as a change because one of 5/19/2023 10:30:38 AM, 5/24/2023 7:12:11 AM falls between 5/15/2023 6:46:12 PM and 5/24/2023 7:12:11 AM.
IsImprovementStdDev: Marked as improvement because 112.73310633397043 (T) = (0 -132.29639568925256) / Math.Sqrt((25.69153788095992 / (299)) + (9.804566593605244 / (19))) is greater than 1.9674995188240387 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (19) - 2, .975) and 0.39799932943239336 = (219.76120984136884 - 132.29639568925256) / 219.76120984136884 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
```
### JIT Disasms
[Baseline](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_24_2023/System_Net_Primitives_Tests_CredentialCacheTests_ForEach_uriCount__10__hostPortCount__0__baseline_5820a4bd-f0ed-456e-8bb1-3713a7a04c6a.log)
[Compare](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_24_2023/System_Net_Primitives_Tests_CredentialCacheTests_ForEach_uriCount__10__hostPortCount__0__compare_5820a4bd-f0ed-456e-8bb1-3713a7a04c6a.log)
[Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_24_2023%2FSystem_Net_Primitives_Tests_CredentialCacheTests_ForEach_uriCount__10__hostPortCount__0__baseline_5820a4bd-f0ed-456e-8bb1-3713a7a04c6a.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_24_2023%2FSystem_Net_Primitives_Tests_CredentialCacheTests_ForEach_uriCount__10__hostPortCount__0__compare_5820a4bd-f0ed-456e-8bb1-3713a7a04c6a.log)
#### System.Net.Primitives.Tests.CredentialCacheTests.ForEach(uriCount: 0, hostPortCount: 10)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 132.2194175196725 < 201.35769404102982.
IsChangePoint: Marked as a change because one of 5/19/2023 10:30:38 AM, 5/24/2023 7:12:11 AM falls between 5/15/2023 6:46:12 PM and 5/24/2023 7:12:11 AM.
IsImprovementStdDev: Marked as improvement because 68.27492752207816 (T) = (0 -134.19948334126906) / Math.Sqrt((28.57110830628427 / (299)) + (20.579106584450656 / (19))) is greater than 1.9674995188240387 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (19) - 2, .975) and 0.35581089101202046 = (208.323117340646 - 134.19948334126906) / 208.323117340646 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
```
### JIT Disasms
[Baseline](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_24_2023/System_Net_Primitives_Tests_CredentialCacheTests_ForEach_uriCount__0__hostPortCount__10__baseline_10c9edcf-b526-45cd-a4e5-b30e21e66004.log)
[Compare](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_24_2023/System_Net_Primitives_Tests_CredentialCacheTests_ForEach_uriCount__0__hostPortCount__10__compare_10c9edcf-b526-45cd-a4e5-b30e21e66004.log)
[Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_24_2023%2FSystem_Net_Primitives_Tests_CredentialCacheTests_ForEach_uriCount__0__hostPortCount__10__baseline_10c9edcf-b526-45cd-a4e5-b30e21e66004.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_24_2023%2FSystem_Net_Primitives_Tests_CredentialCacheTests_ForEach_uriCount__0__hostPortCount__10__compare_10c9edcf-b526-45cd-a4e5-b30e21e66004.log)
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Name | Value |
|---|---|
| Architecture | x64 |
| OS | Windows 10.0.18362 |
| Queue | TigerWindows |
| Baseline | 2f49fcff6df15a200ef01eea16b3ce7930f75c5c |
| Compare | 558345d16cf76525d0c7fdbafbfd3a2457142b39 |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.Collections.ContainsTrueComparer<Int32>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [SortedSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Collections.ContainsTrueComparer(Int32).SortedSet(Size%3a%20512).html>) | 34.91 μs | 25.57 μs | 0.73 | 0.01 | True | 120288.32630098454 | 89265.53672316384 | 0.7420964233869568) | Trace | Trace |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsTrueComparer<Int32>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Collections.ContainsTrueComparer<Int32>.SortedSet(Size: 512)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 25.573585239651415 < 33.23360377775164.
IsChangePoint: Marked as a change because one of 5/19/2023 10:30:38 AM, 5/24/2023 7:12:11 AM falls between 5/15/2023 6:46:12 PM and 5/24/2023 7:12:11 AM.
IsImprovementStdDev: Marked as improvement because 102.53187939720816 (T) = (0 -24693.611429740875) / Math.Sqrt((558454.4344143757 / (299)) + (112833.59976203385 / (19))) is greater than 1.9674995188240387 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (19) - 2, .975) and 0.2683952676861571 = (33752.66771668153 - 24693.611429740875) / 33752.66771668153 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
```
### JIT Disasms
[Baseline](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_24_2023/System_Collections_ContainsTrueComparer_Int32__SortedSet_Size__512__baseline_c53082b1-94fe-4405-9e63-7d9fb97fa451.log)
[Compare](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_24_2023/System_Collections_ContainsTrueComparer_Int32__SortedSet_Size__512__compare_c53082b1-94fe-4405-9e63-7d9fb97fa451.log)
[Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_24_2023%2FSystem_Collections_ContainsTrueComparer_Int32__SortedSet_Size__512__baseline_c53082b1-94fe-4405-9e63-7d9fb97fa451.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_24_2023%2FSystem_Collections_ContainsTrueComparer_Int32__SortedSet_Size__512__compare_c53082b1-94fe-4405-9e63-7d9fb97fa451.log)
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Name | Value |
|---|---|
| Architecture | x64 |
| OS | Windows 10.0.18362 |
| Queue | TigerWindows |
| Baseline | 2f49fcff6df15a200ef01eea16b3ce7930f75c5c |
| Compare | 558345d16cf76525d0c7fdbafbfd3a2457142b39 |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.Collections.ContainsFalse<String>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [Stack - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Collections.ContainsFalse(String).Stack(Size%3a%20512).html>) | 1.16 ms | 854.10 μs | 0.74 | 0.06 | False | 9773697.916666666 | 9510119.047619049 | 0.9730318175070515) | Trace | Trace |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsFalse<String>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Collections.ContainsFalse<String>.Stack(Size: 512)
```log
```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 854.0988377192983 < 1.1022459574032737.
IsChangePoint: Marked as a change because one of 3/29/2023 12:02:44 PM, 4/25/2023 3:46:39 AM, 5/19/2023 10:30:38 AM, 5/24/2023 7:12:11 AM falls between 5/15/2023 6:46:12 PM and 5/24/2023 7:12:11 AM.
IsImprovementStdDev: Marked as improvement because 15.038746686029695 (T) = (0 -900636.7169193749) / Math.Sqrt((5789560908.911155 / (299)) + (1493955973.005694 / (19))) is greater than 1.9674995188240387 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (19) - 2, .975) and 0.14184773824293537 = (1049506.8964513633 - 900636.7169193749) / 1049506.8964513633 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### JIT Disasms
[Baseline](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_24_2023/System_Collections_ContainsFalse_String__Stack_Size__512__baseline_3fcd7c43-0fb3-4297-8a2b-91b0df7339e1.log)
[Compare](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/05_24_2023/System_Collections_ContainsFalse_String__Stack_Size__512__compare_3fcd7c43-0fb3-4297-8a2b-91b0df7339e1.log)
[Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_24_2023%2FSystem_Collections_ContainsFalse_String__Stack_Size__512__baseline_3fcd7c43-0fb3-4297-8a2b-91b0df7339e1.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F05_24_2023%2FSystem_Collections_ContainsFalse_String__Stack_Size__512__compare_3fcd7c43-0fb3-4297-8a2b-91b0df7339e1.log)
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
Improvements in System.Text.Json.Serialization.Tests.ReadJson<MyEventsListerViewModel>
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
Baseline Compare
Run Information
Improvements in System.Collections.CreateAddAndClear<Int32>
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
Baseline Compare
Run Information
Improvements in Microsoft.AspNetCore.Server.Kestrel.Performance.PipeThroughputBenchmark
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
Baseline Compare
Run Information
Improvements in System.Perf_Convert
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
Baseline Compare
Run Information
Improvements in System.Text.Json.Serialization.Tests.ReadJson<Hashtable>
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
Baseline Compare
Run Information
Improvements in Benchstone.MDBenchI.MDNDhrystone
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
Baseline Compare
Run Information
Improvements in System.Tests.Perf_Enum
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
Baseline Compare