performanceautofiler[bot]
commented
1 year ago Run Information
| Architecture | x86 |
|---|---|
| OS | Windows 10.0.18362 |
| Baseline | ee6de921299d1b86a02d9049b9c8dd164cab1401 |
| Compare | 7fa0d5b5942f138c362f2753398b4a8d4f71eb73 |
| Diff | Diff |
Regressions in System.Collections.ContainsTrue<Int32>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [HashSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.ContainsTrue(Int32).HashSet(Size%3a%20512).html>) | 4.35 μs | 6.43 μs | 1.48 | 0.26 | False |
_1.png>)
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsTrue<Int32>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Collections.ContainsTrue<Int32>.HashSet(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 6.428614139854409 > 4.630080526573558.
IsChangePoint: Marked as a change because one of 11/18/2022 4:41:14 PM, 12/6/2022 2:12:43 AM, 12/12/2022 5:25:39 PM, 12/14/2022 5:20:21 PM, 12/21/2022 9:23:17 AM, 1/3/2023 6:29:42 AM, 1/10/2023 12:53:48 PM falls between 1/1/2023 3:57:25 AM and 1/10/2023 12:53:48 PM.
IsRegressionStdDev: Marked as regression because -53.15278494763284 (T) = (0 -6649.055171929061) / Math.Sqrt((1596.2547710259923 / (14)) + (56761.07657949154 / (34))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (14) + (34) - 2, .025) and -0.5096539245664843 = (4404.357226334783 - 6649.055171929061) / 4404.357226334783 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
_1.png>)
_2.png>)
_3.png>)
_4.png>)
_5.png>)
_6.png>)
_7.png>)
_8.png>)
_9.png>)
_10.png>)
_11.png>)
_12.png>)
_13.png>)
_14.png>)
_15.png>)
_16.png>)
_1.png>)
_2.png>)
_3.png>)
_4.png>)
_5.png>)
_6.png>)
_7.png>)
_8.png>)
_1.png>)
_1.png>)
Run Information
Regressions in Microsoft.Extensions.Configuration.ConfigurationBinderBenchmarks
Repro