performanceautofiler[bot]
commented
1 year ago Run Information
| Architecture | x86 |
|---|---|
| OS | Windows 10.0.18362 |
| Baseline | 71bb0d481086b8b8a89a99a17ec80a861f32dc5d |
| Compare | 5385f045f9aee91c22922d21552c4317198710f1 |
| Diff | Diff |
Improvements in System.Numerics.Tests.Perf_VectorOf<Int16>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [DivisionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Numerics.Tests.Perf_VectorOf(Int16).DivisionOperatorBenchmark.html>) | 50.83 ns | 39.59 ns | 0.78 | 0.02 | False |
_1.png>)
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf<Int16>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Numerics.Tests.Perf_VectorOf<Int16>.DivisionOperatorBenchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 39.587887350322994 < 48.15708858167538.
IsChangePoint: Marked as a change because one of 12/1/2022 8:17:56 AM, 12/14/2022 5:20:21 PM, 1/11/2023 2:37:52 AM, 1/17/2023 6:49:05 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 6:49:05 AM.
IsImprovementStdDev: Marked as improvement because 30.7251731346456 (T) = (0 -39.63351312833911) / Math.Sqrt((32.46225771611853 / (299)) + (0.010304918675956393 / (29))) is greater than 1.9672675222597202 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (29) - 2, .975) and 0.20373016985109618 = (49.7739731278373 - 39.63351312833911) / 49.7739731278373 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x86 |
|---|---|
| OS | Windows 10.0.18362 |
| Baseline | 71bb0d481086b8b8a89a99a17ec80a861f32dc5d |
| Compare | 5385f045f9aee91c22922d21552c4317198710f1 |
| Diff | Diff |
Improvements in PerfLabTests.LowLevelPerf
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [ForeachOverList100Elements - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/PerfLabTests.LowLevelPerf.ForeachOverList100Elements.html>) | 9.55 ms | 7.11 ms | 0.74 | 0.01 | False | 132468750 | 91322222.22222222 | 0.6893869099106184 | Trace | Trace |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'PerfLabTests.LowLevelPerf*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### PerfLabTests.LowLevelPerf.ForeachOverList100Elements
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 7.113468333333332 < 9.064342171875001.
IsChangePoint: Marked as a change because one of 11/4/2022 9:11:54 AM, 1/11/2023 2:37:52 AM, 1/17/2023 6:49:05 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 6:49:05 AM.
IsImprovementStdDev: Marked as improvement because 657.7220062109628 (T) = (0 -7086666.596169635) / Math.Sqrt((2548131830.303239 / (299)) + (150279760.2149735 / (29))) is greater than 1.9672675222597202 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (29) - 2, .975) and 0.2557197871617363 = (9521503.42563199 - 7086666.596169635) / 9521503.42563199 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```### Baseline Jit Disasm
```assembly
; PerfLabTests.LowLevelPerf.ForeachOverList100Elements()
push ebp
mov ebp,esp
push edi
push esi
push ebx
sub esp,1C
xor eax,eax
mov [ebp-20],eax
mov [ebp-1C],eax
mov [ebp-18],eax
mov [ebp-14],eax
mov eax,ds:[6B7418C]
xor edx,edx
mov [ebp-24],edx
xor ecx,ecx
mov esi,ds:[0A764C78]
mov [ebp-28],esi
test esi,esi
jle short M00_L01
M00_L00:
mov edi,eax
mov edi,[edi+0C]
xor edi,edi
jmp short M00_L03
M00_L01:
mov edx,[ebp-24]
jmp short M00_L06
nop
nop
M00_L02:
mov edx,ebx
mov [ebp-24],edx
M00_L03:
cmp edi,[eax+8]
jae short M00_L04
mov ebx,[eax+4]
cmp edi,[ebx+4]
jae short M00_L08
mov ebx,[ebx+edi*4+8]
inc edi
mov edx,1
jmp short M00_L05
M00_L04:
mov edi,[eax+8]
inc edi
xor ebx,ebx
xor esi,esi
xor edx,edx
M00_L05:
test edx,edx
jne short M00_L02
mov edx,[ebp-24]
inc ecx
mov esi,[ebp-28]
cmp ecx,esi
jl short M00_L07
M00_L06:
mov eax,edx
lea esp,[ebp-0C]
pop ebx
pop esi
pop edi
pop ebp
ret
M00_L07:
mov [ebp-24],edx
jmp short M00_L00
M00_L08:
call CORINFO_HELP_RNGCHKFAIL
int 3
; Total bytes of code 140
```
### Compare Jit Disasm
```assembly
; PerfLabTests.LowLevelPerf.ForeachOverList100Elements()
push ebp
mov ebp,esp
push edi
push esi
push ebx
sub esp,14
xor eax,eax
mov [ebp-20],eax
mov [ebp-1C],eax
mov [ebp-18],eax
mov [ebp-14],eax
mov eax,ds:[6C1418C]
xor edx,edx
xor ecx,ecx
mov esi,ds:[0A6E6958]
test esi,esi
jle short M00_L03
M00_L00:
mov edi,eax
mov edi,[edi+0C]
xor edi,edi
jmp short M00_L01
nop
nop
nop
nop
nop
nop
nop
nop
nop
nop
nop
nop
nop
M00_L01:
mov ebx,[eax+8]
cmp edi,ebx
jae short M00_L02
mov edx,[eax+4]
cmp edi,[edx+4]
jae short M00_L04
mov edx,[edx+edi*4+8]
inc edi
jmp short M00_L01
M00_L02:
inc ecx
cmp ecx,esi
jl short M00_L00
M00_L03:
mov eax,edx
lea esp,[ebp-0C]
pop ebx
pop esi
pop edi
pop ebp
ret
M00_L04:
call CORINFO_HELP_RNGCHKFAIL
int 3
; Total bytes of code 107
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x86 |
|---|---|
| OS | Windows 10.0.18362 |
| Baseline | 71bb0d481086b8b8a89a99a17ec80a861f32dc5d |
| Compare | 5385f045f9aee91c22922d21552c4317198710f1 |
| Diff | Diff |
Improvements in System.Threading.Channels.Tests.UnboundedChannelPerfTests
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [WriteAsyncThenReadAsync - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Threading.Channels.Tests.UnboundedChannelPerfTests.WriteAsyncThenReadAsync.html>) | 78.49 ns | 69.00 ns | 0.88 | 0.07 | False | 448.76887810849723 | 434.27603618896495 | 0.9677053320171894 | Trace | Trace |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Threading.Channels.Tests.UnboundedChannelPerfTests*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Threading.Channels.Tests.UnboundedChannelPerfTests.WriteAsyncThenReadAsync
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 68.99506021789252 < 75.43173639630004.
IsChangePoint: Marked as a change because one of 1/11/2023 2:37:52 AM, 1/17/2023 6:49:05 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 6:49:05 AM.
IsImprovementStdDev: Marked as improvement because 41.85200424818049 (T) = (0 -70.10413599797332) / Math.Sqrt((1.8845915151909785 / (299)) + (1.2672252780178843 / (29))) is greater than 1.9672675222597202 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (29) - 2, .975) and 0.11777156163218715 = (79.46256655211783 - 70.10413599797332) / 79.46256655211783 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```### Baseline Jit Disasm
```assembly
; System.Threading.Channels.Tests.PerfTests.WriteAsyncThenReadAsync()
push ebp
mov ebp,esp
sub esp,20
vxorps xmm4,xmm4,xmm4
vmovdqu xmmword ptr [ebp-20],xmm4
vmovdqu xmmword ptr [ebp-10],xmm4
mov [ebp-20],ecx
mov dword ptr [ebp-1C],0FFFFFFFF
lea ecx,[ebp-20]
call dword ptr ds:[8A4B438]; System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[System.Threading.Channels.Tests.PerfTests+d__8, MicroBenchmarks]](d__8 ByRef)
mov eax,[ebp-18]
test eax,eax
je short M00_L01
M00_L00:
mov esp,ebp
pop ebp
ret
M00_L01:
lea ecx,[ebp-18]
call dword ptr ds:[8A49660]
jmp short M00_L00
; Total bytes of code 61
```
```assembly
; System.Threading.Tasks.Task.GetAwaiter()
mov eax,ecx
ret
; Total bytes of code 3
```
```assembly
; System.Runtime.CompilerServices.TaskAwaiter.GetResult()
mov ecx,[ecx]
mov eax,[ecx+1C]
and eax,11000000
cmp eax,1000000
jne short M02_L01
M02_L00:
ret
M02_L01:
call dword ptr ds:[8A49558]
jmp short M02_L00
; Total bytes of code 26
```
```assembly
; System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[System.Threading.Channels.Tests.PerfTests+d__8, MicroBenchmarks]](d__8 ByRef)
push ebp
mov ebp,esp
push edi
push esi
push ebx
sub esp,20
xor eax,eax
mov [ebp-18],eax
mov esi,ecx
mov ebx,esi
cmp [ebx],bl
mov ecx,2FB4DB8
mov edx,2FE
call CORINFO_HELP_GETSHARED_GCTHREADSTATIC_BASE
mov eax,[eax+0C]
test eax,eax
je short M03_L04
M03_L00:
mov edi,eax
mov [ebp-24],edi
mov ecx,[eax+4]
mov [ebp-28],ecx
mov eax,[eax+8]
mov [ebp-2C],eax
mov ecx,esi
call dword ptr ds:[8A4B330]; System.Threading.Channels.Tests.PerfTests+d__8.MoveNext()
mov eax,[ebp-2C]
cmp eax,[edi+8]
je short M03_L01
lea edx,[edi+8]
call CORINFO_HELP_ASSIGN_REF_EAX
M03_L01:
mov ecx,[edi+4]
mov edx,[ebp-28]
cmp edx,ecx
je short M03_L09
lea edx,[edi+4]
mov eax,[ebp-28]
call CORINFO_HELP_ASSIGN_REF_EAX
test ecx,ecx
je short M03_L02
cmp dword ptr [ecx+8],0
jne short M03_L03
M03_L02:
test eax,eax
je short M03_L09
cmp dword ptr [eax+8],0
je short M03_L09
M03_L03:
mov edx,eax
call dword ptr ds:[8A4B630]
jmp short M03_L09
M03_L04:
call dword ptr ds:[3087210]
jmp short M03_L00
mov eax,[ebp-2C]
mov edi,[ebp-24]
cmp eax,[edi+8]
je short M03_L05
lea edx,[edi+8]
call CORINFO_HELP_ASSIGN_REF_EAX
M03_L05:
mov ecx,[edi+4]
mov edx,[ebp-28]
cmp edx,ecx
je short M03_L08
lea edx,[edi+4]
mov eax,[ebp-28]
call CORINFO_HELP_ASSIGN_REF_EAX
test ecx,ecx
je short M03_L06
cmp dword ptr [ecx+8],0
jne short M03_L07
M03_L06:
test eax,eax
je short M03_L08
cmp dword ptr [eax+8],0
je short M03_L08
M03_L07:
mov edx,eax
call dword ptr ds:[8A4B630]
M03_L08:
pop eax
jmp eax
M03_L09:
lea esp,[ebp-0C]
pop ebx
pop esi
pop edi
pop ebp
ret
; Total bytes of code 221
```
### Compare Jit Disasm
```assembly
; System.Threading.Channels.Tests.PerfTests.WriteAsyncThenReadAsync()
push ebp
mov ebp,esp
sub esp,20
vxorps xmm4,xmm4,xmm4
vmovdqu xmmword ptr [ebp-20],xmm4
vmovdqu xmmword ptr [ebp-10],xmm4
mov [ebp-20],ecx
mov dword ptr [ebp-1C],0FFFFFFFF
lea ecx,[ebp-20]
call dword ptr ds:[0AF9F990]; System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[System.Threading.Channels.Tests.PerfTests+d__8, MicroBenchmarks]](d__8 ByRef)
mov eax,[ebp-18]
test eax,eax
je short M00_L01
M00_L00:
mov esp,ebp
pop ebp
ret
M00_L01:
lea ecx,[ebp-18]
call dword ptr ds:[0AF9DBA0]
jmp short M00_L00
; Total bytes of code 61
```
```assembly
; System.Threading.Tasks.Task.GetAwaiter()
mov eax,ecx
ret
; Total bytes of code 3
```
```assembly
; System.Runtime.CompilerServices.TaskAwaiter.GetResult()
mov ecx,[ecx]
mov eax,[ecx+1C]
and eax,11000000
cmp eax,1000000
jne short M02_L01
M02_L00:
ret
M02_L01:
call dword ptr ds:[0AF9DA98]
jmp short M02_L00
; Total bytes of code 26
```
```assembly
; System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[System.Threading.Channels.Tests.PerfTests+d__8, MicroBenchmarks]](d__8 ByRef)
push ebp
mov ebp,esp
push edi
push esi
push ebx
sub esp,20
xor eax,eax
mov [ebp-18],eax
mov esi,ecx
mov ebx,esi
cmp [ebx],bl
mov ecx,2FC4E08
mov edx,2FE
call CORINFO_HELP_GETSHARED_GCTHREADSTATIC_BASE
mov eax,[eax+0C]
test eax,eax
je short M03_L04
M03_L00:
mov edi,eax
mov [ebp-24],edi
mov ecx,[eax+4]
mov [ebp-28],ecx
mov eax,[eax+8]
mov [ebp-2C],eax
mov ecx,esi
call dword ptr ds:[0AF9F888]; System.Threading.Channels.Tests.PerfTests+d__8.MoveNext()
mov eax,[ebp-2C]
cmp eax,[edi+8]
je short M03_L01
lea edx,[edi+8]
call CORINFO_HELP_ASSIGN_REF_EAX
M03_L01:
mov ecx,[edi+4]
mov edx,[ebp-28]
cmp edx,ecx
je short M03_L09
lea edx,[edi+4]
mov eax,[ebp-28]
call CORINFO_HELP_ASSIGN_REF_EAX
test ecx,ecx
je short M03_L02
cmp dword ptr [ecx+8],0
jne short M03_L03
M03_L02:
test eax,eax
je short M03_L09
cmp dword ptr [eax+8],0
je short M03_L09
M03_L03:
mov edx,eax
call dword ptr ds:[0AF9FB88]
jmp short M03_L09
M03_L04:
call dword ptr ds:[7E271F8]
jmp short M03_L00
mov eax,[ebp-2C]
mov edi,[ebp-24]
cmp eax,[edi+8]
je short M03_L05
lea edx,[edi+8]
call CORINFO_HELP_ASSIGN_REF_EAX
M03_L05:
mov ecx,[edi+4]
mov edx,[ebp-28]
cmp edx,ecx
je short M03_L08
lea edx,[edi+4]
mov eax,[ebp-28]
call CORINFO_HELP_ASSIGN_REF_EAX
test ecx,ecx
je short M03_L06
cmp dword ptr [ecx+8],0
jne short M03_L07
M03_L06:
test eax,eax
je short M03_L08
cmp dword ptr [eax+8],0
je short M03_L08
M03_L07:
mov edx,eax
call dword ptr ds:[0AF9FB88]
M03_L08:
pop eax
jmp eax
M03_L09:
lea esp,[ebp-0C]
pop ebx
pop esi
pop edi
pop ebp
ret
; Total bytes of code 221
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x86 |
|---|---|
| OS | Windows 10.0.18362 |
| Baseline | 71bb0d481086b8b8a89a99a17ec80a861f32dc5d |
| Compare | 5385f045f9aee91c22922d21552c4317198710f1 |
| Diff | Diff |
Improvements in System.Collections.TryGetValueFalse<String, String>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [IDictionary - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.TryGetValueFalse(String%2c%20String).IDictionary(Size%3a%20512).html>) | 18.64 μs | 14.94 μs | 0.80 | 0.00 | False | |||||
| [Dictionary - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.TryGetValueFalse(String%2c%20String).Dictionary(Size%3a%20512).html>) | 14.71 μs | 12.23 μs | 0.83 | 0.06 | False |
_1.png>)
_2.png>)
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.TryGetValueFalse<String, String>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Collections.TryGetValueFalse<String, String>.IDictionary(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 14.935940894894078 < 17.479950715874782.
IsChangePoint: Marked as a change because one of 1/11/2023 2:37:52 AM, 1/17/2023 6:49:05 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 6:49:05 AM.
IsImprovementStdDev: Marked as improvement because 140.903528343876 (T) = (0 -14751.224529895297) / Math.Sqrt((66263.51085393834 / (299)) + (17239.804737963288 / (29))) is greater than 1.9672675222597202 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (29) - 2, .975) and 0.21437686547291956 = (18776.464034215405 - 14751.224529895297) / 18776.464034215405 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Collections.TryGetValueFalse<String, String>.Dictionary(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 12.232803296846495 < 13.648242878754317.
IsChangePoint: Marked as a change because one of 11/4/2022 9:11:54 AM, 12/14/2022 5:20:21 PM, 1/11/2023 2:37:52 AM, 1/17/2023 6:49:05 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 6:49:05 AM.
IsImprovementStdDev: Marked as improvement because 49.75871733492242 (T) = (0 -12427.6626217891) / Math.Sqrt((272289.57914656703 / (299)) + (37586.26554871782 / (29))) is greater than 1.9672675222597202 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (29) - 2, .975) and 0.15830990065345707 = (14765.128675551106 - 12427.6626217891) / 14765.128675551106 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x86 |
|---|---|
| OS | Windows 10.0.18362 |
| Baseline | 71bb0d481086b8b8a89a99a17ec80a861f32dc5d |
| Compare | 5385f045f9aee91c22922d21552c4317198710f1 |
| Diff | Diff |
Improvements in System.Collections.IndexerSet<String>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [IList - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.IndexerSet(String).IList(Size%3a%20512).html>) | 4.08 μs | 3.39 μs | 0.83 | 0.03 | False |
_1.png>)
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.IndexerSet<String>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Collections.IndexerSet<String>.IList(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 3.391847423776019 < 3.830924251584255.
IsChangePoint: Marked as a change because one of 10/25/2022 12:27:43 PM, 11/7/2022 4:10:19 PM, 11/22/2022 2:20:42 AM, 1/11/2023 2:37:52 AM, 1/17/2023 6:49:05 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 6:49:05 AM.
IsImprovementStdDev: Marked as improvement because 12.327784994269063 (T) = (0 -3500.533184332884) / Math.Sqrt((12672.63072747942 / (299)) + (33010.94504123568 / (29))) is greater than 1.9672675222597202 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (29) - 2, .975) and 0.10794682534627054 = (3924.1306278537654 - 3500.533184332884) / 3924.1306278537654 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x86 |
|---|---|
| OS | Windows 10.0.18362 |
| Baseline | 71bb0d481086b8b8a89a99a17ec80a861f32dc5d |
| Compare | 5385f045f9aee91c22922d21552c4317198710f1 |
| Diff | Diff |
Improvements in System.Threading.Channels.Tests.SpscUnboundedChannelPerfTests
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [WriteAsyncThenReadAsync - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Threading.Channels.Tests.SpscUnboundedChannelPerfTests.WriteAsyncThenReadAsync.html>) | 68.72 ns | 58.47 ns | 0.85 | 0.27 | False | Trace | Trace |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Threading.Channels.Tests.SpscUnboundedChannelPerfTests*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Threading.Channels.Tests.SpscUnboundedChannelPerfTests.WriteAsyncThenReadAsync
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 58.47103189810568 < 64.18867246599277.
IsChangePoint: Marked as a change because one of 1/11/2023 2:37:52 AM, 1/17/2023 6:49:05 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 6:49:05 AM.
IsImprovementStdDev: Marked as improvement because 18.026053537644955 (T) = (0 -59.40707641899552) / Math.Sqrt((9.564220130282616 / (299)) + (6.779108776172904 / (29))) is greater than 1.9672675222597202 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (29) - 2, .975) and 0.1352640554205448 = (68.69967276298063 - 59.40707641899552) / 68.69967276298063 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```### Baseline Jit Disasm
```assembly
; System.Threading.Channels.Tests.PerfTests.WriteAsyncThenReadAsync()
push ebp
mov ebp,esp
sub esp,20
vxorps xmm4,xmm4,xmm4
vmovdqu xmmword ptr [ebp-20],xmm4
vmovdqu xmmword ptr [ebp-10],xmm4
mov [ebp-20],ecx
mov dword ptr [ebp-1C],0FFFFFFFF
lea ecx,[ebp-20]
call dword ptr ds:[0AD99F60]; System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[System.Threading.Channels.Tests.PerfTests+d__8, MicroBenchmarks]](d__8 ByRef)
mov eax,[ebp-18]
test eax,eax
je short M00_L01
M00_L00:
mov esp,ebp
pop ebp
ret
M00_L01:
lea ecx,[ebp-18]
call dword ptr ds:[0AD991C8]
jmp short M00_L00
; Total bytes of code 61
```
```assembly
; System.Threading.Tasks.Task.GetAwaiter()
mov eax,ecx
ret
; Total bytes of code 3
```
```assembly
; System.Runtime.CompilerServices.TaskAwaiter.GetResult()
mov ecx,[ecx]
mov eax,[ecx+1C]
and eax,11000000
cmp eax,1000000
jne short M02_L01
M02_L00:
ret
M02_L01:
call dword ptr ds:[0AD990C0]
jmp short M02_L00
; Total bytes of code 26
```
```assembly
; System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[System.Threading.Channels.Tests.PerfTests+d__8, MicroBenchmarks]](d__8 ByRef)
push ebp
mov ebp,esp
push edi
push esi
push ebx
sub esp,20
xor eax,eax
mov [ebp-18],eax
mov esi,ecx
mov ebx,esi
cmp [ebx],bl
mov ecx,2824DB8
mov edx,2FE
call CORINFO_HELP_GETSHARED_GCTHREADSTATIC_BASE
mov eax,[eax+0C]
test eax,eax
je short M03_L04
M03_L00:
mov edi,eax
mov [ebp-24],edi
mov ecx,[eax+4]
mov [ebp-28],ecx
mov eax,[eax+8]
mov [ebp-2C],eax
mov ecx,esi
call dword ptr ds:[0AD99E58]; System.Threading.Channels.Tests.PerfTests+d__8.MoveNext()
mov eax,[ebp-2C]
cmp eax,[edi+8]
je short M03_L01
lea edx,[edi+8]
call CORINFO_HELP_ASSIGN_REF_EAX
M03_L01:
mov ecx,[edi+4]
mov edx,[ebp-28]
cmp edx,ecx
je short M03_L09
lea edx,[edi+4]
mov eax,[ebp-28]
call CORINFO_HELP_ASSIGN_REF_EAX
test ecx,ecx
je short M03_L02
cmp dword ptr [ecx+8],0
jne short M03_L03
M03_L02:
test eax,eax
je short M03_L09
cmp dword ptr [eax+8],0
je short M03_L09
M03_L03:
mov edx,eax
call dword ptr ds:[0AD9B1C8]
jmp short M03_L09
M03_L04:
call dword ptr ds:[4A07210]
jmp short M03_L00
mov eax,[ebp-2C]
mov edi,[ebp-24]
cmp eax,[edi+8]
je short M03_L05
lea edx,[edi+8]
call CORINFO_HELP_ASSIGN_REF_EAX
M03_L05:
mov ecx,[edi+4]
mov edx,[ebp-28]
cmp edx,ecx
je short M03_L08
lea edx,[edi+4]
mov eax,[ebp-28]
call CORINFO_HELP_ASSIGN_REF_EAX
test ecx,ecx
je short M03_L06
cmp dword ptr [ecx+8],0
jne short M03_L07
M03_L06:
test eax,eax
je short M03_L08
cmp dword ptr [eax+8],0
je short M03_L08
M03_L07:
mov edx,eax
call dword ptr ds:[0AD9B1C8]
M03_L08:
pop eax
jmp eax
M03_L09:
lea esp,[ebp-0C]
pop ebx
pop esi
pop edi
pop ebp
ret
; Total bytes of code 221
```
### Compare Jit Disasm
```assembly
; System.Threading.Channels.Tests.PerfTests.WriteAsyncThenReadAsync()
push ebp
mov ebp,esp
sub esp,20
vxorps xmm4,xmm4,xmm4
vmovdqu xmmword ptr [ebp-20],xmm4
vmovdqu xmmword ptr [ebp-10],xmm4
mov [ebp-20],ecx
mov dword ptr [ebp-1C],0FFFFFFFF
lea ecx,[ebp-20]
call dword ptr ds:[0B481750]; System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[System.Threading.Channels.Tests.PerfTests+d__8, MicroBenchmarks]](d__8 ByRef)
mov eax,[ebp-18]
test eax,eax
je short M00_L01
M00_L00:
mov esp,ebp
pop ebp
ret
M00_L01:
lea ecx,[ebp-18]
call dword ptr ds:[0B44F840]
jmp short M00_L00
; Total bytes of code 61
```
```assembly
; System.Threading.Tasks.Task.GetAwaiter()
mov eax,ecx
ret
; Total bytes of code 3
```
```assembly
; System.Runtime.CompilerServices.TaskAwaiter.GetResult()
mov ecx,[ecx]
mov eax,[ecx+1C]
and eax,11000000
cmp eax,1000000
jne short M02_L01
M02_L00:
ret
M02_L01:
call dword ptr ds:[0B44F738]
jmp short M02_L00
; Total bytes of code 26
```
```assembly
; System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[System.Threading.Channels.Tests.PerfTests+d__8, MicroBenchmarks]](d__8 ByRef)
push ebp
mov ebp,esp
push edi
push esi
push ebx
sub esp,20
xor eax,eax
mov [ebp-18],eax
mov esi,ecx
mov ebx,esi
cmp [ebx],bl
mov ecx,4F44E08
mov edx,2FE
call CORINFO_HELP_GETSHARED_GCTHREADSTATIC_BASE
mov eax,[eax+0C]
test eax,eax
je short M03_L04
M03_L00:
mov edi,eax
mov [ebp-24],edi
mov ecx,[eax+4]
mov [ebp-28],ecx
mov eax,[eax+8]
mov [ebp-2C],eax
mov ecx,esi
call dword ptr ds:[0B481648]; System.Threading.Channels.Tests.PerfTests+d__8.MoveNext()
mov eax,[ebp-2C]
cmp eax,[edi+8]
je short M03_L01
lea edx,[edi+8]
call CORINFO_HELP_ASSIGN_REF_EAX
M03_L01:
mov ecx,[edi+4]
mov edx,[ebp-28]
cmp edx,ecx
je short M03_L09
lea edx,[edi+4]
mov eax,[ebp-28]
call CORINFO_HELP_ASSIGN_REF_EAX
test ecx,ecx
je short M03_L02
cmp dword ptr [ecx+8],0
jne short M03_L03
M03_L02:
test eax,eax
je short M03_L09
cmp dword ptr [eax+8],0
je short M03_L09
M03_L03:
mov edx,eax
call dword ptr ds:[0B481948]
jmp short M03_L09
M03_L04:
call dword ptr ds:[4FC71F8]
jmp short M03_L00
mov eax,[ebp-2C]
mov edi,[ebp-24]
cmp eax,[edi+8]
je short M03_L05
lea edx,[edi+8]
call CORINFO_HELP_ASSIGN_REF_EAX
M03_L05:
mov ecx,[edi+4]
mov edx,[ebp-28]
cmp edx,ecx
je short M03_L08
lea edx,[edi+4]
mov eax,[ebp-28]
call CORINFO_HELP_ASSIGN_REF_EAX
test ecx,ecx
je short M03_L06
cmp dword ptr [ecx+8],0
jne short M03_L07
M03_L06:
test eax,eax
je short M03_L08
cmp dword ptr [eax+8],0
je short M03_L08
M03_L07:
mov edx,eax
call dword ptr ds:[0B481948]
M03_L08:
pop eax
jmp eax
M03_L09:
lea esp,[ebp-0C]
pop ebx
pop esi
pop edi
pop ebp
ret
; Total bytes of code 221
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x86 |
|---|---|
| OS | Windows 10.0.18362 |
| Baseline | 71bb0d481086b8b8a89a99a17ec80a861f32dc5d |
| Compare | 5385f045f9aee91c22922d21552c4317198710f1 |
| Diff | Diff |
Improvements in System.Collections.ContainsTrue<Int32>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [HashSet - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.ContainsTrue(Int32).HashSet(Size%3a%20512).html>) | 6.41 μs | 4.85 μs | 0.76 | 0.24 | False |
_1.png>)
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsTrue<Int32>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Collections.ContainsTrue<Int32>.HashSet(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 4.847492002063984 < 6.168948481325149.
IsChangePoint: Marked as a change because one of 12/6/2022 2:12:43 AM, 12/12/2022 5:25:39 PM, 12/14/2022 5:20:21 PM, 12/21/2022 9:23:17 AM, 1/3/2023 6:29:42 AM, 1/11/2023 2:37:52 AM, 1/17/2023 6:49:05 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 6:49:05 AM.
IsImprovementStdDev: Marked as improvement because 16.46860879924014 (T) = (0 -4898.850792637759) / Math.Sqrt((1167405.874654567 / (299)) + (4174.877958564275 / (29))) is greater than 1.9672675222597202 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (29) - 2, .975) and 0.17620550577272676 = (5946.690378445568 - 4898.850792637759) / 5946.690378445568 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x86 |
|---|---|
| OS | Windows 10.0.18362 |
| Baseline | 71bb0d481086b8b8a89a99a17ec80a861f32dc5d |
| Compare | 5385f045f9aee91c22922d21552c4317198710f1 |
| Diff | Diff |
Improvements in System.Numerics.Tests.Perf_VectorConvert
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [Convert_float_uint - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Numerics.Tests.Perf_VectorConvert.Convert_float_uint.html>) | 24.48 μs | 20.50 μs | 0.84 | 0.01 | False | Trace | Trace |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorConvert*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Numerics.Tests.Perf_VectorConvert.Convert_float_uint
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 20.50007773243386 < 23.202761227490342.
IsChangePoint: Marked as a change because one of 11/2/2022 4:14:20 AM, 1/11/2023 2:37:52 AM, 1/17/2023 6:49:05 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 6:49:05 AM.
IsImprovementStdDev: Marked as improvement because 105.24477064391749 (T) = (0 -20596.833538403436) / Math.Sqrt((21992.90570356107 / (299)) + (32582.618285785586 / (29))) is greater than 1.9672675222597202 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (29) - 2, .975) and 0.15023259212443937 = (24238.20135664655 - 20596.833538403436) / 24238.20135664655 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```### Baseline Jit Disasm
```assembly
; System.Numerics.Tests.Perf_VectorConvert.Convert_float_uint()
mov ecx,edx
mov edx,ds:[6E8451C]
call dword ptr ds:[0B1550A8]
ret
; Total bytes of code 15
```
### Compare Jit Disasm
```assembly
; BenchmarkDotNet.Autogenerated.Runnable_0.__ForDisassemblyDiagnoser__()
push ebp
mov ebp,esp
sub esp,28
vzeroupper
vxorps xmm4,xmm4,xmm4
vmovdqu xmmword ptr [ebp-28],xmm4
vmovdqu xmmword ptr [ebp-18],xmm4
mov [ebp-4],ecx
mov [ebp-8],edx
mov ecx,[ebp-4]
cmp dword ptr [ecx+1C],0B
jne short M00_L00
mov ecx,[ebp-4]
mov edx,[ebp-8]
call dword ptr ds:[0A40F438]
vzeroupper
mov esp,ebp
pop ebp
ret
M00_L00:
vxorps ymm0,ymm0,ymm0
vmovups [ebp-28],ymm0
mov eax,[ebp-8]
vmovups ymm0,[ebp-28]
vmovups [eax],ymm0
vzeroupper
mov esp,ebp
pop ebp
ret
; Total bytes of code 85
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x86 |
|---|---|
| OS | Windows 10.0.18362 |
| Baseline | 71bb0d481086b8b8a89a99a17ec80a861f32dc5d |
| Compare | 5385f045f9aee91c22922d21552c4317198710f1 |
| Diff | Diff |
Improvements in System.Collections.CreateAddAndRemove<String>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [Stack - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.CreateAddAndRemove(String).Stack(Size%3a%20512).html>) | 4.64 μs | 4.20 μs | 0.90 | 0.07 | False |
_1.png>)
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CreateAddAndRemove<String>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Collections.CreateAddAndRemove<String>.Stack(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 4.196900461097681 < 4.420162554807141.
IsChangePoint: Marked as a change because one of 11/23/2022 1:02:40 AM, 12/6/2022 11:39:16 PM, 12/23/2022 9:40:21 PM, 1/11/2023 2:37:52 AM, 1/17/2023 6:49:05 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 6:49:05 AM.
IsImprovementStdDev: Marked as improvement because 21.3253952177897 (T) = (0 -4235.333274072996) / Math.Sqrt((38286.80414735247 / (299)) + (7971.163245116676 / (29))) is greater than 1.9672675222597202 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (29) - 2, .975) and 0.0917915965240986 = (4663.393619640051 - 4235.333274072996) / 4663.393619640051 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
_1.png>)
_2.png>)
_1.png>)
Run Information
Improvements in System.Collections.ContainsKeyFalse<String, String>
Repro