performanceautofiler[bot]
commented
1 year ago Run Information
| Architecture | x86 |
|---|---|
| OS | Windows 10.0.18362 |
| Baseline | 6123cb00bbec8ae3500c970890f5b0efcf7950e8 |
| Compare | ffbcb8336ac67496b0565112f663f74fda6cac34 |
| Diff | Diff |
Regressions in PerfLabTests.CastingPerf2.CastingPerf
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [IFooObjIsDescendantOfIFoo - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/PerfLabTests.CastingPerf2.CastingPerf.IFooObjIsDescendantOfIFoo.html>) | 478.51 μs | 584.96 μs | 1.22 | 0.04 | False | Trace | Trace | |||
| [IFooObjIsIFooInterAlia - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/PerfLabTests.CastingPerf2.CastingPerf.IFooObjIsIFooInterAlia.html>) | 374.20 μs | 463.90 μs | 1.24 | 0.03 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'PerfLabTests.CastingPerf2.CastingPerf*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### PerfLabTests.CastingPerf2.CastingPerf.IFooObjIsDescendantOfIFoo
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 584.9637792397659 > 506.16589015151516.
IsChangePoint: Marked as a change because one of 1/18/2023 6:24:13 PM, 1/27/2023 7:12:54 PM, 2/9/2023 4:27:10 AM, 2/24/2023 9:01:57 AM, 3/6/2023 11:14:52 AM, 3/14/2023 10:43:28 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 10:43:28 AM.
IsRegressionStdDev: Marked as regression because -71.71082077437953 (T) = (0 -582220.4148962059) / Math.Sqrt((31398254.517656684 / (24)) + (24972737.360400695 / (36))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (36) - 2, .025) and -0.21105020657606796 = (480756.62902720104 - 582220.4148962059) / 480756.62902720104 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```### Baseline Jit Disasm
```assembly
; PerfLabTests.CastingPerf2.CastingPerf.IFooObjIsDescendantOfIFoo()
push ebp
mov ebp,esp
push edi
push esi
push ebx
xor esi,esi
mov edi,ds:[0A5C6334]
test edi,edi
jle short M00_L01
mov ebx,ds:[6CA4274]
mov edx,ebx
mov ecx,offset MT_PerfLabTests.CastingPerf2.IFoo
call dword ptr ds:[4ACB888]; System.Runtime.CompilerServices.CastHelpers.ChkCastInterface(Void*, System.Object)
M00_L00:
mov edx,ebx
mov ecx,offset MT_PerfLabTests.CastingPerf2.IFoo
call dword ptr ds:[4ACB888]; System.Runtime.CompilerServices.CastHelpers.ChkCastInterface(Void*, System.Object)
mov edx,6CA42C4
call CORINFO_HELP_ASSIGN_REF_EAX
inc esi
cmp esi,edi
jl short M00_L00
M00_L01:
pop ebx
pop esi
pop edi
pop ebp
ret
; Total bytes of code 70
```
```assembly
; System.Runtime.CompilerServices.CastHelpers.ChkCastInterface(Void*, System.Object)
push ebp
mov ebp,esp
push esi
test edx,edx
je short M01_L01
mov eax,[edx]
movzx esi,word ptr [eax+0E]
test esi,esi
je short M01_L04
mov eax,[eax+24]
cmp esi,4
jl short M01_L03
M01_L00:
cmp [eax],ecx
je short M01_L01
cmp [eax+4],ecx
je short M01_L01
cmp [eax+8],ecx
je short M01_L01
cmp [eax+0C],ecx
jne short M01_L02
M01_L01:
mov eax,edx
pop esi
pop ebp
ret
M01_L02:
add eax,10
add esi,0FFFFFFFC
cmp esi,4
jge short M01_L00
test esi,esi
je short M01_L04
M01_L03:
cmp [eax],ecx
je short M01_L01
add eax,4
dec esi
test esi,esi
jg short M01_L03
M01_L04:
call dword ptr ds:[4ACB870]
pop esi
pop ebp
ret
; Total bytes of code 86
```
### Compare Jit Disasm
```assembly
; PerfLabTests.CastingPerf2.CastingPerf.IFooObjIsDescendantOfIFoo()
push ebp
mov ebp,esp
push edi
push esi
push ebx
xor esi,esi
mov edi,ds:[0A878084]
test edi,edi
jle short M00_L01
mov ebx,ds:[6CF4274]
mov edx,ebx
mov ecx,offset MT_PerfLabTests.CastingPerf2.IFoo
call dword ptr ds:[7FEB888]; System.Runtime.CompilerServices.CastHelpers.ChkCastInterface(Void*, System.Object)
M00_L00:
mov edx,ebx
mov ecx,offset MT_PerfLabTests.CastingPerf2.IFoo
call dword ptr ds:[7FEB888]; System.Runtime.CompilerServices.CastHelpers.ChkCastInterface(Void*, System.Object)
mov edx,6CF42C4
call CORINFO_HELP_ASSIGN_REF_EAX
inc esi
cmp esi,edi
jl short M00_L00
M00_L01:
pop ebx
pop esi
pop edi
pop ebp
ret
; Total bytes of code 70
```
```assembly
; System.Runtime.CompilerServices.CastHelpers.ChkCastInterface(Void*, System.Object)
push ebp
mov ebp,esp
push esi
test edx,edx
je short M01_L01
mov eax,[edx]
movzx esi,word ptr [eax+0E]
test esi,esi
je short M01_L04
mov eax,[eax+24]
cmp esi,4
jl short M01_L03
M01_L00:
cmp [eax],ecx
je short M01_L01
cmp [eax+4],ecx
je short M01_L01
cmp [eax+8],ecx
je short M01_L01
cmp [eax+0C],ecx
jne short M01_L02
M01_L01:
mov eax,edx
pop esi
pop ebp
ret
M01_L02:
add eax,10
add esi,0FFFFFFFC
cmp esi,4
jge short M01_L00
test esi,esi
je short M01_L04
M01_L03:
cmp [eax],ecx
je short M01_L01
add eax,4
dec esi
test esi,esi
jg short M01_L03
M01_L04:
call dword ptr ds:[7FEB870]
pop esi
pop ebp
ret
; Total bytes of code 86
```
#### PerfLabTests.CastingPerf2.CastingPerf.IFooObjIsIFooInterAlia
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 463.897818627451 > 392.9108080929488.
IsChangePoint: Marked as a change because one of 1/3/2023 6:29:42 AM, 1/5/2023 11:35:29 PM, 1/13/2023 4:37:08 PM, 1/18/2023 6:24:13 PM, 1/27/2023 7:12:54 PM, 3/6/2023 11:14:52 AM, 3/14/2023 10:43:28 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 10:43:28 AM.
IsRegressionStdDev: Marked as regression because -73.50002922397927 (T) = (0 -451966.92761713424) / Math.Sqrt((193042.52599733995 / (24)) + (39870831.8898378 / (36))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (36) - 2, .025) and -0.207383288344262 = (374335.91468450456 - 451966.92761713424) / 374335.91468450456 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x86 |
|---|---|
| OS | Windows 10.0.18362 |
| Baseline | 6123cb00bbec8ae3500c970890f5b0efcf7950e8 |
| Compare | ffbcb8336ac67496b0565112f663f74fda6cac34 |
| Diff | Diff |
Regressions in System.Collections.ContainsTrue<Int32>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [Span - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.ContainsTrue(Int32).Span(Size%3a%20512).html>) | 16.41 μs | 17.52 μs | 1.07 | 0.12 | False |
_1.png>)
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsTrue<Int32>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Collections.ContainsTrue<Int32>.Span(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 17.519744698660705 > 17.20258114060867.
IsChangePoint: Marked as a change because one of 2/9/2023 4:27:10 AM, 2/14/2023 5:47:38 PM, 2/20/2023 9:09:49 AM, 3/6/2023 11:14:52 AM, 3/14/2023 10:43:28 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 10:43:28 AM.
IsRegressionStdDev: Marked as regression because -67.06055528893727 (T) = (0 -17573.505741413042) / Math.Sqrt((6572.556686996529 / (24)) + (2182.10084530761 / (36))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (36) - 2, .025) and -0.07502503137354344 = (16347.06655989176 - 17573.505741413042) / 16347.06655989176 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x86 |
|---|---|
| OS | Windows 10.0.18362 |
| Baseline | 6123cb00bbec8ae3500c970890f5b0efcf7950e8 |
| Compare | ffbcb8336ac67496b0565112f663f74fda6cac34 |
| Diff | Diff |
Regressions in System.Collections.AddGivenSize<Int32>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.AddGivenSize(Int32).Dictionary(Size%3a%20512).html>) | 8.10 μs | 8.94 μs | 1.10 | 0.07 | False |
_1.png>)
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.AddGivenSize<Int32>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Collections.AddGivenSize<Int32>.Dictionary(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 8.942225650593185 > 8.487165399912895.
IsChangePoint: Marked as a change because one of 1/20/2023 8:02:54 AM, 1/30/2023 9:42:46 PM, 2/9/2023 4:27:10 AM, 2/16/2023 6:27:39 AM, 3/6/2023 11:14:52 AM, 3/14/2023 10:43:28 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 10:43:28 AM.
IsRegressionStdDev: Marked as regression because -16.244634772737133 (T) = (0 -8900.454097841575) / Math.Sqrt((24952.46402797539 / (24)) + (38346.11713749472 / (36))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (36) - 2, .025) and -0.0913877645753172 = (8155.171229452931 - 8900.454097841575) / 8155.171229452931 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x86 |
|---|---|
| OS | Windows 10.0.18362 |
| Baseline | 6123cb00bbec8ae3500c970890f5b0efcf7950e8 |
| Compare | ffbcb8336ac67496b0565112f663f74fda6cac34 |
| Diff | Diff |
Regressions in PerfLabTests.LowLevelPerf
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [ClassVirtualMethod - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/PerfLabTests.LowLevelPerf.ClassVirtualMethod.html>) | 155.93 μs | 187.11 μs | 1.20 | 0.02 | False | Trace | Trace | |||
| [GenericClassGenericStaticField - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/PerfLabTests.LowLevelPerf.GenericClassGenericStaticField.html>) | 31.20 μs | 62.38 μs | 2.00 | 0.02 | False | Trace | Trace | |||
| [InterfaceInterfaceMethodLongHierarchy - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/PerfLabTests.LowLevelPerf.InterfaceInterfaceMethodLongHierarchy.html>) | 311.82 μs | 380.04 μs | 1.22 | 0.02 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'PerfLabTests.LowLevelPerf*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### PerfLabTests.LowLevelPerf.ClassVirtualMethod
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 187.10671626984123 > 163.72974798886136.
IsChangePoint: Marked as a change because one of 1/5/2023 11:35:29 PM, 1/11/2023 2:37:52 AM, 1/20/2023 8:02:54 AM, 1/30/2023 9:42:46 PM, 2/13/2023 6:54:14 PM, 2/16/2023 9:36:08 AM, 2/20/2023 10:31:48 AM, 3/6/2023 11:14:52 AM, 3/14/2023 10:43:28 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 10:43:28 AM.
IsRegressionStdDev: Marked as regression because -425.5329595517297 (T) = (0 -187248.32546094916) / Math.Sqrt((58050.08684586906 / (24)) + (106764.32828036108 / (36))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (36) - 2, .025) and -0.20013066457353257 = (156023.28228775656 - 187248.32546094916) / 156023.28228775656 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```### Baseline Jit Disasm
```assembly
; PerfLabTests.LowLevelPerf.ClassVirtualMethod()
push ebp
mov ebp,esp
push edi
push esi
push ebx
mov esi,ds:[6BC4180]
xor eax,eax
xor edi,edi
cmp dword ptr ds:[0A6B62D0],0
jle short M00_L01
mov ecx,[esi]
mov ebx,[ecx+28]
M00_L00:
mov ecx,esi
call dword ptr [ebx+14]
inc edi
cmp edi,ds:[0A6B62D0]
jl short M00_L00
M00_L01:
pop ebx
pop esi
pop edi
pop ebp
ret
; Total bytes of code 49
```
### Compare Jit Disasm
```assembly
; PerfLabTests.LowLevelPerf.ClassVirtualMethod()
push ebp
mov ebp,esp
push edi
push esi
push ebx
mov esi,ds:[6CB4180]
xor eax,eax
xor edi,edi
cmp dword ptr ds:[0A7567D0],0
jle short M00_L01
mov ecx,[esi]
mov ebx,[ecx+28]
M00_L00:
mov ecx,esi
call dword ptr [ebx+14]
inc edi
cmp edi,ds:[0A7567D0]
jl short M00_L00
M00_L01:
pop ebx
pop esi
pop edi
pop ebp
ret
; Total bytes of code 49
```
#### PerfLabTests.LowLevelPerf.GenericClassGenericStaticField
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 62.37623256972112 > 32.75622397632619.
IsChangePoint: Marked as a change because one of 1/3/2023 6:29:42 AM, 1/5/2023 11:35:29 PM, 1/13/2023 4:37:08 PM, 1/18/2023 6:24:13 PM, 1/30/2023 9:42:46 PM, 2/13/2023 6:54:14 PM, 2/16/2023 9:36:08 AM, 2/20/2023 10:31:48 AM, 3/6/2023 11:14:52 AM, 3/14/2023 10:43:28 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 10:43:28 AM.
IsRegressionStdDev: Marked as regression because -1128.529317987603 (T) = (0 -62435.66215330479) / Math.Sqrt((8565.986708358476 / (24)) + (14674.132653367786 / (36))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (36) - 2, .025) and -0.9991147549783176 = (31231.654910166457 - 62435.66215330479) / 31231.654910166457 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```### Baseline Jit Disasm
```assembly
; PerfLabTests.LowLevelPerf.GenericClassGenericStaticField()
push ebp
mov ebp,esp
push esi
xor esi,esi
mov ecx,0A9F5CF8
mov edx,82
call CORINFO_HELP_GETSHARED_NONGCSTATIC_BASE
mov eax,ds:[0A9F62D0]
test eax,eax
jle short M00_L01
M00_L00:
mov dword ptr ds:[881C2C4],1
inc esi
cmp esi,eax
jl short M00_L00
M00_L01:
pop esi
pop ebp
ret
; Total bytes of code 48
```
### Compare Jit Disasm
```assembly
; PerfLabTests.LowLevelPerf.GenericClassGenericStaticField()
push ebp
mov ebp,esp
push esi
xor esi,esi
mov ecx,0A9D61F8
mov edx,82
call CORINFO_HELP_GETSHARED_NONGCSTATIC_BASE
mov eax,ds:[0A9D67D0]
test eax,eax
jle short M00_L01
M00_L00:
mov dword ptr ds:[0B27D754],1
inc esi
cmp esi,eax
jl short M00_L00
M00_L01:
pop esi
pop ebp
ret
; Total bytes of code 48
```
#### PerfLabTests.LowLevelPerf.InterfaceInterfaceMethodLongHierarchy
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 380.044481707317 > 327.420234375.
IsChangePoint: Marked as a change because one of 1/13/2023 4:37:08 PM, 2/9/2023 4:10:34 PM, 3/6/2023 11:14:52 AM, 3/14/2023 10:43:28 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 10:43:28 AM.
IsRegressionStdDev: Marked as regression because -75.57120057269363 (T) = (0 -385052.770856858) / Math.Sqrt((198994.66501203293 / (24)) + (33348110.537572358 / (36))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (36) - 2, .025) and -0.2341694389421504 = (311993.4416678638 - 385052.770856858) / 311993.4416678638 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x86 |
|---|---|
| OS | Windows 10.0.18362 |
| Baseline | 6123cb00bbec8ae3500c970890f5b0efcf7950e8 |
| Compare | ffbcb8336ac67496b0565112f663f74fda6cac34 |
| Diff | Diff |
Regressions in System.Collections.IterateForEach<String>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [SortedList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.IterateForEach(String).SortedList(Size%3a%20512).html>) | 7.94 μs | 8.84 μs | 1.11 | 0.02 | False | |||||
| [ConcurrentStack - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.IterateForEach(String).ConcurrentStack(Size%3a%20512).html>) | 4.05 μs | 5.13 μs | 1.27 | 0.02 | False |
_1.png>)
_2.png>)
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.IterateForEach<String>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Collections.IterateForEach<String>.SortedList(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 8.841750896564744 > 8.336263618844152.
IsChangePoint: Marked as a change because one of 1/13/2023 4:37:08 PM, 1/30/2023 9:42:46 PM, 2/9/2023 10:24:28 PM, 3/6/2023 11:14:52 AM, 3/14/2023 10:43:28 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 10:43:28 AM.
IsRegressionStdDev: Marked as regression because -27.658055193378182 (T) = (0 -8804.723376091297) / Math.Sqrt((8594.676277900546 / (24)) + (19485.919154248557 / (36))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (36) - 2, .025) and -0.1040039578919097 = (7975.264321428588 - 8804.723376091297) / 7975.264321428588 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Collections.IterateForEach<String>.ConcurrentStack(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 5.129883038541327 > 4.253312632149037.
IsChangePoint: Marked as a change because one of 1/5/2023 11:35:29 PM, 1/13/2023 4:37:08 PM, 2/24/2023 9:01:57 AM, 3/6/2023 11:14:52 AM, 3/14/2023 10:43:28 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 10:43:28 AM.
IsRegressionStdDev: Marked as regression because -444.8606311260765 (T) = (0 -5138.528545236457) / Math.Sqrt((54.654414204322315 / (24)) + (132.40356666253672 / (36))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (36) - 2, .025) and -0.26785591333788006 = (4052.9278533774946 - 5138.528545236457) / 4052.9278533774946 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x86 |
|---|---|
| OS | Windows 10.0.18362 |
| Baseline | 6123cb00bbec8ae3500c970890f5b0efcf7950e8 |
| Compare | ffbcb8336ac67496b0565112f663f74fda6cac34 |
| Diff | Diff |
Regressions in System.Collections.IterateForEach<Int32>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [Stack - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.IterateForEach(Int32).Stack(Size%3a%20512).html>) | 1.61 μs | 1.85 μs | 1.15 | 0.04 | False |
_1.png>)
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.IterateForEach<Int32>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Collections.IterateForEach<Int32>.Stack(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.8501803161747752 > 1.6952009570327216.
IsChangePoint: Marked as a change because one of 2/20/2023 10:31:48 AM, 2/24/2023 9:01:57 AM, 3/6/2023 11:14:52 AM, 3/14/2023 10:43:28 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 10:43:28 AM.
IsRegressionStdDev: Marked as regression because -44.09752106064356 (T) = (0 -1844.2975034335623) / Math.Sqrt((157.15794928146107 / (24)) + (715.8529377092491 / (36))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (36) - 2, .025) and -0.14015947108710994 = (1617.5785494945515 - 1844.2975034335623) / 1617.5785494945515 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x86 |
|---|---|
| OS | Windows 10.0.18362 |
| Baseline | 6123cb00bbec8ae3500c970890f5b0efcf7950e8 |
| Compare | ffbcb8336ac67496b0565112f663f74fda6cac34 |
| Diff | Diff |
Regressions in System.Collections.CtorFromCollection<String>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [ConcurrentStack - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.CtorFromCollection(String).ConcurrentStack(Size%3a%20512).html>) | 5.32 μs | 5.67 μs | 1.07 | 0.03 | False |
_1.png>)
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CtorFromCollection<String>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Collections.CtorFromCollection<String>.ConcurrentStack(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 5.669010524813123 > 5.582494478783927.
IsChangePoint: Marked as a change because one of 1/5/2023 11:35:29 PM, 1/11/2023 2:37:52 AM, 2/9/2023 4:27:10 AM, 3/6/2023 11:14:52 AM, 3/14/2023 10:43:28 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 10:43:28 AM.
IsRegressionStdDev: Marked as regression because -64.61550338725053 (T) = (0 -5672.42177703227) / Math.Sqrt((186.51507670715745 / (24)) + (761.5052560156096 / (36))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (36) - 2, .025) and -0.0652614143950648 = (5324.91058098964 - 5672.42177703227) / 5324.91058098964 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x86 |
|---|---|
| OS | Windows 10.0.18362 |
| Baseline | 6123cb00bbec8ae3500c970890f5b0efcf7950e8 |
| Compare | ffbcb8336ac67496b0565112f663f74fda6cac34 |
| Diff | Diff |
Regressions in System.Collections.CreateAddAndClear<Int32>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.CreateAddAndClear(Int32).Dictionary(Size%3a%20512).html>) | 13.15 μs | 14.00 μs | 1.06 | 0.08 | False |
_1.png>)
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CreateAddAndClear<Int32>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Collections.CreateAddAndClear<Int32>.Dictionary(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 14.003076553491352 > 13.836187538165515.
IsChangePoint: Marked as a change because one of 1/5/2023 9:29:47 PM, 1/20/2023 8:02:54 AM, 1/30/2023 9:42:46 PM, 2/14/2023 5:47:38 PM, 2/16/2023 9:36:08 AM, 3/6/2023 11:14:52 AM, 3/14/2023 10:43:28 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 10:43:28 AM.
IsRegressionStdDev: Marked as regression because -12.965773709909348 (T) = (0 -14160.9262579021) / Math.Sqrt((40555.95466057374 / (24)) + (178129.9335055944 / (36))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (36) - 2, .025) and -0.08061034187612506 = (13104.562957741364 - 14160.9262579021) / 13104.562957741364 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x86 |
|---|---|
| OS | Windows 10.0.18362 |
| Baseline | 6123cb00bbec8ae3500c970890f5b0efcf7950e8 |
| Compare | ffbcb8336ac67496b0565112f663f74fda6cac34 |
| Diff | Diff |
Regressions in System.Collections.IterateForEachNonGeneric<Int32>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [Stack - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.IterateForEachNonGeneric(Int32).Stack(Size%3a%20512).html>) | 3.40 μs | 3.87 μs | 1.14 | 0.02 | False | |||||
| [ArrayList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.IterateForEachNonGeneric(Int32).ArrayList(Size%3a%20512).html>) | 2.81 μs | 3.48 μs | 1.24 | 0.04 | False |
_1.png>)
_2.png>)
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.IterateForEachNonGeneric<Int32>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Collections.IterateForEachNonGeneric<Int32>.Stack(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 3.8677428270713925 > 3.5684256509376597.
IsChangePoint: Marked as a change because one of 1/5/2023 11:35:29 PM, 1/13/2023 4:37:08 PM, 2/16/2023 9:36:08 AM, 2/24/2023 9:01:57 AM, 3/6/2023 11:14:52 AM, 3/14/2023 10:43:28 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 10:43:28 AM.
IsRegressionStdDev: Marked as regression because -280.1849419569997 (T) = (0 -3870.7894405538227) / Math.Sqrt((38.16790043841436 / (24)) + (45.01073194796441 / (36))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (36) - 2, .025) and -0.1389494458342943 = (3398.5612396680367 - 3870.7894405538227) / 3398.5612396680367 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Collections.IterateForEachNonGeneric<Int32>.ArrayList(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 3.475180127779008 > 2.950874249853479.
IsChangePoint: Marked as a change because one of 1/3/2023 6:29:42 AM, 3/6/2023 11:14:52 AM, 3/14/2023 10:43:28 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 10:43:28 AM.
IsRegressionStdDev: Marked as regression because -205.80893614102638 (T) = (0 -3443.9912775766957) / Math.Sqrt((36.95247773577524 / (24)) + (286.3528374785658 / (36))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (36) - 2, .025) and -0.22568590498293964 = (2809.8481540624657 - 3443.9912775766957) / 2809.8481540624657 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
_1.png>)
Run Information
Regressions in System.Linq.Tests.Perf_Enumerable
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
Baseline Compare
Run Information
Regressions in Benchstone.BenchI.Fib
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
Baseline Compare