performanceautofiler[bot]
commented
1 year ago Run Information
| Architecture | x86 |
|---|---|
| OS | Windows 10.0.18362 |
| Baseline | 6123cb00bbec8ae3500c970890f5b0efcf7950e8 |
| Compare | ffbcb8336ac67496b0565112f663f74fda6cac34 |
| Diff | Diff |
Regressions in System.Collections.CtorFromCollection<String>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [ConcurrentStack - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.CtorFromCollection(String).ConcurrentStack(Size%3a%20512).html>) | 5.32 μs | 5.67 μs | 1.07 | 0.03 | False |
_1.png>)
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CtorFromCollection<String>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Collections.CtorFromCollection<String>.ConcurrentStack(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 5.67254234724743 > 5.582494478783927.
IsChangePoint: Marked as a change because one of 1/5/2023 11:35:29 PM, 1/11/2023 2:37:52 AM, 2/9/2023 4:27:10 AM, 3/6/2023 11:14:52 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
IsRegressionStdDev: Marked as regression because -63.297255228892055 (T) = (0 -5672.519241381389) / Math.Sqrt((186.51507670715745 / (24)) + (783.5504365696022 / (35))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (35) - 2, .025) and -0.06527971786657605 = (5324.91058098964 - 5672.519241381389) / 5324.91058098964 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x86 |
|---|---|
| OS | Windows 10.0.18362 |
| Baseline | 6123cb00bbec8ae3500c970890f5b0efcf7950e8 |
| Compare | ffbcb8336ac67496b0565112f663f74fda6cac34 |
| Diff | Diff |
Regressions in System.Linq.Tests.Perf_Enumerable
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [ElementAt - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Linq.Tests.Perf_Enumerable.ElementAt(input%3a%20IEnumerable).html>) | 162.47 ns | 188.79 ns | 1.16 | 0.14 | False | Trace | Trace | |||
| [TakeLastHalf - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Linq.Tests.Perf_Enumerable.TakeLastHalf(input%3a%20List).html>) | 731.09 ns | 792.12 ns | 1.08 | 0.09 | False | Trace | Trace | |||
| [ToArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Linq.Tests.Perf_Enumerable.ToArray(input%3a%20IEnumerable).html>) | 760.18 ns | 847.02 ns | 1.11 | 0.03 | False | Trace | Trace |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Linq.Tests.Perf_Enumerable*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Linq.Tests.Perf_Enumerable.ElementAt(input: IEnumerable)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 188.7896728490783 > 170.98356995417618.
IsChangePoint: Marked as a change because one of 1/3/2023 6:29:42 AM, 1/5/2023 11:35:29 PM, 1/13/2023 4:37:08 PM, 3/6/2023 11:14:52 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
IsRegressionStdDev: Marked as regression because -35.86877535381221 (T) = (0 -187.5392378052312) / Math.Sqrt((0.27585995257251955 / (24)) + (16.310924907264923 / (35))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (35) - 2, .025) and -0.15229438828422917 = (162.75288651234158 - 187.5392378052312) / 162.75288651234158 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```### Baseline Jit Disasm
```assembly
; System.Linq.Tests.Perf_Enumerable.ElementAt(System.Linq.Tests.LinqTestData)
mov ecx,[edx+4]
mov edx,32
call dword ptr ds:[0BB9DA08]; System.Linq.Enumerable.ElementAt[[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1, Int32)
ret
; Total bytes of code 15
```
```assembly
; System.Linq.Enumerable.ElementAt[[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1, Int32)
push ebp
mov ebp,esp
push edi
push esi
sub esp,8
mov esi,ecx
mov edi,edx
test esi,esi
je short M01_L03
mov edx,esi
mov ecx,offset MT_System.Linq.IPartition`1[[System.Int32, System.Private.CoreLib]]
call dword ptr ds:[8A3B810]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfInterface(Void*, System.Object)
test eax,eax
je short M01_L00
lea ecx,[ebp-0C]
push ecx
mov ecx,eax
mov edx,edi
call dword ptr ds:[3D102FC]
cmp byte ptr [ebp-0C],0
je short M01_L02
lea esp,[ebp-8]
pop esi
pop edi
pop ebp
ret
M01_L00:
mov edx,esi
mov ecx,offset MT_System.Collections.Generic.IList`1[[System.Int32, System.Private.CoreLib]]
call dword ptr ds:[8A3B810]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfInterface(Void*, System.Object)
test eax,eax
je short M01_L01
mov ecx,eax
mov edx,edi
call dword ptr ds:[3D102F8]
lea esp,[ebp-8]
pop esi
pop edi
pop ebp
ret
M01_L01:
lea ecx,[ebp-10]
push ecx
mov ecx,esi
mov edx,edi
call dword ptr ds:[0BB9DA20]; System.Linq.Enumerable.TryGetElement[[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1, Int32, Int32 ByRef)
test eax,eax
je short M01_L02
mov eax,[ebp-10]
lea esp,[ebp-8]
pop esi
pop edi
pop ebp
ret
M01_L02:
mov ecx,6
call dword ptr ds:[0B157E28]
int 3
M01_L03:
mov ecx,10
call dword ptr ds:[0B157E10]
int 3
; Total bytes of code 146
```
### Compare Jit Disasm
```assembly
; System.Linq.Tests.Perf_Enumerable.ElementAt(System.Linq.Tests.LinqTestData)
mov ecx,[edx+4]
mov edx,32
call dword ptr ds:[0BA2DA08]; System.Linq.Enumerable.ElementAt[[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1, Int32)
ret
; Total bytes of code 15
```
```assembly
; System.Linq.Enumerable.ElementAt[[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1, Int32)
push ebp
mov ebp,esp
push edi
push esi
sub esp,8
mov esi,ecx
mov edi,edx
test esi,esi
je short M01_L03
mov edx,esi
mov ecx,offset MT_System.Linq.IPartition`1[[System.Int32, System.Private.CoreLib]]
call dword ptr ds:[885B810]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfInterface(Void*, System.Object)
test eax,eax
je short M01_L00
lea ecx,[ebp-0C]
push ecx
mov ecx,eax
mov edx,edi
call dword ptr ds:[32002F8]
cmp byte ptr [ebp-0C],0
je short M01_L02
lea esp,[ebp-8]
pop esi
pop edi
pop ebp
ret
M01_L00:
mov edx,esi
mov ecx,offset MT_System.Collections.Generic.IList`1[[System.Int32, System.Private.CoreLib]]
call dword ptr ds:[885B810]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfInterface(Void*, System.Object)
test eax,eax
je short M01_L01
mov ecx,eax
mov edx,edi
call dword ptr ds:[32002F4]
lea esp,[ebp-8]
pop esi
pop edi
pop ebp
ret
M01_L01:
lea ecx,[ebp-10]
push ecx
mov ecx,esi
mov edx,edi
call dword ptr ds:[0BA2DA20]; System.Linq.Enumerable.TryGetElement[[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1, Int32, Int32 ByRef)
test eax,eax
je short M01_L02
mov eax,[ebp-10]
lea esp,[ebp-8]
pop esi
pop edi
pop ebp
ret
M01_L02:
mov ecx,6
call dword ptr ds:[0B015E28]
int 3
M01_L03:
mov ecx,10
call dword ptr ds:[0B015E10]
int 3
; Total bytes of code 146
```
#### System.Linq.Tests.Perf_Enumerable.TakeLastHalf(input: List)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 792.1205841470029 > 765.208855202714.
IsChangePoint: Marked as a change because one of 1/13/2023 4:37:08 PM, 1/22/2023 11:22:03 PM, 1/27/2023 7:12:54 PM, 2/9/2023 4:10:34 PM, 3/6/2023 11:14:52 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
IsRegressionStdDev: Marked as regression because -26.12702449089223 (T) = (0 -790.6412651029751) / Math.Sqrt((103.55121034321009 / (24)) + (64.35268733103771 / (35))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (35) - 2, .025) and -0.08929102513316257 = (725.831065216315 - 790.6412651029751) / 725.831065216315 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```### Baseline Jit Disasm
```assembly
; System.Linq.Tests.Perf_Enumerable.TakeLastHalf(System.Linq.Tests.LinqTestData)
push ebp
mov ebp,esp
push edi
push esi
push ebx
mov esi,ecx
mov edi,[edx+4]
test edi,edi
je short M00_L00
mov ecx,offset MT_System.Linq.Enumerable+d__278`1[[System.Int32, System.Private.CoreLib]]
call CORINFO_HELP_NEWSFAST
mov ebx,eax
mov dword ptr [ebx+14],0FFFFFFFE
call CORINFO_HELP_GETCURRENTMANAGEDTHREADID
mov [ebx+1C],eax
lea edx,[ebx+8]
call CORINFO_HELP_ASSIGN_REF_EDI
mov byte ptr [ebx+35],1
mov dword ptr [ebx+24],32
mov byte ptr [ebx+37],1
xor edx,edx
mov [ebx+2C],edx
mov edx,[esi+4]
mov ecx,ebx
call dword ptr ds:[0B57DA80]; BenchmarkDotNet.Engines.ConsumerExtensions.Consume[[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1, BenchmarkDotNet.Engines.Consumer)
pop ebx
pop esi
pop edi
pop ebp
ret
M00_L00:
mov ecx,10
call dword ptr ds:[0AB37E10]
int 3
; Total bytes of code 98
```
```assembly
; BenchmarkDotNet.Engines.ConsumerExtensions.Consume[[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1, BenchmarkDotNet.Engines.Consumer)
push ebp
mov ebp,esp
push esi
sub esp,18
xor eax,eax
mov [ebp-18],eax
mov [ebp-14],eax
mov [ebp-10],eax
mov [ebp-0C],eax
mov esi,edx
call dword ptr ds:[2F602AC]
mov ecx,eax
mov [ebp-1C],ecx
call dword ptr ds:[2F602B0]
test eax,eax
je short M01_L01
M01_L00:
mov ecx,[ebp-1C]
call dword ptr ds:[2F602B4]
mov [esi+24],eax
mov ecx,[ebp-1C]
call dword ptr ds:[2F602B0]
test eax,eax
jne short M01_L00
M01_L01:
mov ecx,[ebp-1C]
call dword ptr ds:[2F602B8]
jmp short M01_L03
cmp dword ptr [ebp-1C],0
je short M01_L02
mov ecx,[ebp-1C]
call dword ptr ds:[2F602B8]
M01_L02:
pop eax
jmp eax
M01_L03:
lea esp,[ebp-4]
pop esi
pop ebp
ret
; Total bytes of code 104
```
### Compare Jit Disasm
```assembly
; System.Linq.Tests.Perf_Enumerable.TakeLastHalf(System.Linq.Tests.LinqTestData)
push ebp
mov ebp,esp
push edi
push esi
push ebx
mov esi,ecx
mov edi,[edx+4]
test edi,edi
je short M00_L00
mov ecx,offset MT_System.Linq.Enumerable+d__278`1[[System.Int32, System.Private.CoreLib]]
call CORINFO_HELP_NEWSFAST
mov ebx,eax
mov dword ptr [ebx+14],0FFFFFFFE
call CORINFO_HELP_GETCURRENTMANAGEDTHREADID
mov [ebx+1C],eax
lea edx,[ebx+8]
call CORINFO_HELP_ASSIGN_REF_EDI
mov byte ptr [ebx+35],1
mov dword ptr [ebx+24],32
mov byte ptr [ebx+37],1
xor edx,edx
mov [ebx+2C],edx
mov edx,[esi+4]
mov ecx,ebx
call dword ptr ds:[0B9FDA80]; BenchmarkDotNet.Engines.ConsumerExtensions.Consume[[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1, BenchmarkDotNet.Engines.Consumer)
pop ebx
pop esi
pop edi
pop ebp
ret
M00_L00:
mov ecx,10
call dword ptr ds:[0AFE5E10]
int 3
; Total bytes of code 98
```
```assembly
; BenchmarkDotNet.Engines.ConsumerExtensions.Consume[[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1, BenchmarkDotNet.Engines.Consumer)
push ebp
mov ebp,esp
push esi
sub esp,18
xor eax,eax
mov [ebp-18],eax
mov [ebp-14],eax
mov [ebp-10],eax
mov [ebp-0C],eax
mov esi,edx
call dword ptr ds:[34402A8]
mov ecx,eax
mov [ebp-1C],ecx
call dword ptr ds:[34402AC]
test eax,eax
je short M01_L01
M01_L00:
mov ecx,[ebp-1C]
call dword ptr ds:[34402B0]
mov [esi+24],eax
mov ecx,[ebp-1C]
call dword ptr ds:[34402AC]
test eax,eax
jne short M01_L00
M01_L01:
mov ecx,[ebp-1C]
call dword ptr ds:[34402B4]
jmp short M01_L03
cmp dword ptr [ebp-1C],0
je short M01_L02
mov ecx,[ebp-1C]
call dword ptr ds:[34402B4]
M01_L02:
pop eax
jmp eax
M01_L03:
lea esp,[ebp-4]
pop esi
pop ebp
ret
; Total bytes of code 104
```
#### System.Linq.Tests.Perf_Enumerable.ToArray(input: IEnumerable)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 847.0167017436025 > 800.81239036007.
IsChangePoint: Marked as a change because one of 1/13/2023 4:37:08 PM, 2/13/2023 6:54:14 PM, 3/6/2023 11:14:52 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
IsRegressionStdDev: Marked as regression because -52.66728328926339 (T) = (0 -849.2849475336598) / Math.Sqrt((24.36431107521769 / (24)) + (54.38219554814983 / (35))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (35) - 2, .025) and -0.11036507722874557 = (764.8700098289377 - 849.2849475336598) / 764.8700098289377 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```### Baseline Jit Disasm
```assembly
; System.Linq.Tests.Perf_Enumerable.ToArray(System.Linq.Tests.LinqTestData)
mov ecx,[edx+4]
call dword ptr ds:[0ACFB120]; System.Linq.Enumerable.ToArray[[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1)
ret
; Total bytes of code 10
```
```assembly
; System.Linq.Enumerable.ToArray[[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1)
push ebp
mov ebp,esp
push esi
mov esi,ecx
test esi,esi
je short M01_L01
mov edx,esi
mov ecx,offset MT_System.Linq.IIListProvider`1[[System.Int32, System.Private.CoreLib]]
call dword ptr ds:[526B810]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfInterface(Void*, System.Object)
test eax,eax
jne short M01_L00
mov ecx,esi
call dword ptr ds:[0ACFB9D8]; System.Collections.Generic.EnumerableHelpers.ToArray[[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1)
pop esi
pop ebp
ret
M01_L00:
mov ecx,eax
call dword ptr ds:[2FC02F4]
pop esi
pop ebp
ret
M01_L01:
mov ecx,10
call dword ptr ds:[0AB87E10]
int 3
; Total bytes of code 61
```
### Compare Jit Disasm
```assembly
; System.Linq.Tests.Perf_Enumerable.ToArray(System.Linq.Tests.LinqTestData)
mov ecx,[edx+4]
call dword ptr ds:[0A899120]; System.Linq.Enumerable.ToArray[[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1)
ret
; Total bytes of code 10
```
```assembly
; System.Linq.Enumerable.ToArray[[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1)
push ebp
mov ebp,esp
push esi
mov esi,ecx
test esi,esi
je short M01_L01
mov edx,esi
mov ecx,offset MT_System.Linq.IIListProvider`1[[System.Int32, System.Private.CoreLib]]
call dword ptr ds:[7C8B810]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfInterface(Void*, System.Object)
test eax,eax
jne short M01_L00
mov ecx,esi
call dword ptr ds:[0A8999D8]; System.Collections.Generic.EnumerableHelpers.ToArray[[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1)
pop esi
pop ebp
ret
M01_L00:
mov ecx,eax
call dword ptr ds:[0D502F0]
pop esi
pop ebp
ret
M01_L01:
mov ecx,10
call dword ptr ds:[0A445E10]
int 3
; Total bytes of code 61
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x86 |
|---|---|
| OS | Windows 10.0.18362 |
| Baseline | 6123cb00bbec8ae3500c970890f5b0efcf7950e8 |
| Compare | ffbcb8336ac67496b0565112f663f74fda6cac34 |
| Diff | Diff |
Regressions in System.Numerics.Tests.Perf_VectorOf<Double>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [GetHashCodeBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Numerics.Tests.Perf_VectorOf(Double).GetHashCodeBenchmark.html>) | 21.27 ns | 23.32 ns | 1.10 | 0.02 | False |
_1.png>)
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf<Double>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Numerics.Tests.Perf_VectorOf<Double>.GetHashCodeBenchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 23.319995047137127 > 22.341660796825142.
IsChangePoint: Marked as a change because one of 1/10/2023 7:48:18 AM, 2/24/2023 9:01:57 AM, 3/6/2023 11:14:52 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
IsRegressionStdDev: Marked as regression because -36.73484573605478 (T) = (0 -23.40419434121898) / Math.Sqrt((0.057530083563129976 / (24)) + (0.035533467685909315 / (35))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (35) - 2, .025) and -0.10094263766685839 = (21.25832313190963 - 23.40419434121898) / 21.25832313190963 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x86 |
|---|---|
| OS | Windows 10.0.18362 |
| Baseline | 6123cb00bbec8ae3500c970890f5b0efcf7950e8 |
| Compare | ffbcb8336ac67496b0565112f663f74fda6cac34 |
| Diff | Diff |
Regressions in System.Collections.ContainsTrue<Int32>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [Span - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.ContainsTrue(Int32).Span(Size%3a%20512).html>) | 16.41 μs | 17.54 μs | 1.07 | 0.12 | False | |||||
| [HashSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.ContainsTrue(Int32).HashSet(Size%3a%20512).html>) | 4.15 μs | 6.55 μs | 1.58 | 0.16 | False |
_1.png>)
_2.png>)
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsTrue<Int32>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Collections.ContainsTrue<Int32>.Span(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 17.53546739947388 > 17.20258114060867.
IsChangePoint: Marked as a change because one of 2/9/2023 4:27:10 AM, 2/14/2023 5:47:38 PM, 2/20/2023 9:09:49 AM, 3/6/2023 11:14:52 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
IsRegressionStdDev: Marked as regression because -67.03766515855008 (T) = (0 -17575.041771205968) / Math.Sqrt((6572.556686996529 / (24)) + (2158.844156017105 / (35))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (35) - 2, .025) and -0.07511899500838262 = (16347.06655989176 - 17575.041771205968) / 16347.06655989176 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Collections.ContainsTrue<Int32>.HashSet(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 6.550494242173494 > 4.428796102994272.
IsChangePoint: Marked as a change because one of 1/3/2023 6:29:42 AM, 1/11/2023 2:37:52 AM, 2/13/2023 6:54:14 PM, 3/13/2023 12:04:12 PM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
IsRegressionStdDev: Marked as regression because -20.994485648491388 (T) = (0 -6652.723566056071) / Math.Sqrt((361551.5215622887 / (55)) + (16064.502069054206 / (4))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (55) + (4) - 2, .025) and -0.48093342411597445 = (4492.250264408297 - 6652.723566056071) / 4492.250264408297 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x86 |
|---|---|
| OS | Windows 10.0.18362 |
| Baseline | 6123cb00bbec8ae3500c970890f5b0efcf7950e8 |
| Compare | ffbcb8336ac67496b0565112f663f74fda6cac34 |
| Diff | Diff |
Regressions in PerfLabTests.DelegatePerf
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [DelegateInvoke - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/PerfLabTests.DelegatePerf.DelegateInvoke.html>) | 438.41 μs | 498.88 μs | 1.14 | 0.03 | False | Trace | Trace |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'PerfLabTests.DelegatePerf*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### PerfLabTests.DelegatePerf.DelegateInvoke
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 498.87991071428576 > 458.39878559027784.
IsChangePoint: Marked as a change because one of 1/5/2023 11:35:29 PM, 1/30/2023 9:42:46 PM, 2/13/2023 6:54:14 PM, 2/16/2023 9:36:08 AM, 2/20/2023 10:31:48 AM, 3/6/2023 11:14:52 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
IsRegressionStdDev: Marked as regression because -289.3214041940763 (T) = (0 -499194.14573317306) / Math.Sqrt((768519.1176506117 / (24)) + (490410.7507173291 / (35))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (35) - 2, .025) and -0.14200941163207 = (437119.11710058857 - 499194.14573317306) / 437119.11710058857 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```### Baseline Jit Disasm
```assembly
; PerfLabTests.DelegatePerf.DelegateInvoke()
push ebp
mov ebp,esp
push edi
push esi
push ebx
sub esp,10
mov esi,[ecx+4]
mov edi,[ecx+8]
xor ebx,ebx
xor eax,eax
mov [ebp-1C],eax
xor edx,edx
mov [ebp-18],edx
mov ecx,0A625CF8
mov edx,7D
call CORINFO_HELP_GETSHARED_NONGCSTATIC_BASE
cmp dword ptr ds:[0A6262C4],0
mov edx,[ebp-1C]
jle short M00_L01
M00_L00:
push 0
push 64
push 0
push 64
mov ecx,[esi+4]
mov edx,edi
call dword ptr [esi+0C]
mov ebx,eax
mov eax,[ebp-18]
inc eax
cmp eax,ds:[0A6262C4]
mov [ebp-18],eax
jl short M00_L00
M00_L01:
mov eax,ebx
lea esp,[ebp-0C]
pop ebx
pop esi
pop edi
pop ebp
ret
; Total bytes of code 97
```
### Compare Jit Disasm
```assembly
; PerfLabTests.DelegatePerf.DelegateInvoke()
push ebp
mov ebp,esp
push edi
push esi
push ebx
sub esp,10
mov esi,[ecx+4]
mov edi,[ecx+8]
xor ebx,ebx
xor eax,eax
mov [ebp-1C],eax
xor edx,edx
mov [ebp-18],edx
mov ecx,0A6661F8
mov edx,7D
call CORINFO_HELP_GETSHARED_NONGCSTATIC_BASE
cmp dword ptr ds:[0A6667C4],0
mov edx,[ebp-1C]
jle short M00_L01
M00_L00:
push 0
push 64
push 0
push 64
mov ecx,[esi+4]
mov edx,edi
call dword ptr [esi+0C]
mov ebx,eax
mov eax,[ebp-18]
inc eax
cmp eax,ds:[0A6667C4]
mov [ebp-18],eax
jl short M00_L00
M00_L01:
mov eax,ebx
lea esp,[ebp-0C]
pop ebx
pop esi
pop edi
pop ebp
ret
; Total bytes of code 97
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x86 |
|---|---|
| OS | Windows 10.0.18362 |
| Baseline | 6123cb00bbec8ae3500c970890f5b0efcf7950e8 |
| Compare | ffbcb8336ac67496b0565112f663f74fda6cac34 |
| Diff | Diff |
Regressions in System.Collections.ContainsFalse<Int32>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [SortedSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.ContainsFalse(Int32).SortedSet(Size%3a%20512).html>) | 35.80 μs | 40.06 μs | 1.12 | 0.02 | False |
_1.png>)
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsFalse<Int32>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Collections.ContainsFalse<Int32>.SortedSet(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 40.05804707379135 > 37.545262621073675.
IsChangePoint: Marked as a change because one of 2/9/2023 4:27:10 AM, 3/6/2023 11:14:52 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
IsRegressionStdDev: Marked as regression because -39.811474428139846 (T) = (0 -39560.49874552842) / Math.Sqrt((27989.27689104861 / (24)) + (266018.30209685606 / (35))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (35) - 2, .025) and -0.10402680342865663 = (35832.91512730457 - 39560.49874552842) / 35832.91512730457 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x86 |
|---|---|
| OS | Windows 10.0.18362 |
| Baseline | 6123cb00bbec8ae3500c970890f5b0efcf7950e8 |
| Compare | ffbcb8336ac67496b0565112f663f74fda6cac34 |
| Diff | Diff |
Regressions in System.Collections.AddGivenSize<Int32>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.AddGivenSize(Int32).Dictionary(Size%3a%20512).html>) | 8.10 μs | 8.95 μs | 1.10 | 0.07 | False |
_1.png>)
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.AddGivenSize<Int32>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Collections.AddGivenSize<Int32>.Dictionary(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 8.94649799885649 > 8.487165399912895.
IsChangePoint: Marked as a change because one of 1/20/2023 8:02:54 AM, 1/30/2023 9:42:46 PM, 2/9/2023 4:27:10 AM, 2/16/2023 6:27:39 AM, 3/6/2023 11:14:52 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
IsRegressionStdDev: Marked as regression because -15.988046645697532 (T) = (0 -8899.260624905815) / Math.Sqrt((24952.46402797539 / (24)) + (39421.15835221591 / (35))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (35) - 2, .025) and -0.09124141903551423 = (8155.171229452931 - 8899.260624905815) / 8155.171229452931 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
Regressions in System.Collections.CreateAddAndClear<Int32>
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
Baseline Compare
Run Information
Regressions in System.Collections.IterateForEach<String>
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
Baseline Compare
Run Information
Regressions in System.Collections.IterateForEachNonGeneric<Int32>
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
Baseline Compare
Run Information
Regressions in PerfLabTests.CastingPerf2.CastingPerf
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
Baseline Compare
Run Information
Regressions in Microsoft.Extensions.Primitives.StringSegmentBenchmark
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
Baseline Compare
Run Information
Regressions in System.Collections.IterateForEach<Int32>
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
Baseline Compare
Run Information
Regressions in System.Numerics.Tests.Perf_BitOperations
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
Baseline Compare