performanceautofiler[bot]
commented
2 years ago Run Information
| Architecture | x64 |
|---|---|
| OS | ubuntu 18.04 |
| Baseline | a1f1e7cc5e856915c61b80cf8864dbe6531bd639 |
| Compare | bf7cdc5825f94cf67d69ab5f0ea0c2dc9490861b |
| Diff | Diff |
Improvements in System.Tests.Perf_Array
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [IndexOfShort - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompliationMode=wasm_RunKind=micro/System.Tests.Perf_Array.IndexOfShort.html>) | 60.26 ns | 53.28 ns | 0.88 | 0.34 | False |
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Array*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Tests.Perf_Array.IndexOfShort
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 53.28472804437214 < 56.0234917630151.
IsChangePoint: Marked as a change because one of 6/8/2022 12:55:36 PM, 6/24/2022 10:40:04 AM, 6/29/2022 4:06:39 AM, 7/19/2022 10:33:10 AM, 7/26/2022 6:20:16 AM falls between 7/17/2022 2:02:19 PM and 7/26/2022 6:20:16 AM.
IsImprovementStdDev: Marked as improvement because 15.488237608607742 (T) = (0 -52.32451531960063) / Math.Sqrt((15.367099991895552 / (299)) + (1.2099383947460562 / (43))) is greater than 1.9669657340893643 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (43) - 2, .975) and 0.07704610871581474 = (56.692447817514505 - 52.32451531960063) / 56.692447817514505 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x64 |
|---|---|
| OS | ubuntu 18.04 |
| Baseline | a1f1e7cc5e856915c61b80cf8864dbe6531bd639 |
| Compare | bf7cdc5825f94cf67d69ab5f0ea0c2dc9490861b |
| Diff | Diff |
Improvements in System.MathBenchmarks.Single
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [ILogB - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompliationMode=wasm_RunKind=micro/System.MathBenchmarks.Single.ILogB.html>) | 28.26 μs | 25.89 μs | 0.92 | 0.17 | False |
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.MathBenchmarks.Single*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.MathBenchmarks.Single.ILogB
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 25.88983413404683 < 26.855462820034656.
IsChangePoint: Marked as a change because one of 6/17/2022 9:56:33 AM, 7/7/2022 8:07:51 AM, 7/19/2022 10:33:10 AM, 7/26/2022 6:20:16 AM falls between 7/17/2022 2:02:19 PM and 7/26/2022 6:20:16 AM.
IsImprovementStdDev: Marked as improvement because 38.811283823428475 (T) = (0 -25459.166735721064) / Math.Sqrt((1822623.9836549847 / (299)) + (228874.9083914411 / (44))) is greater than 1.9669451293272056 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (44) - 2, .975) and 0.1394393169226172 = (29584.394495782166 - 25459.166735721064) / 29584.394495782166 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x64 |
|---|---|
| OS | ubuntu 18.04 |
| Baseline | a1f1e7cc5e856915c61b80cf8864dbe6531bd639 |
| Compare | bf7cdc5825f94cf67d69ab5f0ea0c2dc9490861b |
| Diff | Diff |
Improvements in System.Tests.Perf_String
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [ToLower - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompliationMode=wasm_RunKind=micro/System.Tests.Perf_String.ToLower(s%3a%20%22test%22).html>) | 62.68 ns | 54.91 ns | 0.88 | 0.51 | False |
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_String*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Tests.Perf_String.ToLower(s: "test")
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 54.90625068962194 < 55.850833189174864.
IsChangePoint: Marked as a change because one of 7/7/2022 10:54:04 PM, 7/19/2022 10:33:10 AM, 7/26/2022 6:20:16 AM falls between 7/17/2022 2:02:19 PM and 7/26/2022 6:20:16 AM.
IsImprovementStdDev: Marked as improvement because 8.788547186740681 (T) = (0 -52.73361474729918) / Math.Sqrt((15.158420660747062 / (299)) + (6.394235953358294 / (44))) is greater than 1.9669451293272056 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (44) - 2, .975) and 0.06871668935696537 = (56.6246749454659 - 52.73361474729918) / 56.6246749454659 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x64 |
|---|---|
| OS | ubuntu 18.04 |
| Baseline | a1f1e7cc5e856915c61b80cf8864dbe6531bd639 |
| Compare | bf7cdc5825f94cf67d69ab5f0ea0c2dc9490861b |
| Diff | Diff |
Improvements in System.IO.Tests.Perf_RandomAccess
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [Write - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompliationMode=wasm_RunKind=micro/System.IO.Tests.Perf_RandomAccess.Write(fileSize%3a%201048576%2c%20bufferSize%3a%204096%2c%20options%3a%20Asynchronous).html>) | 810.89 μs | 723.80 μs | 0.89 | 0.09 | False | |||||
| [WriteGather - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompliationMode=wasm_RunKind=micro/System.IO.Tests.Perf_RandomAccess.WriteGather(fileSize%3a%201048576%2c%20buffersSize%3a%2016384%2c%20options%3a%20Asynchronous).html>) | 957.03 μs | 841.86 μs | 0.88 | 0.06 | False | |||||
| [WriteGather - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompliationMode=wasm_RunKind=micro/System.IO.Tests.Perf_RandomAccess.WriteGather(fileSize%3a%201048576%2c%20buffersSize%3a%2016384%2c%20options%3a%20None).html>) | 981.96 μs | 846.57 μs | 0.86 | 0.05 | False | |||||
| [Write - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompliationMode=wasm_RunKind=micro/System.IO.Tests.Perf_RandomAccess.Write(fileSize%3a%201048576%2c%20bufferSize%3a%204096%2c%20options%3a%20None).html>) | 795.82 μs | 711.93 μs | 0.89 | 0.06 | False |
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Tests.Perf_RandomAccess*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.IO.Tests.Perf_RandomAccess.Write(fileSize: 1048576, bufferSize: 4096, options: Asynchronous)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 723.8004731060604 < 776.1838159259099.
IsChangePoint: Marked as a change because one of 6/17/2022 9:56:33 AM, 6/22/2022 6:53:40 PM, 7/19/2022 10:33:10 AM, 7/26/2022 6:20:16 AM falls between 7/17/2022 2:02:19 PM and 7/26/2022 6:20:16 AM.
IsImprovementStdDev: Marked as improvement because 37.49204590477035 (T) = (0 -713021.6736189087) / Math.Sqrt((1736124457.9833834 / (299)) + (125143985.66818184 / (44))) is greater than 1.9669451293272056 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (44) - 2, .975) and 0.13393937427986036 = (823293.0264275931 - 713021.6736189087) / 823293.0264275931 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.IO.Tests.Perf_RandomAccess.WriteGather(fileSize: 1048576, buffersSize: 16384, options: Asynchronous)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 841.8572344298245 < 906.3941846997549.
IsChangePoint: Marked as a change because one of 6/17/2022 9:56:33 AM, 6/22/2022 6:53:40 PM, 7/5/2022 3:17:18 PM, 7/19/2022 10:33:10 AM, 7/26/2022 6:20:16 AM falls between 7/17/2022 2:02:19 PM and 7/26/2022 6:20:16 AM.
IsImprovementStdDev: Marked as improvement because 13.572002581944577 (T) = (0 -852360.4278037536) / Math.Sqrt((3534528465.233562 / (299)) + (122460162.61104932 / (44))) is greater than 1.9669451293272056 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (44) - 2, .975) and 0.05735981415421087 = (904226.70346795 - 852360.4278037536) / 904226.70346795 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.IO.Tests.Perf_RandomAccess.WriteGather(fileSize: 1048576, buffersSize: 16384, options: None)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 846.5664427631579 < 913.6682055882352.
IsChangePoint: Marked as a change because one of 6/17/2022 9:56:33 AM, 6/22/2022 6:53:40 PM, 7/5/2022 3:17:18 PM, 7/19/2022 10:33:10 AM, 7/26/2022 6:20:16 AM falls between 7/17/2022 2:02:19 PM and 7/26/2022 6:20:16 AM.
IsImprovementStdDev: Marked as improvement because 13.338427989111045 (T) = (0 -852502.1621449154) / Math.Sqrt((3565585381.994941 / (299)) + (117462544.86285415 / (44))) is greater than 1.9669451293272056 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (44) - 2, .975) and 0.05640179543925086 = (903458.8641907818 - 852502.1621449154) / 903458.8641907818 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.IO.Tests.Perf_RandomAccess.Write(fileSize: 1048576, bufferSize: 4096, options: None)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 711.9312493371212 < 768.6098367447917.
IsChangePoint: Marked as a change because one of 6/17/2022 9:56:33 AM, 6/22/2022 6:53:40 PM, 7/19/2022 10:33:10 AM, 7/26/2022 6:20:16 AM falls between 7/17/2022 2:02:19 PM and 7/26/2022 6:20:16 AM.
IsImprovementStdDev: Marked as improvement because 33.803891228925586 (T) = (0 -705302.5243153312) / Math.Sqrt((2452919802.589953 / (299)) + (183508146.51950067 / (43))) is greater than 1.9669657340893643 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (43) - 2, .975) and 0.14475654570346003 = (824680.4120768874 - 705302.5243153312) / 824680.4120768874 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x64 |
|---|---|
| OS | ubuntu 18.04 |
| Baseline | a1f1e7cc5e856915c61b80cf8864dbe6531bd639 |
| Compare | bf7cdc5825f94cf67d69ab5f0ea0c2dc9490861b |
| Diff | Diff |
Improvements in PerfLabTests.DelegatePerf
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [MulticastDelegateCombineInvoke - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompliationMode=wasm_RunKind=micro/PerfLabTests.DelegatePerf.MulticastDelegateCombineInvoke.html>) | 402.49 ms | 240.82 ms | 0.60 | 0.18 | False |
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'PerfLabTests.DelegatePerf*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### PerfLabTests.DelegatePerf.MulticastDelegateCombineInvoke
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 240.8190002142857 < 326.31763067809527.
IsChangePoint: Marked as a change because one of 6/17/2022 9:56:33 AM, 7/19/2022 10:33:10 AM, 7/26/2022 6:20:16 AM falls between 7/17/2022 2:02:19 PM and 7/26/2022 6:20:16 AM.
IsImprovementStdDev: Marked as improvement because 16.52714410196644 (T) = (0 -244673504.95057496) / Math.Sqrt((2620578179332145 / (299)) + (160869181017595.47 / (43))) is greater than 1.9669657340893643 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (43) - 2, .975) and 0.19281347251241937 = (303118915.66393805 - 244673504.95057496) / 303118915.66393805 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x64 |
|---|---|
| OS | ubuntu 18.04 |
| Baseline | a1f1e7cc5e856915c61b80cf8864dbe6531bd639 |
| Compare | bf7cdc5825f94cf67d69ab5f0ea0c2dc9490861b |
| Diff | Diff |
Improvements in System.Numerics.Tests.Perf_Vector4
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [EqualsBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompliationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_Vector4.EqualsBenchmark.html>) | 8.58 ns | 7.31 ns | 0.85 | 0.59 | False | |||||
| [TransformVector3ByMatrix4x4Benchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompliationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_Vector4.TransformVector3ByMatrix4x4Benchmark.html>) | 21.96 ns | 20.61 ns | 0.94 | 0.51 | False |
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_Vector4*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Numerics.Tests.Perf_Vector4.EqualsBenchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 7.3111369065007255 < 8.567678068642106.
IsChangePoint: Marked as a change because one of 7/5/2022 10:15:28 AM, 7/19/2022 10:33:10 AM, 7/26/2022 6:20:16 AM falls between 7/17/2022 2:02:19 PM and 7/26/2022 6:20:16 AM.
IsImprovementStdDev: Marked as improvement because 4.578748406002887 (T) = (0 -7.934228420123285) / Math.Sqrt((2.31638892814451 / (299)) + (1.1065790851905795 / (44))) is greater than 1.9669451293272056 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (44) - 2, .975) and 0.0947514217939052 = (8.76469580968171 - 7.934228420123285) / 8.76469580968171 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Vector4.TransformVector3ByMatrix4x4Benchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 20.607928328153317 < 20.771896719929952.
IsChangePoint: Marked as a change because one of 7/19/2022 5:42:31 PM, 7/26/2022 6:20:16 AM falls between 7/17/2022 2:02:19 PM and 7/26/2022 6:20:16 AM.
IsImprovementStdDev: Marked as improvement because 11.303507929741128 (T) = (0 -20.566004984285982) / Math.Sqrt((5.184223912500965 / (299)) + (0.7342150123187052 / (42))) is greater than 1.9669864608404333 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (42) - 2, .975) and 0.09301963830504295 = (22.67524838779575 - 20.566004984285982) / 22.67524838779575 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x64 |
|---|---|
| OS | ubuntu 18.04 |
| Baseline | a1f1e7cc5e856915c61b80cf8864dbe6531bd639 |
| Compare | bf7cdc5825f94cf67d69ab5f0ea0c2dc9490861b |
| Diff | Diff |
Improvements in Microsoft.Extensions.Logging.LoggingOverhead
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [NoArguments_DefineMessage_FilteredByLevel - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompliationMode=wasm_RunKind=micro/Microsoft.Extensions.Logging.LoggingOverhead.NoArguments_DefineMessage_FilteredByLevel.html>) | 45.75 ns | 38.59 ns | 0.84 | 0.72 | False |
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Microsoft.Extensions.Logging.LoggingOverhead*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### Microsoft.Extensions.Logging.LoggingOverhead.NoArguments_DefineMessage_FilteredByLevel
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 38.587773950534434 < 39.195892296146646.
IsChangePoint: Marked as a change because one of 6/22/2022 10:05:16 PM, 7/19/2022 10:33:10 AM, 7/26/2022 6:20:16 AM falls between 7/17/2022 2:02:19 PM and 7/26/2022 6:20:16 AM.
IsImprovementStdDev: Marked as improvement because 5.474719694439799 (T) = (0 -33.676570892352515) / Math.Sqrt((20.31272940115969 / (299)) + (11.547080757506441 / (43))) is greater than 1.9669657340893643 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (43) - 2, .975) and 0.08617326545369904 = (36.852249577784946 - 33.676570892352515) / 36.852249577784946 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x64 |
|---|---|
| OS | ubuntu 18.04 |
| Baseline | a1f1e7cc5e856915c61b80cf8864dbe6531bd639 |
| Compare | bf7cdc5825f94cf67d69ab5f0ea0c2dc9490861b |
| Diff | Diff |
Improvements in PerfLabTests.GetMember
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [GetMethod12 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompliationMode=wasm_RunKind=micro/PerfLabTests.GetMember.GetMethod12.html>) | 71.79 ms | 66.19 ms | 0.92 | 0.05 | False |
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'PerfLabTests.GetMember*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### PerfLabTests.GetMember.GetMethod12
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 66.18758919642858 < 68.00474455166666.
IsChangePoint: Marked as a change because one of 6/17/2022 9:56:33 AM, 7/19/2022 10:33:10 AM, 7/26/2022 6:20:16 AM falls between 7/17/2022 2:02:19 PM and 7/26/2022 6:20:16 AM.
IsImprovementStdDev: Marked as improvement because 15.499480486647174 (T) = (0 -66412563.73314083) / Math.Sqrt((9241350945008.982 / (299)) + (1031143209306.6697 / (44))) is greater than 1.9669451293272056 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (44) - 2, .975) and 0.051597628196204996 = (70025725.05889961 - 66412563.73314083) / 70025725.05889961 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x64 |
|---|---|
| OS | ubuntu 18.04 |
| Baseline | a1f1e7cc5e856915c61b80cf8864dbe6531bd639 |
| Compare | bf7cdc5825f94cf67d69ab5f0ea0c2dc9490861b |
| Diff | Diff |
Improvements in LinqBenchmarks
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [Where00ForX - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompliationMode=wasm_RunKind=micro/LinqBenchmarks.Where00ForX.html>) | 1.66 secs | 1.52 secs | 0.92 | 0.23 | False |
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'LinqBenchmarks*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### LinqBenchmarks.Where00ForX
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.522007 < 1.5487913990976923.
IsChangePoint: Marked as a change because one of 7/19/2022 10:33:10 AM, 7/26/2022 6:20:16 AM falls between 7/17/2022 2:02:19 PM and 7/26/2022 6:20:16 AM.
IsImprovementStdDev: Marked as improvement because 7.788811386811647 (T) = (0 -1554375621.618028) / Math.Sqrt((5866638333461114 / (299)) + (6249929898478657 / (44))) is greater than 1.9669451293272056 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (44) - 2, .975) and 0.05989612000996643 = (1653408367.6311457 - 1554375621.618028) / 1653408367.6311457 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x64 |
|---|---|
| OS | ubuntu 18.04 |
| Baseline | a1f1e7cc5e856915c61b80cf8864dbe6531bd639 |
| Compare | bf7cdc5825f94cf67d69ab5f0ea0c2dc9490861b |
| Diff | Diff |
Improvements in JetStream.TimeSeriesSegmentation
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [MaximizeSchwarzCriterion - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompliationMode=wasm_RunKind=micro/JetStream.TimeSeriesSegmentation.MaximizeSchwarzCriterion.html>) | 139.06 ms | 128.61 ms | 0.92 | 0.05 | False |
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'JetStream.TimeSeriesSegmentation*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### JetStream.TimeSeriesSegmentation.MaximizeSchwarzCriterion
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 128.60689996666667 < 132.14325041553568.
IsChangePoint: Marked as a change because one of 6/24/2022 7:16:38 AM, 6/24/2022 5:01:29 PM, 7/12/2022 7:47:24 PM, 7/19/2022 10:33:10 AM, 7/26/2022 6:20:16 AM falls between 7/17/2022 2:02:19 PM and 7/26/2022 6:20:16 AM.
IsImprovementStdDev: Marked as improvement because 12.16055496838109 (T) = (0 -127097458.97580667) / Math.Sqrt((75218182642310.42 / (299)) + (3014329203407.1396 / (42))) is greater than 1.9669864608404333 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (42) - 2, .975) and 0.05159832259047071 = (134012267.16823353 - 127097458.97580667) / 134012267.16823353 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x64 |
|---|---|
| OS | ubuntu 18.04 |
| Baseline | a1f1e7cc5e856915c61b80cf8864dbe6531bd639 |
| Compare | bf7cdc5825f94cf67d69ab5f0ea0c2dc9490861b |
| Diff | Diff |
Improvements in System.Globalization.Tests.StringSearch
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [LastIndexOf_Word_NotFound - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompliationMode=wasm_RunKind=micro/System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options%3a%20(en-US%2c%20OrdinalIgnoreCase%2c%20False)).html>) | 1.40 μs | 1.11 μs | 0.79 | 0.03 | False |
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Globalization.Tests.StringSearch*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options: (en-US, OrdinalIgnoreCase, False))
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.1067359581877392 < 1.325250359499081.
IsChangePoint: Marked as a change because one of 5/25/2022 12:28:02 PM, 6/14/2022 5:34:25 PM, 7/12/2022 7:47:24 PM, 7/19/2022 10:33:10 AM, 7/26/2022 6:20:16 AM falls between 7/17/2022 2:02:19 PM and 7/26/2022 6:20:16 AM.
IsImprovementStdDev: Marked as improvement because 25.248258607521866 (T) = (0 -1107.9510482807584) / Math.Sqrt((10882.167427917355 / (299)) + (7.327447720867756 / (44))) is greater than 1.9669451293272056 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (44) - 2, .975) and 0.12110480759252992 = (1260.6179415384654 - 1107.9510482807584) / 1260.6179415384654 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
_1.png>)
_2.png>)
_3.png>)
_4.png>)
_5.png>)
_6.png>)
_7.png>)
_1.png>)
Run Information
Improvements in System.IO.Tests.Perf_FileStream
Repro
Run Information
Improvements in System.IO.Tests.Perf_File
Repro
Run Information
Improvements in System.Memory.Constructors<String>
Repro