performanceautofiler[bot]
commented
2 years ago Run Information
| Architecture | x64 |
|---|---|
| OS | ubuntu 18.04 |
| Baseline | 283e351d0406d455a035b651b3d96b0209e73450 |
| Compare | cc9d46546b8e72b34a5f387a5ec9615197d79f1f |
| Diff | Diff |
Improvements in System.Tests.Perf_DateTimeOffset
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [GetUtcNow - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/System.Tests.Perf_DateTimeOffset.GetUtcNow.html>) | 21.41 ns | 16.66 ns | 0.78 | 0.03 | False |
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_DateTimeOffset*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
### Edge Detector Info
[Collection Data]()
#### System.Tests.Perf_DateTimeOffset.GetUtcNow
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 16.656104630407956 < 20.20284831555495.
IsChangePoint: Marked as a change because one of 9/7/2022 8:07:21 PM, 9/13/2022 3:28:55 PM falls between 9/5/2022 12:53:33 AM and 9/13/2022 3:28:55 PM.
IsImprovementStdDev: Marked as improvement because 83.32057030347146 (T) = (0 -16.522379810909158) / Math.Sqrt((0.46361488762233904 / (299)) + (0.04230737338697938 / (29))) is greater than 1.9672675222597202 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (29) - 2, .975) and 0.21669636970356138 = (21.09319958680176 - 16.522379810909158) / 21.09319958680176 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x64 |
|---|---|
| OS | ubuntu 18.04 |
| Baseline | 283e351d0406d455a035b651b3d96b0209e73450 |
| Compare | cc9d46546b8e72b34a5f387a5ec9615197d79f1f |
| Diff | Diff |
Improvements in System.Threading.Tasks.ValueTaskPerfTest
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [CreateAndAwait_FromResult - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/System.Threading.Tasks.ValueTaskPerfTest.CreateAndAwait_FromResult.html>) | 14.72 ns | 11.39 ns | 0.77 | 0.22 | False | |||||
| [Await_FromResult - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/System.Threading.Tasks.ValueTaskPerfTest.Await_FromResult.html>) | 16.58 ns | 11.08 ns | 0.67 | 0.31 | False | |||||
| [CreateAndAwait_FromCompletedValueTaskSource - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/System.Threading.Tasks.ValueTaskPerfTest.CreateAndAwait_FromCompletedValueTaskSource.html>) | 25.47 ns | 18.64 ns | 0.73 | 0.38 | False | |||||
| [Await_FromCompletedTask - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/System.Threading.Tasks.ValueTaskPerfTest.Await_FromCompletedTask.html>) | 24.08 ns | 20.14 ns | 0.84 | 0.30 | False | |||||
| [CreateAndAwait_FromResult_ConfigureAwait - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/System.Threading.Tasks.ValueTaskPerfTest.CreateAndAwait_FromResult_ConfigureAwait.html>) | 14.77 ns | 11.72 ns | 0.79 | 0.33 | False | |||||
| [Await_FromCompletedValueTaskSource - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/System.Threading.Tasks.ValueTaskPerfTest.Await_FromCompletedValueTaskSource.html>) | 56.70 ns | 48.26 ns | 0.85 | 0.42 | False | |||||
| [CreateAndAwait_FromCompletedTask - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/System.Threading.Tasks.ValueTaskPerfTest.CreateAndAwait_FromCompletedTask.html>) | 18.91 ns | 15.45 ns | 0.82 | 0.31 | False |
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Threading.Tasks.ValueTaskPerfTest*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
### Edge Detector Info
[Collection Data]()
#### System.Threading.Tasks.ValueTaskPerfTest.CreateAndAwait_FromResult
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 11.392172509650083 < 13.977757720521835.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/7/2022 8:07:21 PM, 9/13/2022 3:28:55 PM falls between 9/5/2022 12:53:33 AM and 9/13/2022 3:28:55 PM.
IsImprovementStdDev: Marked as improvement because 33.91943841933426 (T) = (0 -11.634560986331577) / Math.Sqrt((0.532033320278278 / (299)) + (0.39087218689667563 / (29))) is greater than 1.9672675222597202 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (29) - 2, .975) and 0.264769110645959 = (15.82436368601633 - 11.634560986331577) / 15.82436368601633 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Threading.Tasks.ValueTaskPerfTest.Await_FromResult
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 11.075122444533338 < 13.987295162072355.
IsChangePoint: Marked as a change because one of 9/7/2022 8:07:21 PM, 9/13/2022 3:28:55 PM falls between 9/5/2022 12:53:33 AM and 9/13/2022 3:28:55 PM.
IsImprovementStdDev: Marked as improvement because 21.530487502825775 (T) = (0 -11.818200701600652) / Math.Sqrt((0.5711557156633587 / (299)) + (0.6423848761585714 / (29))) is greater than 1.9672675222597202 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (29) - 2, .975) and 0.220330134666363 = (15.157954958979206 - 11.818200701600652) / 15.157954958979206 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Threading.Tasks.ValueTaskPerfTest.CreateAndAwait_FromCompletedValueTaskSource
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 18.643768390156218 < 23.759094191449975.
IsChangePoint: Marked as a change because one of 9/8/2022 1:37:01 AM, 9/13/2022 3:28:55 PM falls between 9/5/2022 12:53:33 AM and 9/13/2022 3:28:55 PM.
IsImprovementStdDev: Marked as improvement because 25.926717571320523 (T) = (0 -19.476871129947394) / Math.Sqrt((2.4884155999924604 / (299)) + (1.4532499407447308 / (28))) is greater than 1.967290077109849 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (28) - 2, .975) and 0.24623508875559474 = (25.83945052283297 - 19.476871129947394) / 25.83945052283297 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Threading.Tasks.ValueTaskPerfTest.Await_FromCompletedTask
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 20.144068764508756 < 22.829873971927352.
IsChangePoint: Marked as a change because one of 9/7/2022 8:07:21 PM, 9/13/2022 3:28:55 PM falls between 9/5/2022 12:53:33 AM and 9/13/2022 3:28:55 PM.
IsImprovementStdDev: Marked as improvement because 15.406891608997972 (T) = (0 -21.17940784073205) / Math.Sqrt((0.8631842163204586 / (299)) + (1.324098949648062 / (29))) is greater than 1.9672675222597202 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (29) - 2, .975) and 0.13813806010438198 = (24.57401453798637 - 21.17940784073205) / 24.57401453798637 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Threading.Tasks.ValueTaskPerfTest.CreateAndAwait_FromResult_ConfigureAwait
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 11.72479763486277 < 13.987589675117176.
IsChangePoint: Marked as a change because one of 9/7/2022 8:07:21 PM, 9/13/2022 3:28:55 PM falls between 9/5/2022 12:53:33 AM and 9/13/2022 3:28:55 PM.
IsImprovementStdDev: Marked as improvement because 39.16146519982152 (T) = (0 -11.615408623473444) / Math.Sqrt((0.7575137104424119 / (299)) + (0.27863335723761 / (29))) is greater than 1.9672675222597202 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (29) - 2, .975) and 0.2708724292272014 = (15.930557407344137 - 11.615408623473444) / 15.930557407344137 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Threading.Tasks.ValueTaskPerfTest.Await_FromCompletedValueTaskSource
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 48.26174363136406 < 53.61651113278144.
IsChangePoint: Marked as a change because one of 8/30/2022 9:25:07 PM, 9/7/2022 8:46:47 AM, 9/13/2022 3:28:55 PM falls between 9/5/2022 12:53:33 AM and 9/13/2022 3:28:55 PM.
IsImprovementStdDev: Marked as improvement because 12.732441308459572 (T) = (0 -45.41533197965417) / Math.Sqrt((10.741092717803115 / (299)) + (4.934333096062273 / (32))) is greater than 1.9672006833568965 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (32) - 2, .975) and 0.10892751736313912 = (50.96704573937819 - 45.41533197965417) / 50.96704573937819 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Threading.Tasks.ValueTaskPerfTest.CreateAndAwait_FromCompletedTask
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 15.4457528953906 < 17.144418272655777.
IsChangePoint: Marked as a change because one of 9/7/2022 8:07:21 PM, 9/13/2022 3:28:55 PM falls between 9/5/2022 12:53:33 AM and 9/13/2022 3:28:55 PM.
IsImprovementStdDev: Marked as improvement because 26.010912527242194 (T) = (0 -15.617051854735294) / Math.Sqrt((0.753420192989985 / (299)) + (0.45073465383578254 / (29))) is greater than 1.9672675222597202 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (29) - 2, .975) and 0.18290187871583474 = (19.112823108920225 - 15.617051854735294) / 19.112823108920225 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x64 |
|---|---|
| OS | ubuntu 18.04 |
| Baseline | 283e351d0406d455a035b651b3d96b0209e73450 |
| Compare | cc9d46546b8e72b34a5f387a5ec9615197d79f1f |
| Diff | Diff |
Improvements in System.Tests.Perf_Decimal
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [Subtract - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/System.Tests.Perf_Decimal.Subtract.html>) | 6.48 ns | 5.22 ns | 0.81 | 0.03 | False | |||||
| [Add - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/System.Tests.Perf_Decimal.Add.html>) | 6.64 ns | 5.18 ns | 0.78 | 0.03 | False | |||||
| [Multiply - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/System.Tests.Perf_Decimal.Multiply.html>) | 6.23 ns | 4.76 ns | 0.77 | 0.05 | False |
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Decimal*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
### Edge Detector Info
[Collection Data]()
#### System.Tests.Perf_Decimal.Subtract
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 5.223211619089862 < 6.1914971711263.
IsChangePoint: Marked as a change because one of 7/18/2022 6:27:40 PM, 7/19/2022 5:40:44 AM, 9/7/2022 8:07:21 PM, 9/13/2022 3:28:55 PM falls between 9/5/2022 12:53:33 AM and 9/13/2022 3:28:55 PM.
IsImprovementStdDev: Marked as improvement because 41.91311197718798 (T) = (0 -5.165184591808604) / Math.Sqrt((0.37663472011465043 / (299)) + (0.00015054383049833948 / (29))) is greater than 1.9672675222597202 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (29) - 2, .975) and 0.22395813645325793 = (6.6558066445052 - 5.165184591808604) / 6.6558066445052 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_Decimal.Add
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 5.17616672234007 < 6.154363332064669.
IsChangePoint: Marked as a change because one of 7/26/2022 5:16:37 PM, 7/27/2022 2:59:41 AM, 9/7/2022 8:07:21 PM, 9/13/2022 3:28:55 PM falls between 9/5/2022 12:53:33 AM and 9/13/2022 3:28:55 PM.
IsImprovementStdDev: Marked as improvement because 35.88922315988965 (T) = (0 -5.164791881617765) / Math.Sqrt((0.4812484438514175 / (299)) + (3.0116532534073423E-05 / (29))) is greater than 1.9672675222597202 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (29) - 2, .975) and 0.21805913306709437 = (6.605092661132046 - 5.164791881617765) / 6.605092661132046 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_Decimal.Multiply
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 4.763921594347189 < 5.731082473324902.
IsChangePoint: Marked as a change because one of 7/25/2022 3:11:28 PM, 7/26/2022 4:40:06 AM, 9/7/2022 8:07:21 PM, 9/13/2022 3:28:55 PM falls between 9/5/2022 12:53:33 AM and 9/13/2022 3:28:55 PM.
IsImprovementStdDev: Marked as improvement because 4.411744695910631 (T) = (0 -5.164387905571024) / Math.Sqrt((0.8131408648232255 / (299)) + (1.5197960653165208 / (29))) is greater than 1.9672675222597202 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (29) - 2, .975) and 0.16706389710413594 = (6.200220986479067 - 5.164387905571024) / 6.200220986479067 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x64 |
|---|---|
| OS | ubuntu 18.04 |
| Baseline | 283e351d0406d455a035b651b3d96b0209e73450 |
| Compare | cc9d46546b8e72b34a5f387a5ec9615197d79f1f |
| Diff | Diff |
Improvements in System.Numerics.Tests.Perf_Plane
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [NormalizeBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/System.Numerics.Tests.Perf_Plane.NormalizeBenchmark.html>) | 5.12 ns | 0.89 ns | 0.17 | 0.05 | False | |||||
| [TransformByQuaternionBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/System.Numerics.Tests.Perf_Plane.TransformByQuaternionBenchmark.html>) | 5.63 ns | 1.58 ns | 0.28 | 0.03 | False | |||||
| [TransformByMatrix4x4Benchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/System.Numerics.Tests.Perf_Plane.TransformByMatrix4x4Benchmark.html>) | 25.27 ns | 23.38 ns | 0.93 | 0.11 | False | |||||
| [CreateFromVerticesBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/System.Numerics.Tests.Perf_Plane.CreateFromVerticesBenchmark.html>) | 6.22 ns | 4.30 ns | 0.69 | 0.05 | False |
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_Plane*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
### Edge Detector Info
[Collection Data]()
#### System.Numerics.Tests.Perf_Plane.NormalizeBenchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.8917062348634751 < 4.8674272527153.
IsChangePoint: Marked as a change because one of 9/7/2022 8:07:21 PM, 9/13/2022 3:28:55 PM falls between 9/5/2022 12:53:33 AM and 9/13/2022 3:28:55 PM.
IsImprovementStdDev: Marked as improvement because 394.961924768846 (T) = (0 -0.8168812912688513) / Math.Sqrt((0.0060662241659738755 / (299)) + (0.0028927335226541042 / (29))) is greater than 1.9672675222597202 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (29) - 2, .975) and 0.8412020119862713 = (5.144153912064862 - 0.8168812912688513) / 5.144153912064862 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Plane.TransformByQuaternionBenchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.5849791081049285 < 5.348476242558277.
IsChangePoint: Marked as a change because one of 9/7/2022 8:07:21 PM, 9/13/2022 3:28:55 PM falls between 9/5/2022 12:53:33 AM and 9/13/2022 3:28:55 PM.
IsImprovementStdDev: Marked as improvement because 576.1888022590423 (T) = (0 -1.538931635631195) / Math.Sqrt((0.007275202611121568 / (299)) + (0.0007671253203400046 / (29))) is greater than 1.9672675222597202 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (29) - 2, .975) and 0.7273831576141719 = (5.645035068864828 - 1.538931635631195) / 5.645035068864828 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Plane.TransformByMatrix4x4Benchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 23.380878776577408 < 24.005250250292363.
IsChangePoint: Marked as a change because one of 8/9/2022 4:43:10 PM, 8/11/2022 12:05:11 PM, 9/7/2022 8:07:21 PM, 9/13/2022 3:28:55 PM falls between 9/5/2022 12:53:33 AM and 9/13/2022 3:28:55 PM.
IsImprovementStdDev: Marked as improvement because 16.014924282488685 (T) = (0 -23.60344695866618) / Math.Sqrt((2.8583956709476994 / (299)) + (0.18464961806104166 / (29))) is greater than 1.9672675222597202 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (29) - 2, .975) and 0.07887445408113673 = (25.62457100798426 - 23.60344695866618) / 25.62457100798426 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Plane.CreateFromVerticesBenchmark
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 4.30107861692509 < 5.906082582191388.
IsChangePoint: Marked as a change because one of 9/7/2022 8:07:21 PM, 9/13/2022 3:28:55 PM falls between 9/5/2022 12:53:33 AM and 9/13/2022 3:28:55 PM.
IsImprovementStdDev: Marked as improvement because 61.72394361919438 (T) = (0 -4.323866271750219) / Math.Sqrt((0.11077116365769271 / (299)) + (0.017784530946711032 / (29))) is greater than 1.9672675222597202 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (29) - 2, .975) and 0.3092652255888343 = (6.2598068490705545 - 4.323866271750219) / 6.2598068490705545 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x64 |
|---|---|
| OS | ubuntu 18.04 |
| Baseline | 283e351d0406d455a035b651b3d96b0209e73450 |
| Compare | cc9d46546b8e72b34a5f387a5ec9615197d79f1f |
| Diff | Diff |
Improvements in System.Collections.IterateForEach<Int32>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [ImmutableDictionary - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/System.Collections.IterateForEach(Int32).ImmutableDictionary(Size%3a%20512).html>) | 13.87 μs | 12.95 μs | 0.93 | 0.11 | False |
_1.png>)
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.IterateForEach<Int32>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
### Edge Detector Info
[Collection Data]()
#### System.Collections.IterateForEach<Int32>.ImmutableDictionary(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 12.94822649550484 < 13.174721755291163.
IsChangePoint: Marked as a change because one of 8/9/2022 6:41:10 AM, 8/30/2022 6:17:03 PM, 9/7/2022 8:07:21 PM, 9/13/2022 3:28:55 PM falls between 9/5/2022 12:53:33 AM and 9/13/2022 3:28:55 PM.
IsImprovementStdDev: Marked as improvement because 13.418097799702782 (T) = (0 -13053.717551100248) / Math.Sqrt((214397.38733139558 / (299)) + (259835.44537555153 / (29))) is greater than 1.9672675222597202 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (29) - 2, .975) and 0.09183138929421131 = (14373.67180193056 - 13053.717551100248) / 14373.67180193056 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x64 |
|---|---|
| OS | ubuntu 18.04 |
| Baseline | 283e351d0406d455a035b651b3d96b0209e73450 |
| Compare | cc9d46546b8e72b34a5f387a5ec9615197d79f1f |
| Diff | Diff |
Improvements in System.Threading.Channels.Tests.BoundedChannelPerfTests
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [WriteAsyncThenReadAsync - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/System.Threading.Channels.Tests.BoundedChannelPerfTests.WriteAsyncThenReadAsync.html>) | 64.03 ns | 56.87 ns | 0.89 | 0.13 | False |
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Threading.Channels.Tests.BoundedChannelPerfTests*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
### Edge Detector Info
[Collection Data]()
#### System.Threading.Channels.Tests.BoundedChannelPerfTests.WriteAsyncThenReadAsync
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 56.8686945805376 < 60.77207950356876.
IsChangePoint: Marked as a change because one of 9/7/2022 8:07:21 PM, 9/13/2022 3:28:55 PM falls between 9/5/2022 12:53:33 AM and 9/13/2022 3:28:55 PM.
IsImprovementStdDev: Marked as improvement because 11.707661775947681 (T) = (0 -58.401036215948274) / Math.Sqrt((3.355572619911722 / (299)) + (6.508175449980561 / (29))) is greater than 1.9672675222597202 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (29) - 2, .975) and 0.0886840264092467 = (64.08428899346228 - 58.401036215948274) / 64.08428899346228 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x64 |
|---|---|
| OS | ubuntu 18.04 |
| Baseline | 283e351d0406d455a035b651b3d96b0209e73450 |
| Compare | cc9d46546b8e72b34a5f387a5ec9615197d79f1f |
| Diff | Diff |
Improvements in System.Threading.Channels.Tests.UnboundedChannelPerfTests
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [WriteAsyncThenReadAsync - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/System.Threading.Channels.Tests.UnboundedChannelPerfTests.WriteAsyncThenReadAsync.html>) | 61.58 ns | 55.18 ns | 0.90 | 0.11 | False |
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Threading.Channels.Tests.UnboundedChannelPerfTests*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
### Edge Detector Info
[Collection Data]()
#### System.Threading.Channels.Tests.UnboundedChannelPerfTests.WriteAsyncThenReadAsync
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 55.18269676334297 < 58.08503455463076.
IsChangePoint: Marked as a change because one of 9/7/2022 8:07:21 PM, 9/13/2022 3:28:55 PM falls between 9/5/2022 12:53:33 AM and 9/13/2022 3:28:55 PM.
IsImprovementStdDev: Marked as improvement because 15.755282436700188 (T) = (0 -55.794759524918646) / Math.Sqrt((2.5052303654753447 / (299)) + (4.01273424810821 / (29))) is greater than 1.9672675222597202 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (29) - 2, .975) and 0.097614074157148 = (61.83026344610249 - 55.794759524918646) / 61.83026344610249 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
Regressions in System.Numerics.Tests.Perf_BigInteger
Repro