[Perf] Changes at 6/5/2022 9:07:46 PM

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in Benchstone.BenchF.Lorenz

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Test - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Benchstone.BenchF.Lorenz.Test.html>)	2.35 secs	1.50 secs	0.64	0.09	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Benchstone.BenchF.Lorenz*'

### Payloads [Baseline]() [Compare]() ### Histogram #### Benchstone.BenchF.Lorenz.Test ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.4989861829285716 < 2.132580097204762. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.871957769490383 (T) = (0 -1529132982.9811196) / Math.Sqrt((62986202509371310 / (299)) + (1634592489611608.5 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15326411695011355 = (1805914941.8272958 - 1529132982.9811196) / 1805914941.8272958 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Xml.Linq.Perf_XDocument

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[CreateWithRootlEement - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Xml.Linq.Perf_XDocument.CreateWithRootlEement.html>)	376.35 ns	318.67 ns	0.85	0.07	False
[GetRootElement - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Xml.Linq.Perf_XDocument.GetRootElement.html>)	35.84 ns	28.41 ns	0.79	0.43	False
[GetElement - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Xml.Linq.Perf_XDocument.GetElement.html>)	692.40 ns	517.58 ns	0.75	0.25	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Xml.Linq.Perf_XDocument*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Xml.Linq.Perf_XDocument.CreateWithRootlEement ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 318.67356354539214 < 354.6752825480343. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 19.144337346635897 (T) = (0 -321.7711076225534) / Math.Sqrt((265.1267226904356 / (299)) + (50.88150664403177 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.0738332801028981 = (347.42244642336374 - 321.7711076225534) / 347.42244642336374 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Xml.Linq.Perf_XDocument.GetRootElement ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 28.405915874870114 < 34.088393378636354. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.5227239401157 (T) = (0 -29.129702448927706) / Math.Sqrt((9.139196273282009 / (299)) + (3.784263865064363 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1438219256850196 = (34.02294840618769 - 29.129702448927706) / 34.02294840618769 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Xml.Linq.Perf_XDocument.GetElement ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 517.5776200850116 < 648.2064020047796. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.07164483254655 (T) = (0 -546.4723366731115) / Math.Sqrt((2512.4418216863046 / (299)) + (341.4373707044448 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10667292391100094 = (611.7270497000679 - 546.4723366731115) / 611.7270497000679 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.IO.Tests.Perf_Directory

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[GetCurrentDirectory - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_Directory.GetCurrentDirectory.html>)	2.72 μs	2.20 μs	0.81	0.06	False
[EnumerateFiles - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_Directory.EnumerateFiles.html>)	22.27 ms	18.42 ms	0.83	0.03	False
[MoveFolders - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_Directory.MoveFolders.html>)	15.99 μs	12.60 μs	0.79	0.02	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Tests.Perf_Directory*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.IO.Tests.Perf_Directory.GetCurrentDirectory ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.20149636519782 < 2.5551423974572893. IsChangePoint: Marked as a change because one of 4/21/2022 5:54:30 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 36.89640767491524 (T) = (0 -2147.625528569317) / Math.Sqrt((19694.708821040236 / (299)) + (776.2821053442815 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13300158436647141 = (2477.0812608694505 - 2147.625528569317) / 2477.0812608694505 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_Directory.EnumerateFiles ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 18.424913104761906 < 21.04083125405844. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.628287216615226 (T) = (0 -18861326.719218656) / Math.Sqrt((1808573583711.8477 / (299)) + (84127803521.30368 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.05507524180959173 = (19960665.180727523 - 18861326.719218656) / 19960665.180727523 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_Directory.MoveFolders ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 12.601535543699187 < 15.226753546637655. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.626163427679665 (T) = (0 -12798.513511934101) / Math.Sqrt((2258699.5583687695 / (299)) + (28539.428649312722 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.05079009544349101 = (13483.333296984336 - 12798.513511934101) / 13483.333296984336 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in MicroBenchmarks.Serializers.Xml_ToStream<ClassImplementingIXmlSerialiable>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[XmlSerializer_ - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/MicroBenchmarks.Serializers.XmlToStream(ClassImplementingIXmlSerialiable).XmlSerializer.html>)	22.25 μs	19.04 μs	0.86	0.01	False
[DataContractSerializer_ - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/MicroBenchmarks.Serializers.XmlToStream(ClassImplementingIXmlSerialiable).DataContractSerializer.html>)	13.76 μs	11.24 μs	0.82	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'MicroBenchmarks.Serializers.Xml_ToStream<ClassImplementingIXmlSerialiable>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### MicroBenchmarks.Serializers.Xml_ToStream<ClassImplementingIXmlSerialiable>.XmlSerializer_ ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 19.03590293920823 < 21.23271643835079. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 21.49113702357177 (T) = (0 -19196.823716761937) / Math.Sqrt((1139876.1486849296 / (299)) + (34021.158337146284 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.06935208230453362 = (20627.37513483984 - 19196.823716761937) / 20627.37513483984 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### MicroBenchmarks.Serializers.Xml_ToStream<ClassImplementingIXmlSerialiable>.DataContractSerializer_ ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 11.240531470655956 < 13.076850122200904. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.431022296832179 (T) = (0 -11299.745851398291) / Math.Sqrt((919905.7746149951 / (299)) + (9283.020767280326 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.05897561818722712 = (12007.920378886101 - 11299.745851398291) / 12007.920378886101 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Text.Json.Document.Tests.Perf_EnumerateObject

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_EnumerateObject.Parse(TestCase%3a%20ObjectProperties).html>)	19.49 ms	14.56 ms	0.75	0.03	False
[EnumerateProperties - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_EnumerateObject.EnumerateProperties(TestCase%3a%20NumericProperties).html>)	67.11 μs	54.60 μs	0.81	0.20	False
[EnumerateProperties - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_EnumerateObject.EnumerateProperties(TestCase%3a%20StringProperties).html>)	71.52 μs	60.33 μs	0.84	0.20	False
[PropertyIndexer - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_EnumerateObject.PropertyIndexer(TestCase%3a%20ObjectProperties).html>)	121.10 μs	87.48 μs	0.72	0.09	False
[EnumerateProperties - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_EnumerateObject.EnumerateProperties(TestCase%3a%20ObjectProperties).html>)	70.79 μs	57.99 μs	0.82	0.16	False
[PropertyIndexer - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_EnumerateObject.PropertyIndexer(TestCase%3a%20NumericProperties).html>)	114.96 μs	86.40 μs	0.75	0.17	False
[PropertyIndexer - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_EnumerateObject.PropertyIndexer(TestCase%3a%20StringProperties).html>)	116.23 μs	84.78 μs	0.73	0.09	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_EnumerateObject.Parse(TestCase%3a%20NumericProperties).html>)	486.19 μs	358.76 μs	0.74	0.03	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_EnumerateObject.Parse(TestCase%3a%20StringProperties).html>)	389.94 μs	284.18 μs	0.73	0.04	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Document.Tests.Perf_EnumerateObject*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Document.Tests.Perf_EnumerateObject.Parse(TestCase: ObjectProperties) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 14.560436147058825 < 18.60981528289923. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.162780532725275 (T) = (0 -14965222.757577594) / Math.Sqrt((4171210073724.2383 / (299)) + (44999256142.96052 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.06925423787154171 = (16078743.913219286 - 14965222.757577594) / 16078743.913219286 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_EnumerateObject.EnumerateProperties(TestCase: NumericProperties) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 54.602753512002195 < 65.20419951042591. IsChangePoint: Marked as a change because one of 5/25/2022 12:28:02 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.862806254179873 (T) = (0 -55086.884247688555) / Math.Sqrt((19109285.360739186 / (299)) + (1709115.6203480035 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08597931538357306 = (60268.75012222073 - 55086.884247688555) / 60268.75012222073 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_EnumerateObject.EnumerateProperties(TestCase: StringProperties) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 60.32841496732027 < 63.686664182249025. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.466769348809358 (T) = (0 -55014.98645078752) / Math.Sqrt((19673532.64002297 / (299)) + (2096894.8311330124 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08773581075219275 = (60305.98054731189 - 55014.98645078752) / 60305.98054731189 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_EnumerateObject.PropertyIndexer(TestCase: ObjectProperties) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 87.48104327114925 < 115.31749983671017. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 18.49644368693195 (T) = (0 -89528.1036148641) / Math.Sqrt((139495051.74970475 / (299)) + (1829143.6512310163 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12737766792236785 = (102596.62207097778 - 89528.1036148641) / 102596.62207097778 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_EnumerateObject.EnumerateProperties(TestCase: ObjectProperties) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 57.98906969572368 < 67.20890080801553. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.471779672130488 (T) = (0 -57267.148719691846) / Math.Sqrt((26210289.35659627 / (299)) + (1579607.3175242313 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09408082409271963 = (63214.41276738474 - 57267.148719691846) / 63214.41276738474 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_EnumerateObject.PropertyIndexer(TestCase: NumericProperties) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 86.39684111089188 < 110.20020783845592. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.7387084858543 (T) = (0 -87174.12452927002) / Math.Sqrt((169716251.7320115 / (299)) + (5939568.255790102 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12201306227155753 = (99288.63492526422 - 87174.12452927002) / 99288.63492526422 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_EnumerateObject.PropertyIndexer(TestCase: StringProperties) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 84.78442266757246 < 110.37989725582965. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.986444984601665 (T) = (0 -86706.22450493572) / Math.Sqrt((118203560.63609236 / (299)) + (2465882.253792406 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12088015386066094 = (98628.44626441628 - 86706.22450493572) / 98628.44626441628 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_EnumerateObject.Parse(TestCase: NumericProperties) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 358.76284861111105 < 445.4541416285321. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.0519797175861925 (T) = (0 -349375.4894832928) / Math.Sqrt((3269888512.8604813 / (299)) + (20205638.920478884 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.05501840118541088 = (369716.71186143626 - 349375.4894832928) / 369716.71186143626 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_EnumerateObject.Parse(TestCase: StringProperties) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 284.17727299679484 < 370.6234790491072. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.717706094194437 (T) = (0 -282971.71824049065) / Math.Sqrt((2324264345.6039534 / (299)) + (11992934.527404532 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.08011387810199763 = (307616.0314894573 - 282971.71824049065) / 307616.0314894573 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in BenchmarksGame.SpectralNorm_3

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[RunBench - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/BenchmarksGame.SpectralNorm_3.RunBench.html>)	4.11 ms	3.35 ms	0.81	0.07	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'BenchmarksGame.SpectralNorm_3*'

### Payloads [Baseline]() [Compare]() ### Histogram #### BenchmarksGame.SpectralNorm_3.RunBench ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.347176477678572 < 3.9188892809184024. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.66996991863265 (T) = (0 -3360406.9939651093) / Math.Sqrt((102093032547.28972 / (299)) + (3383388225.0820913 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.05984286122790163 = (3574303.544994619 - 3360406.9939651093) / 3574303.544994619 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Collections.IterateForNonGeneric<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ArrayList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateForNonGeneric(String).ArrayList(Size%3a%20512).html>)	21.00 μs	17.43 μs	0.83	0.14	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.IterateForNonGeneric<String>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.IterateForNonGeneric<String>.ArrayList(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.42538324597417 < 19.97051203000803. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.143465582041323 (T) = (0 -17399.93738301485) / Math.Sqrt((1721741.258330793 / (299)) + (153523.07919110358 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08327150526582183 = (18980.469662460175 - 17399.93738301485) / 18980.469662460175 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in System.Collections.AddGivenSize<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[List - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.AddGivenSize(Int32).List(Size%3a%20512).html>)	15.95 μs	9.05 μs	0.57	0.07	False
[IDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.AddGivenSize(Int32).IDictionary(Size%3a%20512).html>)	90.79 μs	68.83 μs	0.76	0.02	False
[HashSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.AddGivenSize(Int32).HashSet(Size%3a%20512).html>)	82.44 μs	60.60 μs	0.74	0.08	False
[Stack - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.AddGivenSize(Int32).Stack(Size%3a%20512).html>)	16.94 μs	12.25 μs	0.72	0.06	False
[ObservableCollection - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.AddGivenSize(Int32).ObservableCollection(Size%3a%20512).html>)	188.22 μs	155.89 μs	0.83	0.02	False
[Queue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.AddGivenSize(Int32).Queue(Size%3a%20512).html>)	29.81 μs	21.45 μs	0.72	0.06	False
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.AddGivenSize(Int32).Dictionary(Size%3a%20512).html>)	91.25 μs	67.80 μs	0.74	0.05	False
[ICollection - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.AddGivenSize(Int32).ICollection(Size%3a%20512).html>)	19.91 μs	14.47 μs	0.73	0.06	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.AddGivenSize<Int32>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.AddGivenSize<Int32>.List(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 9.048479224436742 < 14.71303762681539. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 53.389752340290975 (T) = (0 -9150.23593449056) / Math.Sqrt((1863694.3577036597 / (299)) + (136028.5398299444 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.35251262334725464 = (14131.914017835645 - 9150.23593449056) / 14131.914017835645 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.AddGivenSize<Int32>.IDictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 68.82760463169643 < 87.15736538560519. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.802189551846793 (T) = (0 -68027.57873804067) / Math.Sqrt((84329479.66705535 / (299)) + (487157.48753440613 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09214744287635289 = (74932.40857697501 - 68027.57873804067) / 74932.40857697501 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.AddGivenSize<Int32>.HashSet(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 60.60239721760798 < 78.64622740734836. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.197360431276534 (T) = (0 -61666.459329107856) / Math.Sqrt((77266560.04039605 / (299)) + (1827040.7183382988 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.08938772927105278 = (67719.77636513037 - 61666.459329107856) / 67719.77636513037 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.AddGivenSize<Int32>.Stack(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 12.248734531608505 < 16.10218016652952. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 22.693986401461718 (T) = (0 -12297.682541262384) / Math.Sqrt((2264459.581104508 / (299)) + (14356.439433159156 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14037009545399912 = (14305.787265226887 - 12297.682541262384) / 14305.787265226887 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.AddGivenSize<Int32>.ObservableCollection(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 155.88543527227722 < 174.93103801296024. IsChangePoint: Marked as a change because one of 5/25/2022 12:28:02 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 22.662822116559703 (T) = (0 -153889.0357699066) / Math.Sqrt((83725703.21583295 / (299)) + (5937085.41245062 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08382968121546897 = (167969.8988437748 - 153889.0357699066) / 167969.8988437748 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.AddGivenSize<Int32>.Queue(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 21.44656477506868 < 28.27256236495503. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 24.3142748986938 (T) = (0 -21741.428219364832) / Math.Sqrt((6420080.465232 / (299)) + (158371.7732218187 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1484516073733366 = (25531.641428271392 - 21741.428219364832) / 25531.641428271392 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.AddGivenSize<Int32>.Dictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 67.7998572002924 < 84.13271267272353. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.809365583891584 (T) = (0 -66029.83776626781) / Math.Sqrt((80837124.44818863 / (299)) + (482681.5756299431 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09294104759414461 = (72795.53064454332 - 66029.83776626781) / 72795.53064454332 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.AddGivenSize<Int32>.ICollection(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 14.474303401321032 < 19.031432428904022. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.75304297140249 (T) = (0 -14624.708733110445) / Math.Sqrt((3745856.6513047786 / (299)) + (111771.49781642281 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11489782107757414 = (16523.18690585013 - 14624.708733110445) / 16523.18690585013 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Memory.Slice<Byte>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[SpanStart - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Slice(Byte).SpanStart.html>)	33.63 ns	23.44 ns	0.70	0.06	False
[ReadOnlySpanStart - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Slice(Byte).ReadOnlySpanStart.html>)	33.37 ns	23.60 ns	0.71	0.07	False
[ReadOnlyMemorySpanStart - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Slice(Byte).ReadOnlyMemorySpanStart.html>)	75.68 ns	47.78 ns	0.63	0.07	False
[MemoryStart - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Slice(Byte).MemoryStart.html>)	36.98 ns	26.42 ns	0.71	0.04	False
[MemorySpanStart - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Slice(Byte).MemorySpanStart.html>)	76.12 ns	48.40 ns	0.64	0.10	False
[ReadOnlySpanStartLength - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Slice(Byte).ReadOnlySpanStartLength.html>)	32.89 ns	23.09 ns	0.70	0.06	False
[ReadOnlyMemorySpanStartLength - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Slice(Byte).ReadOnlyMemorySpanStartLength.html>)	75.55 ns	46.59 ns	0.62	0.10	False
[ReadOnlyMemoryStart - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Slice(Byte).ReadOnlyMemoryStart.html>)	37.06 ns	26.65 ns	0.72	0.03	False
[MemoryStartLength - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Slice(Byte).MemoryStartLength.html>)	37.50 ns	26.52 ns	0.71	0.07	False
[ReadOnlyMemoryStartSpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Slice(Byte).ReadOnlyMemoryStartSpan.html>)	79.12 ns	50.80 ns	0.64	0.11	False
[ReadOnlyMemoryStartLength - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Slice(Byte).ReadOnlyMemoryStartLength.html>)	38.30 ns	26.10 ns	0.68	0.07	False
[MemoryStartSpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Slice(Byte).MemoryStartSpan.html>)	80.30 ns	53.53 ns	0.67	0.10	False
[SpanStartLength - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Slice(Byte).SpanStartLength.html>)	32.99 ns	23.19 ns	0.70	0.07	False
[MemorySpanStartLength - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Slice(Byte).MemorySpanStartLength.html>)	75.23 ns	46.70 ns	0.62	0.06	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Memory.Slice<Byte>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Memory.Slice<Byte>.SpanStart ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 23.44174459671721 < 31.929463933185495. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.03969364581281 (T) = (0 -23.829353308771505) / Math.Sqrt((13.672709424915071 / (299)) + (0.11626816243135503 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11411818031556126 = (26.899020590872713 - 23.829353308771505) / 26.899020590872713 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Slice<Byte>.ReadOnlySpanStart ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 23.597220777500176 < 31.851260084390127. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.159759569463752 (T) = (0 -23.83021602238038) / Math.Sqrt((13.634999729975382 / (299)) + (0.10304919018109537 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11459183984317979 = (26.914384907136682 - 23.83021602238038) / 26.914384907136682 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Slice<Byte>.ReadOnlyMemorySpanStart ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 47.778281530149535 < 71.82648139672214. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.356092475715682 (T) = (0 -47.961329344315565) / Math.Sqrt((128.96214610872383 / (299)) + (0.420704758162518 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13558327234909162 = (55.4840365880617 - 47.961329344315565) / 55.4840365880617 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Slice<Byte>.MemoryStart ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 26.423268206632986 < 35.29803722202072. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.292456397730076 (T) = (0 -26.92802649470689) / Math.Sqrt((16.32426455715329 / (299)) + (1.2131823317784989 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11194916756844461 = (30.322618380949844 - 26.92802649470689) / 30.322618380949844 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Slice<Byte>.MemorySpanStart ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 48.398452750149 < 71.93683827194046. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.825207288148263 (T) = (0 -48.14699402342562) / Math.Sqrt((130.84146277060418 / (299)) + (1.8075992031801325 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.13361104661756837 = (55.57203128624508 - 48.14699402342562) / 55.57203128624508 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Slice<Byte>.ReadOnlySpanStartLength ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 23.085599634906043 < 31.142444857914853. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.5963535387295 (T) = (0 -23.172988116049606) / Math.Sqrt((16.843986988163042 / (299)) + (0.045679722208489856 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.09856692359035765 = (25.706831402666435 - 23.172988116049606) / 25.706831402666435 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Slice<Byte>.ReadOnlyMemorySpanStartLength ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 46.590514050633196 < 71.65574637936659. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.296137001786677 (T) = (0 -47.64725164969047) / Math.Sqrt((138.12429617386874 / (299)) + (5.625722388985671 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12764037834257935 = (54.61881827951196 - 47.64725164969047) / 54.61881827951196 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Slice<Byte>.ReadOnlyMemoryStart ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 26.65300237481143 < 35.23979802726073. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.770440301748724 (T) = (0 -26.770632893479217) / Math.Sqrt((14.618338412602265 / (299)) + (0.39203340006347587 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11538784103713853 = (30.262564924345703 - 26.770632893479217) / 30.262564924345703 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Slice<Byte>.MemoryStartLength ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 26.521676886634012 < 35.71825600588841. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.300564410526368 (T) = (0 -26.341932541896025) / Math.Sqrt((22.942634872286305 / (299)) + (0.33742641600245343 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1011157319227053 = (29.30514358454752 - 26.341932541896025) / 29.30514358454752 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Slice<Byte>.ReadOnlyMemoryStartSpan ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 50.80408016828192 < 75.2703459043708. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.178000047915933 (T) = (0 -51.810754557923) / Math.Sqrt((134.28727672580527 / (299)) + (0.5522085242190744 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12752494047110136 = (59.383651133705435 - 51.810754557923) / 59.383651133705435 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Slice<Byte>.ReadOnlyMemoryStartLength ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 26.09965274431146 < 35.54293310223745. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.590645156614347 (T) = (0 -26.37349054879829) / Math.Sqrt((22.44049968300813 / (299)) + (1.0097531999188178 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.0998670859937569 = (29.29955136449479 - 26.37349054879829) / 29.29955136449479 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Slice<Byte>.MemoryStartSpan ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 53.52944776306207 < 75.34360293326253. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.395444860688047 (T) = (0 -52.05834847462315) / Math.Sqrt((128.11749060816814 / (299)) + (1.6564614772144726 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11912089666211108 = (59.0981762166454 - 52.05834847462315) / 59.0981762166454 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Slice<Byte>.SpanStartLength ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 23.194609581588807 < 31.328256835002986. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.211668996835455 (T) = (0 -23.335642378880806) / Math.Sqrt((16.706131383843104 / (299)) + (0.37305077368615897 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.08992442482996196 = (25.64143354195698 - 23.335642378880806) / 25.64143354195698 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Slice<Byte>.MemorySpanStartLength ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 46.7015093178721 < 71.56548431164929. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.168372501825527 (T) = (0 -47.26329496624563) / Math.Sqrt((141.28904824902563 / (299)) + (2.033161313370749 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1330498438293432 = (54.51673851125298 - 47.26329496624563) / 54.51673851125298 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Text.Json.Tests.Perf_Basic

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[WriteBasicUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted%3a%20True%2c%20SkipValidation%3a%20False%2c%20DataSize%3a%20100000).html>)	50.59 ms	35.86 ms	0.71	0.09	False
[WriteBasicUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted%3a%20False%2c%20SkipValidation%3a%20False%2c%20DataSize%3a%2010).html>)	25.74 μs	19.73 μs	0.77	0.01	False
[WriteBasicUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted%3a%20False%2c%20SkipValidation%3a%20True%2c%20DataSize%3a%20100000).html>)	36.50 ms	26.04 ms	0.71	0.09	False
[WriteBasicUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted%3a%20True%2c%20SkipValidation%3a%20True%2c%20DataSize%3a%2010).html>)	28.53 μs	21.33 μs	0.75	0.02	False
[WriteBasicUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted%3a%20False%2c%20SkipValidation%3a%20True%2c%20DataSize%3a%20100000).html>)	36.48 ms	26.34 ms	0.72	0.10	False
[WriteBasicUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted%3a%20True%2c%20SkipValidation%3a%20False%2c%20DataSize%3a%20100000).html>)	50.42 ms	35.12 ms	0.70	0.09	False
[WriteBasicUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted%3a%20False%2c%20SkipValidation%3a%20True%2c%20DataSize%3a%2010).html>)	29.02 μs	22.36 μs	0.77	0.01	False
[WriteBasicUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted%3a%20False%2c%20SkipValidation%3a%20False%2c%20DataSize%3a%20100000).html>)	38.77 ms	26.86 ms	0.69	0.09	False
[WriteBasicUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted%3a%20False%2c%20SkipValidation%3a%20False%2c%20DataSize%3a%20100000).html>)	38.21 ms	27.02 ms	0.71	0.07	False
[WriteBasicUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted%3a%20True%2c%20SkipValidation%3a%20True%2c%20DataSize%3a%20100000).html>)	49.60 ms	37.75 ms	0.76	0.09	False
[WriteBasicUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted%3a%20True%2c%20SkipValidation%3a%20True%2c%20DataSize%3a%2010).html>)	34.36 μs	26.63 μs	0.78	0.01	False
[WriteBasicUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted%3a%20False%2c%20SkipValidation%3a%20False%2c%20DataSize%3a%2010).html>)	31.70 μs	25.23 μs	0.80	0.01	False
[WriteBasicUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted%3a%20True%2c%20SkipValidation%3a%20False%2c%20DataSize%3a%2010).html>)	31.11 μs	23.71 μs	0.76	0.01	False
[WriteBasicUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted%3a%20True%2c%20SkipValidation%3a%20False%2c%20DataSize%3a%2010).html>)	37.31 μs	28.95 μs	0.78	0.02	False
[WriteBasicUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted%3a%20False%2c%20SkipValidation%3a%20True%2c%20DataSize%3a%2010).html>)	23.26 μs	17.36 μs	0.75	0.02	False
[WriteBasicUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted%3a%20True%2c%20SkipValidation%3a%20True%2c%20DataSize%3a%20100000).html>)	48.62 ms	33.89 ms	0.70	0.09	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Tests.Perf_Basic*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted: True, SkipValidation: False, DataSize: 100000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 35.86464625714286 < 48.39063714416666. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.17758003645893 (T) = (0 -34994527.56133383) / Math.Sqrt((43924764904492.02 / (299)) + (397766436299.6635 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10244226832837304 = (38988609.11838999 - 34994527.56133383) / 38988609.11838999 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted: False, SkipValidation: False, DataSize: 10) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 19.730210268987342 < 24.426061591920842. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.748511065477112 (T) = (0 -19807.241371700096) / Math.Sqrt((5868535.710888074 / (299)) + (41444.84183841312 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07187801327462684 = (21341.204771567343 - 19807.241371700096) / 21341.204771567343 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted: False, SkipValidation: True, DataSize: 100000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 26.03732332 < 34.748633184540815. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.849085342216589 (T) = (0 -25660035.27593011) / Math.Sqrt((23783517621333.715 / (299)) + (117704779287.02702 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.0803779729657574 = (27902806.285189867 - 25660035.27593011) / 27902806.285189867 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted: True, SkipValidation: True, DataSize: 10) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 21.33462421124829 < 27.052602793501286. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.301395927992306 (T) = (0 -21613.12151470725) / Math.Sqrt((8183463.522417766 / (299)) + (41984.01973242135 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.074009310645434 = (23340.538693506765 - 21613.12151470725) / 23340.538693506765 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted: False, SkipValidation: True, DataSize: 100000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 26.343479037037035 < 34.65540350017007. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.023937511592896 (T) = (0 -25845884.69521957) / Math.Sqrt((23561805121060.92 / (299)) + (284255893897.9705 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07296420117690648 = (27880136.590228643 - 25845884.69521957) / 27880136.590228643 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted: True, SkipValidation: False, DataSize: 100000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 35.12007677142858 < 48.134851829166664. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.703421488776058 (T) = (0 -35498129.59490701) / Math.Sqrt((44260758877364.555 / (299)) + (501633880630.6753 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.08858455308914326 = (38948351.945563406 - 35498129.59490701) / 38948351.945563406 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted: False, SkipValidation: True, DataSize: 10) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 22.35956286300183 < 27.513201185705242. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.141376186215712 (T) = (0 -22551.23764852147) / Math.Sqrt((7212517.807855064 / (299)) + (56919.16960697643 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.06041005346038966 = (24001.148300463192 - 22551.23764852147) / 24001.148300463192 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted: False, SkipValidation: False, DataSize: 100000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 26.86256857037037 < 36.47213376664682. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.90258237193421 (T) = (0 -27200928.238022022) / Math.Sqrt((25014989194848.555 / (299)) + (185489889453.5966 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.0789185822282603 = (29531513.407170802 - 27200928.238022022) / 29531513.407170802 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted: False, SkipValidation: False, DataSize: 100000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 27.02453555 < 36.40489818617064. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.569377602146831 (T) = (0 -27172551.709099375) / Math.Sqrt((25413290585996.637 / (299)) + (319891428956.2353 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.0774035766840648 = (29452262.140186477 - 27172551.709099375) / 29452262.140186477 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted: True, SkipValidation: True, DataSize: 100000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 37.75487976190476 < 46.914981671666666. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.651528761526032 (T) = (0 -33897159.80138952) / Math.Sqrt((43146006806821.48 / (299)) + (879213344180.4728 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.0926346457690439 = (37357784.979700156 - 33897159.80138952) / 37357784.979700156 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted: True, SkipValidation: True, DataSize: 10) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 26.628844378897394 < 32.745346123052. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.684751337502577 (T) = (0 -26863.341013071775) / Math.Sqrt((10266857.330017451 / (299)) + (72823.6650260697 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.057538691137381345 = (28503.38869135222 - 26863.341013071775) / 28503.38869135222 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted: False, SkipValidation: False, DataSize: 10) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 25.22585861664377 < 30.17153147624032. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.078643088248123 (T) = (0 -25156.04260968449) / Math.Sqrt((7938219.0724337455 / (299)) + (69261.25487431338 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.056744190553397966 = (26669.374688975695 - 25156.04260968449) / 26669.374688975695 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted: True, SkipValidation: False, DataSize: 10) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 23.710718045017703 < 29.312236259149884. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.144251516793469 (T) = (0 -23777.585762589173) / Math.Sqrt((8841391.826851446 / (299)) + (56073.35583361257 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.06941664935512445 = (25551.269261492573 - 23777.585762589173) / 25551.269261492573 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted: True, SkipValidation: False, DataSize: 10) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 28.945694934944235 < 35.29446639260645. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.730950316734974 (T) = (0 -29196.46010722816) / Math.Sqrt((11316928.80526899 / (299)) + (74467.69493223533 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.055916675409651714 = (30925.72376479262 - 29196.46010722816) / 30925.72376479262 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted: False, SkipValidation: True, DataSize: 10) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.364749589858317 < 22.079255510099536. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.279413704837165 (T) = (0 -17440.490243284286) / Math.Sqrt((5366828.761125261 / (299)) + (44541.41862238716 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08134293495733139 = (18984.766902624575 - 17440.490243284286) / 18984.766902624575 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted: True, SkipValidation: True, DataSize: 100000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 33.894041780952385 < 46.390348707916665. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.72391532497003 (T) = (0 -34034602.562232755) / Math.Sqrt((41024114670973.28 / (299)) + (467349231343.5475 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08907939670423182 = (37362863.94126274 - 34034602.562232755) / 37362863.94126274 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Text.Json.Tests.Perf_DateTimes

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[WriteDateTimes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_DateTimes.WriteDateTimes(Formatted%3a%20True%2c%20SkipValidation%3a%20True).html>)	132.47 ms	94.79 ms	0.72	0.04	False
[WriteDateTimes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_DateTimes.WriteDateTimes(Formatted%3a%20True%2c%20SkipValidation%3a%20False).html>)	135.37 ms	94.15 ms	0.70	0.03	False
[WriteDateTimes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_DateTimes.WriteDateTimes(Formatted%3a%20False%2c%20SkipValidation%3a%20False).html>)	124.65 ms	86.98 ms	0.70	0.03	False
[WriteDateTimes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_DateTimes.WriteDateTimes(Formatted%3a%20False%2c%20SkipValidation%3a%20True).html>)	121.83 ms	84.43 ms	0.69	0.02	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Tests.Perf_DateTimes*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Tests.Perf_DateTimes.WriteDateTimes(Formatted: True, SkipValidation: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 94.79046460714285 < 126.10047592916666. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.581549685868826 (T) = (0 -97187353.20555994) / Math.Sqrt((260927471477002.38 / (299)) + (2576776027383.1694 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.0780289255016424 = (105412583.8583812 - 97187353.20555994) / 105412583.8583812 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_DateTimes.WriteDateTimes(Formatted: True, SkipValidation: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 94.14901608928572 < 129.03573398. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.837228508418422 (T) = (0 -98686756.91024578) / Math.Sqrt((254669960621031.16 / (299)) + (2796116138503.135 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07836795245611694 = (107078260.97545382 - 98686756.91024578) / 107078260.97545382 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_DateTimes.WriteDateTimes(Formatted: False, SkipValidation: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 86.98340389285715 < 117.90696032339743. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.684415696958686 (T) = (0 -87660370.35875817) / Math.Sqrt((222252866066210.94 / (299)) + (1721452777267.7769 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.09691334987709038 = (97067507.69356145 - 87660370.35875817) / 97067507.69356145 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_DateTimes.WriteDateTimes(Formatted: False, SkipValidation: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 84.43013001785715 < 116.05962850339284. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.848176246999543 (T) = (0 -85894644.74392109) / Math.Sqrt((217408352409231.66 / (299)) + (1717239857483.6584 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09908474384347486 = (95341536.46189086 - 85894644.74392109) / 95341536.46189086 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Count(Pattern%3a%20%22%5b%5cw%5d%2b%3a%2f%2f%5b%5e%2f%5cs%3f%23%5d%2b%5b%5e%5cs%3f%23%5d%2b(%3f%3a%5c%3f%5b%5e%5cs%23%5d)%3f(%3f%3a%23%5b%5e%5cs%5d)%3f%22%2c%20Options%3a%20None).html>)	90.05 ms	60.90 ms	0.68	0.01	False
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Count(Pattern%3a%20%22%5b%5cw%5d%2b%3a%2f%2f%5b%5e%2f%5cs%3f%23%5d%2b%5b%5e%5cs%3f%23%5d%2b(%3f%3a%5c%3f%5b%5e%5cs%23%5d)%3f(%3f%3a%23%5b%5e%5cs%5d)%3f%22%2c%20Options%3a%20NonBacktracking).html>)	240.96 ms	81.68 ms	0.34	0.03	False
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Count(Pattern%3a%20%22(%3f%3a(%3f%3a25%5b0-5%5d%7c2%5b0-4%5d%5b0-9%5d%7c%5b01%5d%3f%5b0-9%5d%5b0-9%5d)%5c.)%7b3%7d(%3f%3a25%5b0-5%5d%7c2%5b0-4%5d%5b0-9%5d%7c%5b01%5d%3f%5b0-9%5d%5b0-9%5d)%22%2c%20Options%3a%20None).html>)	580.49 ms	376.29 ms	0.65	0.01	False
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Count(Pattern%3a%20%22%5b%5cw%5c.%2b-%5d%2b%40%5b%5cw%5c.-%5d%2b%5c.%5b%5cw%5c.-%5d%2b%22%2c%20Options%3a%20Compiled).html>)	41.76 ms	24.50 ms	0.59	0.06	False
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Count(Pattern%3a%20%22(%3f%3a(%3f%3a25%5b0-5%5d%7c2%5b0-4%5d%5b0-9%5d%7c%5b01%5d%3f%5b0-9%5d%5b0-9%5d)%5c.)%7b3%7d(%3f%3a25%5b0-5%5d%7c2%5b0-4%5d%5b0-9%5d%7c%5b01%5d%3f%5b0-9%5d%5b0-9%5d)%22%2c%20Options%3a%20Compiled).html>)	578.01 ms	374.00 ms	0.65	0.03	False
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Count(Pattern%3a%20%22%5b%5cw%5c.%2b-%5d%2b%40%5b%5cw%5c.-%5d%2b%5c.%5b%5cw%5c.-%5d%2b%22%2c%20Options%3a%20None).html>)	41.76 ms	24.50 ms	0.59	0.09	False
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Count(Pattern%3a%20%22(%3f%3a(%3f%3a25%5b0-5%5d%7c2%5b0-4%5d%5b0-9%5d%7c%5b01%5d%3f%5b0-9%5d%5b0-9%5d)%5c.)%7b3%7d(%3f%3a25%5b0-5%5d%7c2%5b0-4%5d%5b0-9%5d%7c%5b01%5d%3f%5b0-9%5d%5b0-9%5d)%22%2c%20Options%3a%20NonBacktracking).html>)	397.11 ms	240.48 ms	0.61	0.06	False
[Ctor - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Ctor(Pattern%3a%20%22%5b%5cw%5c.%2b-%5d%2b%40%5b%5cw%5c.-%5d%2b%5c.%5b%5cw%5c.-%5d%2b%22%2c%20Options%3a%20NonBacktracking).html>)	12.94 ms	10.27 ms	0.79	0.01	False
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Count(Pattern%3a%20%22%5b%5cw%5c.%2b-%5d%2b%40%5b%5cw%5c.-%5d%2b%5c.%5b%5cw%5c.-%5d%2b%22%2c%20Options%3a%20NonBacktracking).html>)	41.81 ms	24.40 ms	0.58	0.09	False
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Count(Pattern%3a%20%22%5b%5cw%5d%2b%3a%2f%2f%5b%5e%2f%5cs%3f%23%5d%2b%5b%5e%5cs%3f%23%5d%2b(%3f%3a%5c%3f%5b%5e%5cs%23%5d)%3f(%3f%3a%23%5b%5e%5cs%5d)%3f%22%2c%20Options%3a%20Compiled).html>)	90.27 ms	61.03 ms	0.68	0.02	False
[Ctor - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Ctor(Pattern%3a%20%22%5b%5cw%5d%2b%3a%2f%2f%5b%5e%2f%5cs%3f%23%5d%2b%5b%5e%5cs%3f%23%5d%2b(%3f%3a%5c%3f%5b%5e%5cs%23%5d)%3f(%3f%3a%23%5b%5e%5cs%5d)%3f%22%2c%20Options%3a%20NonBacktracking).html>)	17.84 ms	14.38 ms	0.81	0.01	False
[Ctor - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Ctor(Pattern%3a%20%22(%3f%3a(%3f%3a25%5b0-5%5d%7c2%5b0-4%5d%5b0-9%5d%7c%5b01%5d%3f%5b0-9%5d%5b0-9%5d)%5c.)%7b3%7d(%3f%3a25%5b0-5%5d%7c2%5b0-4%5d%5b0-9%5d%7c%5b01%5d%3f%5b0-9%5d%5b0-9%5d)%22%2c%20Options%3a%20NonBacktracking).html>)	4.09 ms	3.31 ms	0.81	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Count(Pattern: "[\w]+://[^/\s?#]+[^\s?#]+(?:\?[^\s#]*)?(?:#[^\s]*)?", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 60.903189616666666 < 85.38143148914837. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.734723389022664 (T) = (0 -61498435.71641076) / Math.Sqrt((128931003509874.92 / (299)) + (408096789368.4809 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11218011606029775 = (69269045.25218713 - 61498435.71641076) / 69269045.25218713 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Count(Pattern: "[\w]+://[^/\s?#]+[^\s?#]+(?:\?[^\s#]*)?(?:#[^\s]*)?", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 81.67609513333333 < 232.30397448846153. IsChangePoint: Marked as a change because one of 5/27/2022 11:47:05 PM, 6/7/2022 9:37:06 AM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.320391057655934 (T) = (0 -81988137.48677829) / Math.Sqrt((3888755751903421 / (299)) + (608287443091.9292 / (42))) is greater than 1.9669864608404333 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (42) - 2, .975) and 0.3325416227624422 = (122836329.99874322 - 81988137.48677829) / 122836329.99874322 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Count(Pattern: "(?:(?:25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9])\.){3}(?:25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9])", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 376.2884383333333 < 550.3346974611904. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.725136841102284 (T) = (0 -378658999.0482272) / Math.Sqrt((6275000377863252 / (299)) + (8542367748446.947 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13383207105441164 = (437165803.99043393 - 378658999.0482272) / 437165803.99043393 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Count(Pattern: "[\w\.+-]+@[\w\.-]+\.[\w\.-]+", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 24.50469493076923 < 39.66358255588369. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.758250672169524 (T) = (0 -24583096.2472521) / Math.Sqrt((50237445066782.266 / (299)) + (208999628727.285 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1535216844201944 = (29041613.70089393 - 24583096.2472521) / 29041613.70089393 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Count(Pattern: "(?:(?:25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9])\.){3}(?:25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9])", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 374.002865 < 551.1336423534615. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.533355752042878 (T) = (0 -378651003.5348019) / Math.Sqrt((6385763039120617 / (299)) + (14443978769621.467 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.13337758558110444 = (436927313.71216875 - 378651003.5348019) / 436927313.71216875 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Count(Pattern: "[\w\.+-]+@[\w\.-]+\.[\w\.-]+", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 24.49779040666667 < 39.73251618222222. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.740315414633015 (T) = (0 -24603876.981568884) / Math.Sqrt((52044962061226.21 / (299)) + (194294872842.1885 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1553555975572119 = (29129272.52037928 - 24603876.981568884) / 29129272.52037928 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Count(Pattern: "(?:(?:25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9])\.){3}(?:25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9])", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 240.47611830769233 < 377.8434649857143. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.077411424655848 (T) = (0 -241792101.81328335) / Math.Sqrt((3979405241640048.5 / (299)) + (19974090957974.992 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.15589967950235634 = (286449484.66638845 - 241792101.81328335) / 286449484.66638845 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Ctor(Pattern: "[\w\.+-]+@[\w\.-]+\.[\w\.-]+", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 10.274138530434781 < 12.217339573981478. IsChangePoint: Marked as a change because one of 4/7/2022 6:53:49 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.54868650172682 (T) = (0 -10299004.241377283) / Math.Sqrt((823754283278.2927 / (299)) + (4120084538.558161 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07873017435490295 = (11179139.872692186 - 10299004.241377283) / 11179139.872692186 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Count(Pattern: "[\w\.+-]+@[\w\.-]+\.[\w\.-]+", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 24.40158918 < 39.74515501388888. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.978009221396833 (T) = (0 -24458870.82411122) / Math.Sqrt((50949425883189.2 / (299)) + (120424221964.64236 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15714401838336728 = (29019039.263621397 - 24458870.82411122) / 29019039.263621397 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Count(Pattern: "[\w]+://[^/\s?#]+[^\s?#]+(?:\?[^\s#]*)?(?:#[^\s]*)?", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 61.031808700000006 < 85.43767199350961. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.624239543329836 (T) = (0 -61571692.20526723) / Math.Sqrt((127245702791469.8 / (299)) + (740303069988.2025 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11115708264780869 = (69271736.32511528 - 61571692.20526723) / 69271736.32511528 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Ctor(Pattern: "[\w]+://[^/\s?#]+[^\s?#]+(?:\?[^\s#]*)?(?:#[^\s]*)?", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 14.377034370833334 < 16.945699399267397. IsChangePoint: Marked as a change because one of 4/7/2022 6:53:49 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.53110611431323 (T) = (0 -14367982.770481315) / Math.Sqrt((1638094858300.69 / (299)) + (6425349579.747553 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07479606610384855 = (15529530.565197568 - 14367982.770481315) / 15529530.565197568 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Ctor(Pattern: "(?:(?:25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9])\.){3}(?:25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9])", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.307290011434511 < 3.8926179150318148. IsChangePoint: Marked as a change because one of 4/7/2022 6:53:49 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.859496941874525 (T) = (0 -3314944.384080675) / Math.Sqrt((79031995120.0752 / (299)) + (395892628.59339803 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07732457029359883 = (3592752.4212230328 - 3314944.384080675) / 3592752.4212230328 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Tests.Perf_UInt64

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ParseSpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt64.ParseSpan(value%3a%20%2218446744073709551615%22).html>)	779.74 ns	460.41 ns	0.59	0.07	False
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt64.ToString(value%3a%200).html>)	48.10 ns	38.51 ns	0.80	0.21	False
[TryFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt64.TryFormat(value%3a%2018446744073709551615).html>)	638.26 ns	462.05 ns	0.72	0.09	False
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt64.ToString(value%3a%2012345).html>)	322.68 ns	267.79 ns	0.83	0.08	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt64.Parse(value%3a%20%2218446744073709551615%22).html>)	766.27 ns	455.28 ns	0.59	0.09	False
[TryParseHex - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt64.TryParseHex(value%3a%20%220%22).html>)	170.11 ns	122.34 ns	0.72	0.22	False
[TryFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt64.TryFormat(value%3a%200).html>)	141.12 ns	110.41 ns	0.78	0.21	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt64.Parse(value%3a%20%2212345%22).html>)	304.69 ns	192.41 ns	0.63	0.21	False
[TryParseHex - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt64.TryParseHex(value%3a%20%22FFFFFFFFFFFFFFFF%22).html>)	951.31 ns	629.99 ns	0.66	0.09	False
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt64.ToString(value%3a%2018446744073709551615).html>)	709.11 ns	549.67 ns	0.78	0.07	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt64.Parse(value%3a%20%220%22).html>)	163.45 ns	115.92 ns	0.71	0.30	False
[TryParse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt64.TryParse(value%3a%20%2212345%22).html>)	287.37 ns	184.34 ns	0.64	0.21	False
[TryParse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt64.TryParse(value%3a%20%2218446744073709551615%22).html>)	732.79 ns	423.34 ns	0.58	0.06	False
[ParseSpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt64.ParseSpan(value%3a%20%2212345%22).html>)	317.19 ns	206.99 ns	0.65	0.18	False
[ParseSpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt64.ParseSpan(value%3a%20%220%22).html>)	185.71 ns	152.29 ns	0.82	0.29	False
[TryParseHex - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt64.TryParseHex(value%3a%20%223039%22).html>)	348.47 ns	236.53 ns	0.68	0.19	False
[TryFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt64.TryFormat(value%3a%2012345).html>)	249.90 ns	178.33 ns	0.71	0.18	False
[TryParse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt64.TryParse(value%3a%20%220%22).html>)	171.38 ns	100.90 ns	0.59	0.20	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_UInt64*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Tests.Perf_UInt64.ParseSpan(value: "18446744073709551615") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 460.41273493806796 < 740.4221114992945. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.20867224392272 (T) = (0 -467.9603562275318) / Math.Sqrt((18773.337741123672 / (299)) + (50.018646572490994 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13572027630437736 = (541.4454873782687 - 467.9603562275318) / 541.4454873782687 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt64.ToString(value: 0) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 38.51246733791835 < 45.95780925822367. IsChangePoint: Marked as a change because one of 5/5/2022 12:13:02 AM, 5/25/2022 12:28:02 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.191369454624313 (T) = (0 -38.28984475363162) / Math.Sqrt((21.900340771243588 / (299)) + (1.7232325343490207 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.08635632059739098 = (41.90894723714134 - 38.28984475363162) / 41.90894723714134 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt64.TryFormat(value: 18446744073709551615) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 462.0490486891099 < 606.0333981330499. IsChangePoint: Marked as a change because one of 5/5/2022 12:13:02 AM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.779208007519326 (T) = (0 -476.5980736192421) / Math.Sqrt((5217.235955951374 / (299)) + (791.9386570208995 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.14027255773136854 = (554.3594983563682 - 476.5980736192421) / 554.3594983563682 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt64.ToString(value: 12345) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 267.7856570482939 < 306.2729350220611. IsChangePoint: Marked as a change because one of 5/5/2022 12:13:02 AM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.191527341584708 (T) = (0 -270.6100881400645) / Math.Sqrt((469.531496272115 / (299)) + (34.37951753596772 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07193122002037519 = (291.5840872763822 - 270.6100881400645) / 291.5840872763822 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt64.Parse(value: "18446744073709551615") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 455.28015818655865 < 720.8537224229033. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.503959846181223 (T) = (0 -451.40272519495886) / Math.Sqrt((17521.411782470364 / (299)) + (131.1798162407438 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12825091972807096 = (517.8126773063535 - 451.40272519495886) / 517.8126773063535 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt64.TryParseHex(value: "0") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 122.34090858680825 < 161.81878333092888. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.065633766514299 (T) = (0 -125.09131844646032) / Math.Sqrt((396.9877449944891 / (299)) + (40.96500836837401 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.07543178084847078 = (135.29701308709906 - 125.09131844646032) / 135.29701308709906 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt64.TryFormat(value: 0) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 110.41223278942225 < 134.21542145974487. IsChangePoint: Marked as a change because one of 5/5/2022 12:13:02 AM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.338927252783474 (T) = (0 -99.51937112879423) / Math.Sqrt((307.2912405541746 / (299)) + (11.728603524852815 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.15461522180652426 = (117.72079850013353 - 99.51937112879423) / 117.72079850013353 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt64.Parse(value: "12345") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 192.4052075511856 < 281.98200866428687. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.10285994122594 (T) = (0 -191.83455132580434) / Math.Sqrt((1907.9953510712792 / (299)) + (36.31051131340602 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.13323465648386654 = (221.32235992224307 - 191.83455132580434) / 221.32235992224307 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt64.TryParseHex(value: "FFFFFFFFFFFFFFFF") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 629.9896148577953 < 897.4183522352552. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.286366900429764 (T) = (0 -607.5207870360081) / Math.Sqrt((17465.07489883075 / (299)) + (80.692298358477 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.14473745469552884 = (710.3325059321197 - 607.5207870360081) / 710.3325059321197 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt64.ToString(value: 18446744073709551615) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 549.672522036502 < 677.0440063369001. IsChangePoint: Marked as a change because one of 5/5/2022 12:13:02 AM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 19.40755867833468 (T) = (0 -559.8278127449541) / Math.Sqrt((4066.145233946807 / (299)) + (241.1537115892795 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12817054588739404 = (642.1299602853823 - 559.8278127449541) / 642.1299602853823 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt64.Parse(value: "0") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 115.92297023983663 < 156.71151402053772. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.558117907984697 (T) = (0 -118.21808297105196) / Math.Sqrt((362.86747096771 / (299)) + (14.014609701013628 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11404509646589045 = (133.43577929246206 - 118.21808297105196) / 133.43577929246206 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt64.TryParse(value: "12345") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 184.33994300801788 < 261.984480772532. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.359153103895446 (T) = (0 -177.66850811436126) / Math.Sqrt((1703.3908648770002 / (299)) + (24.884141281316957 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11553723358100754 = (200.8773176893635 - 177.66850811436126) / 200.8773176893635 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt64.TryParse(value: "18446744073709551615") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 423.3445374923172 < 698.3281177312821. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.829281249737218 (T) = (0 -429.6463357736108) / Math.Sqrt((17158.42589941018 / (299)) + (61.40993535950256 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13581141399517566 = (497.1673344586529 - 429.6463357736108) / 497.1673344586529 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt64.ParseSpan(value: "12345") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 206.98958488573751 < 304.60554520590244. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.212826176646443 (T) = (0 -209.12636380538444) / Math.Sqrt((2012.9716021601528 / (299)) + (19.648190400157688 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13451799896274366 = (241.62993979626643 - 209.12636380538444) / 241.62993979626643 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt64.ParseSpan(value: "0") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 152.28815212434068 < 176.54563606465288. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.351731687676706 (T) = (0 -137.1939618985148) / Math.Sqrt((383.60726028893373 / (299)) + (24.921685297786073 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11365565899324068 = (154.78630093433242 - 137.1939618985148) / 154.78630093433242 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt64.TryParseHex(value: "3039") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 236.53118901287863 < 331.865128314425. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.443475858088405 (T) = (0 -237.63467130938383) / Math.Sqrt((2114.887077759121 / (299)) + (58.491575262230434 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12064973490048536 = (270.2389261035716 - 237.63467130938383) / 270.2389261035716 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt64.TryFormat(value: 12345) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 178.32864852026745 < 236.7701286885642. IsChangePoint: Marked as a change because one of 5/5/2022 12:13:02 AM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.536172094695852 (T) = (0 -182.36565893813017) / Math.Sqrt((760.145149729664 / (299)) + (15.09690595339704 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11068907420576506 = (205.06400365570812 - 182.36565893813017) / 205.06400365570812 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt64.TryParse(value: "0") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 100.89671455450006 < 134.52749286333218. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.08739428459062 (T) = (0 -102.96334511549983) / Math.Sqrt((253.97563517443018 / (299)) + (11.020105405021061 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09108138566170564 = (113.28114914937528 - 102.96334511549983) / 113.28114914937528 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Memory.Span<Byte>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[BinarySearch - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Byte).BinarySearch(Size%3a%20512).html>)	345.28 ns	226.69 ns	0.66	0.10	False
[StartsWith - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Byte).StartsWith(Size%3a%20512).html>)	409.51 ns	264.62 ns	0.65	0.15	False
[SequenceEqual - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Byte).SequenceEqual(Size%3a%20512).html>)	657.08 ns	425.17 ns	0.65	0.09	False
[GetPinnableReference - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Byte).GetPinnableReference(Size%3a%20512).html>)	22.58 ns	18.32 ns	0.81	0.10	False
[EndsWith - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Byte).EndsWith(Size%3a%20512).html>)	412.99 ns	264.82 ns	0.64	0.09	False
[IndexOfAnyFourValues - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Byte).IndexOfAnyFourValues(Size%3a%20512).html>)	19.91 μs	12.35 μs	0.62	0.11	False
[IndexOfAnyThreeValues - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Byte).IndexOfAnyThreeValues(Size%3a%20512).html>)	2.29 μs	1.59 μs	0.69	0.04	False
[SequenceCompareTo - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Byte).SequenceCompareTo(Size%3a%20512).html>)	763.86 ns	504.96 ns	0.66	0.09	False
[Fill - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Byte).Fill(Size%3a%20512).html>)	42.65 ns	26.33 ns	0.62	0.41	False
[IndexOfValue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Byte).IndexOfValue(Size%3a%20512).html>)	1.37 μs	854.44 ns	0.62	0.30	False
[LastIndexOfValue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Byte).LastIndexOfValue(Size%3a%20512).html>)	1.38 μs	820.57 ns	0.60	0.09	False
[Clear - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Byte).Clear(Size%3a%20512).html>)	50.20 ns	36.00 ns	0.72	0.31	False
[IndexOfAnyTwoValues - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Byte).IndexOfAnyTwoValues(Size%3a%20512).html>)	2.17 μs	1.35 μs	0.62	0.12	False
[LastIndexOfAnyValues - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Byte).LastIndexOfAnyValues(Size%3a%20512).html>)	1.93 μs	1.37 μs	0.71	0.10	False
[ToArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Byte).ToArray(Size%3a%20512).html>)	315.54 ns	274.48 ns	0.87	0.06	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Memory.Span<Byte>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Memory.Span<Byte>.BinarySearch(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 226.6894505564939 < 329.3943472925939. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.706121314199185 (T) = (0 -228.01819237179953) / Math.Sqrt((2367.9386582036527 / (299)) + (26.414526546301037 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11972709064887767 = (259.0312503651613 - 228.01819237179953) / 259.0312503651613 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Byte>.StartsWith(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 264.6196390143701 < 389.10865971301297. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.186489690818526 (T) = (0 -268.33882076032467) / Math.Sqrt((3918.6120846397343 / (299)) + (90.95779373559509 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1048159799886995 = (299.75827847880623 - 268.33882076032467) / 299.75827847880623 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Byte>.SequenceEqual(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 425.165913267698 < 623.1620695664069. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.799632769266836 (T) = (0 -420.6417530636007) / Math.Sqrt((10472.460273660263 / (299)) + (39.78702987370196 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11115471046232661 = (473.2451845274384 - 420.6417530636007) / 473.2451845274384 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Byte>.GetPinnableReference(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 18.316985349030748 < 21.475258473201382. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 34.51647158663833 (T) = (0 -18.483712449563523) / Math.Sqrt((0.6674993663221825 / (299)) + (0.4235943055448014 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15599795206921332 = (21.90008009444937 - 18.483712449563523) / 21.90008009444937 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Byte>.EndsWith(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 264.82377825412675 < 391.5273690981814. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.903537552121147 (T) = (0 -269.29761877984896) / Math.Sqrt((3934.8235919521544 / (299)) + (18.29852760981126 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10827183274732476 = (301.99519166197007 - 269.29761877984896) / 301.99519166197007 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Byte>.IndexOfAnyFourValues(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 12.349090913155802 < 18.991245858544985. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.008276265379387 (T) = (0 -12402.711385532693) / Math.Sqrt((12181330.324111337 / (299)) + (239069.97296405598 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10704700153448658 = (13889.545594052559 - 12402.711385532693) / 13889.545594052559 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Byte>.IndexOfAnyThreeValues(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.585360425178754 < 2.1785332653225247. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.7296171699553 (T) = (0 -1516.6255760448828) / Math.Sqrt((99847.74883783498 / (299)) + (1173.5146512714143 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1176589623947832 = (1718.8655082406606 - 1516.6255760448828) / 1718.8655082406606 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Byte>.SequenceCompareTo(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 504.9617535215189 < 724.9464669951203. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.7820860064468125 (T) = (0 -485.5119068574848) / Math.Sqrt((14913.434828465155 / (299)) + (216.30439331554004 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10514720446085693 = (542.5606415689488 - 485.5119068574848) / 542.5606415689488 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Byte>.Fill(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 26.332067656037115 < 40.95410043827739. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.641021607151527 (T) = (0 -26.469789722934223) / Math.Sqrt((55.08608818749667 / (299)) + (3.8982335972119553 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.12753470049670226 = (30.3390745030246 - 26.469789722934223) / 30.3390745030246 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Byte>.IndexOfValue(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 854.4407965652052 < 1.280191778298206. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 48.31806245616624 (T) = (0 -824.8882336683008) / Math.Sqrt((18566.194441264033 / (299)) + (349.1823842131306 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.32623350158256853 = (1224.293929136919 - 824.8882336683008) / 1224.293929136919 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Byte>.LastIndexOfValue(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 820.5724696650162 < 1.2824629566385326. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.924451957263805 (T) = (0 -813.953174820854) / Math.Sqrt((49455.19403757815 / (299)) + (30.476204640541244 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1474091862582839 = (954.6820839515085 - 813.953174820854) / 954.6820839515085 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Byte>.Clear(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 36.004386179311055 < 47.73476876815621. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.605584991854808 (T) = (0 -34.249105492381) / Math.Sqrt((39.9219896072593 / (299)) + (2.58457701976269 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14411893011696258 = (40.01619698991753 - 34.249105492381) / 40.01619698991753 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Byte>.IndexOfAnyTwoValues(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.3451282789319656 < 1.8660452720551008. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.037394872849086 (T) = (0 -1264.244363328997) / Math.Sqrt((93900.46590673036 / (299)) + (2265.8753639987017 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11862770836492842 = (1434.4044796139926 - 1264.244363328997) / 1434.4044796139926 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Byte>.LastIndexOfAnyValues(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.3689870491114848 < 1.8326226667417094. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.306548577778827 (T) = (0 -1294.6451041018486) / Math.Sqrt((85157.63907212595 / (299)) + (2965.898699832771 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.0939750655513329 = (1428.9287798571063 - 1294.6451041018486) / 1428.9287798571063 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Byte>.ToArray(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 274.4838474642348 < 300.2772126726385. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.094647519185354 (T) = (0 -272.3384884342534) / Math.Sqrt((328.6296023490392 / (299)) + (33.0604861426564 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.05473762911128805 = (288.1088857670359 - 272.3384884342534) / 288.1088857670359 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.IO.Tests.Perf_Path

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ChangeExtension - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_Path.ChangeExtension.html>)	505.86 ns	410.56 ns	0.81	0.07	False
[GetFileNameWithoutExtension - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_Path.GetFileNameWithoutExtension.html>)	696.79 ns	520.08 ns	0.75	0.06	False
[GetFileName - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_Path.GetFileName.html>)	617.47 ns	459.51 ns	0.74	0.07	False
[IsPathRooted - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_Path.IsPathRooted.html>)	51.94 ns	40.75 ns	0.78	0.22	False
[GetFullPathForReallyLongPath - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_Path.GetFullPathForReallyLongPath.html>)	57.83 μs	34.32 μs	0.59	0.08	False
[GetPathRoot - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_Path.GetPathRoot.html>)	76.77 ns	55.26 ns	0.72	0.18	False
[HasExtension - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_Path.HasExtension.html>)	120.30 ns	82.87 ns	0.69	0.17	False
[GetFullPathNoRedundantSegments - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_Path.GetFullPathNoRedundantSegments.html>)	6.35 μs	3.93 μs	0.62	0.04	False
[GetFullPathWithRedundantSegments - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_Path.GetFullPathWithRedundantSegments.html>)	20.29 μs	13.61 μs	0.67	0.05	False
[GetExtension - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_Path.GetExtension.html>)	369.92 ns	300.79 ns	0.81	0.11	False
[GetFullPathForTypicalLongPath - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_Path.GetFullPathForTypicalLongPath.html>)	29.42 μs	18.00 μs	0.61	0.05	False
[GetFullPathForLegacyLength - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_Path.GetFullPathForLegacyLength.html>)	11.67 μs	7.36 μs	0.63	0.06	False
[Combine - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_Path.Combine.html>)	104.80 ns	76.03 ns	0.73	0.18	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Tests.Perf_Path*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.IO.Tests.Perf_Path.ChangeExtension ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 410.56291994009183 < 486.07318085178093. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.17342132729242 (T) = (0 -402.64821326352507) / Math.Sqrt((2058.945244871106 / (299)) + (52.11686547191306 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07199836090123686 = (433.8873944819326 - 402.64821326352507) / 433.8873944819326 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_Path.GetFileNameWithoutExtension ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 520.0781729762735 < 668.6446347098882. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.32935111017529 (T) = (0 -528.8763707734174) / Math.Sqrt((3876.7680613474167 / (299)) + (107.5688455953901 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11223416468400287 = (595.7385942715015 - 528.8763707734174) / 595.7385942715015 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_Path.GetFileName ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 459.51053725400686 < 577.3155766165812. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.280869011699599 (T) = (0 -458.6631249118894) / Math.Sqrt((2692.983445007455 / (299)) + (120.0035841512964 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.10042891088921822 = (509.86868126817404 - 458.6631249118894) / 509.86868126817404 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_Path.IsPathRooted ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 40.74659150261951 < 49.342899257325236. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.783751203477502 (T) = (0 -41.0224248768013) / Math.Sqrt((21.43096664841252 / (299)) + (1.985631051781018 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07944440623795859 = (44.56268057549317 - 41.0224248768013) / 44.56268057549317 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_Path.GetFullPathForReallyLongPath ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 34.323147890502355 < 54.993669176745584. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.029654134716122 (T) = (0 -34772.9149930707) / Math.Sqrt((92420750.12309977 / (299)) + (661707.2933176645 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1404875489424631 = (40456.55761040622 - 34772.9149930707) / 40456.55761040622 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_Path.GetPathRoot ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 55.26172113064394 < 71.23518847918707. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.923657587555304 (T) = (0 -55.56893926437484) / Math.Sqrt((54.95283034532088 / (299)) + (1.5234598677663325 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1227248117606033 = (63.34265463029466 - 55.56893926437484) / 63.34265463029466 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_Path.HasExtension ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 82.87380345091216 < 113.7947161978122. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.254632653415209 (T) = (0 -83.34875816268877) / Math.Sqrt((206.66245946204074 / (299)) + (7.943344292647473 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12674694300825434 = (95.44628271879799 - 83.34875816268877) / 95.44628271879799 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_Path.GetFullPathNoRedundantSegments ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.92750424611139 < 6.035753392612282. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.180573747848031 (T) = (0 -3934.6994381705044) / Math.Sqrt((1085728.4013277476 / (299)) + (8725.46475880797 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12555626492756009 = (4499.659932773776 - 3934.6994381705044) / 4499.659932773776 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_Path.GetFullPathWithRedundantSegments ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 13.610064619502314 < 19.318529772109954. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.626430196103755 (T) = (0 -13767.474851204173) / Math.Sqrt((8576419.837122535 / (299)) + (171275.4520152812 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1107748132424632 = (15482.551614856724 - 13767.474851204173) / 15482.551614856724 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_Path.GetExtension ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 300.7870938475281 < 355.326862872643. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.37588312174062 (T) = (0 -300.7564234780727) / Math.Sqrt((740.177555484394 / (299)) + (30.636358426122552 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.08660652772147902 = (329.273672963543 - 300.7564234780727) / 329.273672963543 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_Path.GetFullPathForTypicalLongPath ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 18.001761843114693 < 28.057743671642765. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.00413191943654 (T) = (0 -17989.316518145333) / Math.Sqrt((23504356.862088975 / (299)) + (49127.03903104329 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.135537477993266 = (20809.828141983002 - 17989.316518145333) / 20809.828141983002 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_Path.GetFullPathForLegacyLength ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 7.356858848288185 < 11.110892668389905. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.496509067286292 (T) = (0 -7058.8671395555475) / Math.Sqrt((3841658.5919331857 / (299)) + (13273.299419985438 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.1334081532244889 = (8145.549910053715 - 7058.8671395555475) / 8145.549910053715 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_Path.Combine ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 76.03344812203164 < 98.23653171835953. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.62223726365611 (T) = (0 -76.65058844981596) / Math.Sqrt((96.34488251452072 / (299)) + (2.0280655723659753 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1150060156809717 = (86.61142313729498 - 76.65058844981596) / 86.61142313729498 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Collections.ContainsTrue<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Stack - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.ContainsTrue(Int32).Stack(Size%3a%20512).html>)	2.03 ms	1.18 ms	0.58	0.06	False
[List - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.ContainsTrue(Int32).List(Size%3a%20512).html>)	1.81 ms	1.07 ms	0.59	0.07	False
[ImmutableHashSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.ContainsTrue(Int32).ImmutableHashSet(Size%3a%20512).html>)	291.87 μs	237.71 μs	0.81	0.03	False
[ICollection - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.ContainsTrue(Int32).ICollection(Size%3a%20512).html>)	1.81 ms	1.07 ms	0.59	0.06	False
[ImmutableArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.ContainsTrue(Int32).ImmutableArray(Size%3a%20512).html>)	1.86 ms	1.10 ms	0.59	0.07	False
[Queue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.ContainsTrue(Int32).Queue(Size%3a%20512).html>)	1.82 ms	1.11 ms	0.61	0.08	False
[Span - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.ContainsTrue(Int32).Span(Size%3a%20512).html>)	1.79 ms	1.05 ms	0.58	0.07	False
[Array - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.ContainsTrue(Int32).Array(Size%3a%20512).html>)	1.81 ms	1.08 ms	0.60	0.06	False
[HashSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.ContainsTrue(Int32).HashSet(Size%3a%20512).html>)	123.85 μs	99.50 μs	0.80	0.04	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.ContainsTrue<Int32>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.ContainsTrue<Int32>.Stack(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.1833448036242602 < 1.913936658285757. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.907126073580686 (T) = (0 -1209314.7357203548) / Math.Sqrt((110684943526.87688 / (299)) + (186458672.58117086 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14843661671020697 = (1420111.2441548188 - 1209314.7357203548) / 1420111.2441548188 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.ContainsTrue<Int32>.List(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.0689213705357143 < 1.7192050430879884. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.712718183514369 (T) = (0 -1076334.472072875) / Math.Sqrt((87459867743.39961 / (299)) + (363255082.07101876 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14683141113910603 = (1261573.0186573563 - 1076334.472072875) / 1261573.0186573563 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.ContainsTrue<Int32>.ImmutableHashSet(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 237.7142409361472 < 284.8443684148546. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.198837483827628 (T) = (0 -238867.3307022832) / Math.Sqrt((638609275.7362319 / (299)) + (12135027.522597535 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.05001260356866948 = (251442.63134395133 - 238867.3307022832) / 251442.63134395133 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.ContainsTrue<Int32>.ICollection(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.070507878611111 < 1.7212484852571097. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.191004940424628 (T) = (0 -1083079.7823316199) / Math.Sqrt((86638809812.72339 / (299)) + (968713154.2553855 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.14160481377027306 = (1261749.599375971 - 1083079.7823316199) / 1261749.599375971 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.ContainsTrue<Int32>.ImmutableArray(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.1004283339285716 < 1.7707174971011397. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.389586287014351 (T) = (0 -1122865.182531309) / Math.Sqrt((88639635003.51622 / (299)) + (742186009.7061424 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.14007914532221058 = (1305777.3589547893 - 1122865.182531309) / 1305777.3589547893 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.ContainsTrue<Int32>.Queue(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.1093375309311226 < 1.7239872443652702. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.630963500893024 (T) = (0 -1090000.3988904995) / Math.Sqrt((87399561388.43463 / (299)) + (975732316.092055 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.13463448148607626 = (1259583.8123551966 - 1090000.3988904995) / 1259583.8123551966 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.ContainsTrue<Int32>.Span(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.0484148269444444 < 1.7006264326851852. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.932388371600558 (T) = (0 -1066269.3473159883) / Math.Sqrt((86389285189.99321 / (299)) + (1000952006.295055 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1402735557382512 = (1240242.584641675 - 1066269.3473159883) / 1240242.584641675 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.ContainsTrue<Int32>.Array(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.0775268613095237 < 1.725155379247685. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.59332969252098 (T) = (0 -1089158.6340038194) / Math.Sqrt((86059182568.54243 / (299)) + (1019598112.1866113 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14540634085420662 = (1274475.4449646687 - 1089158.6340038194) / 1274475.4449646687 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.ContainsTrue<Int32>.HashSet(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 99.5042001326964 < 117.79578236589268. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.509134014169614 (T) = (0 -101097.96493922663) / Math.Sqrt((85177018.24981867 / (299)) + (2613936.932241822 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07641942835109476 = (109463.07018859481 - 101097.96493922663) / 109463.07018859481 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in System.IO.Tests.BinaryWriterExtendedTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[WriteAsciiCharArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.BinaryWriterExtendedTests.WriteAsciiCharArray(StringLengthInChars%3a%2032).html>)	893.45 ns	641.71 ns	0.72	0.08	False
[WriteAsciiString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.BinaryWriterExtendedTests.WriteAsciiString(StringLengthInChars%3a%208000).html>)	71.00 μs	40.56 μs	0.57	0.09	False
[WriteAsciiCharArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.BinaryWriterExtendedTests.WriteAsciiCharArray(StringLengthInChars%3a%202000000).html>)	17.63 ms	9.91 ms	0.56	0.12	False
[WriteAsciiCharArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.BinaryWriterExtendedTests.WriteAsciiCharArray(StringLengthInChars%3a%208000).html>)	71.41 μs	40.03 μs	0.56	0.14	False
[WriteAsciiString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.BinaryWriterExtendedTests.WriteAsciiString(StringLengthInChars%3a%2032).html>)	651.79 ns	435.49 ns	0.67	0.13	False
[WriteAsciiString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.BinaryWriterExtendedTests.WriteAsciiString(StringLengthInChars%3a%202000000).html>)	25.84 ms	14.97 ms	0.58	0.13	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Tests.BinaryWriterExtendedTests*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.IO.Tests.BinaryWriterExtendedTests.WriteAsciiCharArray(StringLengthInChars: 32) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 641.710041788794 < 840.4102649432274. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.71989308910403 (T) = (0 -651.4760191820967) / Math.Sqrt((9737.755397415936 / (299)) + (192.18457149290802 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.11235808888970972 = (733.9401294911933 - 651.4760191820967) / 733.9401294911933 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.BinaryWriterExtendedTests.WriteAsciiString(StringLengthInChars: 8000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 40.55759591274982 < 67.52795358766755. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.390535032858056 (T) = (0 -40898.80853569566) / Math.Sqrt((167632388.78160948 / (299)) + (577776.3381365541 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1478434945934561 = (47994.48021133606 - 40898.80853569566) / 47994.48021133606 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.BinaryWriterExtendedTests.WriteAsciiCharArray(StringLengthInChars: 2000000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 9.90716190625 < 16.751302485384617. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.900599693581674 (T) = (0 -9975458.153417712) / Math.Sqrt((10684664155877.543 / (299)) + (21785912038.581432 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15869960247231965 = (11857189.397190914 - 9975458.153417712) / 11857189.397190914 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.BinaryWriterExtendedTests.WriteAsciiCharArray(StringLengthInChars: 8000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 40.03071715153452 < 67.52351175246888. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.017967401316609 (T) = (0 -40253.01968815939) / Math.Sqrt((171119146.75561127 / (299)) + (459267.7200532843 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.15941276179404118 = (47886.784212986924 - 40253.01968815939) / 47886.784212986924 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.BinaryWriterExtendedTests.WriteAsciiString(StringLengthInChars: 32) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 435.4874805047754 < 580.9269370337629. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.478875618891293 (T) = (0 -425.64217893691495) / Math.Sqrt((7607.124303363251 / (299)) + (157.77003778875448 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07492155869060166 = (460.1146885819126 - 425.64217893691495) / 460.1146885819126 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.BinaryWriterExtendedTests.WriteAsciiString(StringLengthInChars: 2000000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 14.968630754464286 < 24.530092482407408. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.161427298922254 (T) = (0 -15011382.412298692) / Math.Sqrt((20891759415474.99 / (299)) + (15434045288.034777 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.1520369974640135 = (17702874.26150014 - 15011382.412298692) / 17702874.26150014 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in System.Numerics.Tests.Perf_VectorOf<UInt16>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[LessThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt16).LessThanBenchmark.html>)	293.06 ns	168.51 ns	0.58	0.09	False
[GreaterThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt16).GreaterThanBenchmark.html>)	309.23 ns	163.56 ns	0.53	0.10	False
[MaxBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt16).MaxBenchmark.html>)	341.26 ns	192.15 ns	0.56	0.09	False
[EqualsStaticBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt16).EqualsStaticBenchmark.html>)	291.48 ns	164.48 ns	0.56	0.08	False
[GreaterThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt16).GreaterThanAllBenchmark.html>)	367.95 ns	209.19 ns	0.57	0.11	False
[GetHashCodeBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt16).GetHashCodeBenchmark.html>)	989.42 ns	759.61 ns	0.77	0.01	False
[GreaterThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt16).GreaterThanOrEqualBenchmark.html>)	314.08 ns	178.96 ns	0.57	0.12	False
[InequalityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt16).InequalityOperatorBenchmark.html>)	39.30 ns	26.68 ns	0.68	0.28	False
[LessThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt16).LessThanAnyBenchmark.html>)	320.17 ns	187.63 ns	0.59	0.13	False
[EqualityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt16).EqualityOperatorBenchmark.html>)	37.29 ns	22.45 ns	0.60	0.26	False
[LessThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt16).LessThanOrEqualAnyBenchmark.html>)	332.85 ns	193.10 ns	0.58	0.09	False
[GreaterThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt16).GreaterThanAnyBenchmark.html>)	349.83 ns	196.04 ns	0.56	0.12	False
[OnesComplementOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt16).OnesComplementOperatorBenchmark.html>)	156.89 ns	95.65 ns	0.61	0.14	False
[LessThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt16).LessThanAllBenchmark.html>)	379.23 ns	228.06 ns	0.60	0.11	False
[ConditionalSelectBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt16).ConditionalSelectBenchmark.html>)	276.66 ns	178.99 ns	0.65	0.25	False
[DivisionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt16).DivisionOperatorBenchmark.html>)	296.52 ns	184.50 ns	0.62	0.10	False
[MultiplyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt16).MultiplyBenchmark.html>)	289.15 ns	163.66 ns	0.57	0.06	False
[GreaterThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt16).GreaterThanOrEqualAnyBenchmark.html>)	361.54 ns	212.15 ns	0.59	0.15	False
[SubtractBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt16).SubtractBenchmark.html>)	290.96 ns	163.75 ns	0.56	0.11	False
[SubtractionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt16).SubtractionOperatorBenchmark.html>)	293.20 ns	161.60 ns	0.55	0.11	False
[LessThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt16).LessThanOrEqualAllBenchmark.html>)	401.21 ns	230.43 ns	0.57	0.09	False
[EqualsAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt16).EqualsAllBenchmark.html>)	40.71 ns	22.69 ns	0.56	0.26	False
[AddBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt16).AddBenchmark.html>)	293.73 ns	163.75 ns	0.56	0.11	False
[SquareRootBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt16).SquareRootBenchmark.html>)	233.31 ns	144.52 ns	0.62	0.09	False
[LessThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt16).LessThanOrEqualBenchmark.html>)	303.86 ns	171.55 ns	0.56	0.09	False
[GreaterThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt16).GreaterThanOrEqualAllBenchmark.html>)	459.81 ns	224.60 ns	0.49	0.12	False
[AndNotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt16).AndNotBenchmark.html>)	212.25 ns	123.70 ns	0.58	0.21	False
[OnesComplementBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt16).OnesComplementBenchmark.html>)	156.02 ns	96.56 ns	0.62	0.18	False
[MultiplyOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt16).MultiplyOperatorBenchmark.html>)	288.27 ns	167.58 ns	0.58	0.09	False
[MinBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt16).MinBenchmark.html>)	344.69 ns	198.40 ns	0.58	0.07	False
[OneBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt16).OneBenchmark.html>)	124.14 ns	71.10 ns	0.57	0.10	False
[AddOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt16).AddOperatorBenchmark.html>)	286.38 ns	161.91 ns	0.57	0.10	False
[EqualsAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt16).EqualsAnyBenchmark.html>)	349.99 ns	196.62 ns	0.56	0.12	False
[NegateBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt16).NegateBenchmark.html>)	309.47 ns	163.68 ns	0.53	0.13	False
[DotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt16).DotBenchmark.html>)	280.15 ns	151.75 ns	0.54	0.11	False
[UnaryNegateOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt16).UnaryNegateOperatorBenchmark.html>)	290.46 ns	163.06 ns	0.56	0.10	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_VectorOf<UInt16>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorOf<UInt16>.LessThanBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 168.51094009103159 < 278.16688468592434. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.242854759076828 (T) = (0 -170.43338628951918) / Math.Sqrt((2577.8989169943015 / (299)) + (17.3552336444621 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.13954778667975928 = (198.07420290298882 - 170.43338628951918) / 198.07420290298882 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt16>.GreaterThanBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 163.55822637910467 < 289.65228864938217. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.537017554143985 (T) = (0 -165.81494239698003) / Math.Sqrt((2856.7113669625346 / (299)) + (19.662262776948584 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.17964196928946805 = (202.12509195937741 - 165.81494239698003) / 202.12509195937741 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt16>.MaxBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 192.14520084332005 < 324.36105254782757. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.820753126593303 (T) = (0 -194.18015994648877) / Math.Sqrt((3588.338991380254 / (299)) + (30.235178812714235 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15189885437374884 = (228.95872850531654 - 194.18015994648877) / 228.95872850531654 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt16>.EqualsStaticBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 164.4830395130678 < 290.7749130098658. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.203638897160285 (T) = (0 -166.53796971113238) / Math.Sqrt((2929.186227067911 / (299)) + (95.38358064732914 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1720296805761773 = (201.1400237474994 - 166.53796971113238) / 201.1400237474994 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt16>.GreaterThanAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 209.19378909201498 < 348.8020935290839. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.865055022090003 (T) = (0 -212.0024289896409) / Math.Sqrt((3799.5621343763037 / (299)) + (32.019981438218494 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.19251822490199708 = (262.54763330591635 - 212.0024289896409) / 262.54763330591635 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt16>.GetHashCodeBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 759.6148507264567 < 943.1370860795539. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.633653714126286 (T) = (0 -736.1518610845266) / Math.Sqrt((9903.180877392972 / (299)) + (113.86253297709813 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10548489760046918 = (822.9619143486835 - 736.1518610845266) / 822.9619143486835 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt16>.GreaterThanOrEqualBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 178.95515134225843 < 300.1884790770216. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.587197008027905 (T) = (0 -179.949062243082) / Math.Sqrt((3201.818706094526 / (299)) + (29.45331472613618 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1378917036305701 = (208.73138908521813 - 179.949062243082) / 208.73138908521813 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt16>.InequalityOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 26.67512108738908 < 36.72828130921898. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 5.878950466706519 (T) = (0 -23.743300515643234) / Math.Sqrt((53.278205181066525 / (299)) + (6.301104809807025 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11777816557168072 = (26.913072867924335 - 23.743300515643234) / 26.913072867924335 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt16>.LessThanAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 187.6274853696754 < 307.11593967785126. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.107365503446792 (T) = (0 -191.75829472110357) / Math.Sqrt((3224.018794538612 / (299)) + (113.3466584043085 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13141813298548208 = (220.7716992529599 - 191.75829472110357) / 220.7716992529599 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt16>.EqualityOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 22.454638286429333 < 35.44545890551192. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.603955697043387 (T) = (0 -22.89511364886519) / Math.Sqrt((41.95397012906191 / (299)) + (2.908870733661553 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11227486184456333 = (25.790768634126884 - 22.89511364886519) / 25.790768634126884 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt16>.LessThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 193.10021390349917 < 316.9025692768379. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.09253000015083 (T) = (0 -192.84538134130548) / Math.Sqrt((3174.3085604104276 / (299)) + (13.352018862313798 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.17127918409514428 = (232.70247065140185 - 192.84538134130548) / 232.70247065140185 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt16>.GreaterThanAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 196.03908517948375 < 333.76977500029886. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.653191775598772 (T) = (0 -199.08603568798657) / Math.Sqrt((3983.7535988813033 / (299)) + (28.480941128367665 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1788256751597079 = (242.4406483077832 - 199.08603568798657) / 242.4406483077832 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt16>.OnesComplementOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 95.64564214785385 < 148.11525853066735. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.700408961061461 (T) = (0 -98.1162678272103) / Math.Sqrt((534.7195723293361 / (299)) + (9.707935141108194 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15347406438887592 = (115.90462111048988 - 98.1162678272103) / 115.90462111048988 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt16>.LessThanAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 228.06214493349052 < 360.30217386096916. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.868508422380875 (T) = (0 -230.6884944913551) / Math.Sqrt((4027.465543244285 / (299)) + (255.92178746079097 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1540567559907785 = (272.6997303011033 - 230.6884944913551) / 272.6997303011033 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt16>.ConditionalSelectBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 178.99096572315275 < 260.4232255613994. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.76816979302984 (T) = (0 -184.92722354589517) / Math.Sqrt((1225.8240339099882 / (299)) + (43.31963538392573 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10442971292324761 = (206.49102165896946 - 184.92722354589517) / 206.49102165896946 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt16>.DivisionOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 184.5048019736796 < 281.3871749981017. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.63344915485133 (T) = (0 -186.98177986253054) / Math.Sqrt((2345.7187270555587 / (299)) + (29.74402960210872 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.11800205519630858 = (211.99797682538542 - 186.98177986253054) / 211.99797682538542 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt16>.MultiplyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 163.6613674817109 < 275.03106648415235. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.281296593814728 (T) = (0 -165.40511615189445) / Math.Sqrt((2801.895228334781 / (299)) + (10.750135584093323 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.16122680553361735 = (197.1988580978952 - 165.40511615189445) / 197.1988580978952 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt16>.GreaterThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 212.1549153664627 < 349.28935211258164. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.384845516007704 (T) = (0 -218.00601531452247) / Math.Sqrt((4481.483418312259 / (299)) + (203.6679202087236 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1277429872907421 = (249.93323313892185 - 218.00601531452247) / 249.93323313892185 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt16>.SubtractBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 163.7509982838994 < 276.9819269795355. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.10973823828442 (T) = (0 -166.59373798901782) / Math.Sqrt((2981.5498366434826 / (299)) + (20.911210034868958 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.16331047121952383 = (199.11058075728272 - 166.59373798901782) / 199.11058075728272 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt16>.SubtractionOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 161.60364125594765 < 277.52087171121735. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.969478062106813 (T) = (0 -163.8149568096487) / Math.Sqrt((3053.69220931075 / (299)) + (23.537334979481198 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.16558963375704228 = (196.32421100812428 - 163.8149568096487) / 196.32421100812428 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt16>.LessThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 230.43130184259556 < 374.11584712258303. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.616025676380653 (T) = (0 -232.1705654439215) / Math.Sqrt((3845.0976723237854 / (299)) + (43.54400058972255 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.18862879635407975 = (286.1459272903158 - 232.1705654439215) / 286.1459272903158 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt16>.EqualsAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 22.691892387002333 < 35.65989899920132. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.723227926532861 (T) = (0 -22.681249004376763) / Math.Sqrt((43.569609150893854 / (299)) + (3.9609625290387505 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12151001194046147 = (25.818449057656842 - 22.681249004376763) / 25.818449057656842 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt16>.AddBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 163.74884774940273 < 278.6520042008469. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.220928888720522 (T) = (0 -165.49422554113107) / Math.Sqrt((3141.4784482712985 / (299)) + (10.361108862092223 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.16803604170896788 = (198.91994586049 - 165.49422554113107) / 198.91994586049 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt16>.SquareRootBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 144.5220348007821 < 221.4376891491469. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.661891046142529 (T) = (0 -145.44460152434303) / Math.Sqrt((1590.3901277184377 / (299)) + (13.72374172698302 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13546968362433195 = (168.2353976134509 - 145.44460152434303) / 168.2353976134509 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt16>.LessThanOrEqualBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 171.5467981576243 < 286.81528635789937. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.548546907911255 (T) = (0 -175.41321030689178) / Math.Sqrt((2564.7710270469265 / (299)) + (136.01239502080793 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.16660171028540643 = (210.47944598850086 - 175.41321030689178) / 210.47944598850086 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt16>.GreaterThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 224.5958553640286 < 359.38452567856916. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.841095455622794 (T) = (0 -228.41129469290144) / Math.Sqrt((4294.299775469343 / (299)) + (165.36886355432296 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1520273561982462 = (269.3616313715674 - 228.41129469290144) / 269.3616313715674 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt16>.AndNotBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 123.70359761727961 < 183.2264848277856. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.973013111578227 (T) = (0 -123.41585076888518) / Math.Sqrt((772.4408731283901 / (299)) + (20.92765564745448 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13261734859770583 = (142.28535764389483 - 123.41585076888518) / 142.28535764389483 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt16>.OnesComplementBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 96.56105352414117 < 148.2896606601069. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.070466448133478 (T) = (0 -97.7753243309699) / Math.Sqrt((529.7610185604368 / (299)) + (9.323197039121949 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15690736145490966 = (115.97221925659201 - 97.7753243309699) / 115.97221925659201 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt16>.MultiplyOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 167.58262007676683 < 275.74536339213404. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.908055282284558 (T) = (0 -165.53089135273902) / Math.Sqrt((3090.912892404621 / (299)) + (55.615741096249366 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15336530530682743 = (195.51630991537476 - 165.53089135273902) / 195.51630991537476 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt16>.MinBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 198.39778059353645 < 328.5310298566544. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.19495402499334 (T) = (0 -200.166666475911) / Math.Sqrt((3629.174160011314 / (299)) + (9.910180379053925 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1388386877805473 = (232.43806199331658 - 200.166666475911) / 232.43806199331658 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt16>.OneBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 71.09919769959089 < 117.91127916084386. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.893601741421307 (T) = (0 -73.07011326712271) / Math.Sqrt((394.81061010932615 / (299)) + (1.3966778316906838 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.16989791708859636 = (88.0254546655817 - 73.07011326712271) / 88.0254546655817 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt16>.AddOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 161.9072624918453 < 273.6334167338017. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.517899961033844 (T) = (0 -164.43414595366465) / Math.Sqrt((2998.2192687348092 / (299)) + (38.49623047584751 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15929041143952027 = (195.58971158544773 - 164.43414595366465) / 195.58971158544773 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt16>.EqualsAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 196.61891618666644 < 332.5270630096537. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.912618495176934 (T) = (0 -200.4399154003588) / Math.Sqrt((3944.6821102238146 / (299)) + (201.27352020225155 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1687575556330346 = (241.13291706729953 - 200.4399154003588) / 241.13291706729953 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt16>.NegateBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 163.684611531477 < 278.4125193451056. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.400223110788971 (T) = (0 -164.74882163577894) / Math.Sqrt((3021.579203681283 / (299)) + (10.201342208746665 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1683850474933523 = (198.1070940814547 - 164.74882163577894) / 198.1070940814547 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt16>.DotBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 151.74803451110188 < 266.69781770025094. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.803760891640796 (T) = (0 -155.18993995267417) / Math.Sqrt((2865.9425254547286 / (299)) + (126.03447869737896 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1476996984323945 = (182.08363843968945 - 155.18993995267417) / 182.08363843968945 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt16>.UnaryNegateOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 163.0556954658505 < 278.4369986366139. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.727265779994042 (T) = (0 -170.01504969800652) / Math.Sqrt((3154.4704953509613 / (299)) + (166.12601202560984 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14317421586101486 = (198.42429213174623 - 170.01504969800652) / 198.42429213174623 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in ByteMark

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[BenchAssignJagged - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/ByteMark.BenchAssignJagged.html>)	13.93 secs	8.69 secs	0.62	0.02	False
[BenchNumericSortRectangular - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/ByteMark.BenchNumericSortRectangular.html>)	8.03 secs	5.89 secs	0.73	0.07	False
[BenchStringSort - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/ByteMark.BenchStringSort.html>)	9.28 secs	7.61 secs	0.82	0.02	False
[BenchEmFloatClass - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/ByteMark.BenchEmFloatClass.html>)	7.65 secs	4.93 secs	0.64	0.02	False
[BenchNeuralJagged - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/ByteMark.BenchNeuralJagged.html>)	9.01 secs	5.94 secs	0.66	0.05	False
[BenchAssignRectangular - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/ByteMark.BenchAssignRectangular.html>)	15.80 secs	10.23 secs	0.65	0.05	False
[BenchLUDecomp - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/ByteMark.BenchLUDecomp.html>)	15.95 secs	10.51 secs	0.66	0.06	False
[BenchNeural - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/ByteMark.BenchNeural.html>)	6.64 secs	4.78 secs	0.72	0.06	False
[BenchIDEAEncryption - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/ByteMark.BenchIDEAEncryption.html>)	16.52 secs	10.58 secs	0.64	0.03	False
[BenchNumericSortJagged - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/ByteMark.BenchNumericSortJagged.html>)	7.87 secs	5.35 secs	0.68	0.08	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'ByteMark*'

### Payloads [Baseline]() [Compare]() ### Histogram #### ByteMark.BenchAssignJagged ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 8.690940515571429 < 13.233436577356922. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.334229814908824 (T) = (0 -8702662444.824282) / Math.Sqrt((4.47034372038088E+18 / (299)) + (1227795690435951.8 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1374588664598161 = (10089562232.3603 - 8702662444.824282) / 10089562232.3603 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### ByteMark.BenchNumericSortRectangular ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.890402948538462 < 7.670278368933242. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.334432031807987 (T) = (0 -5981336561.147867) / Math.Sqrt((6.389640014115507E+17 / (299)) + (5927981686985347 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09549653531960003 = (6612839856.02126 - 5981336561.147867) / 6612839856.02126 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### ByteMark.BenchStringSort ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 7.6123792428 < 8.808380062214285. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.843494816523688 (T) = (0 -7475218660.062721) / Math.Sqrt((4.304996071861562E+17 / (299)) + (4160923512105077 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08498844950258704 = (8169534751.773449 - 7475218660.062721) / 8169534751.773449 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### ByteMark.BenchEmFloatClass ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 4.9292603718 < 7.223073209846667. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.83087225801191 (T) = (0 -4972783414.982028) / Math.Sqrt((1.1202200566707638E+18 / (299)) + (3750610113709793 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11855568533675329 = (5641630823.703101 - 4972783414.982028) / 5641630823.703101 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### ByteMark.BenchNeuralJagged ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.9448628858 < 8.519364417448333. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.749714226391085 (T) = (0 -6031009112.4138775) / Math.Sqrt((1.0881308157117454E+18 / (299)) + (6481316195856027 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15279024833538432 = (7118672914.899791 - 6031009112.4138775) / 7118672914.899791 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### ByteMark.BenchAssignRectangular ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 10.2289623145 < 14.986963177807949. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.257289069285784 (T) = (0 -10277461455.115738) / Math.Sqrt((5.967630027342448E+18 / (299)) + (5099906498464108 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11311891202491263 = (11588319555.422106 - 10277461455.115738) / 11588319555.422106 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### ByteMark.BenchLUDecomp ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 10.50958513342857 < 15.177811462772619. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.89418551572653 (T) = (0 -10573106032.980492) / Math.Sqrt((4.936645929572833E+18 / (299)) + (25386824836775296 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11834709800991725 = (11992367981.90613 - 10573106032.980492) / 11992367981.90613 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### ByteMark.BenchNeural ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 4.782981034923076 < 6.312478928077884. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.62935909427413 (T) = (0 -4807996715.801415) / Math.Sqrt((4.450670829546502E+17 / (299)) + (4836952711614305 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12708294444140636 = (5507965144.208004 - 4807996715.801415) / 5507965144.208004 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### ByteMark.BenchIDEAEncryption ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 10.577409712928572 < 15.699424155204285. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.366123599110635 (T) = (0 -10524108642.97614) / Math.Sqrt((5.199846144928654E+18 / (299)) + (49744350785714776 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12746190774979657 = (12061489047.240717 - 10524108642.97614) / 12061489047.240717 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### ByteMark.BenchNumericSortJagged ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.349627754071428 < 7.472626811561538. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.388519181199701 (T) = (0 -5422049537.812961) / Math.Sqrt((1.0573761772880736E+18 / (299)) + (18816267607191796 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10660223627102731 = (6069020718.36597 - 5422049537.812961) / 6069020718.36597 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Threading.Channels.Tests.SpscUnboundedChannelPerfTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ReadAsyncThenWriteAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Threading.Channels.Tests.SpscUnboundedChannelPerfTests.ReadAsyncThenWriteAsync.html>)	1.64 μs	1.38 μs	0.84	0.06	False
[TryWriteThenTryRead - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Threading.Channels.Tests.SpscUnboundedChannelPerfTests.TryWriteThenTryRead.html>)	406.67 ns	321.19 ns	0.79	0.15	False
[WriteAsyncThenReadAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Threading.Channels.Tests.SpscUnboundedChannelPerfTests.WriteAsyncThenReadAsync.html>)	858.80 ns	732.47 ns	0.85	0.07	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Threading.Channels.Tests.SpscUnboundedChannelPerfTests*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Threading.Channels.Tests.SpscUnboundedChannelPerfTests.ReadAsyncThenWriteAsync ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.378972405820946 < 1.5337525483320527. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 28.583482862161148 (T) = (0 -1395.7436557418675) / Math.Sqrt((3306.810891014689 / (299)) + (788.3260593791408 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09311445862621535 = (1539.0516135338778 - 1395.7436557418675) / 1539.0516135338778 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Threading.Channels.Tests.SpscUnboundedChannelPerfTests.TryWriteThenTryRead ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 321.18613225794996 < 384.82129539817447. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.706441310288977 (T) = (0 -327.36603878547544) / Math.Sqrt((722.6771496234718 / (299)) + (45.34888322911923 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07482890872711627 = (353.84378292135506 - 327.36603878547544) / 353.84378292135506 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Threading.Channels.Tests.SpscUnboundedChannelPerfTests.WriteAsyncThenReadAsync ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 732.4670005646434 < 834.0691617840332. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 28.5887627250345 (T) = (0 -744.0008930700475) / Math.Sqrt((1053.8987451914227 / (299)) + (266.1405345697722 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.0995465729435075 = (826.2513870396658 - 744.0008930700475) / 826.2513870396658 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in Microsoft.Extensions.Primitives.StringSegmentBenchmark

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[StartsWith - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Primitives.StringSegmentBenchmark.StartsWith.html>)	169.32 ns	117.94 ns	0.70	0.24	False
[SubSegment - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Primitives.StringSegmentBenchmark.SubSegment.html>)	59.67 ns	39.33 ns	0.66	0.22	False
[TrimStart - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Primitives.StringSegmentBenchmark.TrimStart.html>)	407.88 ns	288.73 ns	0.71	0.15	False
[TrimEnd - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Primitives.StringSegmentBenchmark.TrimEnd.html>)	449.78 ns	344.08 ns	0.77	0.09	False
[EndsWith - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Primitives.StringSegmentBenchmark.EndsWith.html>)	175.23 ns	133.47 ns	0.76	0.28	False
[Equals_Object_Valid - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Primitives.StringSegmentBenchmark.Equals_Object_Valid.html>)	305.86 ns	218.24 ns	0.71	0.20	False
[LastIndexOf - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Primitives.StringSegmentBenchmark.LastIndexOf.html>)	126.76 ns	91.26 ns	0.72	0.16	False
[Indexer - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Primitives.StringSegmentBenchmark.Indexer.html>)	433.16 ns	299.64 ns	0.69	0.08	False
[SubString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Primitives.StringSegmentBenchmark.SubString.html>)	243.48 ns	206.51 ns	0.85	0.07	False
[Trim - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Primitives.StringSegmentBenchmark.Trim.html>)	944.66 ns	709.74 ns	0.75	0.04	False
[Equals_String - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Primitives.StringSegmentBenchmark.Equals_String.html>)	225.93 ns	159.72 ns	0.71	0.21	False
[IndexOfAny - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Primitives.StringSegmentBenchmark.IndexOfAny.html>)	163.68 ns	113.71 ns	0.69	0.27	False
[GetValue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Primitives.StringSegmentBenchmark.GetValue.html>)	49.59 ns	37.44 ns	0.75	0.23	False
[Ctor_String - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Primitives.StringSegmentBenchmark.Ctor_String.html>)	27.79 ns	20.27 ns	0.73	0.29	False
[Equals_Valid - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Primitives.StringSegmentBenchmark.Equals_Valid.html>)	266.42 ns	196.28 ns	0.74	0.16	False
[GetSegmentHashCode - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Primitives.StringSegmentBenchmark.GetSegmentHashCode.html>)	164.61 ns	115.15 ns	0.70	0.17	False
[IndexOf - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Primitives.StringSegmentBenchmark.IndexOf.html>)	180.59 ns	139.58 ns	0.77	0.17	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Microsoft.Extensions.Primitives.StringSegmentBenchmark*'

### Payloads [Baseline]() [Compare]() ### Histogram #### Microsoft.Extensions.Primitives.StringSegmentBenchmark.StartsWith ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 117.942073755999 < 160.55717343287554. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.231980404984707 (T) = (0 -122.06544909018876) / Math.Sqrt((350.19785084984943 / (299)) + (25.245413740354284 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10513484089626426 = (136.4065276744544 - 122.06544909018876) / 136.4065276744544 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Primitives.StringSegmentBenchmark.SubSegment ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 39.33085703737939 < 56.85576290018233. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.927636276252465 (T) = (0 -40.69006012525059) / Math.Sqrt((70.64850746534343 / (299)) + (10.095775808174217 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09900562564067744 = (45.16128100598231 - 40.69006012525059) / 45.16128100598231 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Primitives.StringSegmentBenchmark.TrimStart ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 288.7289283606755 < 387.6942217006885. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.216787106881524 (T) = (0 -293.8699662106772) / Math.Sqrt((2081.4103776962243 / (299)) + (36.94599122300049 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11044569949146238 = (330.3564111181055 - 293.8699662106772) / 330.3564111181055 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Primitives.StringSegmentBenchmark.TrimEnd ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 344.08247748570733 < 428.8292918154039. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.01698607106245 (T) = (0 -323.3468589191956) / Math.Sqrt((2568.35293457807 / (299)) + (33.71795599349218 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10877568616593168 = (362.8119811141032 - 323.3468589191956) / 362.8119811141032 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Primitives.StringSegmentBenchmark.EndsWith ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 133.47365595620326 < 166.61758843773129. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.170550957698017 (T) = (0 -124.05422741555172) / Math.Sqrt((425.8840686535967 / (299)) + (26.364747554605355 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11898807903341947 = (140.80879550352586 - 124.05422741555172) / 140.80879550352586 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Primitives.StringSegmentBenchmark.Equals_Object_Valid ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 218.23601922689505 < 276.09768332515586. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.274581573275475 (T) = (0 -220.0173816561609) / Math.Sqrt((919.3695821513576 / (299)) + (35.36142112057877 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08979480213471323 = (241.7228358749981 - 220.0173816561609) / 241.7228358749981 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Primitives.StringSegmentBenchmark.LastIndexOf ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 91.26324993560482 < 119.90144126024923. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.065402057827109 (T) = (0 -91.99461376344365) / Math.Sqrt((234.0705419070289 / (299)) + (12.424608459661393 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.08092892304435674 = (100.09521142605116 - 91.99461376344365) / 100.09521142605116 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Primitives.StringSegmentBenchmark.Indexer ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 299.6373296889988 < 411.6567192117012. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 19.455487914279246 (T) = (0 -303.59400541175904) / Math.Sqrt((1779.7974785722647 / (299)) + (156.7844750315677 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.15976083850026285 = (361.3185618126584 - 303.59400541175904) / 361.3185618126584 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Primitives.StringSegmentBenchmark.SubString ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 206.5115405160134 < 230.28244136525475. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.166628737317073 (T) = (0 -205.9207786400821) / Math.Sqrt((169.16739699367187 / (299)) + (15.291232381765488 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07113101054485951 = (221.68979799925486 - 205.9207786400821) / 221.68979799925486 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Primitives.StringSegmentBenchmark.Trim ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 709.7446921989073 < 894.049999581679. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.814518367081654 (T) = (0 -696.05622638198) / Math.Sqrt((8888.000541120415 / (299)) + (59.04242484093653 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1056100004129551 = (778.2468796647559 - 696.05622638198) / 778.2468796647559 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Primitives.StringSegmentBenchmark.Equals_String ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 159.71819064492794 < 199.61610214150068. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.260015039391783 (T) = (0 -153.3506244600541) / Math.Sqrt((586.9593393741383 / (299)) + (23.34546847541907 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09369412696679572 = (169.2040502251449 - 153.3506244600541) / 169.2040502251449 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Primitives.StringSegmentBenchmark.IndexOfAny ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 113.71198874216616 < 157.1118742821513. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.823535456093687 (T) = (0 -117.01557240366287) / Math.Sqrt((467.6519032221779 / (299)) + (19.03053358933544 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09423942854035001 = (129.19040206739194 - 117.01557240366287) / 129.19040206739194 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Primitives.StringSegmentBenchmark.GetValue ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 37.442068856475466 < 47.40024615685561. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.07663641459655 (T) = (0 -37.70926141401378) / Math.Sqrt((24.256689257451747 / (299)) + (1.17019343985082 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10653144711231542 = (42.20547135334276 - 37.70926141401378) / 42.20547135334276 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Primitives.StringSegmentBenchmark.Ctor_String ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 20.27480771922356 < 23.799557824108184. IsChangePoint: Marked as a change because one of 5/25/2022 12:28:02 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.174674607594249 (T) = (0 -20.250474330063728) / Math.Sqrt((5.024171076722287 / (299)) + (0.534438253267224 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.054550011058997566 = (21.41887415192237 - 20.250474330063728) / 21.41887415192237 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Primitives.StringSegmentBenchmark.Equals_Valid ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 196.2828038677399 < 252.9421818564988. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.988343681180016 (T) = (0 -198.9917541565232) / Math.Sqrt((768.009301373937 / (299)) + (34.45668072927761 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09706439835008604 = (220.38310793472982 - 198.9917541565232) / 220.38310793472982 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Primitives.StringSegmentBenchmark.GetSegmentHashCode ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 115.15254018317272 < 154.8597332166698. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.307790071563815 (T) = (0 -112.76451231126472) / Math.Sqrt((453.76275611998597 / (299)) + (12.39457300314909 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.10779982893981405 = (126.38925206354602 - 112.76451231126472) / 126.38925206354602 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Primitives.StringSegmentBenchmark.IndexOf ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 139.57545607336334 < 173.59470232671046. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.238502706039636 (T) = (0 -116.88778074622323) / Math.Sqrt((712.70628635056 / (299)) + (15.288065493261563 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.13570399237296946 = (135.24044970095915 - 116.88778074622323) / 135.24044970095915 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Tests.Perf_UInt32

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[TryParseHex - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt32.TryParseHex(value%3a%20%223039%22).html>)	355.86 ns	232.00 ns	0.65	0.16	False
[ParseSpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt32.ParseSpan(value%3a%20%224294967295%22).html>)	456.36 ns	290.63 ns	0.64	0.11	False
[TryParse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt32.TryParse(value%3a%20%220%22).html>)	140.95 ns	100.88 ns	0.72	0.26	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt32.Parse(value%3a%20%220%22).html>)	163.59 ns	121.67 ns	0.74	0.25	False
[TryParse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt32.TryParse(value%3a%20%224294967295%22).html>)	425.76 ns	264.57 ns	0.62	0.12	False
[ParseSpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt32.ParseSpan(value%3a%20%220%22).html>)	194.91 ns	133.44 ns	0.68	0.24	False
[TryParseHex - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt32.TryParseHex(value%3a%20%220%22).html>)	169.90 ns	123.46 ns	0.73	0.24	False
[ParseSpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt32.ParseSpan(value%3a%20%2212345%22).html>)	306.58 ns	200.74 ns	0.65	0.20	False
[TryParse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt32.TryParse(value%3a%20%2212345%22).html>)	262.58 ns	173.70 ns	0.66	0.17	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt32.Parse(value%3a%20%2212345%22).html>)	282.37 ns	183.24 ns	0.65	0.19	False
[TryFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt32.TryFormat(value%3a%2012345).html>)	238.13 ns	157.63 ns	0.66	0.17	False
[TryFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt32.TryFormat(value%3a%200).html>)	137.87 ns	95.60 ns	0.69	0.21	False
[TryFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt32.TryFormat(value%3a%204294967295).html>)	366.17 ns	242.84 ns	0.66	0.12	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt32.Parse(value%3a%20%224294967295%22).html>)	434.37 ns	273.41 ns	0.63	0.13	False
[TryParseHex - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt32.TryParseHex(value%3a%20%22FFFFFFFF%22).html>)	541.50 ns	352.82 ns	0.65	0.10	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_UInt32*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Tests.Perf_UInt32.TryParseHex(value: "3039") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 232.00008780796526 < 329.2579452778898. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.657287603308355 (T) = (0 -237.65733440288273) / Math.Sqrt((2052.4642713310627 / (299)) + (43.22862636282049 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1102563943590831 = (267.1076621356429 - 237.65733440288273) / 267.1076621356429 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt32.ParseSpan(value: "4294967295") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 290.6254338776705 < 437.49970343207303. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.437229299457425 (T) = (0 -297.42309072836196) / Math.Sqrt((4495.693571418681 / (299)) + (55.46642574821647 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12317914487634725 = (339.2062232443344 - 297.42309072836196) / 339.2062232443344 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt32.TryParse(value: "0") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 100.87632282216838 < 133.80737185574435. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.47987109239528 (T) = (0 -103.60456411858522) / Math.Sqrt((283.5278623126358 / (299)) + (15.50136396502622 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09213303627789927 = (114.11866304047903 - 103.60456411858522) / 114.11866304047903 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt32.Parse(value: "0") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 121.66689402017886 < 156.45366789407518. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.97179042165918 (T) = (0 -117.6230157268423) / Math.Sqrt((370.184037778156 / (299)) + (18.26033481681671 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1129195543164517 = (132.5956583748239 - 117.6230157268423) / 132.5956583748239 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt32.TryParse(value: "4294967295") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 264.5672639722134 < 392.30490612296074. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.500234078823508 (T) = (0 -264.2053431323956) / Math.Sqrt((4224.428293793113 / (299)) + (24.94928623970808 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10938759914231791 = (296.6558099549919 - 264.2053431323956) / 296.6558099549919 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt32.ParseSpan(value: "0") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 133.44021151813268 < 179.04612240028462. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.953067611781117 (T) = (0 -136.4904948405832) / Math.Sqrt((409.78121392112774 / (299)) + (19.03258795986298 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11040936000953484 = (153.43067778011485 - 136.4904948405832) / 153.43067778011485 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt32.TryParseHex(value: "0") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 123.45883112193634 < 160.23858538788218. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.08173399598513 (T) = (0 -123.5874713983089) / Math.Sqrt((384.12624577095295 / (299)) + (20.52948453398077 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08628189887739253 = (135.25776850263503 - 123.5874713983089) / 135.25776850263503 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt32.ParseSpan(value: "12345") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 200.73529899305757 < 290.6016293996551. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.128538582488416 (T) = (0 -206.1895358778565) / Math.Sqrt((1554.4047757840995 / (299)) + (35.197106923493926 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12433909425668058 = (235.4673304763207 - 206.1895358778565) / 235.4673304763207 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt32.TryParse(value: "12345") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 173.70233680720912 < 244.8859863311412. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.300723459984964 (T) = (0 -172.82577043513172) / Math.Sqrt((1342.9660762673118 / (299)) + (23.5964389266838 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10657051079117533 = (193.440861895187 - 172.82577043513172) / 193.440861895187 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt32.Parse(value: "12345") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 183.2395483477973 < 267.3864798094931. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.400836635007378 (T) = (0 -186.4644979647512) / Math.Sqrt((1522.313936024801 / (299)) + (36.47754838626133 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12779620434148356 = (213.78546951170964 - 186.4644979647512) / 213.78546951170964 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt32.TryFormat(value: 12345) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 157.63481870073207 < 226.1086970304616. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.530086623533716 (T) = (0 -160.57013409887483) / Math.Sqrt((976.9763517382584 / (299)) + (18.487251578318297 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11987269540718139 = (182.4396689671625 - 160.57013409887483) / 182.4396689671625 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt32.TryFormat(value: 0) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 95.60235704380874 < 131.96045805997767. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.318620156514486 (T) = (0 -94.76366388896015) / Math.Sqrt((305.77039140898563 / (299)) + (8.173030118780634 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.12345974326585651 = (108.11102303736196 - 94.76366388896015) / 108.11102303736196 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt32.TryFormat(value: 4294967295) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 242.8353469877612 < 346.24915559010105. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.761125053038917 (T) = (0 -247.58349584665095) / Math.Sqrt((2355.888167336518 / (299)) + (28.647778784699625 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11187936764045794 = (278.77237260987374 - 247.58349584665095) / 278.77237260987374 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt32.Parse(value: "4294967295") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 273.41148921926083 < 412.813025883977. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.706253072117761 (T) = (0 -278.5991652348349) / Math.Sqrt((4481.71240005806 / (299)) + (58.351660677258714 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12241664319142559 = (317.4617693844953 - 278.5991652348349) / 317.4617693844953 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt32.TryParseHex(value: "FFFFFFFF") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 352.81612905185295 < 517.4715549153382. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.255539463905286 (T) = (0 -360.0006865127169) / Math.Sqrt((5574.881652019787 / (299)) + (66.95693238680063 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13167160632639868 = (414.5904811308505 - 360.0006865127169) / 414.5904811308505 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in MicroBenchmarks.Serializers.Json_ToStream<LoginViewModel>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[JsonNet_ - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/MicroBenchmarks.Serializers.JsonToStream(LoginViewModel).JsonNet.html>)	12.80 μs	10.57 μs	0.83	0.01	False
[DataContractJsonSerializer_ - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/MicroBenchmarks.Serializers.JsonToStream(LoginViewModel).DataContractJsonSerializer.html>)	27.54 μs	22.65 μs	0.82	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'MicroBenchmarks.Serializers.Json_ToStream<LoginViewModel>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### MicroBenchmarks.Serializers.Json_ToStream<LoginViewModel>.JsonNet_ ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 10.567940061917746 < 11.96681847847263. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.98765821976859 (T) = (0 -10579.538133868593) / Math.Sqrt((512780.66687603685 / (299)) + (12796.448082723244 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.06610814078758635 = (11328.44025730208 - 10579.538133868593) / 11328.44025730208 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### MicroBenchmarks.Serializers.Json_ToStream<LoginViewModel>.DataContractJsonSerializer_ ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 22.650367426905856 < 26.17751006942724. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.507475594036935 (T) = (0 -22685.878673336756) / Math.Sqrt((3646584.12216358 / (299)) + (27775.759311861675 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.06288262109399408 = (24208.150637244962 - 22685.878673336756) / 24208.150637244962 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Collections.CtorFromCollection<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[HashSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CtorFromCollection(Int32).HashSet(Size%3a%20512).html>)	100.24 μs	75.63 μs	0.75	0.04	False
[ImmutableDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CtorFromCollection(Int32).ImmutableDictionary(Size%3a%20512).html>)	1.36 ms	1.06 ms	0.78	0.01	False
[ImmutableHashSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CtorFromCollection(Int32).ImmutableHashSet(Size%3a%20512).html>)	1.35 ms	1.07 ms	0.79	0.02	False
[SortedDictionaryDeepCopy - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CtorFromCollection(Int32).SortedDictionaryDeepCopy(Size%3a%20512).html>)	114.93 μs	98.57 μs	0.86	0.03	False
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CtorFromCollection(Int32).Dictionary(Size%3a%20512).html>)	33.23 μs	25.36 μs	0.76	0.06	False
[ConcurrentBag - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CtorFromCollection(Int32).ConcurrentBag(Size%3a%20512).html>)	88.08 μs	68.76 μs	0.78	0.10	False
[ConcurrentQueue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CtorFromCollection(Int32).ConcurrentQueue(Size%3a%20512).html>)	82.52 μs	64.73 μs	0.78	0.12	False
[ImmutableArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CtorFromCollection(Int32).ImmutableArray(Size%3a%20512).html>)	541.48 ns	485.23 ns	0.90	0.03	False
[ImmutableList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CtorFromCollection(Int32).ImmutableList(Size%3a%20512).html>)	176.02 μs	146.68 μs	0.83	0.04	False
[ConcurrentDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CtorFromCollection(Int32).ConcurrentDictionary(Size%3a%20512).html>)	562.30 μs	463.47 μs	0.82	0.01	False
[ImmutableStack - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CtorFromCollection(Int32).ImmutableStack(Size%3a%20512).html>)	54.25 μs	49.02 μs	0.90	0.03	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.CtorFromCollection<Int32>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.CtorFromCollection<Int32>.HashSet(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 75.63234481323964 < 95.53156338922496. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.18185794406866 (T) = (0 -76670.1664940827) / Math.Sqrt((106219458.36607166 / (299)) + (1000943.518666648 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07503309182117723 = (82889.63185184583 - 76670.1664940827) / 82889.63185184583 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CtorFromCollection<Int32>.ImmutableDictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.0554756809523809 < 1.2819866272569445. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 21.976156457394577 (T) = (0 -1064128.6329869574) / Math.Sqrt((9075583922.470335 / (299)) + (124177964.20776932 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10549281164955014 = (1189625.5802586724 - 1064128.6329869574) / 1189625.5802586724 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CtorFromCollection<Int32>.ImmutableHashSet(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.0656517233333334 < 1.2918116933066717. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 22.909969740460152 (T) = (0 -1073440.5142493565) / Math.Sqrt((8351325742.753695 / (299)) + (122939429.96777132 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.10498652936895649 = (1199356.8247553974 - 1073440.5142493565) / 1199356.8247553974 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CtorFromCollection<Int32>.SortedDictionaryDeepCopy(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 98.57268289820674 < 108.43143544584652. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 19.480004262435735 (T) = (0 -99538.36604115916) / Math.Sqrt((17593662.34286685 / (299)) + (2729623.0604332597 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.060551999611592036 = (105954.09857704284 - 99538.36604115916) / 105954.09857704284 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CtorFromCollection<Int32>.Dictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 25.35752266119747 < 31.768123448051483. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.93608573728301 (T) = (0 -25135.84507927761) / Math.Sqrt((12343940.419110944 / (299)) + (194056.99181884047 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09128313805828048 = (27660.81067932213 - 25135.84507927761) / 27660.81067932213 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CtorFromCollection<Int32>.ConcurrentBag(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 68.75693537137683 < 82.9358771889159. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.245415874079324 (T) = (0 -69184.36716735092) / Math.Sqrt((49014848.50119513 / (299)) + (2719581.3682588763 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08109614846447849 = (75290.1046738909 - 69184.36716735092) / 75290.1046738909 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CtorFromCollection<Int32>.ConcurrentQueue(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 64.73280662955467 < 78.49606858010912. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.500379322757416 (T) = (0 -64989.360077093625) / Math.Sqrt((42179808.12644693 / (299)) + (1809453.1408008437 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.08513887114893888 = (71037.40450609292 - 64989.360077093625) / 71037.40450609292 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CtorFromCollection<Int32>.ImmutableArray(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 485.23144813363695 < 511.4006778208143. IsChangePoint: Marked as a change because one of 4/21/2022 5:54:30 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 25.833258515915777 (T) = (0 -483.1976652051512) / Math.Sqrt((239.94049478995078 / (299)) + (46.788634200422116 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.06404216306468317 = (516.2600772566046 - 483.1976652051512) / 516.2600772566046 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CtorFromCollection<Int32>.ImmutableList(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 146.6810128858025 < 168.34986333931838. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.31727538869656 (T) = (0 -145955.69101070036) / Math.Sqrt((123074895.87132993 / (299)) + (4060432.626213648 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07635457595138775 = (158021.34370019744 - 145955.69101070036) / 158021.34370019744 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CtorFromCollection<Int32>.ConcurrentDictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 463.4699232843137 < 533.619401737351. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.32021234568355 (T) = (0 -467201.6312027395) / Math.Sqrt((1428003998.5178306 / (299)) + (16458489.461875476 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.051734140460349624 = (492690.5535010502 - 467201.6312027395) / 492690.5535010502 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CtorFromCollection<Int32>.ImmutableStack(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 49.02273796508664 < 51.60263299481489. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.404550511803192 (T) = (0 -46561.15151890332) / Math.Sqrt((7589443.972525899 / (299)) + (683295.9686906552 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.05300980674945494 = (49167.51181876774 - 46561.15151890332) / 49167.51181876774 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in System.Tests.Perf_Int16

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[TryParse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int16.TryParse(value%3a%20%22-32768%22).html>)	311.34 ns	202.22 ns	0.65	0.24	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int16.Parse(value%3a%20%22-32768%22).html>)	311.54 ns	208.03 ns	0.67	0.25	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int16.Parse(value%3a%20%2232767%22).html>)	300.58 ns	203.37 ns	0.68	0.18	False
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int16.ToString(value%3a%200).html>)	22.42 ns	19.59 ns	0.87	0.28	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int16.Parse(value%3a%20%220%22).html>)	184.18 ns	132.48 ns	0.72	0.26	False
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int16.ToString(value%3a%20-32768).html>)	397.20 ns	308.38 ns	0.78	0.12	False
[TryParse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int16.TryParse(value%3a%20%220%22).html>)	186.72 ns	141.34 ns	0.76	0.23	False
[TryParse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int16.TryParse(value%3a%20%2232767%22).html>)	308.53 ns	196.45 ns	0.64	0.25	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Int16*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Tests.Perf_Int16.TryParse(value: "-32768") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 202.2227302874838 < 300.2744665087087. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.355266741909805 (T) = (0 -205.18376225429586) / Math.Sqrt((2087.294420178407 / (299)) + (31.12718703866264 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.13196926360961353 = (236.3784525736159 - 205.18376225429586) / 236.3784525736159 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Int16.Parse(value: "-32768") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 208.03270893804324 < 296.0037676759025. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.749725219540117 (T) = (0 -205.40913765724255) / Math.Sqrt((2124.773570051215 / (299)) + (54.160592410140694 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11883843487805838 = (233.11177630496914 - 205.40913765724255) / 233.11177630496914 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Int16.Parse(value: "32767") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 203.36633974479983 < 284.84855807363505. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.161852399151739 (T) = (0 -198.4695202073621) / Math.Sqrt((1873.8462246243691 / (299)) + (45.70270953631694 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.12015054948572926 = (225.5721363369119 - 198.4695202073621) / 225.5721363369119 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Int16.ToString(value: 0) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 19.585756731689052 < 21.357506618701546. IsChangePoint: Marked as a change because one of 5/30/2022 12:57:05 PM, 5/31/2022 12:36:20 AM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.909727511806244 (T) = (0 -20.262968921441146) / Math.Sqrt((2.3042325200228366 / (299)) + (1.458198798411033 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.09116422637484245 = (22.295523030102967 - 20.262968921441146) / 22.295523030102967 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Int16.Parse(value: "0") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 132.47660278711535 < 176.26323815451275. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.547897487666885 (T) = (0 -130.0603082729513) / Math.Sqrt((520.4394756918269 / (299)) + (22.43451913460867 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11515741242052027 = (146.9869444561164 - 130.0603082729513) / 146.9869444561164 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Int16.ToString(value: -32768) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 308.37968013753874 < 376.86185696898747. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 21.726057265972983 (T) = (0 -311.95610055303405) / Math.Sqrt((876.000384803346 / (299)) + (31.307160127669512 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11511074494816977 = (352.53688387792886 - 311.95610055303405) / 352.53688387792886 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Int16.TryParse(value: "0") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 141.34433372373942 < 179.76008792809048. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.832541494879152 (T) = (0 -131.42921875797194) / Math.Sqrt((511.1176949458404 / (299)) + (17.324741583859304 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12182781203137188 = (149.6622422784666 - 131.42921875797194) / 149.6622422784666 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Int16.TryParse(value: "32767") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 196.44740272187778 < 288.0000543028929. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.414993727333396 (T) = (0 -201.48188787348806) / Math.Sqrt((1828.0003727869848 / (299)) + (39.204529773589485 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11898834933240235 = (228.69378369833433 - 201.48188787348806) / 228.69378369833433 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Numerics.Tests.Perf_VectorOf<Double>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[GreaterThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).GreaterThanAllBenchmark.html>)	163.31 ns	96.73 ns	0.59	0.22	False
[LessThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).LessThanAllBenchmark.html>)	196.62 ns	115.68 ns	0.59	0.24	False
[DotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).DotBenchmark.html>)	64.14 ns	35.74 ns	0.56	0.25	False
[EqualsAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).EqualsAnyBenchmark.html>)	140.32 ns	81.61 ns	0.58	0.27	False
[SubtractBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).SubtractBenchmark.html>)	89.97 ns	58.04 ns	0.65	0.22	False
[LessThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).LessThanOrEqualBenchmark.html>)	108.09 ns	54.89 ns	0.51	0.17	False
[GreaterThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).GreaterThanBenchmark.html>)	87.49 ns	52.84 ns	0.60	0.21	False
[AndNotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).AndNotBenchmark.html>)	119.34 ns	92.88 ns	0.78	0.27	False
[AddBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).AddBenchmark.html>)	90.39 ns	54.13 ns	0.60	0.23	False
[GreaterThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).GreaterThanOrEqualAnyBenchmark.html>)	144.45 ns	82.39 ns	0.57	0.24	False
[OneBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).OneBenchmark.html>)	47.23 ns	34.89 ns	0.74	0.17	False
[OnesComplementOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).OnesComplementOperatorBenchmark.html>)	83.75 ns	60.89 ns	0.73	0.23	False
[GreaterThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).GreaterThanAnyBenchmark.html>)	139.53 ns	82.11 ns	0.59	0.23	False
[LessThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).LessThanOrEqualAllBenchmark.html>)	197.77 ns	113.76 ns	0.58	0.24	False
[UnaryNegateOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).UnaryNegateOperatorBenchmark.html>)	89.20 ns	52.22 ns	0.59	0.23	False
[SubtractionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).SubtractionOperatorBenchmark.html>)	86.74 ns	52.27 ns	0.60	0.21	False
[MaxBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).MaxBenchmark.html>)	101.76 ns	57.89 ns	0.57	0.22	False
[AbsBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).AbsBenchmark.html>)	88.07 ns	56.31 ns	0.64	0.24	False
[LessThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).LessThanAnyBenchmark.html>)	131.30 ns	73.15 ns	0.56	0.26	False
[GreaterThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).GreaterThanOrEqualAllBenchmark.html>)	161.36 ns	114.76 ns	0.71	0.25	False
[ConditionalSelectBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).ConditionalSelectBenchmark.html>)	213.86 ns	139.14 ns	0.65	0.31	False
[NegateBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).NegateBenchmark.html>)	88.78 ns	53.58 ns	0.60	0.21	False
[MultiplyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).MultiplyBenchmark.html>)	89.90 ns	59.09 ns	0.66	0.24	False
[AddOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).AddOperatorBenchmark.html>)	86.31 ns	51.31 ns	0.59	0.22	False
[EqualityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).EqualityOperatorBenchmark.html>)	38.05 ns	23.09 ns	0.61	0.27	False
[EqualsStaticBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).EqualsStaticBenchmark.html>)	86.43 ns	55.84 ns	0.65	0.20	False
[SquareRootBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).SquareRootBenchmark.html>)	57.24 ns	34.95 ns	0.61	0.19	False
[MultiplyOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).MultiplyOperatorBenchmark.html>)	86.03 ns	51.39 ns	0.60	0.20	False
[LessThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).LessThanOrEqualAnyBenchmark.html>)	145.35 ns	76.87 ns	0.53	0.28	False
[DivisionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).DivisionOperatorBenchmark.html>)	86.25 ns	53.36 ns	0.62	0.18	False
[InequalityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).InequalityOperatorBenchmark.html>)	39.67 ns	23.84 ns	0.60	0.29	False
[GreaterThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).GreaterThanOrEqualBenchmark.html>)	91.08 ns	52.12 ns	0.57	0.22	False
[MinBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).MinBenchmark.html>)	100.54 ns	58.19 ns	0.58	0.23	False
[LessThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).LessThanBenchmark.html>)	97.15 ns	55.29 ns	0.57	0.23	False
[OnesComplementBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).OnesComplementBenchmark.html>)	83.80 ns	60.02 ns	0.72	0.20	False
[GetHashCodeBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).GetHashCodeBenchmark.html>)	316.39 ns	234.92 ns	0.74	0.05	False
[EqualsAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).EqualsAllBenchmark.html>)	40.53 ns	23.60 ns	0.58	0.33	False
[DivideBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).DivideBenchmark.html>)	98.69 ns	55.58 ns	0.56	0.21	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_VectorOf<Double>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorOf<Double>.GreaterThanAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 96.73136354345841 < 151.3777602725786. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.025832453553994 (T) = (0 -98.3432198403872) / Math.Sqrt((551.1461269194201 / (299)) + (10.046479995884175 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.17850984282521415 = (119.71320530315622 - 98.3432198403872) / 119.71320530315622 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.LessThanAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 115.68247727384103 < 185.5584336499174. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.65450965849087 (T) = (0 -116.22885846255609) / Math.Sqrt((899.8083898291205 / (299)) + (12.93224352574066 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.18497830985071817 = (142.60830094137404 - 116.22885846255609) / 142.60830094137404 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.DotBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 35.744420888602 < 60.832444651634475. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.226440167927743 (T) = (0 -35.91552041501809) / Math.Sqrt((136.6961536653066 / (299)) + (2.4852603229215933 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.18124778921675586 = (43.866166029231444 - 35.91552041501809) / 43.866166029231444 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.EqualsAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 81.60884213376676 < 133.20167643103372. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.051716998802164 (T) = (0 -84.21144951615169) / Math.Sqrt((599.5699158286137 / (299)) + (22.807814563148938 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14306808657512698 = (98.27087566337262 - 84.21144951615169) / 98.27087566337262 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.SubtractBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 58.037953756406324 < 85.55887305073135. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.59775839778712 (T) = (0 -54.96295961712147) / Math.Sqrt((224.1906705628625 / (299)) + (5.74683794182834 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.13910526825375769 = (63.84399577592301 - 54.96295961712147) / 63.84399577592301 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.LessThanOrEqualBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 54.88763198962073 < 97.71931870074981. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.466210659834653 (T) = (0 -56.27896666041443) / Math.Sqrt((352.8437898657277 / (299)) + (10.6235674621053 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.17874968591610707 = (68.52839590471729 - 56.27896666041443) / 68.52839590471729 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.GreaterThanBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 52.84108305941076 < 82.90163227574503. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.022610225305762 (T) = (0 -52.326560254403475) / Math.Sqrt((240.55788810165186 / (299)) + (5.791288276953175 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12746964123603718 = (59.9710482607504 - 52.326560254403475) / 59.9710482607504 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.AndNotBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 92.8830330013772 < 113.32340950397709. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.492715656198811 (T) = (0 -87.4105636676456) / Math.Sqrt((202.02857822209722 / (299)) + (16.7693605670603 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.08776669274049406 = (95.82040358758753 - 87.4105636676456) / 95.82040358758753 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.AddBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 54.12891585283652 < 85.8448330757502. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.305289024440604 (T) = (0 -54.713652718217574) / Math.Sqrt((224.15593208522054 / (299)) + (4.241110163050493 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14611684203450198 = (64.076275785297 - 54.713652718217574) / 64.076275785297 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.GreaterThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 82.39484745212592 < 136.87981508266893. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.740913149902303 (T) = (0 -84.15477717332575) / Math.Sqrt((610.5659452325674 / (299)) + (7.157533313851078 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15825480302791517 = (99.97654572434301 - 84.15477717332575) / 99.97654572434301 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.OneBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 34.89374448527044 < 44.98017496643703. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.414852007238156 (T) = (0 -35.5040771387992) / Math.Sqrt((29.52989891721704 / (299)) + (6.507666317812281 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07729653547851759 = (38.4783177954271 - 35.5040771387992) / 38.4783177954271 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.OnesComplementOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 60.89324084194917 < 79.57410956304436. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.48843737016734 (T) = (0 -62.74191713089995) / Math.Sqrt((88.21477174957397 / (299)) + (6.467102834430671 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08833588504429254 = (68.82130831040577 - 62.74191713089995) / 68.82130831040577 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.GreaterThanAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 82.10730603311814 < 132.30231602703654. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.107552544087788 (T) = (0 -83.29625780481001) / Math.Sqrt((575.060254256328 / (299)) + (6.599466404812392 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.14781460565244736 = (97.74429174367981 - 83.29625780481001) / 97.74429174367981 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.LessThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 113.76350225892226 < 187.585859317131. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.10976533423013 (T) = (0 -116.23279171557625) / Math.Sqrt((948.8135311512578 / (299)) + (18.948426136110715 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1960235810730327 = (144.57238916373586 - 116.23279171557625) / 144.57238916373586 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.UnaryNegateOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 52.224275842456905 < 84.50496014277296. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.482509252447045 (T) = (0 -53.76240003973049) / Math.Sqrt((220.6967159419329 / (299)) + (6.804367525899257 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.14086240841570769 = (62.577171068245256 - 53.76240003973049) / 62.577171068245256 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.SubtractionOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 52.26508737247177 < 82.11870367553865. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.373427212716608 (T) = (0 -52.4646290094443) / Math.Sqrt((225.12323103852628 / (299)) + (3.5662763580674897 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.13909195350119072 = (60.94103687706311 - 52.4646290094443) / 60.94103687706311 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.MaxBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 57.890041529841895 < 95.5762466222296. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.514045998253486 (T) = (0 -58.373139896329405) / Math.Sqrt((330.4543925199368 / (299)) + (12.904582665338403 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14424952928447546 = (68.2128048933721 - 58.373139896329405) / 68.2128048933721 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.AbsBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 56.31137062078467 < 83.91399142648257. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.17961701196012 (T) = (0 -53.04597765100146) / Math.Sqrt((210.74288417829467 / (299)) + (2.642702845186259 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.15459657358615222 = (62.746348067241 - 53.04597765100146) / 62.746348067241 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.LessThanAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 73.14530734642341 < 122.96858626296518. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.845109424151399 (T) = (0 -75.62733098698067) / Math.Sqrt((593.6612008966327 / (299)) + (14.672298832581573 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.13470762549690324 = (87.40089848868766 - 75.62733098698067) / 87.40089848868766 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.GreaterThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 114.75836991458804 < 153.64105863584632. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.022015577477474 (T) = (0 -99.93994636277105) / Math.Sqrt((563.2617485115221 / (299)) + (24.60029094542629 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.17617394976124295 = (121.31195212121172 - 99.93994636277105) / 121.31195212121172 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.ConditionalSelectBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 139.14392056425234 < 191.7841062534706. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.812754431193081 (T) = (0 -146.5212735110276) / Math.Sqrt((526.43533439242 / (299)) + (39.535379409098184 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.0772733323044611 = (158.79163206256598 - 146.5212735110276) / 158.79163206256598 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.NegateBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 53.5847632611306 < 84.78116177534459. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.31448745199041 (T) = (0 -53.80685873550542) / Math.Sqrt((231.4248189428557 / (299)) + (9.308113266210086 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14372932102693037 = (62.83860939864985 - 53.80685873550542) / 62.83860939864985 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.MultiplyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 59.09254105392846 < 85.60698362098874. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.163166424681656 (T) = (0 -55.3462005381571) / Math.Sqrt((227.08191875234846 / (299)) + (8.53219001550053 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.13669105156805247 = (64.1093789641402 - 55.3462005381571) / 64.1093789641402 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.AddOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 51.30701962894206 < 82.48060936926659. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.204872762339182 (T) = (0 -52.42610659982685) / Math.Sqrt((218.40724817958184 / (299)) + (7.086316905860319 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.13997596450769548 = (60.95888537558897 - 52.42610659982685) / 60.95888537558897 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.EqualityOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 23.086019437891466 < 36.14380560071808. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 5.839314812049167 (T) = (0 -23.884535247995007) / Math.Sqrt((41.12351734925747 / (299)) + (6.187111660902707 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10854030115981511 = (26.792613596632002 - 23.884535247995007) / 26.792613596632002 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.EqualsStaticBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 55.843596835666844 < 82.34537521231883. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.08150905848398 (T) = (0 -51.60270166529477) / Math.Sqrt((238.59830514341016 / (299)) + (4.3275520663548805 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14137118817628222 = (60.09896355060718 - 51.60270166529477) / 60.09896355060718 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.SquareRootBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 34.94555216881868 < 54.727925008112415. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.932855252847817 (T) = (0 -34.93628748590273) / Math.Sqrt((91.98788304433036 / (299)) + (1.244796148957584 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.14044744604217832 = (40.64473699140106 - 34.93628748590273) / 40.64473699140106 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.MultiplyOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 51.38553133927768 < 82.17595817116597. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.575013832185725 (T) = (0 -53.02087258169211) / Math.Sqrt((206.31426782150197 / (299)) + (8.21379916379884 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12887030942288133 = (60.86449945996683 - 53.02087258169211) / 60.86449945996683 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.LessThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 76.87070299739884 < 126.8373121304498. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.240912810193164 (T) = (0 -74.5684180721005) / Math.Sqrt((629.4411779110314 / (299)) + (6.341615170752073 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1698811371589543 = (89.82860336035894 - 74.5684180721005) / 89.82860336035894 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.DivisionOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 53.36429758733845 < 82.1756929868087. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.386228053911848 (T) = (0 -54.331192900943776) / Math.Sqrt((195.14188250937 / (299)) + (3.3470533045782656 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12734518837957845 = (62.25966118270394 - 54.331192900943776) / 62.25966118270394 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.InequalityOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 23.842196359713796 < 37.66326691127286. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.424192396912469 (T) = (0 -24.215945000216546) / Math.Sqrt((49.197826691103536 / (299)) + (2.5338427363834346 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.13767045393098257 = (28.082007755163243 - 24.215945000216546) / 28.082007755163243 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.GreaterThanOrEqualBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 52.123858317925176 < 86.2852621419279. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.33024425666509 (T) = (0 -52.40881039995674) / Math.Sqrt((274.6302433000004 / (299)) + (6.655910223138694 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1534910930607644 = (61.91170579581246 - 52.40881039995674) / 61.91170579581246 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.MinBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 58.19482084608896 < 96.47484887332811. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.775509472500449 (T) = (0 -59.373238811741956) / Math.Sqrt((318.8447317818955 / (299)) + (6.549057477027004 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.15201230754475392 = (70.01662800061862 - 59.373238811741956) / 70.01662800061862 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.LessThanBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 55.28608556146359 < 92.37342012985116. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.436235270019672 (T) = (0 -56.89812488086796) / Math.Sqrt((315.15694647919094 / (299)) + (7.788422585144721 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13938081820805084 = (66.11301035888697 - 56.89812488086796) / 66.11301035888697 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.OnesComplementBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 60.01873774647734 < 80.14511238644553. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.977522255855044 (T) = (0 -62.54483132429706) / Math.Sqrt((90.92757674460954 / (299)) + (10.773147416130858 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09184919097660078 = (68.87053416993162 - 62.54483132429706) / 68.87053416993162 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.GetHashCodeBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 234.92322346774856 < 288.45266691851117. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.953288804187373 (T) = (0 -225.34281306315992) / Math.Sqrt((871.364464786746 / (299)) + (10.734579820300043 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09838958240348494 = (249.93368384525965 - 225.34281306315992) / 249.93368384525965 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.EqualsAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 23.59631634109618 < 36.22464255919492. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.925061583123073 (T) = (0 -23.707057058345406) / Math.Sqrt((43.988826731859774 / (299)) + (1.210784125993464 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12074034521931948 = (26.962521172723218 - 23.707057058345406) / 26.962521172723218 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.DivideBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 55.580456599521355 < 85.98778270457147. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.624111410460158 (T) = (0 -56.08903639198771) / Math.Sqrt((207.39259079501647 / (299)) + (6.136297260297675 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.14527479356977668 = (65.62230289924955 - 56.08903639198771) / 65.62230289924955 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Numerics.Tests.Perf_BitOperations

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Log2_uint - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_BitOperations.Log2_uint.html>)	55.78 μs	36.81 μs	0.66	0.11	False
[TrailingZeroCount_ulong - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_BitOperations.TrailingZeroCount_ulong.html>)	41.93 μs	23.52 μs	0.56	0.10	False
[LeadingZeroCount_uint - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_BitOperations.LeadingZeroCount_uint.html>)	59.44 μs	40.55 μs	0.68	0.17	False
[Log2_ulong - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_BitOperations.Log2_ulong.html>)	66.48 μs	43.24 μs	0.65	0.14	False
[PopCount_uint - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_BitOperations.PopCount_uint.html>)	44.06 μs	27.83 μs	0.63	0.09	False
[TrailingZeroCount_uint - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_BitOperations.TrailingZeroCount_uint.html>)	35.15 μs	19.85 μs	0.56	0.11	False
[PopCount_ulong - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_BitOperations.PopCount_ulong.html>)	43.58 μs	27.67 μs	0.63	0.09	False
[LeadingZeroCount_ulong - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_BitOperations.LeadingZeroCount_ulong.html>)	142.11 μs	46.61 μs	0.33	0.13	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_BitOperations*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_BitOperations.Log2_uint ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 36.80945501050421 < 52.280795156616776. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.549641301267844 (T) = (0 -37070.599171236674) / Math.Sqrt((44572090.3946099 / (299)) + (464295.28192071663 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14265744074663944 = (43238.958303342115 - 37070.599171236674) / 43238.958303342115 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_BitOperations.TrailingZeroCount_ulong ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 23.52132129909365 < 39.530171944754464. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.875651445785033 (T) = (0 -23786.575283761893) / Math.Sqrt((53171921.47460732 / (299)) + (545314.0537877815 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1652882191121782 = (28496.75280545562 - 23786.575283761893) / 28496.75280545562 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_BitOperations.LeadingZeroCount_uint ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 40.54582551198801 < 56.46398387033593. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.212695394579473 (T) = (0 -40507.565573837564) / Math.Sqrt((75703653.73072565 / (299)) + (5913881.969380222 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13120344051305485 = (46624.914810618844 - 40507.565573837564) / 46624.914810618844 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_BitOperations.Log2_ulong ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 43.237927811164525 < 63.196214855017665. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.128840903461775 (T) = (0 -43766.45711129867) / Math.Sqrt((77067945.51930241 / (299)) + (6151907.2381157465 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14385291196333666 = (51120.25459511278 - 43766.45711129867) / 51120.25459511278 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_BitOperations.PopCount_uint ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 27.82823054322084 < 41.79917250822645. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.46800620878694 (T) = (0 -28156.670690586056) / Math.Sqrt((33642673.119773306 / (299)) + (2093336.3430747727 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.16593106344203926 = (33758.20565477852 - 28156.670690586056) / 33758.20565477852 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_BitOperations.TrailingZeroCount_uint ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 19.845455335884356 < 33.724071562942314. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.354879961737364 (T) = (0 -19906.909766316596) / Math.Sqrt((36769376.569102064 / (299)) + (243840.9711995021 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.19319756524386786 = (24673.834521004825 - 19906.909766316596) / 24673.834521004825 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_BitOperations.PopCount_ulong ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 27.670965344500633 < 41.41680152387839. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.684909099439096 (T) = (0 -27987.14780758229) / Math.Sqrt((36688034.070102885 / (299)) + (481230.7919070341 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15975179109800275 = (33308.1909738966 - 27987.14780758229) / 33308.1909738966 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_BitOperations.LeadingZeroCount_ulong ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 46.6097575422263 < 66.3263484688895. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.221232673508203 (T) = (0 -44822.61294588192) / Math.Sqrt((106446524.09282915 / (299)) + (1147852.5974102574 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1724399908420474 = (54162.37185202944 - 44822.61294588192) / 54162.37185202944 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in System.Threading.Channels.Tests.BoundedChannelPerfTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ReadAsyncThenWriteAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Threading.Channels.Tests.BoundedChannelPerfTests.ReadAsyncThenWriteAsync.html>)	1.53 μs	1.37 μs	0.90	0.09	False
[WriteAsyncThenReadAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Threading.Channels.Tests.BoundedChannelPerfTests.WriteAsyncThenReadAsync.html>)	1.04 μs	909.65 ns	0.87	0.03	False
[TryWriteThenTryRead - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Threading.Channels.Tests.BoundedChannelPerfTests.TryWriteThenTryRead.html>)	607.06 ns	534.18 ns	0.88	0.07	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Threading.Channels.Tests.BoundedChannelPerfTests*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Threading.Channels.Tests.BoundedChannelPerfTests.ReadAsyncThenWriteAsync ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.3720061585757237 < 1.4523836613860512. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 33.237096202665015 (T) = (0 -1330.581317542417) / Math.Sqrt((2351.451302822248 / (299)) + (525.584195164084 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.09484791456376217 = (1470.0085642526512 - 1330.581317542417) / 1470.0085642526512 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Threading.Channels.Tests.BoundedChannelPerfTests.WriteAsyncThenReadAsync ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 909.6515362400125 < 0.990050368754444. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 41.50808979366599 (T) = (0 -891.4534697704918) / Math.Sqrt((866.3963973149504 / (299)) + (227.57353400406916 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10941112804041346 = (1000.9708158704059 - 891.4534697704918) / 1000.9708158704059 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Threading.Channels.Tests.BoundedChannelPerfTests.TryWriteThenTryRead ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 534.1808644100494 < 596.4165084730519. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.742860739922484 (T) = (0 -521.9321950749479) / Math.Sqrt((1462.2566816439987 / (299)) + (129.12864314415594 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07505878191788536 = (564.286881016272 - 521.9321950749479) / 564.286881016272 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Text.Json.Document.Tests.Perf_DocumentParse

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented%3a%20False%2c%20TestRandomAccess%3a%20False%2c%20TestCase%3a%20HelloWorld).html>)	6.06 μs	5.09 μs	0.84	0.04	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented%3a%20True%2c%20TestRandomAccess%3a%20True%2c%20TestCase%3a%20Json400KB).html>)	184.85 ms	137.65 ms	0.74	0.07	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented%3a%20False%2c%20TestRandomAccess%3a%20False%2c%20TestCase%3a%20BasicJson).html>)	28.14 μs	23.49 μs	0.83	0.01	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented%3a%20True%2c%20TestRandomAccess%3a%20False%2c%20TestCase%3a%20BasicJson).html>)	34.90 μs	28.39 μs	0.81	0.01	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented%3a%20True%2c%20TestRandomAccess%3a%20False%2c%20TestCase%3a%20Json400B).html>)	40.77 μs	32.59 μs	0.80	0.01	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented%3a%20True%2c%20TestRandomAccess%3a%20False%2c%20TestCase%3a%20Json400KB).html>)	26.91 ms	20.80 ms	0.77	0.03	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented%3a%20False%2c%20TestRandomAccess%3a%20True%2c%20TestCase%3a%20Json400KB).html>)	179.02 ms	133.92 ms	0.75	0.07	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented%3a%20False%2c%20TestRandomAccess%3a%20False%2c%20TestCase%3a%20Json400KB).html>)	21.33 ms	15.81 ms	0.74	0.01	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented%3a%20False%2c%20TestRandomAccess%3a%20False%2c%20TestCase%3a%20Json400B).html>)	34.62 μs	27.48 μs	0.79	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Document.Tests.Perf_DocumentParse*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented: False, TestRandomAccess: False, TestCase: HelloWorld) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.089463901036606 < 5.7982940118519295. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.41395905804652 (T) = (0 -5085.654455132987) / Math.Sqrt((178949.41429026704 / (299)) + (6426.783823110873 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.05185230179091106 = (5363.7787285029935 - 5085.654455132987) / 5363.7787285029935 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented: True, TestRandomAccess: True, TestCase: Json400KB) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 137.65148779166665 < 175.5719889660714. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.857652748923526 (T) = (0 -139326346.8297374) / Math.Sqrt((356908662973604.94 / (299)) + (2796393841259.4336 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07995639801357804 = (151434504.3310171 - 139326346.8297374) / 151434504.3310171 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented: False, TestRandomAccess: False, TestCase: BasicJson) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 23.486090044684996 < 26.84605303433927. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.22932199037536 (T) = (0 -23234.010448976973) / Math.Sqrt((4067119.1320180134 / (299)) + (54218.2558623185 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.050491939589371586 = (24469.524185954873 - 23234.010448976973) / 24469.524185954873 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented: True, TestRandomAccess: False, TestCase: BasicJson) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 28.394116718426503 < 33.2427382139602. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.876638650793799 (T) = (0 -28430.55547615824) / Math.Sqrt((7265190.096437531 / (299)) + (97687.56329777674 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.05308570915723589 = (30024.423277902726 - 28430.55547615824) / 30024.423277902726 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented: True, TestRandomAccess: False, TestCase: Json400B) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 32.59331786320297 < 38.85053286428702. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.35855896291571 (T) = (0 -32651.371252521796) / Math.Sqrt((12120964.917102817 / (299)) + (105786.8463382567 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.05574671057447682 = (34579.038927560054 - 32651.371252521796) / 34579.038927560054 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented: True, TestRandomAccess: False, TestCase: Json400KB) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 20.79876451515151 < 25.597032934722222. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.077305488848458 (T) = (0 -20351779.227432564) / Math.Sqrt((8271952192298.348 / (299)) + (80818928538.44154 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07074499185578247 = (21901177.878047045 - 20351779.227432564) / 21901177.878047045 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented: False, TestRandomAccess: True, TestCase: Json400KB) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 133.92304776666666 < 170.65128389670326. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.16163805279045 (T) = (0 -135562843.3557709) / Math.Sqrt((342850150054016.94 / (299)) + (6566934972581.3545 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07778262758064092 = (146996627.27035087 - 135562843.3557709) / 146996627.27035087 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented: False, TestRandomAccess: False, TestCase: Json400KB) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 15.80609414761905 < 20.32015021420746. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.193233170172364 (T) = (0 -16254568.043892587) / Math.Sqrt((4884386621037.693 / (299)) + (48920712305.91747 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.06910001062770431 = (17461132.48411681 - 16254568.043892587) / 17461132.48411681 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented: False, TestRandomAccess: False, TestCase: Json400B) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 27.47942305946104 < 32.846813724900684. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.120642740488494 (T) = (0 -27784.222295494783) / Math.Sqrt((8026166.402508096 / (299)) + (60198.23815635573 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.051997383234954925 = (29308.170467192795 - 27784.222295494783) / 29308.170467192795 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Numerics.Tests.Perf_VectorOf<Single>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[MultiplyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Single).MultiplyBenchmark.html>)	149.31 ns	84.78 ns	0.57	0.16	False
[OnesComplementBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Single).OnesComplementBenchmark.html>)	107.24 ns	75.79 ns	0.71	0.15	False
[GreaterThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Single).GreaterThanAllBenchmark.html>)	228.17 ns	129.37 ns	0.57	0.21	False
[OneBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Single).OneBenchmark.html>)	69.10 ns	48.00 ns	0.69	0.13	False
[InequalityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Single).InequalityOperatorBenchmark.html>)	39.60 ns	23.96 ns	0.60	0.25	False
[LessThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Single).LessThanOrEqualBenchmark.html>)	179.92 ns	95.13 ns	0.53	0.25	False
[NegateBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Single).NegateBenchmark.html>)	148.26 ns	88.34 ns	0.60	0.15	False
[AddOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Single).AddOperatorBenchmark.html>)	146.54 ns	85.11 ns	0.58	0.16	False
[UnaryNegateOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Single).UnaryNegateOperatorBenchmark.html>)	148.93 ns	86.83 ns	0.58	0.22	False
[LessThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Single).LessThanAnyBenchmark.html>)	216.89 ns	115.80 ns	0.53	0.22	False
[SquareRootBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Single).SquareRootBenchmark.html>)	99.61 ns	59.68 ns	0.60	0.14	False
[GreaterThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Single).GreaterThanAnyBenchmark.html>)	206.82 ns	131.77 ns	0.64	0.20	False
[AbsBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Single).AbsBenchmark.html>)	152.99 ns	94.81 ns	0.62	0.20	False
[MaxBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Single).MaxBenchmark.html>)	178.67 ns	99.62 ns	0.56	0.19	False
[GetHashCodeBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Single).GetHashCodeBenchmark.html>)	584.01 ns	420.73 ns	0.72	0.02	False
[DivisionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Single).DivisionOperatorBenchmark.html>)	146.45 ns	84.19 ns	0.57	0.10	False
[EqualsStaticBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Single).EqualsStaticBenchmark.html>)	150.68 ns	87.72 ns	0.58	0.21	False
[ConditionalSelectBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Single).ConditionalSelectBenchmark.html>)	217.38 ns	152.95 ns	0.70	0.38	False
[MultiplyOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Single).MultiplyOperatorBenchmark.html>)	145.67 ns	85.95 ns	0.59	0.20	False
[SubtractionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Single).SubtractionOperatorBenchmark.html>)	162.31 ns	86.14 ns	0.53	0.17	False
[AndNotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Single).AndNotBenchmark.html>)	140.86 ns	96.74 ns	0.69	0.23	False
[GreaterThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Single).GreaterThanOrEqualAllBenchmark.html>)	235.20 ns	134.33 ns	0.57	0.21	False
[SubtractBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Single).SubtractBenchmark.html>)	149.97 ns	85.03 ns	0.57	0.20	False
[LessThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Single).LessThanOrEqualAnyBenchmark.html>)	211.95 ns	113.62 ns	0.54	0.24	False
[MinBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Single).MinBenchmark.html>)	187.90 ns	100.42 ns	0.53	0.13	False
[LessThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Single).LessThanOrEqualAllBenchmark.html>)	280.42 ns	154.85 ns	0.55	0.18	False
[DotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Single).DotBenchmark.html>)	111.63 ns	60.60 ns	0.54	0.19	False
[AddBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Single).AddBenchmark.html>)	149.28 ns	82.11 ns	0.55	0.15	False
[EqualsAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Single).EqualsAllBenchmark.html>)	37.77 ns	23.41 ns	0.62	0.28	False
[EqualityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Single).EqualityOperatorBenchmark.html>)	38.01 ns	23.28 ns	0.61	0.29	False
[GreaterThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Single).GreaterThanBenchmark.html>)	151.70 ns	83.70 ns	0.55	0.13	False
[LessThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Single).LessThanBenchmark.html>)	173.23 ns	100.07 ns	0.58	0.15	False
[GreaterThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Single).GreaterThanOrEqualAnyBenchmark.html>)	214.62 ns	128.07 ns	0.60	0.21	False
[OnesComplementOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Single).OnesComplementOperatorBenchmark.html>)	106.28 ns	72.11 ns	0.68	0.17	False
[GreaterThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Single).GreaterThanOrEqualBenchmark.html>)	159.55 ns	88.91 ns	0.56	0.20	False
[EqualsAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Single).EqualsAnyBenchmark.html>)	206.81 ns	116.80 ns	0.56	0.20	False
[DivideBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Single).DivideBenchmark.html>)	150.65 ns	86.15 ns	0.57	0.18	False
[LessThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Single).LessThanAllBenchmark.html>)	275.95 ns	153.72 ns	0.56	0.20	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_VectorOf<Single>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorOf<Single>.MultiplyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 84.77712801945758 < 141.96248796462078. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.351169793715997 (T) = (0 -86.26950876255215) / Math.Sqrt((693.8371549012603 / (299)) + (6.883742719090358 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15793531542510822 = (102.4499784195373 - 86.26950876255215) / 102.4499784195373 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Single>.OnesComplementBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 75.78634700732351 < 101.65038982932973. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.30693009388224 (T) = (0 -74.12088638011576) / Math.Sqrt((189.00978067259214 / (299)) + (6.273461876299431 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1072389079245043 = (83.02432424311765 - 74.12088638011576) / 83.02432424311765 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Single>.GreaterThanAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 129.36723884385978 < 217.25343692831743. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.48462796800926 (T) = (0 -131.96683080247033) / Math.Sqrt((1364.9870635241864 / (299)) + (26.72692042471242 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.19773399523271842 = (164.49261219880654 - 131.96683080247033) / 164.49261219880654 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Single>.OneBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 48.00411182841769 < 65.27841478086182. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.298036543139704 (T) = (0 -46.17449096552208) / Math.Sqrt((83.32384112513795 / (299)) + (2.9065579282037306 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12333128548190068 = (52.67039897836891 - 46.17449096552208) / 52.67039897836891 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Single>.InequalityOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 23.955681215959693 < 37.63963275340632. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.595000765323814 (T) = (0 -24.241507022948642) / Math.Sqrt((50.3755373383605 / (299)) + (1.2095108117607263 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13388403882107383 = (27.988754519604935 - 24.241507022948642) / 27.988754519604935 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Single>.LessThanOrEqualBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 95.13447056450785 < 171.30288805036474. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.189112663103867 (T) = (0 -98.63092974209087) / Math.Sqrt((1124.8377267656288 / (299)) + (12.491512074421582 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1846482021398846 = (120.96732968633539 - 98.63092974209087) / 120.96732968633539 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Single>.NegateBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 88.34469304536658 < 141.118425292434. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.142987131804022 (T) = (0 -86.02740414158318) / Math.Sqrt((701.3813902919377 / (299)) + (22.922024039475072 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1501268027078032 = (101.22381128817491 - 86.02740414158318) / 101.22381128817491 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Single>.AddOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 85.11187409671204 < 139.2259075995378. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.735297270145484 (T) = (0 -84.29161584607023) / Math.Sqrt((706.3797005909363 / (299)) + (11.01439751442572 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15594888390227918 = (99.86553449010698 - 84.29161584607023) / 99.86553449010698 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Single>.UnaryNegateOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 86.82543022706543 < 141.25012313913876. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.563968738132724 (T) = (0 -85.45616137539702) / Math.Sqrt((683.9344266257959 / (299)) + (5.937803932825697 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.16059786048177668 = (101.80598470292769 - 85.45616137539702) / 101.80598470292769 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Single>.LessThanAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 115.79768817387453 < 196.8448987400465. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.107550736948113 (T) = (0 -116.35096817727276) / Math.Sqrt((1402.989645281292 / (299)) + (43.32593741823016 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.16881352683041836 = (139.981787400352 - 116.35096817727276) / 139.981787400352 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Single>.SquareRootBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 59.6838833176555 < 94.65462475423129. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.449719559413174 (T) = (0 -59.13190201261942) / Math.Sqrt((286.3975670755506 / (299)) + (2.5954354443194156 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15044685500145272 = (69.603534941561 - 59.13190201261942) / 69.603534941561 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Single>.GreaterThanAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 131.76590463373728 < 198.97561351454422. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.583629907013265 (T) = (0 -116.12474902236711) / Math.Sqrt((1480.926108203781 / (299)) + (24.13434108718054 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1745597168203159 = (140.68219275056722 - 116.12474902236711) / 140.68219275056722 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Single>.AbsBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 94.8114024417617 < 147.06832511286532. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.57674834174243 (T) = (0 -86.16193140198888) / Math.Sqrt((750.1010670542104 / (299)) + (7.240879215849561 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1792004703063758 = (104.97317345460726 - 86.16193140198888) / 104.97317345460726 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Single>.MaxBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 99.62487335915606 < 170.5018531420005. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.691441440899773 (T) = (0 -100.3553092392226) / Math.Sqrt((1084.8869355787417 / (299)) + (7.901920270086004 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.17139062265504926 = (121.11292966630839 - 100.3553092392226) / 121.11292966630839 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Single>.GetHashCodeBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 420.7323439634265 < 557.9714033224178. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.572383228541122 (T) = (0 -424.1036519337806) / Math.Sqrt((3977.9665803936423 / (299)) + (30.420993785830458 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10644941091734803 = (474.62746610595286 - 424.1036519337806) / 474.62746610595286 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Single>.DivisionOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 84.1938288781969 < 139.70611252204637. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.391297375038985 (T) = (0 -85.66226136004938) / Math.Sqrt((659.8022619747932 / (299)) + (7.907870484466793 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15674075486849265 = (101.58472836747879 - 85.66226136004938) / 101.58472836747879 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Single>.EqualsStaticBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 87.721388620346 < 143.56651888229254. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.632943082850396 (T) = (0 -85.83530601745967) / Math.Sqrt((770.468644888316 / (299)) + (33.42041401703974 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.16661547461762885 = (102.99604012694735 - 85.83530601745967) / 102.99604012694735 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Single>.ConditionalSelectBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 152.95198578127804 < 207.3045464774522. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 5.587043642115468 (T) = (0 -161.39676626016686) / Math.Sqrt((1019.2934130795809 / (299)) + (89.41926731402509 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07207609782113325 = (173.9331920227398 - 161.39676626016686) / 173.9331920227398 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Single>.MultiplyOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 85.95399500088556 < 139.10794962414752. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.61418587699242 (T) = (0 -84.41269677180382) / Math.Sqrt((708.9743809007739 / (299)) + (7.467112126698948 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1527813262182421 = (99.63507578864862 - 84.41269677180382) / 99.63507578864862 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Single>.SubtractionOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 86.14423779989507 < 141.712691562704. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.306716023604958 (T) = (0 -84.37905221882167) / Math.Sqrt((721.9538089618704 / (299)) + (13.44669114381577 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15233277656374952 = (99.54266236314783 - 84.37905221882167) / 99.54266236314783 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Single>.AndNotBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 96.73823386376526 < 132.62237582751663. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.381636346102765 (T) = (0 -99.03160273590204) / Math.Sqrt((343.44182762693805 / (299)) + (10.14825140213188 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09848695845505566 = (109.85043828782469 - 99.03160273590204) / 109.85043828782469 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Single>.GreaterThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 134.3333353083564 < 223.55542088966203. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.69228693852462 (T) = (0 -136.10605856995684) / Math.Sqrt((1424.493204634537 / (299)) + (14.617642726272742 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1948376817411244 = (169.04176398155292 - 136.10605856995684) / 169.04176398155292 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Single>.SubtractBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 85.03049916099647 < 142.27759268112453. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.768437075824462 (T) = (0 -85.80933076420794) / Math.Sqrt((750.1175693741659 / (299)) + (5.580401773629463 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.16857058392886598 = (103.20699401001998 - 85.80933076420794) / 103.20699401001998 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Single>.LessThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 113.61747147018926 < 202.09969282198875. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.319443383552807 (T) = (0 -115.68665054862757) / Math.Sqrt((1619.653631702679 / (299)) + (15.187441083429663 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.18920645562663924 = (142.68324082185248 - 115.68665054862757) / 142.68324082185248 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Single>.MinBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 100.41915177548682 < 171.8755830103487. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.160643503343696 (T) = (0 -104.6531245945396) / Math.Sqrt((1084.1903611717457 / (299)) + (11.096679345221158 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1596301145396362 = (124.53221659318442 - 104.6531245945396) / 124.53221659318442 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Single>.LessThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 154.85073809678505 < 270.3382113795845. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.303036435310728 (T) = (0 -156.68743099476032) / Math.Sqrt((2186.0184144689747 / (299)) + (14.73359481770394 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.21184700079736588 = (198.80331757067384 - 156.68743099476032) / 198.80331757067384 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Single>.DotBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 60.59626639244841 < 106.64545455020932. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.429342309398175 (T) = (0 -60.96636321930648) / Math.Sqrt((425.42223958203977 / (299)) + (3.57692531826632 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1991531491029359 = (76.12736836139813 - 60.96636321930648) / 76.12736836139813 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Single>.AddBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 82.11358247116792 < 142.24967596593257. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.915464877811191 (T) = (0 -85.46781544655464) / Math.Sqrt((698.2159222959665 / (299)) + (5.727159656119522 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.16624389880403007 = (102.50937333346828 - 85.46781544655464) / 102.50937333346828 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Single>.EqualsAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 23.40666202024385 < 35.994049676927965. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.043546952234231 (T) = (0 -23.916638657386372) / Math.Sqrt((42.951133076153 / (299)) + (2.0253144372146705 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.111385793589899 = (26.91453555982054 - 23.916638657386372) / 26.91453555982054 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Single>.EqualityOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 23.283526068067182 < 36.340735283655334. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 5.823365909426131 (T) = (0 -24.105983891091736) / Math.Sqrt((40.53524956232616 / (299)) + (4.86504379170231 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10228230400157431 = (26.852521676406845 - 24.105983891091736) / 26.852521676406845 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Single>.GreaterThanBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 83.69985399476333 < 144.23020932181666. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.678511213078368 (T) = (0 -83.56440587896275) / Math.Sqrt((798.1464844945154 / (299)) + (1.0885040435462774 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.18644920565011153 = (102.7156588861048 - 83.56440587896275) / 102.7156588861048 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Single>.LessThanBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 100.0727323238516 < 164.49845729621018. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.19652683310718 (T) = (0 -97.75607358933925) / Math.Sqrt((956.9748911173624 / (299)) + (14.764612616990615 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.17571901580774 = (118.59557052032886 - 97.75607358933925) / 118.59557052032886 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Single>.GreaterThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 128.0653788172557 < 204.82146910241542. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.376098505142734 (T) = (0 -123.36464164696328) / Math.Sqrt((1519.975245044441 / (299)) + (43.1949329640835 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15533656086751252 = (146.05183074298216 - 123.36464164696328) / 146.05183074298216 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Single>.OnesComplementOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 72.10737915217221 < 101.10173810728585. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.042125408950188 (T) = (0 -74.51619736892303) / Math.Sqrt((186.2936003365693 / (299)) + (15.181162772358668 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10318595860734142 = (83.08990931186487 - 74.51619736892303) / 83.08990931186487 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Single>.GreaterThanOrEqualBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 88.91157819401812 < 151.24341603823902. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.586830561806103 (T) = (0 -90.64592188602727) / Math.Sqrt((828.2493098672716 / (299)) + (15.337106776666415 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15577662923351024 = (107.37196460662746 - 90.64592188602727) / 107.37196460662746 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Single>.EqualsAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 116.79951053276027 < 200.7971697925441. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.694096946790394 (T) = (0 -115.54803055468095) / Math.Sqrt((1398.7043470277385 / (299)) + (8.931861075461326 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1820664390084237 = (141.2682350564057 - 115.54803055468095) / 141.2682350564057 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Single>.DivideBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 86.14970277787175 < 142.78557799942686. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.305667972104564 (T) = (0 -87.90330054868616) / Math.Sqrt((670.0597664510417 / (299)) + (6.402842583948681 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1648478741252724 = (105.25423791098822 - 87.90330054868616) / 105.25423791098822 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Single>.LessThanAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 153.71630706507165 < 260.65149113068867. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.40425513769915 (T) = (0 -156.84872877309942) / Math.Sqrt((1962.4295807883254 / (299)) + (22.5654580151988 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.205940202406968 = (197.52760339780713 - 156.84872877309942) / 197.52760339780713 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in Benchstone.BenchI.Ackermann

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Test - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Benchstone.BenchI.Ackermann.Test.html>)	31.68 μs	26.28 μs	0.83	0.06	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Benchstone.BenchI.Ackermann*'

### Payloads [Baseline]() [Compare]() ### Histogram #### Benchstone.BenchI.Ackermann.Test ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 26.27614436813187 < 29.631919649675016. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 24.369600229331486 (T) = (0 -26035.196236568536) / Math.Sqrt((2089882.0093611074 / (299)) + (231353.3461867267 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08984097181178667 = (28605.106833247468 - 26035.196236568536) / 28605.106833247468 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Threading.Tests.Perf_Timer

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ShortScheduleAndDisposeWithFiringTimers - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Threading.Tests.Perf_Timer.ShortScheduleAndDisposeWithFiringTimers.html>)	1.77 μs	1.59 μs	0.90	0.37	False
[ShortScheduleAndDispose - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Threading.Tests.Perf_Timer.ShortScheduleAndDispose.html>)	1.55 μs	1.41 μs	0.91	0.06	False
[LongScheduleAndDispose - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Threading.Tests.Perf_Timer.LongScheduleAndDispose.html>)	1.55 μs	1.36 μs	0.88	0.04	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Threading.Tests.Perf_Timer*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Threading.Tests.Perf_Timer.ShortScheduleAndDisposeWithFiringTimers ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.589352099867725 < 1.703719233388042. IsChangePoint: Marked as a change because one of 5/24/2022 3:42:52 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 4.265739261674179 (T) = (0 -1615.7290286035368) / Math.Sqrt((15842.15216657163 / (299)) + (25531.67311866048 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.056210802851070996 = (1711.9596552751984 - 1615.7290286035368) / 1711.9596552751984 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Threading.Tests.Perf_Timer.ShortScheduleAndDispose ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.4059288513370278 < 1.4627658456379775. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 24.52588378329995 (T) = (0 -1374.2909801342778) / Math.Sqrt((2003.9629637180983 / (299)) + (588.3718413435203 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.06892941502399014 = (1476.033076664846 - 1374.2909801342778) / 1476.033076664846 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Threading.Tests.Perf_Timer.LongScheduleAndDispose ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.3626353106073907 < 1.4450655362933926. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 26.129358400906252 (T) = (0 -1350.2697576644407) / Math.Sqrt((1908.9656026224652 / (299)) + (439.9409353516765 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.06805535306232258 = (1448.8733446791698 - 1350.2697576644407) / 1448.8733446791698 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Collections.CreateAddAndClear<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CreateAddAndClear(Int32).Dictionary(Size%3a%20512).html>)	135.64 μs	97.97 μs	0.72	0.02	False
[Span - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CreateAddAndClear(Int32).Span(Size%3a%20512).html>)	8.70 μs	5.10 μs	0.59	0.09	False
[ImmutableHashSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CreateAddAndClear(Int32).ImmutableHashSet(Size%3a%20512).html>)	2.35 ms	1.96 ms	0.83	0.01	False
[ConcurrentBag - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CreateAddAndClear(Int32).ConcurrentBag(Size%3a%20512).html>)	93.03 μs	73.85 μs	0.79	0.11	False
[ImmutableSortedDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CreateAddAndClear(Int32).ImmutableSortedDictionary(Size%3a%20512).html>)	2.34 ms	1.90 ms	0.81	0.02	False
[ConcurrentStack - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CreateAddAndClear(Int32).ConcurrentStack(Size%3a%20512).html>)	70.12 μs	60.79 μs	0.87	0.09	False
[ImmutableQueue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CreateAddAndClear(Int32).ImmutableQueue(Size%3a%20512).html>)	66.91 μs	57.41 μs	0.86	0.04	False
[IDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CreateAddAndClear(Int32).IDictionary(Size%3a%20512).html>)	136.48 μs	101.64 μs	0.74	0.02	False
[ConcurrentDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CreateAddAndClear(Int32).ConcurrentDictionary(Size%3a%20512).html>)	777.74 μs	657.33 μs	0.85	0.01	False
[ConcurrentQueue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CreateAddAndClear(Int32).ConcurrentQueue(Size%3a%20512).html>)	70.75 μs	54.56 μs	0.77	0.07	False
[List - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CreateAddAndClear(Int32).List(Size%3a%20512).html>)	18.91 μs	12.24 μs	0.65	0.05	False
[ImmutableDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CreateAddAndClear(Int32).ImmutableDictionary(Size%3a%20512).html>)	2.41 ms	1.95 ms	0.81	0.01	False
[ImmutableSortedSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CreateAddAndClear(Int32).ImmutableSortedSet(Size%3a%20512).html>)	2.03 ms	1.69 ms	0.83	0.01	False
[LinkedList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CreateAddAndClear(Int32).LinkedList(Size%3a%20512).html>)	72.91 μs	62.93 μs	0.86	0.08	False
[Queue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CreateAddAndClear(Int32).Queue(Size%3a%20512).html>)	34.23 μs	25.13 μs	0.73	0.05	False
[ImmutableStack - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CreateAddAndClear(Int32).ImmutableStack(Size%3a%20512).html>)	31.01 μs	27.33 μs	0.88	0.05	False
[HashSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CreateAddAndClear(Int32).HashSet(Size%3a%20512).html>)	128.71 μs	94.12 μs	0.73	0.03	False
[Stack - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CreateAddAndClear(Int32).Stack(Size%3a%20512).html>)	20.01 μs	14.95 μs	0.75	0.06	False
[ICollection - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CreateAddAndClear(Int32).ICollection(Size%3a%20512).html>)	24.14 μs	18.59 μs	0.77	0.04	False
[Array - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CreateAddAndClear(Int32).Array(Size%3a%20512).html>)	7.79 μs	5.09 μs	0.65	0.07	False
[ImmutableList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CreateAddAndClear(Int32).ImmutableList(Size%3a%20512).html>)	1.13 ms	894.21 μs	0.79	0.03	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.CreateAddAndClear<Int32>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.CreateAddAndClear<Int32>.Dictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 97.96984884137603 < 128.52054982066542. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.161858637081984 (T) = (0 -97595.56333226079) / Math.Sqrt((204060980.32573807 / (299)) + (655768.3599341378 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10101340724250016 = (108561.75622475277 - 97595.56333226079) / 108561.75622475277 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CreateAddAndClear<Int32>.Span(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.100790750430713 < 8.215492361362644. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.090377992164719 (T) = (0 -5219.235547972829) / Math.Sqrt((1612251.724521455 / (299)) + (25095.344720518962 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.18097108592315847 = (6372.468002372819 - 5219.235547972829) / 6372.468002372819 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CreateAddAndClear<Int32>.ImmutableHashSet(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.9554296328125 < 2.237564226481554. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 25.626615188697926 (T) = (0 -1943289.015090853) / Math.Sqrt((15928757264.882734 / (299)) + (306722153.0044725 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09187041062374184 = (2139880.737093465 - 1943289.015090853) / 2139880.737093465 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CreateAddAndClear<Int32>.ConcurrentBag(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 73.85208081231859 < 89.68168649256454. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.852653115834272 (T) = (0 -71780.86562417104) / Math.Sqrt((62129260.69131327 / (299)) + (2468082.716921385 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11096708244166235 = (80740.39127967479 - 71780.86562417104) / 80740.39127967479 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CreateAddAndClear<Int32>.ImmutableSortedDictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.8971436493055556 < 2.2226398155378404. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.133665637705956 (T) = (0 -1933607.070490057) / Math.Sqrt((21239941981.126266 / (299)) + (436795975.5027596 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07299889952085498 = (2085873.5437213841 - 1933607.070490057) / 2085873.5437213841 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CreateAddAndClear<Int32>.ConcurrentStack(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 60.79334569552529 < 67.85755410491959. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.39605660797318 (T) = (0 -61901.58073594218) / Math.Sqrt((14291103.992951449 / (299)) + (1226622.1964560638 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.05021400960612165 = (65174.24068370545 - 61901.58073594218) / 65174.24068370545 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CreateAddAndClear<Int32>.ImmutableQueue(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 57.40948908547794 < 61.964895324125614. IsChangePoint: Marked as a change because one of 5/25/2022 12:28:02 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.82895819414227 (T) = (0 -56740.065705307985) / Math.Sqrt((8188509.406947865 / (299)) + (1315849.8487303706 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.06644762672069164 = (60778.66366082495 - 56740.065705307985) / 60778.66366082495 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CreateAddAndClear<Int32>.IDictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 101.63590918259023 < 129.86495958559783. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.748167583911428 (T) = (0 -100385.05583885025) / Math.Sqrt((219637899.04322487 / (299)) + (830448.3915137715 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09199176659623484 = (110555.22642404489 - 100385.05583885025) / 110555.22642404489 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CreateAddAndClear<Int32>.ConcurrentDictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 657.3277149305555 < 739.5844269192709. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.984401020855323 (T) = (0 -668469.5110615232) / Math.Sqrt((1997176512.2287934 / (299)) + (71153218.7657376 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.05192422521063637 = (705080.2571240034 - 668469.5110615232) / 705080.2571240034 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CreateAddAndClear<Int32>.ConcurrentQueue(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 54.55728466898956 < 65.89781727343927. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.359515688581526 (T) = (0 -53517.8864133107) / Math.Sqrt((37572106.084227175 / (299)) + (2031700.3252384977 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09145308356015855 = (58904.92328455812 - 53517.8864133107) / 58904.92328455812 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CreateAddAndClear<Int32>.List(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 12.236693961115476 < 17.926023568484933. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 107.93652021800018 (T) = (0 -12183.835722152973) / Math.Sqrt((666928.4521752078 / (299)) + (13180.858099780118 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.3057002798514432 = (17548.38057481291 - 12183.835722152973) / 17548.38057481291 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CreateAddAndClear<Int32>.ImmutableDictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.9505539799107143 < 2.280008437954932. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 25.38352407518093 (T) = (0 -1973460.2414308295) / Math.Sqrt((16670805391.373198 / (299)) + (284691968.28186584 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09117862823755411 = (2171450.0811130423 - 1973460.2414308295) / 2171450.0811130423 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CreateAddAndClear<Int32>.ImmutableSortedSet(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.6900947404166666 < 1.9430856742652527. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 18.54734849784435 (T) = (0 -1696586.1496883265) / Math.Sqrt((16344732539.899906 / (299)) + (375339897.73099405 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07888388512375401 = (1841880.8685333517 - 1696586.1496883265) / 1841880.8685333517 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CreateAddAndClear<Int32>.LinkedList(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 62.92701509370817 < 69.80702469548065. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.933347174535387 (T) = (0 -63258.920265102824) / Math.Sqrt((13606295.07931179 / (299)) + (2438478.124766106 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.06580947565643462 = (67715.22362588021 - 63258.920265102824) / 67715.22362588021 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CreateAddAndClear<Int32>.Queue(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 25.12913967711683 < 32.4406532958878. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 23.679000462382508 (T) = (0 -25322.2607742808) / Math.Sqrt((8149574.751395568 / (299)) + (83817.04538000414 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13686161539347957 = (29337.428650939302 - 25322.2607742808) / 29337.428650939302 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CreateAddAndClear<Int32>.ImmutableStack(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 27.33076939977562 < 29.419702153690693. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 18.0433315741845 (T) = (0 -27667.67462038206) / Math.Sqrt((1554561.8503410008 / (299)) + (104244.72003710481 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.051951604046562995 = (29183.820929897913 - 27667.67462038206) / 29183.820929897913 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CreateAddAndClear<Int32>.HashSet(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 94.12236305147059 < 121.52159642180328. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.376752778604784 (T) = (0 -93451.51414897559) / Math.Sqrt((196905833.86264327 / (299)) + (1812244.1002346473 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09189244956608536 = (102907.98056278941 - 93451.51414897559) / 102907.98056278941 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CreateAddAndClear<Int32>.Stack(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 14.949087454322948 < 19.04858231760571. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.98251639014108 (T) = (0 -15057.585624995654) / Math.Sqrt((3154664.9261641065 / (299)) + (116401.06694865918 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11248904348134901 = (16966.08420932685 - 15057.585624995654) / 16966.08420932685 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CreateAddAndClear<Int32>.ICollection(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 18.591415969147757 < 22.876918415544875. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.67403264679615 (T) = (0 -17916.465889300827) / Math.Sqrt((4778849.565286599 / (299)) + (43517.43622136014 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11324575343836281 = (20204.544786530634 - 17916.465889300827) / 20204.544786530634 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CreateAddAndClear<Int32>.Array(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.090495004078304 < 7.395536182309091. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.45519953081986 (T) = (0 -5063.794503964528) / Math.Sqrt((1133324.953323744 / (299)) + (832.3182216385535 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.1408358082766593 = (5893.861211565856 - 5063.794503964528) / 5893.861211565856 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CreateAddAndClear<Int32>.ImmutableList(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 894.2130697115385 < 1.0709662999118588. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 21.940433419722517 (T) = (0 -900310.3102016475) / Math.Sqrt((4932983567.947463 / (299)) + (232852137.49300772 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.099878946829112 = (1000210.2573093838 - 900310.3102016475) / 1000210.2573093838 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Diagnostics.Perf_Activity

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[EnumerateActivityEventsSmall - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Diagnostics.Perf_Activity.EnumerateActivityEventsSmall.html>)	318.16 ns	286.51 ns	0.90	0.08	False
[EnumerateActivityTagsLarge - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Diagnostics.Perf_Activity.EnumerateActivityTagsLarge.html>)	64.21 μs	51.05 μs	0.80	0.12	False
[ActivityAllocations - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Diagnostics.Perf_Activity.ActivityAllocations(idFormat%3a%20W3C).html>)	3.90 μs	2.80 μs	0.72	0.06	False
[EnumerateActivityTagsSmall - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Diagnostics.Perf_Activity.EnumerateActivityTagsSmall.html>)	451.60 ns	377.35 ns	0.84	0.06	False
[ActivityAllocations - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Diagnostics.Perf_Activity.ActivityAllocations(idFormat%3a%20Hierarchical).html>)	2.39 μs	2.01 μs	0.84	0.03	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Diagnostics.Perf_Activity*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Diagnostics.Perf_Activity.EnumerateActivityEventsSmall ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 286.50659128787163 < 305.45615699499194. IsChangePoint: Marked as a change because one of 5/25/2022 12:28:02 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 26.575416324802223 (T) = (0 -288.56491769912344) / Math.Sqrt((91.39924955644888 / (299)) + (26.651185552045096 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07528940415258191 = (312.05970710725813 - 288.56491769912344) / 312.05970710725813 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Diagnostics.Perf_Activity.EnumerateActivityTagsLarge ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 51.05202626221498 < 60.47157469624482. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.38740763955532 (T) = (0 -51870.125504094) / Math.Sqrt((20053832.811590686 / (299)) + (2297433.5793716926 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.07872337797028796 = (56302.44409091403 - 51870.125504094) / 56302.44409091403 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Diagnostics.Perf_Activity.ActivityAllocations(idFormat: W3C) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.8016843869388732 < 3.6192198421587936. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.804607307137436 (T) = (0 -2809.1584735727324) / Math.Sqrt((152614.7591226533 / (299)) + (1888.6076338941368 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10284253486933898 = (3131.176613643414 - 2809.1584735727324) / 3131.176613643414 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Diagnostics.Perf_Activity.EnumerateActivityTagsSmall ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 377.34879841132647 < 434.2966543387825. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 20.86658042096436 (T) = (0 -380.57041399250704) / Math.Sqrt((577.9839140067176 / (299)) + (27.824854033376702 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.0787399756212419 = (413.0977182572756 - 380.57041399250704) / 413.0977182572756 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Diagnostics.Perf_Activity.ActivityAllocations(idFormat: Hierarchical) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.0131471019884404 < 2.2543428617515002. IsChangePoint: Marked as a change because one of 4/13/2022 5:30:39 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.636488870599342 (T) = (0 -2056.331511558888) / Math.Sqrt((16780.698338092145 / (299)) + (837.4983427860861 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.06035416277006277 = (2188.411239729348 - 2056.331511558888) / 2188.411239729348 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in System.Text.Json.Tests.Perf_Deep

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[WriteDeepUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Deep.WriteDeepUtf8(Formatted%3a%20True%2c%20SkipValidation%3a%20True).html>)	150.41 ms	110.62 ms	0.74	0.03	False
[WriteDeepUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Deep.WriteDeepUtf8(Formatted%3a%20False%2c%20SkipValidation%3a%20True).html>)	112.10 ms	81.05 ms	0.72	0.02	False
[WriteDeepUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Deep.WriteDeepUtf16(Formatted%3a%20False%2c%20SkipValidation%3a%20True).html>)	111.22 ms	79.51 ms	0.71	0.03	False
[WriteDeepUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Deep.WriteDeepUtf8(Formatted%3a%20True%2c%20SkipValidation%3a%20False).html>)	158.64 ms	114.44 ms	0.72	0.03	False
[WriteDeepUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Deep.WriteDeepUtf16(Formatted%3a%20False%2c%20SkipValidation%3a%20False).html>)	117.54 ms	85.83 ms	0.73	0.02	False
[WriteDeepUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Deep.WriteDeepUtf8(Formatted%3a%20False%2c%20SkipValidation%3a%20False).html>)	118.76 ms	84.81 ms	0.71	0.02	False
[WriteDeepUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Deep.WriteDeepUtf16(Formatted%3a%20True%2c%20SkipValidation%3a%20True).html>)	150.24 ms	110.06 ms	0.73	0.03	False
[WriteDeepUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Deep.WriteDeepUtf16(Formatted%3a%20True%2c%20SkipValidation%3a%20False).html>)	157.57 ms	114.28 ms	0.73	0.02	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Tests.Perf_Deep*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Tests.Perf_Deep.WriteDeepUtf8(Formatted: True, SkipValidation: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 110.6243178 < 142.93677692416665. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.129183199104501 (T) = (0 -111542033.65454882) / Math.Sqrt((267424642142054.75 / (299)) + (2824174753863.616 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.08114640973264792 = (121392607.95846078 - 111542033.65454882) / 121392607.95846078 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Deep.WriteDeepUtf8(Formatted: False, SkipValidation: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 81.05113885714285 < 107.18206299565475. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.70288113150871 (T) = (0 -81051816.08770229) / Math.Sqrt((184529600969306.5 / (299)) + (1240136711815.8044 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.08738098536708509 = (88812324.5167141 - 81051816.08770229) / 88812324.5167141 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Deep.WriteDeepUtf16(Formatted: False, SkipValidation: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 79.50879003333333 < 107.08816262630953. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.14646318908372 (T) = (0 -81289345.02932318) / Math.Sqrt((182977627556485.62 / (299)) + (1995787260826.124 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.0830671216614443 = (88653539.36987852 - 81289345.02932318) / 88653539.36987852 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Deep.WriteDeepUtf8(Formatted: True, SkipValidation: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 114.44264776666667 < 148.9719730705357. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.64573189025518 (T) = (0 -115007525.2692569) / Math.Sqrt((310698208681659.6 / (299)) + (2556570379102.3716 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08793197508023576 = (126095337.32900488 - 115007525.2692569) / 126095337.32900488 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Deep.WriteDeepUtf16(Formatted: False, SkipValidation: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 85.82721071666667 < 111.6631692775595. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.541158594739757 (T) = (0 -84939153.31353351) / Math.Sqrt((195316387052009.9 / (299)) + (907639488955.3837 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.0921798580108076 = (93563856.30243564 - 84939153.31353351) / 93563856.30243564 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Deep.WriteDeepUtf8(Formatted: False, SkipValidation: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 84.8105356 < 112.7258595555357. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.169095493134938 (T) = (0 -85195965.23901919) / Math.Sqrt((194437447725622.7 / (299)) + (1483901243845.5474 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08941511273700341 = (93561804.53982513 - 85195965.23901919) / 93561804.53982513 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Deep.WriteDeepUtf16(Formatted: True, SkipValidation: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 110.0612316 < 142.63783353214285. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.112081867076768 (T) = (0 -111303649.49237551) / Math.Sqrt((266344046033222 / (299)) + (3737640827180.895 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.08173955847203822 = (121211417.21750432 - 111303649.49237551) / 121211417.21750432 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Deep.WriteDeepUtf16(Formatted: True, SkipValidation: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 114.27827253333334 < 148.85916733136904. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.43459735155038 (T) = (0 -114935242.58649264) / Math.Sqrt((285801672434781.5 / (299)) + (5243801696384.922 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08509234570431556 = (125624965.58734363 - 114935242.58649264) / 125624965.58734363 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in System.Collections.Sort<IntStruct>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Array_ComparerClass - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Sort(IntStruct).Array_ComparerClass(Size%3a%20512).html>)	295.83 μs	237.21 μs	0.80	0.02	False
[Array_Comparison - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Sort(IntStruct).Array_Comparison(Size%3a%20512).html>)	304.20 μs	235.97 μs	0.78	0.04	False
[LinqOrderByExtension - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Sort(IntStruct).LinqOrderByExtension(Size%3a%20512).html>)	941.01 μs	776.57 μs	0.83	0.01	False
[Array_ComparerStruct - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Sort(IntStruct).Array_ComparerStruct(Size%3a%20512).html>)	298.97 μs	238.77 μs	0.80	0.03	False
[Array - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Sort(IntStruct).Array(Size%3a%20512).html>)	789.38 μs	667.86 μs	0.85	0.01	False
[List - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Sort(IntStruct).List(Size%3a%20512).html>)	792.67 μs	671.61 μs	0.85	0.01	False
[LinqQuery - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Sort(IntStruct).LinqQuery(Size%3a%20512).html>)	950.45 μs	773.07 μs	0.81	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.Sort<IntStruct>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.Sort<IntStruct>.Array_ComparerClass(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 237.21418385714287 < 283.08847817969047. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.926935740253839 (T) = (0 -236594.1975403323) / Math.Sqrt((483557063.7789323 / (299)) + (7654974.724954914 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.08190857613236055 = (257702.2193973156 - 236594.1975403323) / 257702.2193973156 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Sort<IntStruct>.Array_Comparison(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 235.96767997999996 < 282.4217087748333. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.787821251099045 (T) = (0 -237375.15910333666) / Math.Sqrt((479607436.63401896 / (299)) + (17623611.90706345 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.0794383981821008 = (257859.0706309875 - 237375.15910333666) / 257859.0706309875 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Sort<IntStruct>.LinqOrderByExtension(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 776.5686860166667 < 894.5555728924999. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.216128668957309 (T) = (0 -778601.4201838458) / Math.Sqrt((4035816397.586816 / (299)) + (29564593.172065206 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.06822011028481682 = (835606.5941945158 - 778601.4201838458) / 835606.5941945158 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Sort<IntStruct>.Array_ComparerStruct(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 238.77206801333335 < 284.85582506133335. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.607982980548687 (T) = (0 -240053.57553628593) / Math.Sqrt((523384495.25075585 / (299)) + (9469198.127741758 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07281966431277205 = (258907.10393286948 - 240053.57553628593) / 258907.10393286948 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Sort<IntStruct>.Array(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 667.8608876799999 < 751.523451397. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.083464634371524 (T) = (0 -669655.0278386722) / Math.Sqrt((2199698892.7526174 / (299)) + (32790912.837097134 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.05222104668058108 = (706551.9080090673 - 669655.0278386722) / 706551.9080090673 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Sort<IntStruct>.List(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 671.6066421866667 < 749.0201908257618. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.00072862918433 (T) = (0 -670454.5894299367) / Math.Sqrt((2155393840.522791 / (299)) + (34465066.23413289 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.05148387284738388 = (706845.7459364427 - 670454.5894299367) / 706845.7459364427 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Sort<IntStruct>.LinqQuery(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 773.06869226 < 902.8627525902052. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.764408773750711 (T) = (0 -780421.8748911382) / Math.Sqrt((4072352566.7809944 / (299)) + (33825678.53872662 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.06664744975388362 = (836149.0785934513 - 780421.8748911382) / 836149.0785934513 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Numerics.Tests.Perf_Matrix3x2

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[NegateBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Matrix3x2.NegateBenchmark.html>)	56.01 ns	34.69 ns	0.62	0.16	False
[MultiplyByScalarOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Matrix3x2.MultiplyByScalarOperatorBenchmark.html>)	56.06 ns	35.27 ns	0.63	0.21	False
[InvertBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Matrix3x2.InvertBenchmark.html>)	103.86 ns	58.18 ns	0.56	0.14	False
[SubtractOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Matrix3x2.SubtractOperatorBenchmark.html>)	66.99 ns	40.66 ns	0.61	0.28	False
[MultiplyByMatrixOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Matrix3x2.MultiplyByMatrixOperatorBenchmark.html>)	126.31 ns	72.86 ns	0.58	0.12	False
[CreateScaleFromScalarWithCenterBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Matrix3x2.CreateScaleFromScalarWithCenterBenchmark.html>)	46.68 ns	30.69 ns	0.66	0.32	False
[SubtractBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Matrix3x2.SubtractBenchmark.html>)	71.13 ns	42.71 ns	0.60	0.24	False
[EqualsBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Matrix3x2.EqualsBenchmark.html>)	115.18 ns	80.07 ns	0.70	0.10	False
[CreateScaleFromScalarXYWithCenterBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Matrix3x2.CreateScaleFromScalarXYWithCenterBenchmark.html>)	47.93 ns	41.41 ns	0.86	0.32	False
[MultiplyByMatrixBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Matrix3x2.MultiplyByMatrixBenchmark.html>)	130.87 ns	73.64 ns	0.56	0.17	False
[CreateRotationWithCenterBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Matrix3x2.CreateRotationWithCenterBenchmark.html>)	199.17 ns	118.80 ns	0.60	0.23	False
[AddBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Matrix3x2.AddBenchmark.html>)	72.47 ns	42.25 ns	0.58	0.23	False
[NegationOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Matrix3x2.NegationOperatorBenchmark.html>)	54.12 ns	32.52 ns	0.60	0.24	False
[IsIdentityBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Matrix3x2.IsIdentityBenchmark.html>)	53.14 ns	38.29 ns	0.72	0.16	False
[GetDeterminantBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Matrix3x2.GetDeterminantBenchmark.html>)	26.60 ns	20.94 ns	0.79	0.28	False
[LerpBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Matrix3x2.LerpBenchmark.html>)	110.51 ns	68.14 ns	0.62	0.13	False
[AddOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Matrix3x2.AddOperatorBenchmark.html>)	66.90 ns	39.80 ns	0.59	0.17	False
[EqualityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Matrix3x2.EqualityOperatorBenchmark.html>)	40.70 ns	27.31 ns	0.67	0.15	False
[InequalityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Matrix3x2.InequalityOperatorBenchmark.html>)	52.52 ns	39.55 ns	0.75	0.19	False
[CreateRotationBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Matrix3x2.CreateRotationBenchmark.html>)	163.41 ns	102.86 ns	0.63	0.23	False
[MultiplyByScalarBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Matrix3x2.MultiplyByScalarBenchmark.html>)	59.54 ns	37.09 ns	0.62	0.16	False
[CreateScaleFromVectorWithCenterBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Matrix3x2.CreateScaleFromVectorWithCenterBenchmark.html>)	63.42 ns	39.68 ns	0.63	0.26	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_Matrix3x2*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_Matrix3x2.NegateBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 34.686958676099856 < 53.425830261245494. IsChangePoint: Marked as a change because one of 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 61.06551828781299 (T) = (0 -35.80083576910223) / Math.Sqrt((6.493254215789963 / (299)) + (3.8509641501711434 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.33909805289823686 = (54.16966302807662 - 35.80083576910223) / 54.16966302807662 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix3x2.MultiplyByScalarOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 35.26935633945514 < 53.31879161945. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 35.12232422132421 (T) = (0 -35.06433442095588) / Math.Sqrt((32.60698979891438 / (299)) + (1.4014831743754486 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.26868334084257367 = (47.94685582761733 - 35.06433442095588) / 47.94685582761733 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix3x2.InvertBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 58.17919379975535 < 92.70131018724666. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 50.878387904390685 (T) = (0 -58.616694674438335) / Math.Sqrt((69.07249139770941 / (299)) + (0.88383078099696 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.3012860648960205 = (83.89226510233442 - 58.616694674438335) / 83.89226510233442 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix3x2.SubtractOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 40.6647183391282 < 63.78626337718134. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.029580502199694 (T) = (0 -42.21009354030703) / Math.Sqrt((27.753916381482174 / (299)) + (78.42127148994142 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.2905785259192527 = (59.499317517843586 - 42.21009354030703) / 59.499317517843586 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix3x2.MultiplyByMatrixOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 72.85563880041175 < 120.7090007376656. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 26.37951968493394 (T) = (0 -73.55132777717175) / Math.Sqrt((244.17821257398674 / (299)) + (5.232542641293752 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.2549274389825897 = (98.71699969293736 - 73.55132777717175) / 98.71699969293736 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix3x2.CreateScaleFromScalarWithCenterBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 30.685289580140346 < 44.270764281222355. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.703811712584885 (T) = (0 -30.48860614950659) / Math.Sqrt((46.79660603399942 / (299)) + (1.01342404306016 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1173837170011261 = (34.54344400481165 - 30.48860614950659) / 34.54344400481165 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix3x2.SubtractBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 42.705053359673116 < 67.88313086860126. IsChangePoint: Marked as a change because one of 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 59.61315569796729 (T) = (0 -44.14125929065766) / Math.Sqrt((9.267383545740342 / (299)) + (8.82370100733385 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.36965751763693433 = (70.02742243419523 - 44.14125929065766) / 70.02742243419523 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix3x2.EqualsBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 80.06952300162091 < 101.72763267036886. IsChangePoint: Marked as a change because one of 4/29/2022 5:18:09 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.734569800970034 (T) = (0 -81.35906853509428) / Math.Sqrt((636.0977886566742 / (299)) + (5.241919662773399 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.16432151542496254 = (97.35690224987343 - 81.35906853509428) / 97.35690224987343 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix3x2.CreateScaleFromScalarXYWithCenterBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 41.4108737316057 < 45.465565641669734. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.403705622628661 (T) = (0 -32.23747639782368) / Math.Sqrt((48.9277000696271 / (299)) + (5.693111409649171 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09311103269137913 = (35.547324490554786 - 32.23747639782368) / 35.547324490554786 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix3x2.MultiplyByMatrixBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 73.63769712190488 < 123.84619305604505. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 31.245313548298082 (T) = (0 -77.1418379193693) / Math.Sqrt((176.02611496398958 / (299)) + (20.231035770110683 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.2830401396225352 = (107.59575561002214 - 77.1418379193693) / 107.59575561002214 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix3x2.CreateRotationWithCenterBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 118.80495602277054 < 177.96596766272341. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.241607796507338 (T) = (0 -115.95724562951837) / Math.Sqrt((893.8458817262406 / (299)) + (9.617254887927535 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.15817076205374367 = (137.74437902918413 - 115.95724562951837) / 137.74437902918413 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix3x2.AddBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 42.25396598664971 < 68.4486783679288. IsChangePoint: Marked as a change because one of 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 79.56558135480934 (T) = (0 -43.59166291984551) / Math.Sqrt((10.601206416842237 / (299)) + (4.235551025985656 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.3782483139078289 = (70.11104898456729 - 43.59166291984551) / 70.11104898456729 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix3x2.NegationOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 32.51969469786122 < 51.57858202825809. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 27.934957174964936 (T) = (0 -33.33770835119071) / Math.Sqrt((39.51567764200708 / (299)) + (1.9137749678871554 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.25470217327813693 = (44.7307199295403 - 33.33770835119071) / 44.7307199295403 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix3x2.IsIdentityBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 38.29148202320372 < 50.630966480133864. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 26.67970923227533 (T) = (0 -40.125248338033295) / Math.Sqrt((9.296967958128585 / (299)) + (4.812419280664 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.18631488623385203 = (49.3129930229561 - 40.125248338033295) / 49.3129930229561 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix3x2.GetDeterminantBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 20.938133091058585 < 25.316129855493426. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 41.360795494117454 (T) = (0 -21.331814252011878) / Math.Sqrt((2.1702967758169356 / (299)) + (1.2623760710443626 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.25077679409749076 = (28.47190808287327 - 21.331814252011878) / 28.47190808287327 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix3x2.LerpBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 68.14392138336758 < 105.0127098489732. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.639098125434387 (T) = (0 -68.77893395487898) / Math.Sqrt((232.35842562773152 / (299)) + (4.744546737865271 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.17442692451069816 = (83.31053421784011 - 68.77893395487898) / 83.31053421784011 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix3x2.AddOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 39.80164445073836 < 63.9156038458672. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 61.229457772943576 (T) = (0 -40.378455882818784) / Math.Sqrt((24.549974780205968 / (299)) + (0.5795431807052787 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.3155756728261619 = (58.996231255472296 - 40.378455882818784) / 58.996231255472296 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix3x2.EqualityOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 27.30572864563626 < 38.68170793801574. IsChangePoint: Marked as a change because one of 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 100.13893623554759 (T) = (0 -27.546596207722658) / Math.Sqrt((2.5135550398518567 / (299)) + (0.7431440409451464 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.3498864747173329 = (42.37197833370025 - 27.546596207722658) / 42.37197833370025 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix3x2.InequalityOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 39.54964197347176 < 50.274041118547395. IsChangePoint: Marked as a change because one of 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 52.384609577946605 (T) = (0 -39.11988666032963) / Math.Sqrt((11.149928312340373 / (299)) + (3.436059954463809 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.2972371254889725 = (55.66584132314715 - 39.11988666032963) / 55.66584132314715 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix3x2.CreateRotationBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 102.86499574279381 < 154.52116498139188. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.057273789339144 (T) = (0 -104.93940527292031) / Math.Sqrt((544.3087950769595 / (299)) + (26.7480499867314 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.13795583849559437 = (121.73321270430529 - 104.93940527292031) / 121.73321270430529 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix3x2.MultiplyByScalarBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 37.088910794992834 < 57.00576080682922. IsChangePoint: Marked as a change because one of 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 59.025069061658535 (T) = (0 -38.10115447721501) / Math.Sqrt((7.738150863013269 / (299)) + (4.690241468678111 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.3390379665534031 = (57.644997063652724 - 38.10115447721501) / 57.644997063652724 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Matrix3x2.CreateScaleFromVectorWithCenterBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 39.67850462652449 < 58.063534854522274. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.777837383185407 (T) = (0 -40.4360637644453) / Math.Sqrt((86.03194077395821 / (299)) + (13.122849084949568 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10802823118569795 = (45.33334481896995 - 40.4360637644453) / 45.33334481896995 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Numerics.Tests.Perf_VectorOf<UInt64>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[MultiplyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt64).MultiplyBenchmark.html>)	79.84 ns	50.15 ns	0.63	0.23	False
[OneBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt64).OneBenchmark.html>)	43.94 ns	31.77 ns	0.72	0.22	False
[MaxBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt64).MaxBenchmark.html>)	88.32 ns	51.35 ns	0.58	0.21	False
[SubtractionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt64).SubtractionOperatorBenchmark.html>)	76.22 ns	47.67 ns	0.63	0.20	False
[NegateBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt64).NegateBenchmark.html>)	81.45 ns	51.12 ns	0.63	0.22	False
[LessThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt64).LessThanOrEqualAllBenchmark.html>)	176.02 ns	103.27 ns	0.59	0.25	False
[DivideBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt64).DivideBenchmark.html>)	81.72 ns	59.87 ns	0.73	0.21	False
[GreaterThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt64).GreaterThanAllBenchmark.html>)	151.94 ns	90.98 ns	0.60	0.22	False
[LessThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt64).LessThanAnyBenchmark.html>)	108.07 ns	61.64 ns	0.57	0.30	False
[AndNotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt64).AndNotBenchmark.html>)	116.89 ns	79.83 ns	0.68	0.26	False
[LessThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt64).LessThanBenchmark.html>)	75.32 ns	48.67 ns	0.65	0.21	False
[AddBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt64).AddBenchmark.html>)	79.80 ns	48.57 ns	0.61	0.25	False
[InequalityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt64).InequalityOperatorBenchmark.html>)	36.40 ns	21.54 ns	0.59	0.25	False
[GreaterThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt64).GreaterThanOrEqualAnyBenchmark.html>)	133.20 ns	79.42 ns	0.60	0.27	False
[AddOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt64).AddOperatorBenchmark.html>)	75.81 ns	47.13 ns	0.62	0.19	False
[GreaterThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt64).GreaterThanOrEqualBenchmark.html>)	80.83 ns	48.21 ns	0.60	0.19	False
[SquareRootBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt64).SquareRootBenchmark.html>)	59.53 ns	40.21 ns	0.68	0.20	False
[LessThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt64).LessThanOrEqualBenchmark.html>)	77.35 ns	45.98 ns	0.59	0.20	False
[SubtractBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt64).SubtractBenchmark.html>)	80.04 ns	53.71 ns	0.67	0.26	False
[MultiplyOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt64).MultiplyOperatorBenchmark.html>)	83.87 ns	46.66 ns	0.56	0.19	False
[EqualsAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt64).EqualsAnyBenchmark.html>)	130.40 ns	76.05 ns	0.58	0.23	False
[EqualsAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt64).EqualsAllBenchmark.html>)	34.26 ns	21.37 ns	0.62	0.26	False
[LessThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt64).LessThanAllBenchmark.html>)	172.27 ns	102.03 ns	0.59	0.19	False
[OnesComplementOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt64).OnesComplementOperatorBenchmark.html>)	77.19 ns	54.69 ns	0.71	0.18	False
[DotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt64).DotBenchmark.html>)	58.15 ns	32.73 ns	0.56	0.20	False
[OnesComplementBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt64).OnesComplementBenchmark.html>)	74.60 ns	55.23 ns	0.74	0.21	False
[EqualityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt64).EqualityOperatorBenchmark.html>)	34.96 ns	21.43 ns	0.61	0.30	False
[EqualsStaticBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt64).EqualsStaticBenchmark.html>)	77.96 ns	47.56 ns	0.61	0.20	False
[MinBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt64).MinBenchmark.html>)	89.92 ns	50.19 ns	0.56	0.17	False
[GetHashCodeBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt64).GetHashCodeBenchmark.html>)	291.79 ns	215.89 ns	0.74	0.07	False
[UnaryNegateOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt64).UnaryNegateOperatorBenchmark.html>)	79.00 ns	47.69 ns	0.60	0.23	False
[LessThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt64).LessThanOrEqualAnyBenchmark.html>)	108.77 ns	71.74 ns	0.66	0.22	False
[GreaterThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt64).GreaterThanAnyBenchmark.html>)	130.10 ns	75.48 ns	0.58	0.19	False
[DivisionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt64).DivisionOperatorBenchmark.html>)	78.90 ns	57.09 ns	0.72	0.17	False
[GreaterThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt64).GreaterThanBenchmark.html>)	78.17 ns	46.24 ns	0.59	0.15	False
[GreaterThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt64).GreaterThanOrEqualAllBenchmark.html>)	152.00 ns	91.86 ns	0.60	0.25	False
[ConditionalSelectBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt64).ConditionalSelectBenchmark.html>)	196.27 ns	135.61 ns	0.69	0.25	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_VectorOf<UInt64>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorOf<UInt64>.MultiplyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 50.151882673934 < 75.79838601790337. IsChangePoint: Marked as a change because one of 5/25/2022 8:13:38 AM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.916628189354109 (T) = (0 -49.790973369746176) / Math.Sqrt((160.62137729602028 / (299)) + (4.6863687511895415 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14731023634074278 = (58.39283581413218 - 49.790973369746176) / 58.39283581413218 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt64>.OneBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 31.773820615369626 < 40.88391966939846. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.74916885452349 (T) = (0 -32.34607482439722) / Math.Sqrt((20.242293435692055 / (299)) + (3.1411833164847063 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09587826120882144 = (35.77623834998626 - 32.34607482439722) / 35.77623834998626 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt64>.MaxBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 51.35313218444611 < 83.46716109970922. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.650886249381577 (T) = (0 -52.333426010850836) / Math.Sqrt((248.01363348893005 / (299)) + (6.33513048821038 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13829453141939302 = (60.73238237312565 - 52.333426010850836) / 60.73238237312565 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt64>.SubtractionOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 47.67206200419373 < 72.43453795840385. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.658270343849131 (T) = (0 -47.927651840042586) / Math.Sqrt((152.24464060634716 / (299)) + (16.297116564983455 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12506087755012796 = (54.77827040793745 - 47.927651840042586) / 54.77827040793745 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt64>.NegateBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 51.118394123721416 < 74.45869222299352. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.514887816851731 (T) = (0 -48.72034947976607) / Math.Sqrt((153.91778036073842 / (299)) + (3.0416446821214964 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14001531604241374 = (56.65257810820375 - 48.72034947976607) / 56.65257810820375 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt64>.LessThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 103.26757860421438 < 166.33857133145017. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.664920505032615 (T) = (0 -107.14611400733277) / Math.Sqrt((670.8323859865582 / (299)) + (29.529435817977827 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.17511866098678383 = (129.89276025507965 - 107.14611400733277) / 129.89276025507965 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt64>.DivideBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 59.86943591902309 < 82.21319485901635. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.92210696201698 (T) = (0 -59.96719459555815) / Math.Sqrt((96.08544431535347 / (299)) + (0.9696293205099301 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09587628449787139 = (66.3263152678766 - 59.96719459555815) / 66.3263152678766 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt64>.GreaterThanAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 90.97528905492965 < 143.89017267810655. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.193422237436074 (T) = (0 -92.81276172104347) / Math.Sqrt((452.53070716972127 / (299)) + (14.066549750035238 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.18835950648165736 = (114.35205914716471 - 92.81276172104347) / 114.35205914716471 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt64>.LessThanAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 61.63704493662558 < 102.66182503702262. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.160908738925444 (T) = (0 -62.23801941300786) / Math.Sqrt((380.1310714848697 / (299)) + (9.17455258459736 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.16358726821569416 = (74.41065522787595 - 62.23801941300786) / 74.41065522787595 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt64>.AndNotBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 79.82651695157122 < 111.96167602729486. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.640250554882929 (T) = (0 -81.64316873874317) / Math.Sqrt((165.9636262540301 / (299)) + (12.243827451826448 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.0851605124278655 = (89.24316215887616 - 81.64316873874317) / 89.24316215887616 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt64>.LessThanBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 48.665136046846314 < 72.36923566514925. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.258694396642118 (T) = (0 -45.16036385491805) / Math.Sqrt((174.58926785155478 / (299)) + (7.256234274091748 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14761222323014872 = (52.98100827542904 - 45.16036385491805) / 52.98100827542904 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt64>.AddBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 48.569372464067634 < 75.5698874700773. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.30758095358083 (T) = (0 -49.691620085659096) / Math.Sqrt((153.43075738400296 / (299)) + (1.9301186386129263 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14412339399509227 = (58.059327404228824 - 49.691620085659096) / 58.059327404228824 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt64>.InequalityOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 21.540393320495397 < 34.826846637681356. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.917395832095063 (T) = (0 -22.086734720409346) / Math.Sqrt((44.051135356064485 / (299)) + (1.2095933351220618 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12841391090246984 = (25.340852724346142 - 22.086734720409346) / 25.340852724346142 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt64>.GreaterThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 79.42422389017916 < 127.4445730237244. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.560498792933501 (T) = (0 -79.03835782061223) / Math.Sqrt((547.7796324709159 / (299)) + (10.185322432485854 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.15950027622936333 = (94.03733943662895 - 79.03835782061223) / 94.03733943662895 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt64>.AddOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 47.1285807118689 < 72.14252238352039. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.11995225511536 (T) = (0 -47.15724947836238) / Math.Sqrt((142.44302935730576 / (299)) + (1.3563823844779284 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1429867361919717 = (55.02511042690892 - 47.15724947836238) / 55.02511042690892 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt64>.GreaterThanOrEqualBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 48.210930978670895 < 76.72546711111755. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.354322698589609 (T) = (0 -48.1109344346011) / Math.Sqrt((208.9153902069345 / (299)) + (4.904421082549567 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.13354959411071746 = (55.526472268453006 - 48.1109344346011) / 55.526472268453006 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt64>.SquareRootBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 40.20536679726446 < 55.554546922999684. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.302548906010809 (T) = (0 -40.55873816370697) / Math.Sqrt((71.78820164671464 / (299)) + (1.4804361373538517 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08504761441927669 = (44.328796561325106 - 40.55873816370697) / 44.328796561325106 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt64>.LessThanOrEqualBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 45.98408872501326 < 73.62815360881584. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.865588711477567 (T) = (0 -46.68599167264159) / Math.Sqrt((244.12481250738313 / (299)) + (1.123533316198085 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.13354486778378027 = (53.88160325535625 - 46.68599167264159) / 53.88160325535625 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt64>.SubtractBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 53.71345877281232 < 75.94972095003736. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.80253686946894 (T) = (0 -50.798175956430065) / Math.Sqrt((160.65132380365748 / (299)) + (15.190543819289301 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12135458053043932 = (57.81419310999992 - 50.798175956430065) / 57.81419310999992 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt64>.MultiplyOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 46.66466728837225 < 72.29226947512403. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.575187067913877 (T) = (0 -47.0749309646779) / Math.Sqrt((142.16100324735305 / (299)) + (0.5734375928105226 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14629454075476186 = (55.1418881710056 - 47.0749309646779) / 55.1418881710056 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt64>.EqualsAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 76.04684222527393 < 127.14776460410708. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.047089959018203 (T) = (0 -77.78088001722573) / Math.Sqrt((487.9449480736839 / (299)) + (21.91860199111018 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.155218903588347 = (92.07223072061252 - 77.78088001722573) / 92.07223072061252 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt64>.EqualsAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 21.367280023902577 < 33.00967743549445. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.823206471539731 (T) = (0 -21.509150911844745) / Math.Sqrt((37.12143839283455 / (299)) + (1.0650730232457601 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12110206301475909 = (24.472865399621416 - 21.509150911844745) / 24.472865399621416 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt64>.LessThanAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 102.02966459830706 < 164.17261438914028. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.261737767024915 (T) = (0 -103.07831127970705) / Math.Sqrt((636.3916517248152 / (299)) + (8.309513864143854 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.20190841491907333 = (129.15599312985475 - 103.07831127970705) / 129.15599312985475 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt64>.OnesComplementOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 54.69259724875013 < 72.5989508812854. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.678676127123092 (T) = (0 -56.24002949366887) / Math.Sqrt((57.06526345210384 / (299)) + (6.6485939956702005 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10389643177892191 = (62.76063558737428 - 56.24002949366887) / 62.76063558737428 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt64>.DotBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 32.72748855822013 < 54.85464468131043. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.351793386856718 (T) = (0 -32.6460474185858) / Math.Sqrt((95.85764967108274 / (299)) + (0.756773456401352 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.19120201563361963 = (40.36366070343389 - 32.6460474185858) / 40.36366070343389 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt64>.OnesComplementBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 55.233475232784684 < 71.39353376759756. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.20746576788868 (T) = (0 -56.12997471955253) / Math.Sqrt((59.23811192555702 / (299)) + (5.724943440232838 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1067918769334501 = (62.84086907634457 - 56.12997471955253) / 62.84086907634457 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt64>.EqualityOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 21.430380340745028 < 32.97484677956528. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.271008362781648 (T) = (0 -21.705147691453895) / Math.Sqrt((34.537701902605576 / (299)) + (1.9646917600490432 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11504262739827771 = (24.526771981843652 - 21.705147691453895) / 24.526771981843652 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt64>.EqualsStaticBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 47.56112136635402 < 73.90764026837049. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.97923411455403 (T) = (0 -46.57468267267499) / Math.Sqrt((177.080400070967 / (299)) + (3.0065078778753533 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.14699987470544432 = (54.601026766076906 - 46.57468267267499) / 54.601026766076906 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt64>.MinBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 50.18625020367727 < 85.41871525688782. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.854725080571141 (T) = (0 -51.18034679408601) / Math.Sqrt((244.61488289587416 / (299)) + (0.9961119081270844 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1747610158645818 = (62.01881852165086 - 51.18034679408601) / 62.01881852165086 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt64>.GetHashCodeBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 215.89030157725887 < 269.08039239844624. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.797097433900333 (T) = (0 -212.0343625126663) / Math.Sqrt((718.8765299606308 / (299)) + (13.392044772431595 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.1082044736872358 = (237.76118656857122 - 212.0343625126663) / 237.76118656857122 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt64>.UnaryNegateOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 47.68516673848494 < 75.01467114043302. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.110461102843335 (T) = (0 -48.26245523148318) / Math.Sqrt((165.06913538401736 / (299)) + (4.057384228125296 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1539240794184641 = (57.04270037411158 - 48.26245523148318) / 57.04270037411158 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt64>.LessThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 71.735490404652 < 104.63057147200394. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.114370876135524 (T) = (0 -64.61677326224266) / Math.Sqrt((405.53121652162025 / (299)) + (6.068516037511842 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13192707120672909 = (74.43703301756915 - 64.61677326224266) / 74.43703301756915 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt64>.GreaterThanAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 75.48239873304783 < 128.55984993815073. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.569483753671433 (T) = (0 -77.32679647255235) / Math.Sqrt((521.5100775476145 / (299)) + (14.194836441767103 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.1622288405098532 = (92.30061884633521 - 77.32679647255235) / 92.30061884633521 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt64>.DivisionOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 57.094381852357174 < 74.97506125238132. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.285262739791671 (T) = (0 -58.22635326682106) / Math.Sqrt((89.6989266515066 / (299)) + (3.734764716055797 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.0793303293015179 = (63.243479306369046 - 58.22635326682106) / 63.243479306369046 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt64>.GreaterThanBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 46.24160271156149 < 74.06070292619076. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.621643566661117 (T) = (0 -46.37977949396947) / Math.Sqrt((178.27942362832542 / (299)) + (3.5062978886193013 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1441220831733901 = (54.18971395585783 - 46.37977949396947) / 54.18971395585783 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt64>.GreaterThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 91.85968401204086 < 146.22999469381745. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.31654213483032 (T) = (0 -93.78478076793559) / Math.Sqrt((522.876562048655 / (299)) + (11.374298110536905 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.185778569284199 = (115.18338529297516 - 93.78478076793559) / 115.18338529297516 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt64>.ConditionalSelectBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 135.6121766808214 < 178.62500100630677. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.116113992097763 (T) = (0 -140.68327291886368) / Math.Sqrt((420.7620599054473 / (299)) + (15.124709722557371 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07752866310509257 = (152.50693142663036 - 140.68327291886368) / 152.50693142663036 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in GuardedDevirtualization.ThreeClassVirtual

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.ThreeClassVirtual.Call(testInput%3a%20pB%3d0.67%20pD%3d0.33).html>)	23.43 ns	17.27 ns	0.74	0.05	False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.ThreeClassVirtual.Call(testInput%3a%20pB%3d0.00%20pD%3d0.00).html>)	23.47 ns	17.13 ns	0.73	0.06	False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.ThreeClassVirtual.Call(testInput%3a%20pB%3d0.33%20pD%3d0.33).html>)	23.36 ns	17.15 ns	0.73	0.08	False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.ThreeClassVirtual.Call(testInput%3a%20pB%3d1.00%20pD%3d0.00).html>)	23.36 ns	17.18 ns	0.74	0.07	False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.ThreeClassVirtual.Call(testInput%3a%20pB%3d0.00%20pD%3d1.00).html>)	23.35 ns	17.19 ns	0.74	0.06	False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.ThreeClassVirtual.Call(testInput%3a%20pB%3d0.33%20pD%3d0.67).html>)	23.38 ns	18.44 ns	0.79	0.07	False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.ThreeClassVirtual.Call(testInput%3a%20pB%3d0.33%20pD%3d0.00).html>)	23.61 ns	17.22 ns	0.73	0.08	False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.ThreeClassVirtual.Call(testInput%3a%20pB%3d0.67%20pD%3d0.00).html>)	23.39 ns	17.22 ns	0.74	0.07	False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.ThreeClassVirtual.Call(testInput%3a%20pB%3d0.00%20pD%3d0.33).html>)	23.38 ns	17.21 ns	0.74	0.07	False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.ThreeClassVirtual.Call(testInput%3a%20pB%3d0.00%20pD%3d0.67).html>)	23.50 ns	17.20 ns	0.73	0.07	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'GuardedDevirtualization.ThreeClassVirtual*'

### Payloads [Baseline]() [Compare]() ### Histogram #### GuardedDevirtualization.ThreeClassVirtual.Call(testInput: pB=0.67 pD=0.33) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.269045055179998 < 22.255068931385722. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 20.266573337665886 (T) = (0 -17.27418761820713) / Math.Sqrt((4.320168672967273 / (299)) + (0.04009327616910154 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1262385863069647 = (19.769913557061464 - 17.27418761820713) / 19.769913557061464 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.ThreeClassVirtual.Call(testInput: pB=0.00 pD=0.00) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.12539842493865 < 22.221709092095175. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 19.026611382629156 (T) = (0 -17.300501260504525) / Math.Sqrt((4.4726960675032394 / (299)) + (0.10598888395930292 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12492954859817797 = (19.77040960849487 - 17.300501260504525) / 19.77040960849487 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.ThreeClassVirtual.Call(testInput: pB=0.33 pD=0.33) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.15264374411949 < 22.307012060006294. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.825149145323703 (T) = (0 -17.381623690658515) / Math.Sqrt((4.461067043379257 / (299)) + (0.32192998306634846 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12243358809104385 = (19.806619139910502 - 17.381623690658515) / 19.806619139910502 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.ThreeClassVirtual.Call(testInput: pB=1.00 pD=0.00) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.18125284794169 < 22.2653468273637. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.91208307396965 (T) = (0 -17.327880979883208) / Math.Sqrt((4.646786601893932 / (299)) + (0.18938984218759286 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12467265780310643 = (19.795886800923814 - 17.327880979883208) / 19.795886800923814 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.ThreeClassVirtual.Call(testInput: pB=0.00 pD=1.00) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.18909282532612 < 22.297818333971083. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 18.601764101233442 (T) = (0 -17.332738597134664) / Math.Sqrt((4.19423735867606 / (299)) + (0.13126617886741046 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12087770331013885 = (19.71595836255914 - 17.332738597134664) / 19.71595836255914 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.ThreeClassVirtual.Call(testInput: pB=0.33 pD=0.67) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 18.44447046589836 < 22.211640274189445. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.781137168202687 (T) = (0 -17.4337404642913) / Math.Sqrt((4.558903815685315 / (299)) + (0.2423453606484229 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1186884742008798 = (19.781586821394892 - 17.4337404642913) / 19.781586821394892 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.ThreeClassVirtual.Call(testInput: pB=0.33 pD=0.00) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.218673478181152 < 22.2249710310406. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 18.22788109458204 (T) = (0 -17.322113511401152) / Math.Sqrt((5.086033723624374 / (299)) + (0.11795950809028029 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12701296162384973 = (19.84234902687919 - 17.322113511401152) / 19.84234902687919 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.ThreeClassVirtual.Call(testInput: pB=0.67 pD=0.00) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.215689737070324 < 22.212991609047528. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.161476630452643 (T) = (0 -17.39163487629003) / Math.Sqrt((4.7247119763581065 / (299)) + (0.1984047997128645 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.12104071841605726 = (19.78662179316106 - 17.39163487629003) / 19.78662179316106 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.ThreeClassVirtual.Call(testInput: pB=0.00 pD=0.33) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.20872644389789 < 22.21369404062968. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 19.390350142870297 (T) = (0 -17.291471173415488) / Math.Sqrt((4.561253423442993 / (299)) + (0.07223641366074882 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12613575004686492 = (19.787365342320413 - 17.291471173415488) / 19.787365342320413 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.ThreeClassVirtual.Call(testInput: pB=0.00 pD=0.67) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.19987801945668 < 22.22034923858756. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 19.193972430193572 (T) = (0 -17.293021734359353) / Math.Sqrt((4.760680794163995 / (299)) + (0.06433014973050304 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.12678864039892335 = (19.803935833198054 - 17.293021734359353) / 19.803935833198054 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in BenchmarksGame.RegexRedux_1

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[RunBench - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/BenchmarksGame.RegexRedux_1.RunBench.html>)	633.25 ms	466.41 ms	0.74	0.02	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'BenchmarksGame.RegexRedux_1*'

### Payloads [Baseline]() [Compare]() ### Histogram #### BenchmarksGame.RegexRedux_1.RunBench ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 466.40685933333333 < 599.1916527883333. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.090927657923304 (T) = (0 -461713440.07646185) / Math.Sqrt((4363917534058305.5 / (299)) + (25828877636856.195 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.11260676686902894 = (520303088.685281 - 461713440.07646185) / 520303088.685281 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Net.Tests.Perf_WebUtility

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[HtmlDecode_Entities - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Net.Tests.Perf_WebUtility.HtmlDecode_Entities.html>)	4.71 μs	3.32 μs	0.70	0.05	False
[Decode_NoDecodingRequired - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Net.Tests.Perf_WebUtility.Decode_NoDecodingRequired.html>)	1.36 μs	1.01 μs	0.74	0.10	False
[Decode_DecodingRequired - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Net.Tests.Perf_WebUtility.Decode_DecodingRequired.html>)	2.02 μs	1.53 μs	0.76	0.06	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Net.Tests.Perf_WebUtility*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Net.Tests.Perf_WebUtility.HtmlDecode_Entities ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.3195293261604246 < 4.419999729485573. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.838528063258595 (T) = (0 -3189.829094668411) / Math.Sqrt((350037.28642804537 / (299)) + (3954.6315523081635 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11563805096559784 = (3606.927116381762 - 3189.829094668411) / 3606.927116381762 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Net.Tests.Perf_WebUtility.Decode_NoDecodingRequired ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.0087710637267704 < 1.292626223660401. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.762950568945246 (T) = (0 -1009.7190344549575) / Math.Sqrt((23225.96530145893 / (299)) + (228.34423799613552 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07276157494607838 = (1088.952967405594 - 1009.7190344549575) / 1088.952967405594 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Net.Tests.Perf_WebUtility.Decode_DecodingRequired ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.530985666284556 < 1.921029727357425. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.329882118771158 (T) = (0 -1557.475996257597) / Math.Sqrt((37985.47899428815 / (299)) + (694.1521603637154 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.06606350890768778 = (1667.6465810175232 - 1557.475996257597) / 1667.6465810175232 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in Benchstone.BenchF.FFT

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Test - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Benchstone.BenchF.FFT.Test.html>)	1.01 secs	740.48 ms	0.73	0.05	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Benchstone.BenchF.FFT*'

### Payloads [Baseline]() [Compare]() ### Histogram #### Benchstone.BenchF.FFT.Test ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 740.4785942000001 < 0.9582492098283333. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.592175125215837 (T) = (0 -743215243.6193682) / Math.Sqrt((12511211398596144 / (299)) + (59348690087105.17 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08538009159415905 = (812594649.1967065 - 743215243.6193682) / 812594649.1967065 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in Benchstone.BenchI.TreeSort

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Test - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Benchstone.BenchI.TreeSort.Test.html>)	2.24 ms	1.88 ms	0.84	0.05	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Benchstone.BenchI.TreeSort*'

### Payloads [Baseline]() [Compare]() ### Histogram #### Benchstone.BenchI.TreeSort.Test ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.8835642 < 2.1523902949107137. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.01634307684086 (T) = (0 -1898899.8307662983) / Math.Sqrt((19573128623.679672 / (299)) + (458857413.8560939 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.059574536102598094 = (2019192.2737786092 - 1898899.8307662983) / 2019192.2737786092 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in MicroBenchmarks.Serializers.Json_ToStream<CollectionsOfPrimitives>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[JsonNet_ - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/MicroBenchmarks.Serializers.JsonToStream(CollectionsOfPrimitives).JsonNet.html>)	6.65 ms	5.64 ms	0.85	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'MicroBenchmarks.Serializers.Json_ToStream<CollectionsOfPrimitives>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### MicroBenchmarks.Serializers.Json_ToStream<CollectionsOfPrimitives>.JsonNet_ ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.637614912343471 < 6.332148082546295. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.452714889712844 (T) = (0 -5556542.238295349) / Math.Sqrt((161619128123.52448 / (299)) + (2077400833.711651 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07019025623930031 = (5975999.149913628 - 5556542.238295349) / 5975999.149913628 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in System.Tests.Perf_Int32

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ParseSpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int32.ParseSpan(value%3a%20%2212345%22).html>)	303.09 ns	212.15 ns	0.70	0.22	False
[TryParse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int32.TryParse(value%3a%20%222147483647%22).html>)	427.62 ns	264.30 ns	0.62	0.15	False
[ParseSpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int32.ParseSpan(value%3a%20%22-2147483648%22).html>)	471.75 ns	305.65 ns	0.65	0.15	False
[ToStringHex - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int32.ToStringHex(value%3a%204).html>)	414.36 ns	320.48 ns	0.77	0.11	False
[TryParse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int32.TryParse(value%3a%20%224%22).html>)	150.05 ns	107.53 ns	0.72	0.27	False
[TryParseSpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int32.TryParseSpan(value%3a%20%22-2147483648%22).html>)	434.55 ns	272.73 ns	0.63	0.13	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int32.Parse(value%3a%20%224%22).html>)	190.60 ns	122.93 ns	0.64	0.30	False
[ToStringHex - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int32.ToStringHex(value%3a%2012345).html>)	494.09 ns	361.06 ns	0.73	0.11	False
[TryFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int32.TryFormat(value%3a%204).html>)	142.91 ns	94.90 ns	0.66	0.17	False
[ParseSpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int32.ParseSpan(value%3a%20%224%22).html>)	199.66 ns	140.67 ns	0.70	0.31	False
[ParseSpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int32.ParseSpan(value%3a%20%222147483647%22).html>)	460.63 ns	297.57 ns	0.65	0.14	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int32.Parse(value%3a%20%222147483647%22).html>)	446.30 ns	279.38 ns	0.63	0.15	False
[TryFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int32.TryFormat(value%3a%202147483647).html>)	369.34 ns	244.67 ns	0.66	0.08	False
[TryFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int32.TryFormat(value%3a%2012345).html>)	241.23 ns	160.59 ns	0.67	0.21	False
[TryFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int32.TryFormat(value%3a%20-2147483648).html>)	487.88 ns	315.67 ns	0.65	0.12	False
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int32.ToString(value%3a%20-2147483648).html>)	546.99 ns	401.30 ns	0.73	0.07	False
[ParseHex - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int32.ParseHex(value%3a%20%224%22).html>)	218.64 ns	154.95 ns	0.71	0.31	False
[TryParse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int32.TryParse(value%3a%20%2212345%22).html>)	259.75 ns	170.28 ns	0.66	0.17	False
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int32.ToString(value%3a%204).html>)	23.52 ns	19.67 ns	0.84	0.35	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int32.Parse(value%3a%20%2212345%22).html>)	287.84 ns	184.30 ns	0.64	0.19	False
[ParseHex - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int32.ParseHex(value%3a%20%2280000000%22).html>)	568.29 ns	378.50 ns	0.67	0.13	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int32.Parse(value%3a%20%22-2147483648%22).html>)	449.74 ns	292.15 ns	0.65	0.10	False
[ToStringHex - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int32.ToStringHex(value%3a%202147483647).html>)	597.77 ns	442.37 ns	0.74	0.08	False
[ParseHex - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int32.ParseHex(value%3a%20%227FFFFFFF%22).html>)	576.26 ns	371.89 ns	0.65	0.11	False
[TryParseSpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int32.TryParseSpan(value%3a%20%2212345%22).html>)	257.87 ns	167.03 ns	0.65	0.20	False
[TryParse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int32.TryParse(value%3a%20%22-2147483648%22).html>)	424.21 ns	269.68 ns	0.64	0.09	False
[TryParseSpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int32.TryParseSpan(value%3a%20%224%22).html>)	149.49 ns	106.37 ns	0.71	0.23	False
[ParseHex - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int32.ParseHex(value%3a%20%223039%22).html>)	364.45 ns	243.97 ns	0.67	0.14	False
[ToStringHex - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int32.ToStringHex(value%3a%20-2147483648).html>)	621.59 ns	444.65 ns	0.72	0.05	False
[TryParseSpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int32.TryParseSpan(value%3a%20%222147483647%22).html>)	412.18 ns	262.59 ns	0.64	0.14	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Int32*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Tests.Perf_Int32.ParseSpan(value: "12345") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 212.15037330490645 < 290.6643167681179. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.92461889143885 (T) = (0 -207.24253863736476) / Math.Sqrt((1677.3020097519147 / (299)) + (56.48747248041308 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11956460579091181 = (235.38642358140845 - 207.24253863736476) / 235.38642358140845 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Int32.TryParse(value: "2147483647") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 264.29668117112834 < 395.1109055164493. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.736698874090514 (T) = (0 -265.8610207765915) / Math.Sqrt((4397.338405110356 / (299)) + (15.210479293310724 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1128483789115927 = (299.67934956869976 - 265.8610207765915) / 299.67934956869976 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Int32.ParseSpan(value: "-2147483648") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 305.6512058114404 < 454.0056009351222. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.123318832199438 (T) = (0 -305.3789913406342) / Math.Sqrt((4935.420550855761 / (299)) + (66.18336150322605 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12236083237324646 = (347.9550624049942 - 305.3789913406342) / 347.9550624049942 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Int32.ToStringHex(value: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 320.47998804220487 < 390.7418589587908. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.14646111443582 (T) = (0 -320.8124663731711) / Math.Sqrt((1288.5713384108567 / (299)) + (49.85994985610362 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09136617614757027 = (353.07123502511604 - 320.8124663731711) / 353.07123502511604 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Int32.TryParse(value: "4") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 107.53096036024915 < 142.56589688328324. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.17358890658262 (T) = (0 -108.39125660818094) / Math.Sqrt((301.11602779664497 / (299)) + (13.844131561666357 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1117298145704617 = (122.02509820338784 - 108.39125660818094) / 122.02509820338784 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Int32.TryParseSpan(value: "-2147483648") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 272.73072912915075 < 404.12570159661965. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.636393824387232 (T) = (0 -269.6552172313657) / Math.Sqrt((4657.112886053123 / (299)) + (30.289085377668044 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.11399015228154054 = (304.3478782157419 - 269.6552172313657) / 304.3478782157419 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Int32.Parse(value: "4") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 122.92763981639095 < 166.67329559759528. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.738876215954402 (T) = (0 -125.33057190713399) / Math.Sqrt((431.65934412962696 / (299)) + (22.11449554354893 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11269013368452363 = (141.24780605400554 - 125.33057190713399) / 141.24780605400554 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Int32.ToStringHex(value: 12345) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 361.06253292041276 < 468.3229141599288. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.2683709419745 (T) = (0 -370.0796675587663) / Math.Sqrt((2647.1552580921175 / (299)) + (103.67183428300231 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08322524819682699 = (403.6756758744383 - 370.0796675587663) / 403.6756758744383 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Int32.TryFormat(value: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 94.90080117994927 < 134.56543690282777. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.065702773064347 (T) = (0 -97.17421848925457) / Math.Sqrt((365.62655761359383 / (299)) + (10.166024837457202 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11890281488395239 = (110.28774138741113 - 97.17421848925457) / 110.28774138741113 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Int32.ParseSpan(value: "4") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 140.66815196333596 < 188.5116157179045. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.83492947297467 (T) = (0 -143.54282762159102) / Math.Sqrt((455.9565082441222 / (299)) + (29.44523808355312 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1212831188375229 = (163.35503584692094 - 143.54282762159102) / 163.35503584692094 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Int32.ParseSpan(value: "2147483647") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 297.5712361050374 < 439.19642348734976. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.4263384898711 (T) = (0 -301.97322995362583) / Math.Sqrt((4663.047718218784 / (299)) + (67.75981574744779 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.11358369573507812 = (340.66750408437383 - 301.97322995362583) / 340.66750408437383 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Int32.Parse(value: "2147483647") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 279.3831021740643 < 421.1467252813684. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.501001537485635 (T) = (0 -281.0318014769269) / Math.Sqrt((4654.809603999208 / (299)) + (42.93167307925397 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12021148392306011 = (319.4310863820708 - 281.0318014769269) / 319.4310863820708 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Int32.TryFormat(value: 2147483647) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 244.66585208288262 < 350.8616768033946. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.838188692877926 (T) = (0 -248.90857468253748) / Math.Sqrt((2395.6015313243734 / (299)) + (41.66502772035472 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11413965720102831 = (280.9794757219675 - 248.90857468253748) / 280.9794757219675 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Int32.TryFormat(value: 12345) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 160.59386490344053 < 229.51516216573208. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.05923053274831 (T) = (0 -163.3934736529433) / Math.Sqrt((1053.8098482886471 / (299)) + (28.938931127778087 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11989107341803842 = (185.65142190695303 - 163.3934736529433) / 185.65142190695303 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Int32.TryFormat(value: -2147483648) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 315.67044035268606 < 450.97704511702943. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.820871462197411 (T) = (0 -324.88458696163394) / Math.Sqrt((3366.8609171991825 / (299)) + (269.83933644590155 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12762419049684703 = (372.413566977134 - 324.88458696163394) / 372.413566977134 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Int32.ToString(value: -2147483648) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 401.30096809892024 < 515.7017352271201. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.65101504042164 (T) = (0 -407.4418594698189) / Math.Sqrt((2456.0047016779154 / (299)) + (64.2109213754175 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11124808463498709 = (458.4427357351814 - 407.4418594698189) / 458.4427357351814 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Int32.ParseHex(value: "4") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 154.94598811402764 < 209.1699265498581. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.78159150994763 (T) = (0 -154.985735370472) / Math.Sqrt((684.2773470796384 / (299)) + (24.785470147140035 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12828963276460728 = (177.79498924855665 - 154.985735370472) / 177.79498924855665 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Int32.TryParse(value: "12345") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 170.28071041754984 < 246.37080536548132. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.77174847985673 (T) = (0 -172.20906022944206) / Math.Sqrt((1383.3699778118776 / (299)) + (19.39871439826316 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11238943328769006 = (194.0142070044306 - 172.20906022944206) / 194.0142070044306 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Int32.ToString(value: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 19.671146391009813 < 21.85326318575797. IsChangePoint: Marked as a change because one of 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.115348376551125 (T) = (0 -19.859222427492533) / Math.Sqrt((2.045317692631553 / (299)) + (1.2908450013042803 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12303591239757143 = (22.645422666949283 - 19.859222427492533) / 22.645422666949283 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Int32.Parse(value: "12345") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 184.30119917339786 < 268.2511373071563. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.930725690418855 (T) = (0 -186.884459441522) / Math.Sqrt((1617.1398769508828 / (299)) + (27.730169116805342 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12443071296750877 = (213.44337016995775 - 186.884459441522) / 213.44337016995775 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Int32.ParseHex(value: "80000000") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 378.49852050023077 < 536.680917362688. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.209178906061025 (T) = (0 -369.8449414518204) / Math.Sqrt((5823.099477566404 / (299)) + (108.28463068167085 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14181839048208786 = (430.9634899535806 - 369.8449414518204) / 430.9634899535806 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Int32.Parse(value: "-2147483648") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 292.15017355140304 < 429.49049686438775. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.53316257783495 (T) = (0 -286.79447681072486) / Math.Sqrt((4889.316462897443 / (299)) + (27.9401418765752 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12006871850910744 = (325.928266040049 - 286.79447681072486) / 325.928266040049 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Int32.ToStringHex(value: 2147483647) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 442.3696264856955 < 573.654111526449. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.543550062354123 (T) = (0 -437.08677503029367) / Math.Sqrt((5246.643069742797 / (299)) + (74.92731208690606 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.08671422335293709 = (478.5870821671679 - 437.08677503029367) / 478.5870821671679 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Int32.ParseHex(value: "7FFFFFFF") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 371.8913185436875 < 538.8607060999512. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.342256255083164 (T) = (0 -367.34878958032556) / Math.Sqrt((5694.346526737251 / (299)) + (34.06267044615668 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.14758013438154516 = (430.94817987823825 - 367.34878958032556) / 430.94817987823825 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Int32.TryParseSpan(value: "12345") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 167.03354578446806 < 243.0631442790905. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.55198134328896 (T) = (0 -170.30656232623284) / Math.Sqrt((1411.24608092202 / (299)) + (31.27374052313772 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11424610646572479 = (192.27300446480356 - 170.30656232623284) / 192.27300446480356 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Int32.TryParse(value: "-2147483648") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 269.6825448924148 < 404.20976644470664. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.856054945909297 (T) = (0 -272.5802945411786) / Math.Sqrt((4594.6685006159005 / (299)) + (47.13725599796454 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10401316569186608 = (304.22354894495805 - 272.5802945411786) / 304.22354894495805 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Int32.TryParseSpan(value: "4") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 106.37357225883916 < 141.30990294718026. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.121844260997522 (T) = (0 -107.31937475240802) / Math.Sqrt((296.50753661320056 / (299)) + (19.07636217978808 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10683939516034094 = (120.15686111869442 - 107.31937475240802) / 120.15686111869442 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Int32.ParseHex(value: "3039") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 243.96645384185265 < 346.1333346421744. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.683373324391644 (T) = (0 -243.34601007287262) / Math.Sqrt((2195.743552213437 / (299)) + (26.738342255310645 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1443826347818272 = (284.40985417684004 - 243.34601007287262) / 284.40985417684004 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Int32.ToStringHex(value: -2147483648) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 444.65024995067574 < 569.1559904003059. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.36329586864691 (T) = (0 -440.57387709749946) / Math.Sqrt((4854.999789065761 / (299)) + (39.42937194206773 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08043908507044699 = (479.1133136962999 - 440.57387709749946) / 479.1133136962999 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Int32.TryParseSpan(value: "2147483647") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 262.5902858805504 < 392.11331491100185. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.20058799657103 (T) = (0 -266.09266347277145) / Math.Sqrt((4296.4666982848785 / (299)) + (34.88099895018028 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10660775991810308 = (297.8452817637848 - 266.09266347277145) / 297.8452817637848 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in MicroBenchmarks.Serializers.Json_ToStream<Location>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[JsonNet_ - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/MicroBenchmarks.Serializers.JsonToStream(Location).JsonNet.html>)	25.85 μs	20.98 μs	0.81	0.01	False
[DataContractJsonSerializer_ - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/MicroBenchmarks.Serializers.JsonToStream(Location).DataContractJsonSerializer.html>)	57.23 μs	44.05 μs	0.77	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'MicroBenchmarks.Serializers.Json_ToStream<Location>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### MicroBenchmarks.Serializers.Json_ToStream<Location>.JsonNet_ ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 20.983304492362983 < 24.539319441373017. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.674963270277264 (T) = (0 -21069.36076998577) / Math.Sqrt((2999931.312762829 / (299)) + (51151.83135528107 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07652580675822118 = (22815.321667001375 - 21069.36076998577) / 22815.321667001375 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### MicroBenchmarks.Serializers.Json_ToStream<Location>.DataContractJsonSerializer_ ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 44.046218838028175 < 53.31716700654606. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.747426846372512 (T) = (0 -44203.245309181504) / Math.Sqrt((21797580.397977483 / (299)) + (134444.51850388764 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07863291389562307 = (47975.715625003286 - 44203.245309181504) / 47975.715625003286 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in System.Collections.IterateFor<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ImmutableList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateFor(String).ImmutableList(Size%3a%20512).html>)	129.32 μs	104.40 μs	0.81	0.05	False
[IList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateFor(String).IList(Size%3a%20512).html>)	21.24 μs	18.37 μs	0.87	0.16	False
[List - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateFor(String).List(Size%3a%20512).html>)	12.61 μs	9.38 μs	0.74	0.10	False
[ReadOnlySpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateFor(String).ReadOnlySpan(Size%3a%20512).html>)	6.80 μs	4.05 μs	0.60	0.07	False
[Array - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateFor(String).Array(Size%3a%20512).html>)	4.51 μs	2.73 μs	0.61	0.06	False
[ImmutableArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateFor(String).ImmutableArray(Size%3a%20512).html>)	7.91 μs	4.75 μs	0.60	0.05	False
[ImmutableSortedSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateFor(String).ImmutableSortedSet(Size%3a%20512).html>)	129.62 μs	103.04 μs	0.79	0.05	False
[Span - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateFor(String).Span(Size%3a%20512).html>)	6.85 μs	4.09 μs	0.60	0.08	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.IterateFor<String>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.IterateFor<String>.ImmutableList(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 104.39997294444446 < 123.0556315181031. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 20.983312718770154 (T) = (0 -105469.26129707572) / Math.Sqrt((71289241.24961728 / (299)) + (1712286.6501925858 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09362312063118737 = (116363.58307211338 - 105469.26129707572) / 116363.58307211338 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateFor<String>.IList(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 18.37007699175824 < 20.20539928689804. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.197639467315991 (T) = (0 -17564.906685205395) / Math.Sqrt((1385371.9198314925 / (299)) + (1059496.90993339 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.097593489023565 = (19464.51679099651 - 17564.906685205395) / 19464.51679099651 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateFor<String>.List(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 9.37949518651878 < 12.029272283664389. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 22.131518990158824 (T) = (0 -9435.670050327297) / Math.Sqrt((1211922.8019860254 / (299)) + (16505.82168578127 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13394559508494017 = (10895.00843916696 - 9435.670050327297) / 10895.00843916696 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateFor<String>.ReadOnlySpan(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 4.0520324578004 < 6.511219468483986. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.524569496156637 (T) = (0 -4114.0073388245355) / Math.Sqrt((1189783.0514626303 / (299)) + (23357.145730628825 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.156758014129312 = (4878.798029223633 - 4114.0073388245355) / 4878.798029223633 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateFor<String>.Array(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.7315922554987058 < 4.289109867766443. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.954465249972802 (T) = (0 -2759.8592632124796) / Math.Sqrt((603632.4713779335 / (299)) + (426.8676867922464 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11484855601542222 = (3117.9514895086872 - 2759.8592632124796) / 3117.9514895086872 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateFor<String>.ImmutableArray(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 4.749745475681104 < 7.507386325150291. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.573335075126906 (T) = (0 -4717.009881239789) / Math.Sqrt((1897251.2456062068 / (299)) + (1928.1561669458035 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1394931127308057 = (5481.66429696937 - 4717.009881239789) / 5481.66429696937 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateFor<String>.ImmutableSortedSet(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 103.03794601832732 < 123.89815419075519. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 21.330912188333432 (T) = (0 -105219.73884345972) / Math.Sqrt((72167812.693008 / (299)) + (1649397.8059528805 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09543154850094403 = (116320.37207254904 - 105219.73884345972) / 116320.37207254904 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateFor<String>.Span(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 4.093292158671587 < 6.5092494368524845. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.452151235315023 (T) = (0 -4127.467971722111) / Math.Sqrt((1192215.71442317 / (299)) + (21016.699610665295 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1548803547531838 = (4883.885962107399 - 4127.467971722111) / 4883.885962107399 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in Benchstone.BenchI.LogicArray

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Test - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Benchstone.BenchI.LogicArray.Test.html>)	4.61 secs	2.86 secs	0.62	0.12	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Benchstone.BenchI.LogicArray*'

### Payloads [Baseline]() [Compare]() ### Histogram #### Benchstone.BenchI.LogicArray.Test ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.8555202482 < 4.390253805164743. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.233786667651577 (T) = (0 -2892519505.3753805) / Math.Sqrt((4.9565769020026963E+17 / (299)) + (10289931022755220 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14285237024177358 = (3374587299.7295303 - 2892519505.3753805) / 3374587299.7295303 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_SliceSlice

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_SliceSlice.Count(Options%3a%20IgnoreCase%2c%20NonBacktracking).html>)	75.58 secs	46.89 secs	0.62	0.04	False
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_SliceSlice.Count(Options%3a%20None).html>)	48.72 secs	30.01 secs	0.62	0.05	False
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_SliceSlice.Count(Options%3a%20IgnoreCase).html>)	74.78 secs	45.47 secs	0.61	0.04	False
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_SliceSlice.Count(Options%3a%20Compiled).html>)	48.45 secs	30.22 secs	0.62	0.04	False
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_SliceSlice.Count(Options%3a%20IgnoreCase%2c%20Compiled).html>)	74.89 secs	45.44 secs	0.61	0.04	False
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_SliceSlice.Count(Options%3a%20NonBacktracking).html>)	49.52 secs	30.65 secs	0.62	0.04	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Industry_SliceSlice*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_SliceSlice.Count(Options: IgnoreCase, NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 46.886060670333336 < 72.26935553058333. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.366868930854 (T) = (0 -46167999990.721214) / Math.Sqrt((1.521442951633183E+20 / (299)) + (2.4886295001518147E+17 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.13858978069298863 = (53595835010.94579 - 46167999990.721214) / 53595835010.94579 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_SliceSlice.Count(Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 30.005834228 < 46.11082251101667. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.289391433332385 (T) = (0 -30252138832.678577) / Math.Sqrt((5.524909289517698E+19 / (299)) + (2.4412043835894314E+17 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13963314255986442 = (35161906308.99973 - 30252138832.678577) / 35161906308.99973 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_SliceSlice.Count(Options: IgnoreCase) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 45.46908396 < 71.27135260280001. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.267924897083288 (T) = (0 -45474673305.285706) / Math.Sqrt((1.4277057561578873E+20 / (299)) + (1.4169441682603258E+17 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14652063043986469 = (53281514383.554886 - 45474673305.285706) / 53281514383.554886 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_SliceSlice.Count(Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 30.222882185 < 46.101846437283335. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.285378910148328 (T) = (0 -30225226709.654762) / Math.Sqrt((5.573516163476605E+19 / (299)) + (2.6515724695091818E+17 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14033105903837817 = (35159147050.07832 - 30225226709.654762) / 35159147050.07832 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_SliceSlice.Count(Options: IgnoreCase, Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 45.443791729333334 < 71.3504092772. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.019711106110877 (T) = (0 -45484825825.1131) / Math.Sqrt((1.5051046678604536E+20 / (299)) + (2.387373208559712E+17 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14720639034810623 = (53336264848.04428 - 45484825825.1131) / 53336264848.04428 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_SliceSlice.Count(Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 30.652697323 < 46.73284487629166. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.929437763311459 (T) = (0 -30702852055.54762) / Math.Sqrt((5.7773547785522725E+19 / (299)) + (2.7344185453397338E+17 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13677081560428578 = (35567439806.89267 - 30702852055.54762) / 35567439806.89267 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Numerics.Tests.Perf_Vector2

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[GetHashCodeBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector2.GetHashCodeBenchmark.html>)	193.22 ns	140.79 ns	0.73	0.04	False
[TransformByQuaternionBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector2.TransformByQuaternionBenchmark.html>)	97.98 ns	62.53 ns	0.64	0.13	False
[EqualityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector2.EqualityOperatorBenchmark.html>)	13.62 ns	12.57 ns	0.92	0.37	False
[AbsBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector2.AbsBenchmark.html>)	36.41 ns	21.00 ns	0.58	0.21	False
[MultiplyOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector2.MultiplyOperatorBenchmark.html>)	21.91 ns	16.51 ns	0.75	0.35	False
[TransformByMatrix3x2Benchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector2.TransformByMatrix3x2Benchmark.html>)	42.60 ns	24.74 ns	0.58	0.25	False
[MinBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector2.MinBenchmark.html>)	30.30 ns	19.60 ns	0.65	0.26	False
[MultiplyFunctionBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector2.MultiplyFunctionBenchmark.html>)	22.08 ns	14.22 ns	0.64	0.38	False
[TransformNormalByMatrix3x2Benchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector2.TransformNormalByMatrix3x2Benchmark.html>)	34.78 ns	21.12 ns	0.61	0.27	False
[ReflectBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector2.ReflectBenchmark.html>)	56.80 ns	34.19 ns	0.60	0.20	False
[TransformNormalByMatrix4x4Benchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector2.TransformNormalByMatrix4x4Benchmark.html>)	34.66 ns	21.14 ns	0.61	0.24	False
[ClampBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector2.ClampBenchmark.html>)	58.96 ns	36.62 ns	0.62	0.23	False
[LengthBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector2.LengthBenchmark.html>)	17.28 ns	12.01 ns	0.69	0.38	False
[TransformByMatrix4x4Benchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector2.TransformByMatrix4x4Benchmark.html>)	40.04 ns	24.31 ns	0.61	0.21	False
[LengthSquaredBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector2.LengthSquaredBenchmark.html>)	17.63 ns	10.89 ns	0.62	0.39	False
[AddOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector2.AddOperatorBenchmark.html>)	21.84 ns	14.61 ns	0.67	0.36	False
[MultiplyByScalarOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector2.MultiplyByScalarOperatorBenchmark.html>)	25.41 ns	17.33 ns	0.68	0.32	False
[MaxBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector2.MaxBenchmark.html>)	29.47 ns	19.05 ns	0.65	0.24	False
[ZeroBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector2.ZeroBenchmark.html>)	3.96 ns	2.72 ns	0.69	0.84	False
[AddFunctionBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector2.AddFunctionBenchmark.html>)	20.99 ns	14.85 ns	0.71	0.35	False
[DistanceSquaredBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector2.DistanceSquaredBenchmark.html>)	30.86 ns	19.79 ns	0.64	0.29	False
[SubtractOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector2.SubtractOperatorBenchmark.html>)	22.38 ns	14.80 ns	0.66	0.26	False
[LerpBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector2.LerpBenchmark.html>)	82.88 ns	41.48 ns	0.50	0.23	False
[DistanceBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector2.DistanceBenchmark.html>)	32.26 ns	21.93 ns	0.68	0.28	False
[DotBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector2.DotBenchmark.html>)	16.07 ns	10.47 ns	0.65	0.42	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_Vector2*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_Vector2.GetHashCodeBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 140.78969641705996 < 183.42868994501123. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.930151102777007 (T) = (0 -141.55803573442523) / Math.Sqrt((348.6722333616247 / (299)) + (3.728792329424586 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11722193995397935 = (160.3551811505664 - 141.55803573442523) / 160.3551811505664 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector2.TransformByQuaternionBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 62.52797865092261 < 92.63397285509971. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.699600994258825 (T) = (0 -62.94354086051357) / Math.Sqrt((217.06133129415886 / (299)) + (2.3677209477523005 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12972874750365992 = (72.32634730833911 - 62.94354086051357) / 72.32634730833911 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector2.EqualityOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 12.5730460876873 < 13.449209783922543. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 5.165545016183224 (T) = (0 -9.98116204066052) / Math.Sqrt((4.179867137356555 / (299)) + (0.8412413986231192 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08099604750831185 = (10.86084778373224 - 9.98116204066052) / 10.86084778373224 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector2.AbsBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 20.999579398400783 < 34.58347667905748. IsChangePoint: Marked as a change because one of 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 107.90468818199152 (T) = (0 -21.400599268824518) / Math.Sqrt((4.523310255292251 / (299)) + (0.7101314549191949 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.45676634581240727 = (39.39483333526007 - 21.400599268824518) / 39.39483333526007 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector2.MultiplyOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 16.50922959598632 < 20.80306216193737. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 4.284065356954444 (T) = (0 -14.89093809080329) / Math.Sqrt((15.148346952510815 / (299)) + (0.2969080677709573 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.06372321696841368 = (15.904418822164608 - 14.89093809080329) / 15.904418822164608 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector2.TransformByMatrix3x2Benchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 24.743994529383958 < 39.17621107819033. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 36.89790204142736 (T) = (0 -24.707639818193954) / Math.Sqrt((17.7548451533525 / (299)) + (0.4991496239457894 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.28095319207373154 = (34.361657051855644 - 24.707639818193954) / 34.361657051855644 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector2.MinBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 19.6021892098767 < 28.723669269426168. IsChangePoint: Marked as a change because one of 5/25/2022 12:28:02 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 5.023976079309578 (T) = (0 -19.4901289063632) / Math.Sqrt((26.438938248692256 / (299)) + (1.6694235789683167 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08141879654995353 = (21.21764394172376 - 19.4901289063632) / 21.21764394172376 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector2.MultiplyFunctionBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 14.223463273900677 < 20.92456430887319. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 4.208195041548596 (T) = (0 -14.89318573838467) / Math.Sqrt((15.104122567725268 / (299)) + (0.29299710608974383 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.06259216326659393 = (15.88762666021984 - 14.89318573838467) / 15.88762666021984 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector2.TransformNormalByMatrix3x2Benchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 21.11540745909191 < 33.05133794518315. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 33.014167105567566 (T) = (0 -21.70271337982231) / Math.Sqrt((9.739172006826987 / (299)) + (1.9610310281139411 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.2834034416416194 = (30.285818605576473 - 21.70271337982231) / 30.285818605576473 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector2.ReflectBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 34.19016819519094 < 53.93685168429873. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.354461440431789 (T) = (0 -34.911633366056286) / Math.Sqrt((99.11069422504376 / (299)) + (6.64628039226427 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10883061218582497 = (39.17508146423898 - 34.911633366056286) / 39.17508146423898 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector2.TransformNormalByMatrix4x4Benchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 21.13818822070945 < 33.08957450071385. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 26.72439756471734 (T) = (0 -22.172705206340854) / Math.Sqrt((8.420515388799583 / (299)) + (3.5736158230800004 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.27018022650571405 = (30.381069425100268 - 22.172705206340854) / 30.381069425100268 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector2.ClampBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 36.61913022063855 < 56.192332953148345. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 4.829698168428537 (T) = (0 -38.78998285203312) / Math.Sqrt((96.06967785265464 / (299)) + (7.715382289097624 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07779820631187555 = (42.06235893003624 - 38.78998285203312) / 42.06235893003624 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector2.LengthBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 12.005273297116839 < 17.748369975960465. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.876262219965449 (T) = (0 -12.3558526557081) / Math.Sqrt((7.474643184978897 / (299)) + (0.3568107373111396 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.13509411763154455 = (14.28577710891834 - 12.3558526557081) / 14.28577710891834 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector2.TransformByMatrix4x4Benchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 24.313990609490556 < 39.10508975470722. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 37.7944005272721 (T) = (0 -24.771092337280745) / Math.Sqrt((15.967270602029856 / (299)) + (0.7341226849725435 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.28237604508541214 = (34.51820715799408 - 24.771092337280745) / 34.51820715799408 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector2.LengthSquaredBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 10.885930259526996 < 16.2108993223607. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 5.773181453513809 (T) = (0 -11.31777895813499) / Math.Sqrt((7.455014283094867 / (299)) + (0.8608886252565153 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09289596708138846 = (12.476825752521442 - 11.31777895813499) / 12.476825752521442 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector2.AddOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 14.611320846607446 < 20.76880972306402. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 4.457418755966813 (T) = (0 -14.828216798232832) / Math.Sqrt((13.959042582800393 / (299)) + (0.619929604345114 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.06748453820077593 = (15.901309314081306 - 14.828216798232832) / 15.901309314081306 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector2.MultiplyByScalarOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.326557813820372 < 24.877710235063184. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 3.586157410161672 (T) = (0 -17.701459436305065) / Math.Sqrt((18.28110806336146 / (299)) + (0.3731352510770175 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.05015214209625907 = (18.636099759566925 - 17.701459436305065) / 18.636099759566925 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector2.MaxBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 19.047836714843804 < 28.75732779814295. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.2379123489256125 (T) = (0 -19.41121150090339) / Math.Sqrt((23.278798660201332 / (299)) + (0.8117546874512881 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1019107746447652 = (21.613900882983405 - 19.41121150090339) / 21.613900882983405 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector2.ZeroBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.724114382645633 < 3.844512528370983. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.692355504234799 (T) = (0 -1.1459111436489433) / Math.Sqrt((1.3448715972010306 / (299)) + (0.4566852237052007 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.5150438265071712 = (2.362916911430736 - 1.1459111436489433) / 2.362916911430736 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector2.AddFunctionBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 14.850829964092357 < 20.81836755553632. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 3.8515443067374537 (T) = (0 -15.000127435096433) / Math.Sqrt((12.958716184086812 / (299)) + (0.6901386734712762 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.0571194719864478 = (15.908831489710044 - 15.000127435096433) / 15.908831489710044 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector2.DistanceSquaredBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 19.787245112141072 < 29.464474828038213. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 4.4992364871827375 (T) = (0 -19.647715603425162) / Math.Sqrt((29.825000335127495 / (299)) + (8.036914825251726 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10197047909366366 = (21.878696797846583 - 19.647715603425162) / 21.878696797846583 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector2.SubtractOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 14.798367867696587 < 20.90767591830566. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 4.4344839843309325 (T) = (0 -14.864402222830611) / Math.Sqrt((12.204252452240208 / (299)) + (0.1162492757764134 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.05819033674042823 = (15.782809205190581 - 14.864402222830611) / 15.782809205190581 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector2.LerpBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 41.48417743722413 < 64.16742444770972. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 5.6486202996905694 (T) = (0 -43.219981610582906) / Math.Sqrt((134.08352074830077 / (299)) + (7.51208444793379 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09087947705786098 = (47.54043113086079 - 43.219981610582906) / 47.54043113086079 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector2.DistanceBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 21.92959404324157 < 31.187087632668074. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.197301857071971 (T) = (0 -21.5119935131402) / Math.Sqrt((26.79897814606777 / (299)) + (2.267076567449372 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.0941336951678727 = (23.747426522423467 - 21.5119935131402) / 23.747426522423467 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector2.DotBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 10.473936246368082 < 15.345406681806242. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.035400037201592 (T) = (0 -10.694367415570609) / Math.Sqrt((7.787021016010387 / (299)) + (0.13140890333226612 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11237407218254523 = (12.048281917436244 - 10.694367415570609) / 12.048281917436244 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Text.Json.Serialization.Tests.ReadJson<BinaryData>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[DeserializeFromStream - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.ReadJson(BinaryData).DeserializeFromStream.html>)	48.88 μs	36.48 μs	0.75	0.01	False
[DeserializeFromString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.ReadJson(BinaryData).DeserializeFromString.html>)	52.19 μs	34.03 μs	0.65	0.01	False
[DeserializeFromUtf8Bytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.ReadJson(BinaryData).DeserializeFromUtf8Bytes.html>)	36.95 μs	24.82 μs	0.67	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Serialization.Tests.ReadJson<BinaryData>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Serialization.Tests.ReadJson<BinaryData>.DeserializeFromStream ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 36.48422196969697 < 46.44208817527686. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.560917282268264 (T) = (0 -35392.20191666898) / Math.Sqrt((28707201.997650146 / (299)) + (194690.15023260543 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.093407294805576 = (39038.701407903915 - 35392.20191666898) / 39038.701407903915 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Serialization.Tests.ReadJson<BinaryData>.DeserializeFromString ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 34.031596790005004 < 49.273626473560356. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.222073550041635 (T) = (0 -33985.49291488597) / Math.Sqrt((52447139.557381734 / (299)) + (65781.77382493707 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1218558206974736 = (38701.495398943756 - 33985.49291488597) / 38701.495398943756 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Serialization.Tests.ReadJson<BinaryData>.DeserializeFromUtf8Bytes ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 24.81668992782152 < 35.13635253873541. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.893937881785105 (T) = (0 -24436.647711829082) / Math.Sqrt((24841100.287177436 / (299)) + (35095.715386147385 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12344523949518187 = (27878.061717166114 - 24436.647711829082) / 27878.061717166114 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Text.Tests.Perf_StringBuilder

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Append_ValueTypes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_StringBuilder.Append_ValueTypes.html>)	102.23 μs	88.22 μs	0.86	0.01	False
[Append_Memory - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_StringBuilder.Append_Memory.html>)	5.50 μs	4.46 μs	0.81	0.02	False
[Append_Primitives - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_StringBuilder.Append_Primitives.html>)	32.64 μs	26.61 μs	0.82	0.01	False
[Append_Char_Capacity - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_StringBuilder.Append_Char_Capacity(length%3a%20100).html>)	3.12 μs	2.24 μs	0.72	0.11	False
[Append_ValueTypes_Interpolated - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_StringBuilder.Append_ValueTypes_Interpolated.html>)	106.93 μs	91.73 μs	0.86	0.02	False
[ToString_MultipleSegments - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_StringBuilder.ToString_MultipleSegments(length%3a%20100).html>)	587.68 ns	476.79 ns	0.81	0.02	False
[Insert_Primitives - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_StringBuilder.Insert_Primitives.html>)	489.86 μs	383.60 μs	0.78	0.01	False
[ToString_SingleSegment - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_StringBuilder.ToString_SingleSegment(length%3a%20100).html>)	325.90 ns	268.92 ns	0.83	0.05	False
[AppendLine_Strings - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_StringBuilder.AppendLine_Strings.html>)	3.65 μs	2.81 μs	0.77	0.02	False
[Append_Char_Capacity - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_StringBuilder.Append_Char_Capacity(length%3a%20100000).html>)	3.01 ms	2.14 ms	0.71	0.10	False
[Append_Char - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_StringBuilder.Append_Char(length%3a%20100).html>)	3.89 μs	2.89 μs	0.74	0.10	False
[Append_Strings - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_StringBuilder.Append_Strings(repeat%3a%201).html>)	2.87 μs	2.29 μs	0.80	0.01	False
[Append_Char - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_StringBuilder.Append_Char(length%3a%20100000).html>)	3.03 ms	2.19 ms	0.72	0.11	False
[Insert_Strings - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_StringBuilder.Insert_Strings.html>)	9.66 μs	7.07 μs	0.73	0.02	False
[Append_NonEmptySpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_StringBuilder.Append_NonEmptySpan.html>)	4.49 μs	3.62 μs	0.81	0.02	False
[ctor_string - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_StringBuilder.ctor_string(length%3a%20100).html>)	368.33 ns	298.19 ns	0.81	0.06	False
[Append_Strings - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_StringBuilder.Append_Strings(repeat%3a%201000).html>)	2.45 ms	2.00 ms	0.82	0.02	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Tests.Perf_StringBuilder*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Tests.Perf_StringBuilder.Append_ValueTypes ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 88.22009055397724 < 97.5637744966947. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 21.66722930752993 (T) = (0 -88611.109670927) / Math.Sqrt((25911912.19411471 / (299)) + (307529.65218227374 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.0690994281216557 = (95188.58656637203 - 88611.109670927) / 95188.58656637203 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_StringBuilder.Append_Memory ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 4.458240079504768 < 5.241335288768631. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.582494511728104 (T) = (0 -4311.178458578298) / Math.Sqrt((186952.6277041097 / (299)) + (2806.287277848476 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09588933902545027 = (4768.419005181552 - 4311.178458578298) / 4768.419005181552 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_StringBuilder.Append_Primitives ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 26.605573946886445 < 31.116253306417686. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.661183092783718 (T) = (0 -26719.40276773103) / Math.Sqrt((5490149.613038952 / (299)) + (33295.872180378414 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.06126213937227438 = (28463.11402617127 - 26719.40276773103) / 28463.11402617127 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_StringBuilder.Append_Char_Capacity(length: 100) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.235160526155617 < 2.9679343613404146. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.536278046551391 (T) = (0 -2265.9180963481435) / Math.Sqrt((86192.5864321613 / (299)) + (29527.279615287538 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12693754221541223 = (2595.367692361842 - 2265.9180963481435) / 2595.367692361842 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_StringBuilder.Append_ValueTypes_Interpolated ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 91.73474067982457 < 101.63714734075258. IsChangePoint: Marked as a change because one of 5/11/2022 6:23:22 AM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 38.48185135658616 (T) = (0 -92135.25531017603) / Math.Sqrt((107871790.35913211 / (299)) + (560476.9361479528 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.20275897629289133 = (115567.6295755006 - 92135.25531017603) / 115567.6295755006 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_StringBuilder.ToString_MultipleSegments(length: 100) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 476.7930050718512 < 553.2708360342513. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.75510087153513 (T) = (0 -483.7850018186532) / Math.Sqrt((1470.3357259877835 / (299)) + (29.38742579331701 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07060867963714756 = (520.5396168642657 - 483.7850018186532) / 520.5396168642657 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_StringBuilder.Insert_Primitives ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 383.5991470528456 < 464.49886462759235. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.543582053661382 (T) = (0 -390239.98313680483) / Math.Sqrt((1484922757.104685 / (299)) + (7353667.65631578 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.06767702814229178 = (418567.37945567165 - 390239.98313680483) / 418567.37945567165 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_StringBuilder.ToString_SingleSegment(length: 100) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 268.91618810082724 < 292.56383032450344. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.84701726662318 (T) = (0 -267.36248384980826) / Math.Sqrt((203.35150493971508 / (299)) + (21.904905774515576 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.06122547800617646 = (284.7994673757958 - 267.36248384980826) / 284.7994673757958 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_StringBuilder.AppendLine_Strings ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.8129221823007606 < 3.482157428294308. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 19.07056165644491 (T) = (0 -2817.300679329098) / Math.Sqrt((80217.28496093838 / (299)) + (1563.4268427885395 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10442386183785396 = (3145.796944870163 - 2817.300679329098) / 3145.796944870163 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_StringBuilder.Append_Char_Capacity(length: 100000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.142817098214286 < 2.85711640641121. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 20.28115628952504 (T) = (0 -2140801.6368955006) / Math.Sqrt((86229188136.72318 / (299)) + (2074113118.4997911 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.14608579057910337 = (2507045.3369634626 - 2140801.6368955006) / 2507045.3369634626 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_StringBuilder.Append_Char(length: 100) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.889477077121381 < 3.683171121697764. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 21.42886993820811 (T) = (0 -2837.0125812669953) / Math.Sqrt((119362.7558938951 / (299)) + (513.3776484220887 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13242608361055333 = (3270.052876962571 - 2837.0125812669953) / 3270.052876962571 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_StringBuilder.Append_Strings(repeat: 1) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.2938839173120846 < 2.7569602829120763. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.011106954486024 (T) = (0 -2317.2171289660655) / Math.Sqrt((44037.68913908286 / (299)) + (783.597960289511 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.08072829137075382 = (2520.7097175016274 - 2317.2171289660655) / 2520.7097175016274 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_StringBuilder.Append_Char(length: 100000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.189824611778846 < 2.8695831832799144. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.323790437683252 (T) = (0 -2163439.3559025396) / Math.Sqrt((80435135108.69882 / (299)) + (18897209236.827072 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1407980914238808 = (2517963.8619376672 - 2163439.3559025396) / 2517963.8619376672 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_StringBuilder.Insert_Strings ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 7.0699161338736305 < 8.933605873361078. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.92470491043915 (T) = (0 -7141.913070478202) / Math.Sqrt((793326.5205020143 / (299)) + (5263.03840632562 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08663610363834258 = (7819.351190612723 - 7141.913070478202) / 7819.351190612723 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_StringBuilder.Append_NonEmptySpan ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.6150060193852873 < 4.270256621910801. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 18.159653685703738 (T) = (0 -3635.2209199751383) / Math.Sqrt((92075.05617600084 / (299)) + (2406.859389322822 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.08574932705388542 = (3976.1752739660233 - 3635.2209199751383) / 3976.1752739660233 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_StringBuilder.ctor_string(length: 100) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 298.19342895685855 < 349.7558626995536. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 19.361446555569326 (T) = (0 -298.49356498256594) / Math.Sqrt((579.5151763432203 / (299)) + (26.08835000208516 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09138094136123034 = (328.51343161318715 - 298.49356498256594) / 328.51343161318715 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_StringBuilder.Append_Strings(repeat: 1000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.9952775598958332 < 2.1838057294929842. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.310893676113864 (T) = (0 -1984643.9777847864) / Math.Sqrt((13850145154.4544 / (299)) + (226971593.03589436 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.05511622071092631 = (2100410.676197684 - 1984643.9777847864) / 2100410.676197684 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Xml.Tests.Perf_XmlConvert

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[DateTime_ToString_Unspecified - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Xml.Tests.Perf_XmlConvert.DateTime_ToString_Unspecified.html>)	1.25 μs	970.31 ns	0.78	0.05	False
[TimeSpan_ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Xml.Tests.Perf_XmlConvert.TimeSpan_ToString.html>)	1.86 μs	1.37 μs	0.74	0.02	False
[DateTime_ToString_RoundtripKind - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Xml.Tests.Perf_XmlConvert.DateTime_ToString_RoundtripKind.html>)	1.22 μs	958.20 ns	0.78	0.03	False
[DateTime_ToString_Local - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Xml.Tests.Perf_XmlConvert.DateTime_ToString_Local.html>)	8.98 μs	7.45 μs	0.83	0.27	False
[DateTime_ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Xml.Tests.Perf_XmlConvert.DateTime_ToString.html>)	1.30 μs	1.10 μs	0.85	0.04	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Xml.Tests.Perf_XmlConvert*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Xml.Tests.Perf_XmlConvert.DateTime_ToString_Unspecified ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 970.3109174273158 < 1.1821581921773028. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.167994840104848 (T) = (0 -974.5587493848336) / Math.Sqrt((10644.583753424036 / (299)) + (294.3431456165742 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08502407200168269 = (1065.1195507589637 - 974.5587493848336) / 1065.1195507589637 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Xml.Tests.Perf_XmlConvert.TimeSpan_ToString ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.3741643840427027 < 1.7795858642774671. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.648285006587468 (T) = (0 -1380.460606740866) / Math.Sqrt((35327.16027391715 / (299)) + (219.91103535082974 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10493839778042688 = (1542.3079297755605 - 1380.460606740866) / 1542.3079297755605 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Xml.Tests.Perf_XmlConvert.DateTime_ToString_RoundtripKind ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 958.1955745583922 < 1.153918034126754. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.525934812060616 (T) = (0 -950.8472507491807) / Math.Sqrt((10813.384076006128 / (299)) + (190.68049579686945 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08213344769502938 = (1035.9319101032586 - 950.8472507491807) / 1035.9319101032586 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Xml.Tests.Perf_XmlConvert.DateTime_ToString_Local ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 7.445650629726139 < 8.473710378564475. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 2.9881365874943375 (T) = (0 -7062.11597333507) / Math.Sqrt((1152271.286532858 / (299)) + (657268.6144274804 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.05018097856256158 = (7435.222725532907 - 7062.11597333507) / 7435.222725532907 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Xml.Tests.Perf_XmlConvert.DateTime_ToString ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.0978225989342847 < 1.2417768537522416. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.059556137218204 (T) = (0 -1022.1323863596059) / Math.Sqrt((11603.864502562428 / (299)) + (323.7304437861692 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08412383082841905 = (1116.0159208904133 - 1022.1323863596059) / 1116.0159208904133 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Text.Encodings.Web.Tests.Perf_Encoders

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[EncodeUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments%3a%20Url%2c%ef%bf%bd2020%2c512).html>)	23.60 μs	13.25 μs	0.56	0.08	False
[EncodeUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments%3a%20Url%2c%ef%bf%bd2020%2c512).html>)	64.82 μs	43.21 μs	0.67	0.14	False
[EncodeUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments%3a%20UnsafeRelaxed%2cno%20(escaping%20%2f)%20required%2c16).html>)	2.11 μs	1.19 μs	0.56	0.06	False
[EncodeUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments%3a%20UnsafeRelaxed%2cno%20(escaping%20%2f)%20required%2c16).html>)	5.29 μs	3.54 μs	0.67	0.13	False
[EncodeUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments%3a%20UnsafeRelaxed%2cno%20(escaping%20%2f)%20required%2c512).html>)	66.44 μs	43.53 μs	0.66	0.13	False
[EncodeUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments%3a%20Url%2c%26lorem%20ipsum%3ddolor%20sit%20amet%2c512).html>)	24.91 μs	13.81 μs	0.55	0.05	False
[EncodeUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments%3a%20Url%2c%ef%bf%bd2020%2c16).html>)	2.03 μs	1.31 μs	0.64	0.04	False
[EncodeUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments%3a%20JavaScript%2cno%20escaping%20required%2c16).html>)	5.36 μs	3.23 μs	0.60	0.17	False
[EncodeUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments%3a%20JavaScript%2cno%20escaping%20required%2c512).html>)	65.88 μs	43.60 μs	0.66	0.15	False
[EncodeUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments%3a%20JavaScript%2c%26Hello%2b(World)!%2c16).html>)	2.94 μs	1.89 μs	0.64	0.07	False
[EncodeUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments%3a%20UnsafeRelaxed%2chello%20%22there%22%2c16).html>)	3.83 μs	2.55 μs	0.67	0.13	False
[EncodeUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments%3a%20UnsafeRelaxed%2chello%20%22there%22%2c512).html>)	27.11 μs	12.91 μs	0.48	0.05	False
[EncodeUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments%3a%20JavaScript%2c%26Hello%2b(World)!%2c512).html>)	72.21 μs	44.76 μs	0.62	0.14	False
[EncodeUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments%3a%20JavaScript%2c%26Hello%2b(World)!%2c16).html>)	3.96 μs	2.35 μs	0.59	0.14	False
[EncodeUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments%3a%20JavaScript%2c%26Hello%2b(World)!%2c512).html>)	24.61 μs	13.52 μs	0.55	0.04	False
[EncodeUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments%3a%20JavaScript%2cno%20escaping%20required%2c512).html>)	23.80 μs	13.14 μs	0.55	0.06	False
[EncodeUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments%3a%20JavaScript%2cno%20escaping%20required%2c16).html>)	1.94 μs	1.10 μs	0.57	0.05	False
[EncodeUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments%3a%20Url%2c%ef%bf%bd2020%2c16).html>)	3.61 μs	2.38 μs	0.66	0.07	False
[EncodeUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments%3a%20UnsafeRelaxed%2chello%20%22there%22%2c512).html>)	64.95 μs	43.91 μs	0.68	0.19	False
[EncodeUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments%3a%20UnsafeRelaxed%2cno%20(escaping%20%2f)%20required%2c512).html>)	23.75 μs	13.10 μs	0.55	0.07	False
[EncodeUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments%3a%20Url%2c%26lorem%20ipsum%3ddolor%20sit%20amet%2c16).html>)	3.44 μs	2.07 μs	0.60	0.11	False
[EncodeUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments%3a%20UnsafeRelaxed%2chello%20%22there%22%2c16).html>)	2.04 μs	1.30 μs	0.64	0.05	False
[EncodeUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments%3a%20Url%2c%26lorem%20ipsum%3ddolor%20sit%20amet%2c512).html>)	66.18 μs	43.19 μs	0.65	0.11	False
[EncodeUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments%3a%20Url%2c%26lorem%20ipsum%3ddolor%20sit%20amet%2c16).html>)	4.58 μs	2.98 μs	0.65	0.10	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Encodings.Web.Tests.Perf_Encoders*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: Url,�2020,512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 13.251460996055224 < 22.44745826995182. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.604407196171655 (T) = (0 -13276.368637624028) / Math.Sqrt((19651233.720308505 / (299)) + (411108.5881197453 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.17756643436721864 = (16142.785499530499 - 13276.368637624028) / 16142.785499530499 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: Url,�2020,512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 43.20630592105263 < 61.573395158534645. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.818761331196795 (T) = (0 -43519.24780355343) / Math.Sqrt((78719608.65756245 / (299)) + (785539.094216536 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11575662570673423 = (49216.36855728359 - 43519.24780355343) / 49216.36855728359 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: UnsafeRelaxed,no <escaping /> required,16) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.1890357318371958 < 2.0254005052577733. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.728807488758246 (T) = (0 -1198.2413250207223) / Math.Sqrt((126547.84452709915 / (299)) + (491.3433810667996 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.16908131795968379 = (1442.068099947455 - 1198.2413250207223) / 1442.068099947455 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: UnsafeRelaxed,no <escaping /> required,16) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.5356931353622536 < 5.023029515111773. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.22576407112841 (T) = (0 -3636.2839961288705) / Math.Sqrt((487138.33860062825 / (299)) + (17521.67605637378 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10056596699638068 = (4042.8579114197673 - 3636.2839961288705) / 4042.8579114197673 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: UnsafeRelaxed,no <escaping /> required,512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 43.52621167014856 < 63.10551773815101. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.05620991840563 (T) = (0 -45005.10487995866) / Math.Sqrt((83564486.97486696 / (299)) + (3844645.273921745 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10629864142388822 = (50358.1027913653 - 45005.10487995866) / 50358.1027913653 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: Url,&lorem ipsum=dolor sit amet,512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 13.814366018272915 < 23.789855404183164. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.988949648530367 (T) = (0 -13896.692050559874) / Math.Sqrt((19255226.66962729 / (299)) + (15916.203650677671 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.17993408443524916 = (16945.82324030588 - 13896.692050559874) / 16945.82324030588 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: Url,�2020,16) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.3061390021592891 < 1.9352452340736557. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.554877689878541 (T) = (0 -1343.0935429844842) / Math.Sqrt((79658.29040057721 / (299)) + (646.2122456188062 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11584156903196294 = (1519.0643395369466 - 1343.0935429844842) / 1519.0643395369466 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: JavaScript,no escaping required,16) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.2324127180336033 < 4.566446788430802. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.414758435154472 (T) = (0 -3301.5397132982102) / Math.Sqrt((403972.84263543837 / (299)) + (17061.676638738132 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10397104616529525 = (3684.6350769902274 - 3301.5397132982102) / 3684.6350769902274 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: JavaScript,no escaping required,512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 43.597446699438215 < 62.57514104776526. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.331914867615929 (T) = (0 -44379.16870463743) / Math.Sqrt((81646303.35028125 / (299)) + (1691434.4876038583 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11372985020316688 = (50074.087133376685 - 44379.16870463743) / 50074.087133376685 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: JavaScript,&Hello+<World>!,16) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.8855505755785922 < 2.814470268836011. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.907156414077965 (T) = (0 -1916.1075372053388) / Math.Sqrt((204140.87822069955 / (299)) + (2424.1552643753103 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.11142228412376509 = (2156.3758610757495 - 1916.1075372053388) / 2156.3758610757495 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: UnsafeRelaxed,hello "there",16) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.5531050555239516 < 3.6163395569484784. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.826062510120188 (T) = (0 -2586.151394671331) / Math.Sqrt((260129.03150059868 / (299)) + (2301.7041821802954 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11222284672307292 = (2913.0636952363934 - 2586.151394671331) / 2913.0636952363934 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: UnsafeRelaxed,hello "there",512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 12.9055688938902 < 22.474410103090214. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.208268918176396 (T) = (0 -13005.343958933348) / Math.Sqrt((17572476.845071718 / (299)) + (16615.36376695363 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.18576239450771112 = (15972.4187033468 - 13005.343958933348) / 15972.4187033468 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: JavaScript,&Hello+<World>!,512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 44.764647640423576 < 61.97740667652192. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.425648084677126 (T) = (0 -43840.94230171557) / Math.Sqrt((80312085.69732063 / (299)) + (2948627.540106651 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10862229466832898 = (49183.35071596039 - 43840.94230171557) / 49183.35071596039 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: JavaScript,&Hello+<World>!,16) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.3491852716956614 < 3.4967259316269823. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.830472133106394 (T) = (0 -2408.5983920598896) / Math.Sqrt((271053.1982924901 / (299)) + (4966.530838949171 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11406944264301463 = (2718.7214303178685 - 2408.5983920598896) / 2718.7214303178685 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: JavaScript,&Hello+<World>!,512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 13.523214235379754 < 23.352013917451597. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.135783242760118 (T) = (0 -13633.727935489253) / Math.Sqrt((18492302.544479508 / (299)) + (18291.50537474253 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1816365064590259 = (16659.745996852234 - 13633.727935489253) / 16659.745996852234 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: JavaScript,no escaping required,512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 13.140085292139867 < 22.445708269550583. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.659199457458408 (T) = (0 -13016.791737753254) / Math.Sqrt((17278465.284853406 / (299)) + (182927.64063544397 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.18136117095222432 = (15900.530583058375 - 13016.791737753254) / 15900.530583058375 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: JavaScript,no escaping required,16) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.0979404015012841 < 1.8401309227844365. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.821613615813943 (T) = (0 -1104.2317688738442) / Math.Sqrt((105376.23337142714 / (299)) + (215.86373753712104 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.16811949834180925 = (1327.3922957357152 - 1104.2317688738442) / 1327.3922957357152 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: Url,�2020,16) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.376761560890639 < 3.3631960369409626. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.516381427968614 (T) = (0 -2396.096887534666) / Math.Sqrt((217980.79435966862 / (299)) + (8709.015665570398 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09574101196187612 = (2649.7905127083413 - 2396.096887534666) / 2649.7905127083413 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: UnsafeRelaxed,hello "there",512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 43.91456974838412 < 61.777908441514754. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.131896004369676 (T) = (0 -44043.634760374676) / Math.Sqrt((83307653.62759842 / (299)) + (4663345.178559574 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1111032965176684 = (49548.65350251591 - 44043.634760374676) / 49548.65350251591 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: UnsafeRelaxed,no <escaping /> required,512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 13.102247410096819 < 22.483834303144537. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.85760403677198 (T) = (0 -13007.625412152958) / Math.Sqrt((19954821.75535303 / (299)) + (30274.94915591705 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.19124421974476058 = (16083.50225088693 - 13007.625412152958) / 16083.50225088693 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: Url,&lorem ipsum=dolor sit amet,16) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.068155216853719 < 3.2607664767306703. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.583897728411568 (T) = (0 -2144.1998057803016) / Math.Sqrt((307386.52730763226 / (299)) + (2818.5177369136536 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.128039426727847 = (2459.0559154915622 - 2144.1998057803016) / 2459.0559154915622 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: UnsafeRelaxed,hello "there",16) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.3042101698361943 < 1.9396857371162706. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.673517338966615 (T) = (0 -1301.8291177720782) / Math.Sqrt((90758.43633474607 / (299)) + (245.40893143447119 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12577575737871796 = (1489.1249342029932 - 1301.8291177720782) / 1489.1249342029932 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: Url,&lorem ipsum=dolor sit amet,512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 43.18503453038673 < 62.71682768921413. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.977655500729574 (T) = (0 -44195.70619250769) / Math.Sqrt((83264825.03988364 / (299)) + (1823973.240368734 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11183007912890108 = (49760.41763400572 - 44195.70619250769) / 49760.41763400572 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: Url,&lorem ipsum=dolor sit amet,16) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.9752416076091013 < 4.309292354324856. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.649335639397444 (T) = (0 -2944.6155906319277) / Math.Sqrt((451731.8968168638 / (299)) + (2138.774025951304 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12460208830768223 = (3363.745276635858 - 2944.6155906319277) / 3363.745276635858 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Numerics.Tests.Perf_BigInteger

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ModPow - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_BigInteger.ModPow(arguments%3a%2016384%2c16384%2c64%20bits).html>)	33.24 ms	23.99 ms	0.72	0.02	False
[ToByteArray - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_BigInteger.ToByteArray(numberString%3a%20-2147483648).html>)	253.97 ns	168.75 ns	0.66	0.18	False
[Multiply - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_BigInteger.Multiply(arguments%3a%2016%2c16%20bits).html>)	127.89 ns	91.29 ns	0.71	0.21	False
[ToStringX - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_BigInteger.ToStringX(numberString%3a%20-2147483648).html>)	1.02 μs	757.92 ns	0.74	0.07	False
[Divide - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_BigInteger.Divide(arguments%3a%2065536%2c32768%20bits).html>)	37.98 ms	24.77 ms	0.65	0.17	False
[ModPow - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_BigInteger.ModPow(arguments%3a%2016%2c16%2c16%20bits).html>)	476.26 ns	350.67 ns	0.74	0.11	False
[ToStringX - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_BigInteger.ToStringX(numberString%3a%20123).html>)	882.37 ns	636.11 ns	0.72	0.08	False
[ToStringX - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_BigInteger.ToStringX(numberString%3a%20123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678.html>)	6.35 μs	4.03 μs	0.63	0.05	False
[Divide - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_BigInteger.Divide(arguments%3a%2016%2c8%20bits).html>)	81.88 ns	59.96 ns	0.73	0.16	False
[Ctor_ByteArray - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_BigInteger.Ctor_ByteArray(numberString%3a%201234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123.html>)	2.14 μs	1.24 μs	0.58	0.13	False
[Remainder - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_BigInteger.Remainder(arguments%3a%2016%2c8%20bits).html>)	80.84 ns	61.73 ns	0.76	0.21	False
[Parse - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_BigInteger.Parse(numberString%3a%201234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012.html>)	38.19 μs	25.35 μs	0.66	0.01	False
[Remainder - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_BigInteger.Remainder(arguments%3a%201024%2c512%20bits).html>)	14.19 μs	9.48 μs	0.67	0.10	False
[GreatestCommonDivisor - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_BigInteger.GreatestCommonDivisor(arguments%3a%201024%2c1024%20bits).html>)	95.37 μs	60.33 μs	0.63	0.02	False
[ToStringD - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_BigInteger.ToStringD(numberString%3a%20-2147483648).html>)	873.37 ns	699.22 ns	0.80	0.05	False
[Subtract - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_BigInteger.Subtract(arguments%3a%201024%2c1024%20bits).html>)	1.51 μs	962.21 ns	0.64	0.10	False
[Multiply - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_BigInteger.Multiply(arguments%3a%201024%2c1024%20bits).html>)	36.91 μs	27.12 μs	0.73	0.10	False
[GreatestCommonDivisor - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_BigInteger.GreatestCommonDivisor(arguments%3a%2016%2c16%20bits).html>)	247.75 ns	153.51 ns	0.62	0.06	False
[Ctor_ByteArray - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_BigInteger.Ctor_ByteArray(numberString%3a%20-2147483648).html>)	209.87 ns	150.74 ns	0.72	0.17	False
[Divide - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_BigInteger.Divide(arguments%3a%201024%2c512%20bits).html>)	14.00 μs	10.10 μs	0.72	0.12	False
[ToStringD - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_BigInteger.ToStringD(numberString%3a%20123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678.html>)	11.01 μs	8.27 μs	0.75	0.05	False
[Subtract - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_BigInteger.Subtract(arguments%3a%2065536%2c65536%20bits).html>)	64.67 μs	38.84 μs	0.60	0.08	False
[GreatestCommonDivisor - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_BigInteger.GreatestCommonDivisor(arguments%3a%2065536%2c65536%20bits).html>)	136.99 ms	80.97 ms	0.59	0.12	False
[ModPow - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_BigInteger.ModPow(arguments%3a%201024%2c1024%2c64%20bits).html>)	2.05 ms	1.44 ms	0.70	0.03	False
[Ctor_ByteArray - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_BigInteger.Ctor_ByteArray(numberString%3a%20123).html>)	120.75 ns	83.76 ns	0.69	0.23	False
[ToStringD - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_BigInteger.ToStringD(numberString%3a%20123).html>)	410.25 ns	296.85 ns	0.72	0.22	False
[Remainder - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_BigInteger.Remainder(arguments%3a%2065536%2c32768%20bits).html>)	37.99 ms	24.80 ms	0.65	0.18	False
[Add - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_BigInteger.Add(arguments%3a%2065536%2c65536%20bits).html>)	64.24 μs	38.84 μs	0.60	0.10	False
[ToByteArray - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_BigInteger.ToByteArray(numberString%3a%20123).html>)	206.20 ns	142.89 ns	0.69	0.20	False
[ToByteArray - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_BigInteger.ToByteArray(numberString%3a%201234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456.html>)	1.21 μs	735.04 ns	0.61	0.12	False
[Add - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_BigInteger.Add(arguments%3a%2016%2c16%20bits).html>)	147.05 ns	94.12 ns	0.64	0.15	False
[Subtract - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_BigInteger.Subtract(arguments%3a%2016%2c16%20bits).html>)	144.38 ns	95.73 ns	0.66	0.19	False
[Add - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_BigInteger.Add(arguments%3a%201024%2c1024%20bits).html>)	1.46 μs	940.62 ns	0.64	0.07	False
[Multiply - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_BigInteger.Multiply(arguments%3a%2065536%2c65536%20bits).html>)	34.03 ms	19.29 ms	0.57	0.14	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_BigInteger*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_BigInteger.ModPow(arguments: 16384,16384,64 bits) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 23.989856160000002 < 32.033537662142855. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.302807166234816 (T) = (0 -23716630.289268054) / Math.Sqrt((14975582836989.146 / (299)) + (171765830382.1117 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10682016633938118 = (26553029.295419194 - 23716630.289268054) / 26553029.295419194 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_BigInteger.ToByteArray(numberString: -2147483648) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 168.74792330921576 < 242.00758923693945. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.525652163763423 (T) = (0 -174.24072368172105) / Math.Sqrt((967.641644667334 / (299)) + (35.27683664722721 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12384387189784729 = (198.8694915130537 - 174.24072368172105) / 198.8694915130537 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_BigInteger.Multiply(arguments: 16,16 bits) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 91.2911415306056 < 123.05385980628924. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.908885084948844 (T) = (0 -90.95376946483522) / Math.Sqrt((276.11109932987273 / (299)) + (19.78422847906925 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10985178429516465 = (102.17823038921264 - 90.95376946483522) / 102.17823038921264 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_BigInteger.ToStringX(numberString: -2147483648) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 757.9218372468184 < 0.9716966294794203. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.29935557999658 (T) = (0 -760.0259325840559) / Math.Sqrt((11661.53011331157 / (299)) + (179.87329086994083 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09519940437552256 = (839.9927412288001 - 760.0259325840559) / 839.9927412288001 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_BigInteger.Divide(arguments: 65536,32768 bits) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 24.765698246153846 < 36.18571837640306. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.003730310863396 (T) = (0 -25055549.886197146) / Math.Sqrt((30028688250812.953 / (299)) + (481322172684.2763 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11655063427753748 = (28361048.021928627 - 25055549.886197146) / 28361048.021928627 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_BigInteger.ModPow(arguments: 16,16,16 bits) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 350.66756576756575 < 443.5438468019536. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 18.999076790913684 (T) = (0 -356.6850069371732) / Math.Sqrt((1398.2929219709517 / (299)) + (29.7872222478941 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10847718772381781 = (400.0851150701423 - 356.6850069371732) / 400.0851150701423 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_BigInteger.ToStringX(numberString: 123) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 636.1053559600316 < 817.2945824008902. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.313040702692593 (T) = (0 -651.5955573149437) / Math.Sqrt((6390.635951014161 / (299)) + (143.19910138305968 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09702937229369234 = (721.613236711921 - 651.5955573149437) / 721.613236711921 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_BigInteger.ToStringX(numberString: 12345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 4.030912562434279 < 6.124856658098452. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.479081284772658 (T) = (0 -4141.854609129706) / Math.Sqrt((884714.420571547 / (299)) + (8746.962705677806 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12373693164119227 = (4726.725065438591 - 4141.854609129706) / 4726.725065438591 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_BigInteger.Divide(arguments: 16,8 bits) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 59.960195934776074 < 77.78446316528387. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.113526528723023 (T) = (0 -61.0933310754372) / Math.Sqrt((69.17155274531203 / (299)) + (2.1574088064299874 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10043746670869227 = (67.91449044894046 - 61.0933310754372) / 67.91449044894046 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_BigInteger.Ctor_ByteArray(numberString: 12345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.239363372054276 < 2.0310190161026713. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.552948660762064 (T) = (0 -1277.8520693835758) / Math.Sqrt((113343.72762085932 / (299)) + (2293.737219280417 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.16758916898863271 = (1535.1218674449535 - 1277.8520693835758) / 1535.1218674449535 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_BigInteger.Remainder(arguments: 16,8 bits) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 61.72645452334755 < 76.97348839250311. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.884995177101054 (T) = (0 -60.85105900602749) / Math.Sqrt((69.64859604674639 / (299)) + (5.66990279552876 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10145328606645675 = (67.72164213882824 - 60.85105900602749) / 67.72164213882824 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_BigInteger.Parse(numberString: 12345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 25.352785463861924 < 36.14042246629157. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.59096202296561 (T) = (0 -25612.24768241995) / Math.Sqrt((29108732.699180655 / (299)) + (50963.658848115665 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09514175944196841 = (28305.259911900368 - 25612.24768241995) / 28305.259911900368 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_BigInteger.Remainder(arguments: 1024,512 bits) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 9.476557235771464 < 13.441675187759687. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.408843718649202 (T) = (0 -9512.779407331733) / Math.Sqrt((3851981.8633253807 / (299)) + (33347.413772458574 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.10307614318477054 = (10606.00555448422 - 9512.779407331733) / 10606.00555448422 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_BigInteger.GreatestCommonDivisor(arguments: 1024,1024 bits) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 60.32691285162714 < 88.86919261187447. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.453455557458517 (T) = (0 -60504.37292481715) / Math.Sqrt((190525263.2255053 / (299)) + (601699.7937224339 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12210979141008767 = (68920.2047508887 - 60504.37292481715) / 68920.2047508887 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_BigInteger.ToStringD(numberString: -2147483648) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 699.2172351845747 < 827.459906230218. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.568796338778617 (T) = (0 -699.9246412501669) / Math.Sqrt((5244.203084042697 / (299)) + (175.35039451929023 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.06424105302545065 = (747.9753664265028 - 699.9246412501669) / 747.9753664265028 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_BigInteger.Subtract(arguments: 1024,1024 bits) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 962.2114801947648 < 1.4355357350766884. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.474235021093765 (T) = (0 -973.2241711190379) / Math.Sqrt((53559.217538389115 / (299)) + (499.8983508759852 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11781969844979735 = (1103.2032447435624 - 973.2241711190379) / 1103.2032447435624 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_BigInteger.Multiply(arguments: 1024,1024 bits) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 27.122673489763553 < 35.05851894073914. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.119915053836527 (T) = (0 -21970.950895484388) / Math.Sqrt((37942074.32656829 / (299)) + (709704.2316320282 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.14691736788474616 = (25754.774588490334 - 21970.950895484388) / 25754.774588490334 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_BigInteger.GreatestCommonDivisor(arguments: 16,16 bits) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 153.51006056511167 < 173.50782456015497. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.488406604032544 (T) = (0 -151.720960819013) / Math.Sqrt((147.88233910989194 / (299)) + (3.714549670409487 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07526631193929985 = (164.06989685559495 - 151.720960819013) / 164.06989685559495 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_BigInteger.Ctor_ByteArray(numberString: -2147483648) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 150.73900921148183 < 202.32023807954198. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.30048625980475 (T) = (0 -153.87224476130515) / Math.Sqrt((604.5090523702197 / (299)) + (22.389267780880242 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.09460390347605169 = (169.95019677250744 - 153.87224476130515) / 169.95019677250744 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_BigInteger.Divide(arguments: 1024,512 bits) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 10.10471389478472 < 13.320570616487975. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.732303478229161 (T) = (0 -9441.526300745112) / Math.Sqrt((3826627.3914888264 / (299)) + (17688.43904786421 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1055800086900017 = (10556.032280670212 - 9441.526300745112) / 10556.032280670212 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_BigInteger.ToStringD(numberString: 12345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 8.273471631296212 < 10.440292024195635. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.507569856001176 (T) = (0 -8344.401810406152) / Math.Sqrt((1407164.1625229663 / (299)) + (16259.291433462537 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.05224629594796311 = (8804.399048751171 - 8344.401810406152) / 8804.399048751171 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_BigInteger.Subtract(arguments: 65536,65536 bits) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 38.835384305210916 < 61.32139110724951. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.055710645574354 (T) = (0 -38784.81506339095) / Math.Sqrt((110774427.8441602 / (299)) + (309787.2166523059 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1487872204446116 = (45564.18323941203 - 38784.81506339095) / 45564.18323941203 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_BigInteger.GreatestCommonDivisor(arguments: 65536,65536 bits) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 80.97007742857143 < 130.0471459298077. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.493066520505892 (T) = (0 -81693042.35762024) / Math.Sqrt((513184849960676.6 / (299)) + (13098960697085.328 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.15237937383923064 = (96379252.50550169 - 81693042.35762024) / 96379252.50550169 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_BigInteger.ModPow(arguments: 1024,1024,64 bits) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.4441458 < 1.9310229663169642. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.866480556357361 (T) = (0 -1426249.7179335114) / Math.Sqrt((56283171679.9983 / (299)) + (247063561.75853807 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11127918172065276 = (1604834.3738530555 - 1426249.7179335114) / 1604834.3738530555 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_BigInteger.Ctor_ByteArray(numberString: 123) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 83.75925232889318 < 114.75453202242217. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.11231750489752 (T) = (0 -83.31454881803583) / Math.Sqrt((246.4153205915714 / (299)) + (4.208418378740926 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1211611918604461 = (94.80071663472333 - 83.31454881803583) / 94.80071663472333 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_BigInteger.ToStringD(numberString: 123) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 296.8479327979625 < 371.94103297157267. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.87805384611315 (T) = (0 -295.807042998561) / Math.Sqrt((1499.8976734225546 / (299)) + (95.44245887302404 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08703691390424333 = (324.00767074117505 - 295.807042998561) / 324.00767074117505 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_BigInteger.Remainder(arguments: 65536,32768 bits) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 24.80355880666667 < 36.05677361043651. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.30203825507794 (T) = (0 -24987257.89757443) / Math.Sqrt((30070012020976.414 / (299)) + (360612462314.2969 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11884121465756038 = (28357270.350387275 - 24987257.89757443) / 28357270.350387275 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_BigInteger.Add(arguments: 65536,65536 bits) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 38.842390374276256 < 61.11446206626417. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.526117338139228 (T) = (0 -39312.46719030838) / Math.Sqrt((109260446.29078083 / (299)) + (4426762.930722387 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13908122026698164 = (45663.386739571026 - 39312.46719030838) / 45663.386739571026 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_BigInteger.ToByteArray(numberString: 123) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 142.89302674370967 < 196.24291593438716. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.3657482200479 (T) = (0 -147.33550072107) / Math.Sqrt((739.4883632407333 / (299)) + (29.150550618935103 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10867342109433555 = (165.2991217898637 - 147.33550072107) / 165.2991217898637 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_BigInteger.ToByteArray(numberString: 12345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 735.0391007599738 < 1.153882471703722. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.285432130755439 (T) = (0 -744.2474597194393) / Math.Sqrt((37560.80272166065 / (299)) + (432.0861079032512 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14900579560039426 = (874.5623129648944 - 744.2474597194393) / 874.5623129648944 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_BigInteger.Add(arguments: 16,16 bits) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 94.11972255714262 < 137.14739020619828. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.25613232150412 (T) = (0 -95.87254319865451) / Math.Sqrt((399.0070628288424 / (299)) + (7.186151689126797 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12434287323024294 = (109.48639629340101 - 95.87254319865451) / 109.48639629340101 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_BigInteger.Subtract(arguments: 16,16 bits) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 95.7281003502029 < 136.25921063241654. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.911439330504958 (T) = (0 -96.92244826063457) / Math.Sqrt((394.5732773188059 / (299)) + (17.655795558687316 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11581491767836438 = (109.61782798477205 - 96.92244826063457) / 109.61782798477205 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_BigInteger.Add(arguments: 1024,1024 bits) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 940.6245525239157 < 1.403445458646173. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.148999542458338 (T) = (0 -943.2256992540156) / Math.Sqrt((50859.2177091212 / (299)) + (177.3600333926564 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11323806227878302 = (1063.6740923701552 - 943.2256992540156) / 1063.6740923701552 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_BigInteger.Multiply(arguments: 65536,65536 bits) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 19.293759088888887 < 31.10823016366758. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.765093172659782 (T) = (0 -19379419.92766113) / Math.Sqrt((30847483195082.04 / (299)) + (179561590753.66302 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15338514376468973 = (22890479.401503395 - 19379419.92766113) / 22890479.401503395 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in System.Numerics.Tests.Perf_VectorConvert

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Widen_int - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorConvert.Widen_int.html>)	257.14 μs	192.24 μs	0.75	0.10	False
[Convert_float_int - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorConvert.Convert_float_int.html>)	138.15 μs	93.14 μs	0.67	0.19	False
[Narrow_long - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorConvert.Narrow_long.html>)	140.55 μs	88.87 μs	0.63	0.19	False
[Convert_int_float - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorConvert.Convert_int_float.html>)	139.30 μs	101.73 μs	0.73	0.23	False
[Narrow_double - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorConvert.Narrow_double.html>)	158.05 μs	97.79 μs	0.62	0.24	False
[Narrow_uint - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorConvert.Narrow_uint.html>)	248.98 μs	149.36 μs	0.60	0.24	False
[Convert_ulong_double - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorConvert.Convert_ulong_double.html>)	127.33 μs	93.77 μs	0.74	0.20	False
[Convert_float_uint - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorConvert.Convert_float_uint.html>)	145.57 μs	95.91 μs	0.66	0.18	False
[Narrow_int - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorConvert.Narrow_int.html>)	255.24 μs	144.41 μs	0.57	0.19	False
[Widen_float - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorConvert.Widen_float.html>)	271.56 μs	193.07 μs	0.71	0.13	False
[Widen_uint - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorConvert.Widen_uint.html>)	272.89 μs	194.28 μs	0.71	0.21	False
[Convert_double_ulong - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorConvert.Convert_double_ulong.html>)	97.44 μs	65.36 μs	0.67	0.21	False
[Narrow_short - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorConvert.Narrow_short.html>)	393.12 μs	226.59 μs	0.58	0.10	False
[Widen_sbyte - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorConvert.Widen_sbyte.html>)	483.21 μs	308.85 μs	0.64	0.16	False
[Widen_ushort - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorConvert.Widen_ushort.html>)	315.88 μs	240.69 μs	0.76	0.11	False
[Widen_short - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorConvert.Widen_short.html>)	314.08 μs	231.47 μs	0.74	0.13	False
[Narrow_ulong - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorConvert.Narrow_ulong.html>)	139.66 μs	88.91 μs	0.64	0.23	False
[Widen_byte - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorConvert.Widen_byte.html>)	479.94 μs	304.40 μs	0.63	0.10	False
[Convert_double_long - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorConvert.Convert_double_long.html>)	97.01 μs	67.43 μs	0.70	0.18	False
[Narrow_ushort - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorConvert.Narrow_ushort.html>)	393.49 μs	238.47 μs	0.61	0.10	False
[Convert_long_double - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorConvert.Convert_long_double.html>)	127.24 μs	93.13 μs	0.73	0.18	False
[Convert_uint_float - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorConvert.Convert_uint_float.html>)	180.90 μs	128.00 μs	0.71	0.14	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_VectorConvert*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorConvert.Widen_int ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 192.24163325617286 < 248.0575529397484. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.755162766920275 (T) = (0 -192488.18556850922) / Math.Sqrt((863299312.7345182 / (299)) + (11466342.891094534 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.08186896270780894 = (209652.19315121652 - 192488.18556850922) / 209652.19315121652 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorConvert.Convert_float_int ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 93.14238990103463 < 131.10935088541666. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.475744989382246 (T) = (0 -87486.75018276682) / Math.Sqrt((474044783.3748849 / (299)) + (11401570.716140037 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12653885782417548 = (100161.00998475334 - 87486.75018276682) / 100161.00998475334 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorConvert.Narrow_long ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 88.86695567196531 < 132.83888454827726. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.843553450332847 (T) = (0 -91729.87393816873) / Math.Sqrt((471864751.4882402 / (299)) + (11834582.134071415 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10264316455723974 = (102222.29364632718 - 91729.87393816873) / 102222.29364632718 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorConvert.Convert_int_float ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 101.73042774840383 < 132.09876493317378. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.9881041362646625 (T) = (0 -89938.25350297605) / Math.Sqrt((497627289.2515243 / (299)) + (18907452.75930365 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09904722258428224 = (99825.71313110756 - 89938.25350297605) / 99825.71313110756 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorConvert.Narrow_double ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 97.78638043478261 < 150.32041075547139. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.002713520551954 (T) = (0 -101786.08241308083) / Math.Sqrt((654669002.5953584 / (299)) + (26397147.854980495 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10104795791258117 = (113227.48895116545 - 101786.08241308083) / 113227.48895116545 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorConvert.Narrow_uint ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 149.36338878125 < 238.70300265766718. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.232929026863125 (T) = (0 -146907.03467299315) / Math.Sqrt((2007183049.051503 / (299)) + (18716002.454007983 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14298589756165228 = (171417.28969805536 - 146907.03467299315) / 171417.28969805536 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorConvert.Convert_ulong_double ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 93.76770262445886 < 120.90651852351158. IsChangePoint: Marked as a change because one of 5/25/2022 12:28:02 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 51.10043184800146 (T) = (0 -96175.0840579297) / Math.Sqrt((25262319.660985164 / (299)) + (9188264.064360198 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.20942384864133157 = (121651.89133601502 - 96175.0840579297) / 121651.89133601502 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorConvert.Convert_float_uint ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 95.91366219325153 < 137.13381902280832. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 9:07:46 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.71824039309967 (T) = (0 -98839.89795430022) / Math.Sqrt((352205435.56110686 / (299)) + (23030601.932412036 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.10049854768618635 = (109882.97762060471 - 98839.89795430022) / 109882.97762060471 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorConvert.Narrow_int ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 144.4118225152905 < 241.02570493989342. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.02528988254002 (T) = (0 -147145.03439201182) / Math.Sqrt((1931009739.1015284 / (299)) + (17578467.38739392 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15060034884097304 = (173234.15919847478 - 147145.03439201182) / 173234.15919847478 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorConvert.Widen_float ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 193.06608604957813 < 255.185823554619. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.920605293024215 (T) = (0 -196128.7776587022) / Math.Sqrt((824671386.4190717 / (299)) + (26536592.546251588 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08335495766000484 = (213963.7139781263 - 196128.7776587022) / 213963.7139781263 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorConvert.Widen_uint ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 194.2799849156118 < 243.44890435244776. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.616662742126225 (T) = (0 -193720.41624671195) / Math.Sqrt((777052474.4548031 / (299)) + (28131214.819308445 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07263996441587756 = (208894.50570801445 - 193720.41624671195) / 208894.50570801445 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorConvert.Convert_double_ulong ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 65.3593587535014 < 92.28418107381688. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.324819873948666 (T) = (0 -67969.50937618972) / Math.Sqrt((187227061.02124953 / (299)) + (7314190.18542668 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08571404329847584 = (74341.63116909702 - 67969.50937618972) / 74341.63116909702 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorConvert.Narrow_short ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 226.58841851190473 < 375.76638456032026. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.594129455397042 (T) = (0 -228131.02627618398) / Math.Sqrt((4812005188.3051405 / (299)) + (25652870.684850223 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1589081903184078 = (271232.01492420473 - 228131.02627618398) / 271232.01492420473 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorConvert.Widen_sbyte ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 308.8465225961538 < 458.5513921178805. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.717965579814228 (T) = (0 -310212.71053121146) / Math.Sqrt((5907981858.411198 / (299)) + (162290554.47331262 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12989561429610094 = (356523.55697558617 - 310212.71053121146) / 356523.55697558617 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorConvert.Widen_ushort ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 240.69370383029514 < 302.325467275641. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.871733621077007 (T) = (0 -228529.45675222238) / Math.Sqrt((1591107483.6226742 / (299)) + (19727739.9234501 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09334126629395156 = (252056.75328145557 - 228529.45675222238) / 252056.75328145557 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorConvert.Widen_short ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 231.47027007575753 < 302.70423203966345. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.414050469852269 (T) = (0 -229017.96494655893) / Math.Sqrt((1543032595.8923545 / (299)) + (39506100.92472788 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09054477671877803 = (251818.8461442724 - 229017.96494655893) / 251818.8461442724 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorConvert.Narrow_ulong ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 88.91077486263737 < 132.6675449029578. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.504579550196864 (T) = (0 -92070.90237175644) / Math.Sqrt((476741448.66412294 / (299)) + (16530522.774550917 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10088460955287086 = (102401.65316931087 - 92070.90237175644) / 102401.65316931087 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorConvert.Widen_byte ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 304.39502399918297 < 456.72931975717967. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.937729811390172 (T) = (0 -309445.41651225835) / Math.Sqrt((5811065592.6577425 / (299)) + (30455668.50587671 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12555356960833108 = (353875.7844476033 - 309445.41651225835) / 353875.7844476033 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorConvert.Convert_double_long ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 67.42905203125 < 92.47756764173862. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.849239001975077 (T) = (0 -66676.99058653315) / Math.Sqrt((181228188.61891362 / (299)) + (3903966.2935456443 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09837280118256726 = (73951.84026611684 - 66676.99058653315) / 73951.84026611684 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorConvert.Narrow_ushort ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 238.4662134497549 < 375.0283392879779. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.572661200714096 (T) = (0 -228569.74184102012) / Math.Sqrt((4933761513.893356 / (299)) + (22299240.711250383 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1597699992521073 = (272032.35023454187 - 228569.74184102012) / 272032.35023454187 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorConvert.Convert_long_double ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 93.12977730294395 < 119.72162630751137. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 54.30318001263337 (T) = (0 -94872.11307429663) / Math.Sqrt((28199457.975501288 / (299)) + (7561267.805352339 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.2151373124226087 = (120877.3388975021 - 94872.11307429663) / 120877.3388975021 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorConvert.Convert_uint_float ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 128.0040899332061 < 167.7731191094837. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 35.60950697749439 (T) = (0 -121381.87107322122) / Math.Sqrt((193886749.59825623 / (299)) + (8775577.644186959 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.20838503458002675 = (153334.48251426732 - 121381.87107322122) / 153334.48251426732 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Numerics.Tests.Perf_VectorOf<SByte>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[LessThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(SByte).LessThanAllBenchmark.html>)	570.81 ns	341.45 ns	0.60	0.07	False
[LessThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(SByte).LessThanOrEqualAllBenchmark.html>)	596.03 ns	334.42 ns	0.56	0.07	False
[LessThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(SByte).LessThanOrEqualBenchmark.html>)	517.73 ns	274.79 ns	0.53	0.05	False
[EqualityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(SByte).EqualityOperatorBenchmark.html>)	34.22 ns	20.87 ns	0.61	0.28	False
[SubtractBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(SByte).SubtractBenchmark.html>)	471.24 ns	261.85 ns	0.56	0.10	False
[GreaterThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(SByte).GreaterThanOrEqualAnyBenchmark.html>)	572.52 ns	327.36 ns	0.57	0.06	False
[GreaterThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(SByte).GreaterThanOrEqualAllBenchmark.html>)	581.53 ns	341.88 ns	0.59	0.10	False
[DivisionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(SByte).DivisionOperatorBenchmark.html>)	479.62 ns	297.20 ns	0.62	0.05	False
[AddBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(SByte).AddBenchmark.html>)	468.67 ns	259.39 ns	0.55	0.10	False
[AddOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(SByte).AddOperatorBenchmark.html>)	463.10 ns	254.65 ns	0.55	0.09	False
[EqualsAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(SByte).EqualsAllBenchmark.html>)	34.23 ns	20.90 ns	0.61	0.27	False
[AbsBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(SByte).AbsBenchmark.html>)	397.49 ns	229.43 ns	0.58	0.04	False
[InequalityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(SByte).InequalityOperatorBenchmark.html>)	39.07 ns	21.66 ns	0.55	0.30	False
[GreaterThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(SByte).GreaterThanAllBenchmark.html>)	558.43 ns	324.36 ns	0.58	0.05	False
[LessThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(SByte).LessThanOrEqualAnyBenchmark.html>)	535.17 ns	298.25 ns	0.56	0.08	False
[GreaterThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(SByte).GreaterThanBenchmark.html>)	494.97 ns	268.09 ns	0.54	0.10	False
[NegateBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(SByte).NegateBenchmark.html>)	476.16 ns	262.10 ns	0.55	0.09	False
[GetHashCodeBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(SByte).GetHashCodeBenchmark.html>)	1.83 μs	1.37 μs	0.75	0.01	False
[LessThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(SByte).LessThanBenchmark.html>)	483.95 ns	279.97 ns	0.58	0.08	False
[DivideBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(SByte).DivideBenchmark.html>)	479.45 ns	297.74 ns	0.62	0.07	False
[MultiplyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(SByte).MultiplyBenchmark.html>)	466.15 ns	256.33 ns	0.55	0.08	False
[GreaterThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(SByte).GreaterThanOrEqualBenchmark.html>)	522.53 ns	292.86 ns	0.56	0.10	False
[MinBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(SByte).MinBenchmark.html>)	562.25 ns	321.59 ns	0.57	0.04	False
[LessThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(SByte).LessThanAnyBenchmark.html>)	518.75 ns	306.07 ns	0.59	0.06	False
[EqualsAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(SByte).EqualsAnyBenchmark.html>)	542.28 ns	300.65 ns	0.55	0.10	False
[MultiplyOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(SByte).MultiplyOperatorBenchmark.html>)	466.64 ns	255.28 ns	0.55	0.09	False
[OnesComplementOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(SByte).OnesComplementOperatorBenchmark.html>)	228.68 ns	139.76 ns	0.61	0.11	False
[SubtractionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(SByte).SubtractionOperatorBenchmark.html>)	470.21 ns	260.30 ns	0.55	0.13	False
[DotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(SByte).DotBenchmark.html>)	488.79 ns	263.61 ns	0.54	0.05	False
[SquareRootBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(SByte).SquareRootBenchmark.html>)	387.61 ns	235.01 ns	0.61	0.07	False
[OneBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(SByte).OneBenchmark.html>)	193.60 ns	115.15 ns	0.59	0.09	False
[MaxBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(SByte).MaxBenchmark.html>)	549.55 ns	303.31 ns	0.55	0.08	False
[GreaterThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(SByte).GreaterThanAnyBenchmark.html>)	556.50 ns	303.24 ns	0.54	0.09	False
[AndNotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(SByte).AndNotBenchmark.html>)	266.52 ns	163.03 ns	0.61	0.13	False
[EqualsStaticBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(SByte).EqualsStaticBenchmark.html>)	496.90 ns	277.55 ns	0.56	0.10	False
[UnaryNegateOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(SByte).UnaryNegateOperatorBenchmark.html>)	471.89 ns	261.40 ns	0.55	0.10	False
[OnesComplementBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(SByte).OnesComplementBenchmark.html>)	230.62 ns	138.37 ns	0.60	0.10	False
[ConditionalSelectBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(SByte).ConditionalSelectBenchmark.html>)	350.04 ns	220.10 ns	0.63	0.20	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_VectorOf<SByte>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorOf<SByte>.LessThanAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 341.45127683933543 < 543.2953928234838. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.311736449490462 (T) = (0 -340.71464105282104) / Math.Sqrt((9339.21635638073 / (299)) + (50.44238203242803 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15839453567723386 = (404.8389126453589 - 340.71464105282104) / 404.8389126453589 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<SByte>.LessThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 334.4245911900623 < 569.5333195175068. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.389126791382875 (T) = (0 -341.9976689286525) / Math.Sqrt((10252.335631412032 / (299)) + (208.13099124412122 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.18282658610945313 = (418.5129656879171 - 341.9976689286525) / 418.5129656879171 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<SByte>.LessThanOrEqualBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 274.79381854536837 < 483.75216598483496. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.719085597185558 (T) = (0 -277.91113825005914) / Math.Sqrt((7663.6028518147095 / (299)) + (3.048132662464218 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.18828067517943875 = (342.37344085838316 - 277.91113825005914) / 342.37344085838316 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<SByte>.EqualityOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 20.87162291279537 < 32.505950363667765. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.017375625864718 (T) = (0 -21.28188040052068) / Math.Sqrt((36.11544623458417 / (299)) + (0.7924014943814894 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12156244165470133 = (24.2269700314375 - 21.28188040052068) / 24.2269700314375 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<SByte>.SubtractBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 261.85162369370977 < 447.50972139725235. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.336652952159085 (T) = (0 -267.5583888804556) / Math.Sqrt((8207.73351944082 / (299)) + (216.60233626875387 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1484801772092235 = (314.2127543238606 - 267.5583888804556) / 314.2127543238606 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<SByte>.GreaterThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 327.36346041922815 < 543.9613527426047. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.568673487923732 (T) = (0 -327.93337868605306) / Math.Sqrt((10530.487663763675 / (299)) + (11.022093002895211 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.14796073148260003 = (384.8805927180763 - 327.93337868605306) / 384.8805927180763 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<SByte>.GreaterThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 341.8770707694749 < 554.615461357915. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.718170016396371 (T) = (0 -342.18093454408256) / Math.Sqrt((10474.960841881335 / (299)) + (19.282404020899776 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15704791265662876 = (405.9316533902802 - 342.18093454408256) / 405.9316533902802 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<SByte>.DivisionOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 297.19525478327114 < 454.8271418651239. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.725798175018221 (T) = (0 -298.85832319052946) / Math.Sqrt((5770.364257502718 / (299)) + (4.674249662474684 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12532224101428863 = (341.67820105211064 - 298.85832319052946) / 341.67820105211064 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<SByte>.AddBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 259.39189639740755 < 445.30310155067224. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.412953119223705 (T) = (0 -264.85898938898134) / Math.Sqrt((7911.190947026787 / (299)) + (671.5010394245811 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14788452285101086 = (310.82523025534925 - 264.85898938898134) / 310.82523025534925 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<SByte>.AddOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 254.6488787418208 < 439.659908229503. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.11944655958471 (T) = (0 -258.05191592494367) / Math.Sqrt((7938.676592516247 / (299)) + (171.33661877448804 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.16128609823251291 = (307.67573469466856 - 258.05191592494367) / 307.67573469466856 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<SByte>.EqualsAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 20.895220791210566 < 32.77739967227549. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.365075385834464 (T) = (0 -21.183994892428778) / Math.Sqrt((35.892309763485585 / (299)) + (0.6624831198524593 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12541236307666376 = (24.22169488577587 - 21.183994892428778) / 24.22169488577587 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<SByte>.AbsBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 229.42814736009845 < 379.5533518929379. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.209338881616194 (T) = (0 -230.24115981139872) / Math.Sqrt((4055.2228738873096 / (299)) + (4.746390596380939 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.17487988512227004 = (279.0395672822943 - 230.24115981139872) / 279.0395672822943 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<SByte>.InequalityOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 21.65706476541345 < 34.125477035511885. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 5.84146871088583 (T) = (0 -22.09172600070986) / Math.Sqrt((45.579874012281 / (299)) + (1.1220655851056804 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09894841346871124 = (24.517715002039708 - 22.09172600070986) / 24.517715002039708 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<SByte>.GreaterThanAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 324.3561766940459 < 531.7854491625599. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.710752839096024 (T) = (0 -314.631766242495) / Math.Sqrt((9815.719442004603 / (299)) + (12.645289574392171 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.18848586566315687 = (387.7095332413492 - 314.631766242495) / 387.7095332413492 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<SByte>.LessThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 298.25042069664636 < 508.7338949812364. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.837347010463183 (T) = (0 -299.48723600284626) / Math.Sqrt((9155.420777566094 / (299)) + (33.67183122895969 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.18092619168796675 = (365.64132922286535 - 299.48723600284626) / 365.64132922286535 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<SByte>.GreaterThanBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 268.09027557735214 < 470.6892803005422. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.992428848822987 (T) = (0 -272.1988201212915) / Math.Sqrt((8284.934094742855 / (299)) + (120.17696368451003 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.16716158074292278 = (326.83268906362764 - 272.1988201212915) / 326.83268906362764 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<SByte>.NegateBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 262.09796394375275 < 449.75873736130177. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.171782884422244 (T) = (0 -264.370674759671) / Math.Sqrt((8030.9488735230525 / (299)) + (31.130114590959753 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.1537749302733214 = (312.41177343642136 - 264.370674759671) / 312.41177343642136 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<SByte>.GetHashCodeBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.374798258801835 < 1.7412586580872442. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.183437514158108 (T) = (0 -1381.597899671239) / Math.Sqrt((30377.870538522366 / (299)) + (308.08972720349016 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10211795792895802 = (1538.729849729999 - 1381.597899671239) / 1538.729849729999 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<SByte>.LessThanBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 279.967546348846 < 459.9235699334144. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.702360229462565 (T) = (0 -281.4147751549994) / Math.Sqrt((6914.716185799618 / (299)) + (38.51784234391832 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.14404870662781435 = (328.77428579646335 - 281.4147751549994) / 328.77428579646335 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<SByte>.DivideBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 297.74201815046035 < 454.8706822681324. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.861606244556505 (T) = (0 -301.4673326320359) / Math.Sqrt((5760.009817064716 / (299)) + (8.67329718325138 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12599065377160693 = (344.92460971150473 - 301.4673326320359) / 344.92460971150473 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<SByte>.MultiplyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 256.33189645899665 < 443.24017100976073. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.208360272916602 (T) = (0 -258.7381947791246) / Math.Sqrt((7720.346318966276 / (299)) + (7.407184874448287 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.16735787833345875 = (310.74358124143134 - 258.7381947791246) / 310.74358124143134 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<SByte>.GreaterThanOrEqualBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 292.8606433888693 < 496.44633701328155. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.366286994426256 (T) = (0 -298.9351739065205) / Math.Sqrt((8708.034027931451 / (299)) + (595.8535535780475 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1347725347996285 = (345.49894210453937 - 298.9351739065205) / 345.49894210453937 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<SByte>.MinBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 321.59056484902385 < 533.7001260693343. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.763949315563009 (T) = (0 -324.37704070892937) / Math.Sqrt((9849.273839485735 / (299)) + (35.24789208622988 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1353722159867422 = (375.16379499546076 - 324.37704070892937) / 375.16379499546076 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<SByte>.LessThanAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 306.0662321026087 < 492.16717126469155. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.44242020588657 (T) = (0 -301.79147137994124) / Math.Sqrt((8210.821698783247 / (299)) + (83.38699309487212 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1440885435158893 = (352.59660224625554 - 301.79147137994124) / 352.59660224625554 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<SByte>.EqualsAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 300.64599556028526 < 519.0573578181803. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.298368885483711 (T) = (0 -304.2548011705576) / Math.Sqrt((10117.96081989314 / (299)) + (80.39454991784872 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1673824027305411 = (365.41961420026536 - 304.2548011705576) / 365.41961420026536 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<SByte>.MultiplyOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 255.27795662727073 < 443.47399858520447. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.437750251171956 (T) = (0 -257.30115186528195) / Math.Sqrt((8245.614082809561 / (299)) + (53.70941742745998 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.1639239063210979 = (307.74848582633837 - 257.30115186528195) / 307.74848582633837 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<SByte>.OnesComplementOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 139.75802393813703 < 217.34695736785014. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.890223623387017 (T) = (0 -141.42896075968022) / Math.Sqrt((1458.5406786826857 / (299)) + (24.099015717119638 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1265072826254736 = (161.91200904888586 - 141.42896075968022) / 161.91200904888586 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<SByte>.SubtractionOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 260.2998667335198 < 449.4295053512711. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.068425749950244 (T) = (0 -263.6771234236426) / Math.Sqrt((8161.703280280577 / (299)) + (71.98760955836896 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1553651055030492 = (312.1788184949237 - 263.6771234236426) / 312.1788184949237 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<SByte>.DotBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 263.61010377839506 < 464.15563432120905. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.881301115488774 (T) = (0 -263.4782761260723) / Math.Sqrt((9092.792683160631 / (299)) + (60.130750386029014 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14371991342749457 = (307.7010434526347 - 263.4782761260723) / 307.7010434526347 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<SByte>.SquareRootBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 235.00755430190117 < 366.9074146035584. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.429264287451868 (T) = (0 -234.47287605979568) / Math.Sqrt((3518.680203496034 / (299)) + (0.5612845313094258 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1433143524500777 = (273.69768214324154 - 234.47287605979568) / 273.69768214324154 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<SByte>.OneBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 115.14803813285057 < 183.6886436219551. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.118701552788467 (T) = (0 -116.99874088900548) / Math.Sqrt((1093.268894972015 / (299)) + (13.855052021261178 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12057312932805167 = (133.0397612249551 - 116.99874088900548) / 133.0397612249551 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<SByte>.MaxBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 303.3069756038066 < 522.1878411130133. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.933445515857896 (T) = (0 -308.26006634387716) / Math.Sqrt((9155.820917170351 / (299)) + (277.67971946417885 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.17462098142616392 = (373.47698379408354 - 308.26006634387716) / 373.47698379408354 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<SByte>.GreaterThanAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 303.23936557357166 < 523.0521357245005. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.820651301380714 (T) = (0 -303.36177320598415) / Math.Sqrt((9868.452218914295 / (299)) + (43.45621437691838 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1717445230411813 = (366.2659428705081 - 303.36177320598415) / 366.2659428705081 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<SByte>.AndNotBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 163.02707232335095 < 251.85146673854842. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.951170950477666 (T) = (0 -165.94947951916464) / Math.Sqrt((1997.8241114333723 / (299)) + (16.226058234109225 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12466370946665274 = (189.58368493787765 - 165.94947951916464) / 189.58368493787765 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<SByte>.EqualsStaticBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 277.5521627403962 < 471.56842680988797. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.107401634873508 (T) = (0 -270.8398973053101) / Math.Sqrt((8669.371102566143 / (299)) + (44.03717111046236 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.16919745649752327 = (325.9979154174348 - 270.8398973053101) / 325.9979154174348 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<SByte>.UnaryNegateOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 261.3994934430691 < 448.4068925011997. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.742584070123494 (T) = (0 -263.5331090448125) / Math.Sqrt((8103.39823320929 / (299)) + (2.7549099478315613 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.16151912149306155 = (314.2982932587314 - 263.5331090448125) / 314.2982932587314 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<SByte>.OnesComplementBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 138.36740174643506 < 219.76782027528392. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.18993569706392 (T) = (0 -141.4304470267735) / Math.Sqrt((1466.7957110871157 / (299)) + (11.269652886649524 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12803994183195358 = (162.1983090875897 - 141.4304470267735) / 162.1983090875897 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<SByte>.ConditionalSelectBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 220.10231818959616 < 334.1273078394966. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.45777730260937 (T) = (0 -226.59219279015423) / Math.Sqrt((2620.0495751989683 / (299)) + (46.32745363120569 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11454120463390152 = (255.90371226305146 - 226.59219279015423) / 255.90371226305146 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Collections.CtorDefaultSize<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ConcurrentQueue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CtorDefaultSize(Int32).ConcurrentQueue.html>)	636.30 ns	476.17 ns	0.75	0.07	False
[SortedList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CtorDefaultSize(Int32).SortedList.html>)	66.94 ns	61.70 ns	0.92	0.23	False
[List - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CtorDefaultSize(Int32).List.html>)	39.33 ns	36.12 ns	0.92	0.33	False
[ConcurrentBag - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CtorDefaultSize(Int32).ConcurrentBag.html>)	3.33 μs	2.55 μs	0.77	0.45	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.CtorDefaultSize<Int32>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.CtorDefaultSize<Int32>.ConcurrentQueue ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 476.169735233783 < 604.7781563051542. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.238527518700185 (T) = (0 -483.03376119031856) / Math.Sqrt((4395.334079067726 / (299)) + (38.637492450469985 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07679866210470956 = (523.2160541399738 - 483.03376119031856) / 523.2160541399738 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CtorDefaultSize<Int32>.SortedList ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 61.69634270424404 < 63.8765614087689. IsChangePoint: Marked as a change because one of 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.321775130139867 (T) = (0 -62.64388721127134) / Math.Sqrt((6.602495922595092 / (299)) + (3.9960796621124053 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.06956398532732998 = (67.32745317614305 - 62.64388721127134) / 67.32745317614305 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CtorDefaultSize<Int32>.List ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 36.12088234364729 < 37.161756768072834. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 28.279739071693783 (T) = (0 -36.32508467562339) / Math.Sqrt((4.695196157482497 / (299)) + (1.601704180294447 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14079611377107468 = (42.27760751299136 - 36.32508467562339) / 42.27760751299136 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CtorDefaultSize<Int32>.ConcurrentBag ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.5499268082248396 < 2.948848735892791. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 5.156337506610489 (T) = (0 -2471.441303386844) / Math.Sqrt((112324.58988350364 / (299)) + (33570.701382244886 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.0614864888173425 = (2633.3571908543804 - 2471.441303386844) / 2633.3571908543804 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Text.Json.Serialization.Tests.WriteJson<Hashtable>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[SerializeToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.WriteJson(Hashtable).SerializeToString.html>)	502.00 μs	336.45 μs	0.67	0.01	False
[SerializeObjectProperty - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.WriteJson(Hashtable).SerializeObjectProperty.html>)	514.75 μs	339.50 μs	0.66	0.02	False
[SerializeToStream - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.WriteJson(Hashtable).SerializeToStream.html>)	482.07 μs	316.15 μs	0.66	0.01	False
[SerializeToUtf8Bytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.WriteJson(Hashtable).SerializeToUtf8Bytes.html>)	481.89 μs	317.23 μs	0.66	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson<Hashtable>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Serialization.Tests.WriteJson<Hashtable>.SerializeToString ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 336.4503198138298 < 481.9181526264881. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.322725584734185 (T) = (0 -338747.10859925207) / Math.Sqrt((4978321655.133353 / (299)) + (15511729.500978323 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10171187944838916 = (377102.9593391906 - 338747.10859925207) / 377102.9593391906 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Serialization.Tests.WriteJson<Hashtable>.SerializeObjectProperty ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 339.4952299107143 < 487.56082605196355. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.548452535703614 (T) = (0 -344575.49051636044) / Math.Sqrt((4914619412.131496 / (299)) + (19437826.771228667 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10195191700252403 = (383693.80998648476 - 344575.49051636044) / 383693.80998648476 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Serialization.Tests.WriteJson<Hashtable>.SerializeToStream ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 316.15423408385095 < 466.1375400657642. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.799307448161843 (T) = (0 -322981.004558913) / Math.Sqrt((4742210669.204864 / (299)) + (17028340.69456929 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10872039212683704 = (362378.9905051615 - 322981.004558913) / 362378.9905051615 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Serialization.Tests.WriteJson<Hashtable>.SerializeToUtf8Bytes ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 317.22896495833334 < 457.9093229584148. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.910629353675843 (T) = (0 -317000.4938036595) / Math.Sqrt((4628175861.7603245 / (299)) + (12334938.655411322 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11022025404648525 = (356268.4981820442 - 317000.4938036595) / 356268.4981820442 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Memory.ReadOnlySpan

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[IndexOfString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySpan.IndexOfString(input%3a%20%22string1%22%2c%20value%3a%20%22string2%22%2c%20comparisonType%3a%20InvariantCulture).html>)	722.38 ns	446.53 ns	0.62	0.09	False
[IndexOfString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySpan.IndexOfString(input%3a%20%22AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA.html>)	3.37 μs	1.98 μs	0.59	0.07	False
[IndexOfString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySpan.IndexOfString(input%3a%20%22%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%99%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%22%2c%20value%3a%20%22%e3%81%99%22%2c%20comparisonType%3a%20Ordinal).html>)	422.02 ns	259.96 ns	0.62	0.07	False
[IndexOfString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySpan.IndexOfString(input%3a%20%22Hello%20WorldbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbareallyreallylongHello%20WorldbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbareallyreallylongHello%20Worldbbbbbbbbbbbbbbbbbbb.html>)	227.32 ns	148.30 ns	0.65	0.21	False
[Trim - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySpan.Trim(input%3a%20%22abcdefg%22).html>)	214.80 ns	152.00 ns	0.71	0.18	False
[IndexOfString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySpan.IndexOfString(input%3a%20%22More%20Test%27s%22%2c%20value%3a%20%22Tests%22%2c%20comparisonType%3a%20OrdinalIgnoreCase).html>)	319.29 ns	223.08 ns	0.70	0.23	False
[GetPinnableReference - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySpan.GetPinnableReference.html>)	17.52 ns	13.67 ns	0.78	0.14	False
[Trim - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySpan.Trim(input%3a%20%22%22).html>)	73.80 ns	50.46 ns	0.68	0.25	False
[IndexOfString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySpan.IndexOfString(input%3a%20%22%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0.html>)	3.38 μs	1.94 μs	0.57	0.07	False
[IndexOfString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySpan.IndexOfString(input%3a%20%22foobardzsdzs%22%2c%20value%3a%20%22rddzs%22%2c%20comparisonType%3a%20InvariantCulture).html>)	956.40 ns	589.71 ns	0.62	0.12	False
[IndexOfString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySpan.IndexOfString(input%3a%20%22StrIng%22%2c%20value%3a%20%22string%22%2c%20comparisonType%3a%20OrdinalIgnoreCase).html>)	227.41 ns	158.04 ns	0.69	0.26	False
[Trim - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySpan.Trim(input%3a%20%22%20abcdefg%20%22).html>)	355.58 ns	266.12 ns	0.75	0.11	False
[IndexOfString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySpan.IndexOfString(input%3a%20%22Hello%20WorldbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbareallyreallylongHello%20WorldbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbareallyreallylongHello%20Worldbbbbbbbbbbbbbbbbbb.html>)	1.36 μs	791.45 ns	0.58	0.05	False
[IndexOfString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySpan.IndexOfString(input%3a%20%22AAAAA5AAAA%22%2c%20value%3a%20%225%22%2c%20comparisonType%3a%20InvariantCulture).html>)	596.68 ns	365.22 ns	0.61	0.05	False
[IndexOfString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySpan.IndexOfString(input%3a%20%22Hello%20Worldbbbbbbbbbbbbbbcbbbbbbbbbbbbbbbbbbba!%22%2c%20value%3a%20%22y%22%2c%20comparisonType%3a%20Ordinal).html>)	416.42 ns	262.15 ns	0.63	0.06	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Memory.ReadOnlySpan*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Memory.ReadOnlySpan.IndexOfString(input: "string1", value: "string2", comparisonType: InvariantCulture) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 446.5287043864406 < 690.5925498588672. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.681240835757125 (T) = (0 -454.86546912479906) / Math.Sqrt((12331.280511252222 / (299)) + (86.63537828175454 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13315174896043896 = (524.7348293998461 - 454.86546912479906) / 524.7348293998461 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySpan.IndexOfString(input: "AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAXAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA", value: "X", comparisonType: Ordinal) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.9847214500255623 < 3.1954586348534155. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.270620085550282 (T) = (0 -1981.93879994065) / Math.Sqrt((320700.1687576001 / (299)) + (5401.451571077148 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.15060945630198647 = (2333.365746352475 - 1981.93879994065) / 2333.365746352475 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySpan.IndexOfString(input: "だだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだすだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだ", value: "す", comparisonType: Ordinal) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 259.963682997589 < 400.9788581381833. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.75194137352152 (T) = (0 -264.2944353501838) / Math.Sqrt((4059.99974232576 / (299)) + (21.203309652596605 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14245510086988325 = (308.1989475050005 - 264.2944353501838) / 308.1989475050005 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySpan.IndexOfString(input: "Hello WorldbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbareallyreallylongHello WorldbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbareallyreallylongHello Worldbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbareallyreallylong!xyz", value: "w", comparisonType: OrdinalIgnoreCase) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 148.30328884433123 < 214.95600097082314. IsChangePoint: Marked as a change because one of 4/9/2022 5:43:54 AM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 5.481499549997142 (T) = (0 -151.5739270581056) / Math.Sqrt((1308.4919330085656 / (299)) + (23.662018460175563 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07346002354168932 = (163.59135159768857 - 151.5739270581056) / 163.59135159768857 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySpan.Trim(input: "abcdefg") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 151.9994762189666 < 204.2983374131004. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.017599980211362 (T) = (0 -155.70451797742533) / Math.Sqrt((576.3360127046182 / (299)) + (25.279554008238136 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.10671411465043071 = (174.305360166408 - 155.70451797742533) / 174.305360166408 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySpan.IndexOfString(input: "More Test's", value: "Tests", comparisonType: OrdinalIgnoreCase) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 223.08206995680075 < 302.82865862089824. IsChangePoint: Marked as a change because one of 4/9/2022 5:43:54 AM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.651996379304607 (T) = (0 -218.14885942105985) / Math.Sqrt((2149.2721362903067 / (299)) + (63.70160024956143 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09190982509642333 = (240.2281903823301 - 218.14885942105985) / 240.2281903823301 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySpan.GetPinnableReference ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 13.665308698742487 < 16.557985061558107. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 26.110614674845113 (T) = (0 -13.969052041151958) / Math.Sqrt((0.8301736294236337 / (299)) + (0.1689015970419197 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12454361294026085 = (15.956308329724644 - 13.969052041151958) / 15.956308329724644 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySpan.Trim(input: "") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 50.46330665946173 < 70.14416909735712. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.79154265948561 (T) = (0 -52.23030954060944) / Math.Sqrt((106.14176302207812 / (299)) + (10.427158514598752 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08730621845351645 = (57.22654256733242 - 52.23030954060944) / 57.22654256733242 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySpan.IndexOfString(input: "だだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだxだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだ", value: "x", comparisonType: Ordinal) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.9415126435161991 < 3.1978220596024327. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.40221588768199 (T) = (0 -1997.5277261085087) / Math.Sqrt((321633.801903642 / (299)) + (8995.841179245008 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1421452126068111 = (2328.514983495642 - 1997.5277261085087) / 2328.514983495642 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySpan.IndexOfString(input: "foobardzsdzs", value: "rddzs", comparisonType: InvariantCulture) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 589.714256588589 < 887.089478216556. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.95051403985724 (T) = (0 -580.6872632863845) / Math.Sqrt((20126.829811751166 / (299)) + (133.05612243494176 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.14665248703672135 = (680.4815792688349 - 580.6872632863845) / 680.4815792688349 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySpan.IndexOfString(input: "StrIng", value: "string", comparisonType: OrdinalIgnoreCase) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 158.0444757826879 < 217.26917127757585. IsChangePoint: Marked as a change because one of 4/9/2022 5:43:54 AM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.317583273918214 (T) = (0 -161.70551284921564) / Math.Sqrt((1065.9696711531567 / (299)) + (19.842463815606134 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.0717931858473373 = (174.21280514605212 - 161.70551284921564) / 174.21280514605212 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySpan.Trim(input: " abcdefg ") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 266.1236842803331 < 345.5829435374013. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.496030426953498 (T) = (0 -261.776454559524) / Math.Sqrt((1394.7828870150377 / (299)) + (45.626016007892716 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10781741967320328 = (293.41130429114423 - 261.776454559524) / 293.41130429114423 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySpan.IndexOfString(input: "Hello WorldbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbareallyreallylongHello WorldbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbareallyreallylongHello Worldbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbareallyreallylong!xyz", value: "~", comparisonType: Ordinal) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 791.4473632567808 < 1.295065149291773. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.382457075743119 (T) = (0 -800.3521440328341) / Math.Sqrt((54236.483314014375 / (299)) + (509.80671901908454 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.139266816526848 = (929.849295229128 - 800.3521440328341) / 929.849295229128 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySpan.IndexOfString(input: "AAAAA5AAAA", value: "5", comparisonType: InvariantCulture) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 365.2221087698338 < 571.3962395504165. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.947471099981943 (T) = (0 -372.1154524299217) / Math.Sqrt((8510.911759021034 / (299)) + (27.594289825119503 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1473400105961789 = (436.4171616520958 - 372.1154524299217) / 436.4171616520958 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySpan.IndexOfString(input: "Hello Worldbbbbbbbbbbbbbbcbbbbbbbbbbbbbbbbbbba!", value: "y", comparisonType: Ordinal) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 262.15176459750563 < 395.3691236968503. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.252119935702618 (T) = (0 -264.7198683013479) / Math.Sqrt((4049.17304129245 / (299)) + (17.019289607639887 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12595814312099196 = (302.8686397772739 - 264.7198683013479) / 302.8686397772739 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in PerfLabTests.BlockCopyPerf

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[CallBlockCopy - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.BlockCopyPerf.CallBlockCopy(numElements%3a%20100).html>)	278.53 ns	230.92 ns	0.83	0.08	False
[CallBlockCopy - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.BlockCopyPerf.CallBlockCopy(numElements%3a%2010).html>)	113.51 ns	75.40 ns	0.66	0.15	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'PerfLabTests.BlockCopyPerf*'

### Payloads [Baseline]() [Compare]() ### Histogram #### PerfLabTests.BlockCopyPerf.CallBlockCopy(numElements: 100) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 230.92194559891223 < 264.92573984718445. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.836278964358081 (T) = (0 -233.4243996203889) / Math.Sqrt((312.6576851793293 / (299)) + (13.813139294691114 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.06323323013954445 = (249.18091368159943 - 233.4243996203889) / 249.18091368159943 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.BlockCopyPerf.CallBlockCopy(numElements: 10) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 75.39725655144632 < 107.28547776034004. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.834942134338217 (T) = (0 -76.35577150660073) / Math.Sqrt((204.2016971906963 / (299)) + (4.187020501317377 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14465653455823144 = (89.26913525570039 - 76.35577150660073) / 89.26913525570039 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Text.Tests.Perf_Encoding

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[GetByteCount - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_Encoding.GetByteCount(size%3a%20512%2c%20encName%3a%20%22ascii%22).html>)	132.16 ns	102.40 ns	0.77	0.17	False
[GetEncoder - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_Encoding.GetEncoder(size%3a%20512%2c%20encName%3a%20%22ascii%22).html>)	85.20 ns	76.43 ns	0.90	0.24	False
[GetBytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_Encoding.GetBytes(size%3a%20512%2c%20encName%3a%20%22utf-8%22).html>)	7.22 μs	4.34 μs	0.60	0.12	False
[GetBytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_Encoding.GetBytes(size%3a%2016%2c%20encName%3a%20%22ascii%22).html>)	469.30 ns	329.84 ns	0.70	0.15	False
[GetByteCount - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_Encoding.GetByteCount(size%3a%2016%2c%20encName%3a%20%22ascii%22).html>)	132.42 ns	101.38 ns	0.77	0.22	False
[GetBytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_Encoding.GetBytes(size%3a%2016%2c%20encName%3a%20%22utf-8%22).html>)	408.77 ns	315.47 ns	0.77	0.11	False
[GetChars - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_Encoding.GetChars(size%3a%2016%2c%20encName%3a%20%22utf-8%22).html>)	414.64 ns	309.00 ns	0.75	0.16	False
[GetBytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_Encoding.GetBytes(size%3a%20512%2c%20encName%3a%20%22ascii%22).html>)	4.94 μs	2.82 μs	0.57	0.14	False
[GetByteCount - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_Encoding.GetByteCount(size%3a%2016%2c%20encName%3a%20%22utf-8%22).html>)	252.49 ns	181.38 ns	0.72	0.25	False
[GetString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_Encoding.GetString(size%3a%2016%2c%20encName%3a%20%22ascii%22).html>)	375.29 ns	314.66 ns	0.84	0.07	False
[GetString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_Encoding.GetString(size%3a%20512%2c%20encName%3a%20%22utf-8%22).html>)	1.78 μs	1.36 μs	0.77	0.17	False
[GetChars - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_Encoding.GetChars(size%3a%2016%2c%20encName%3a%20%22ascii%22).html>)	307.51 ns	248.37 ns	0.81	0.16	False
[GetByteCount - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_Encoding.GetByteCount(size%3a%20512%2c%20encName%3a%20%22utf-8%22).html>)	2.27 μs	1.44 μs	0.63	0.08	False
[GetString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_Encoding.GetString(size%3a%2016%2c%20encName%3a%20%22utf-8%22).html>)	390.72 ns	331.22 ns	0.85	0.10	False
[GetChars - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_Encoding.GetChars(size%3a%20512%2c%20encName%3a%20%22utf-8%22).html>)	1.74 μs	1.26 μs	0.72	0.12	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Tests.Perf_Encoding*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Tests.Perf_Encoding.GetByteCount(size: 512, encName: "ascii") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 102.40214895752592 < 127.01003285237644. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.596113025281358 (T) = (0 -102.81237543295563) / Math.Sqrt((165.80518730382042 / (299)) + (6.175583097259305 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09082162021760547 = (113.08273240897243 - 102.81237543295563) / 113.08273240897243 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_Encoding.GetEncoder(size: 512, encName: "ascii") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 76.42650924825317 < 81.00034621170383. IsChangePoint: Marked as a change because one of 4/21/2022 3:06:05 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 19.539541790909123 (T) = (0 -77.73681248468581) / Math.Sqrt((13.429723218673487 / (299)) + (4.042598752976031 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07920251649156426 = (84.42335462135702 - 77.73681248468581) / 84.42335462135702 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_Encoding.GetBytes(size: 512, encName: "utf-8") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 4.341733691056507 < 6.840554921157966. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.643513385177993 (T) = (0 -4410.8215319896935) / Math.Sqrt((1550643.0212141806 / (299)) + (71662.6555970737 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10820205394390632 = (4945.987542913958 - 4410.8215319896935) / 4945.987542913958 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_Encoding.GetBytes(size: 16, encName: "ascii") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 329.8375500548443 < 434.7313971897389. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.090379752411506 (T) = (0 -330.88334043733755) / Math.Sqrt((2972.49577900341 / (299)) + (83.33660468259059 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.08507855489567248 = (361.65218577820883 - 330.88334043733755) / 361.65218577820883 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_Encoding.GetByteCount(size: 16, encName: "ascii") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 101.38351234256321 < 127.71315113278376. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.282839809058633 (T) = (0 -104.46549944085079) / Math.Sqrt((169.38744746523238 / (299)) + (16.465196283669425 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07615383698603242 = (113.07672599953352 - 104.46549944085079) / 113.07672599953352 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_Encoding.GetBytes(size: 16, encName: "utf-8") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 315.4722454057232 < 395.6115716487224. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.587612656626197 (T) = (0 -301.974664163119) / Math.Sqrt((2488.2789195057303 / (299)) + (39.44648167808822 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07871430494629138 = (327.7752664394888 - 301.974664163119) / 327.7752664394888 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_Encoding.GetChars(size: 16, encName: "utf-8") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 308.9954687932679 < 398.5877652804587. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.842646872529548 (T) = (0 -312.70005484377583) / Math.Sqrt((1497.8234719755014 / (299)) + (70.10231047735864 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10633523066413314 = (349.90755546530164 - 312.70005484377583) / 349.90755546530164 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_Encoding.GetBytes(size: 512, encName: "ascii") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.821635981643357 < 4.6847411585184044. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.69703189670534 (T) = (0 -2889.4620818424846) / Math.Sqrt((906634.0454686614 / (299)) + (14843.1013906314 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14736515606890144 = (3388.8623041964047 - 2889.4620818424846) / 3388.8623041964047 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_Encoding.GetByteCount(size: 16, encName: "utf-8") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 181.37987479740082 < 231.79481761441508. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.374227933703402 (T) = (0 -179.70019200633217) / Math.Sqrt((728.5164107654075 / (299)) + (52.77723336937052 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09615886197622385 = (198.81833703568938 - 179.70019200633217) / 198.81833703568938 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_Encoding.GetString(size: 16, encName: "ascii") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 314.66293189843566 < 352.8189449882824. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.253469980240595 (T) = (0 -315.8738301376194) / Math.Sqrt((346.4964526854136 / (299)) + (53.38278982022374 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07382277094474272 = (341.05117274349857 - 315.8738301376194) / 341.05117274349857 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_Encoding.GetString(size: 512, encName: "utf-8") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.3596118596800233 < 1.710141982673387. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.306767159883982 (T) = (0 -1306.2918780715577) / Math.Sqrt((47086.26464376756 / (299)) + (1150.021812417925 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08680609691055817 = (1430.4649578279261 - 1306.2918780715577) / 1430.4649578279261 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_Encoding.GetChars(size: 16, encName: "ascii") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 248.3735471431012 < 293.4964910904498. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.39305756253107 (T) = (0 -236.74512908168467) / Math.Sqrt((672.9245104237908 / (299)) + (30.40523511293706 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.09833815841201687 = (262.5653190166453 - 236.74512908168467) / 262.5653190166453 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_Encoding.GetByteCount(size: 512, encName: "utf-8") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.441596619511008 < 2.2041150382824246. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.794362106849022 (T) = (0 -1439.692119933076) / Math.Sqrt((139338.30998056088 / (299)) + (1648.6929529619645 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11969357857121424 = (1635.4443008564863 - 1439.692119933076) / 1635.4443008564863 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_Encoding.GetString(size: 16, encName: "utf-8") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 331.2152223369582 < 364.06356532512797. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.49516636961967 (T) = (0 -319.71053017038133) / Math.Sqrt((481.5802115873578 / (299)) + (44.344800341024374 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.06158115576630904 = (340.69065442889274 - 319.71053017038133) / 340.69065442889274 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_Encoding.GetChars(size: 512, encName: "utf-8") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.2590263016707586 < 1.6416921514590874. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.062167794099304 (T) = (0 -1200.0729976106907) / Math.Sqrt((49409.08750389849 / (299)) + (1141.5771754677744 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.0933715578384448 = (1323.6657287626165 - 1200.0729976106907) / 1323.6657287626165 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Collections.IndexerSetReverse<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Span - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IndexerSetReverse(String).Span(Size%3a%20512).html>)	5.43 μs	3.54 μs	0.65	0.05	False
[IList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IndexerSetReverse(String).IList(Size%3a%20512).html>)	20.95 μs	14.85 μs	0.71	0.20	False
[List - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IndexerSetReverse(String).List(Size%3a%20512).html>)	21.11 μs	13.47 μs	0.64	0.16	False
[Array - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IndexerSetReverse(String).Array(Size%3a%20512).html>)	6.89 μs	4.96 μs	0.72	0.12	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.IndexerSetReverse<String>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.IndexerSetReverse<String>.Span(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.5446004680365295 < 5.155323069008231. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.173123831901297 (T) = (0 -3547.5376392604267) / Math.Sqrt((556884.4402715993 / (299)) + (697.6557629073887 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.129368939878046 = (4074.6738793852633 - 3547.5376392604267) / 4074.6738793852633 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IndexerSetReverse<String>.IList(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 14.852603122710626 < 19.314052487660835. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 20.298074220583608 (T) = (0 -15042.332793260877) / Math.Sqrt((3067071.113575261 / (299)) + (188562.85584340614 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.13634007034384188 = (17416.962715000056 - 15042.332793260877) / 17416.962715000056 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IndexerSetReverse<String>.List(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 13.469901013839717 < 16.31652091227684. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.125357772711633 (T) = (0 -13096.70142976736) / Math.Sqrt((2744726.772344081 / (299)) + (72464.13032871805 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.0930239761392791 = (14439.964326751095 - 13096.70142976736) / 14439.964326751095 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IndexerSetReverse<String>.Array(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 4.963039264252287 < 6.534870778590579. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.502204284441019 (T) = (0 -5185.355262574131) / Math.Sqrt((544893.1080564953 / (299)) + (10906.26902025132 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.06859016327201384 = (5567.211186849951 - 5185.355262574131) / 5567.211186849951 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Collections.IndexerSetReverse<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[List - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IndexerSetReverse(Int32).List(Size%3a%20512).html>)	14.23 μs	10.38 μs	0.73	0.12	False
[Span - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IndexerSetReverse(Int32).Span(Size%3a%20512).html>)	4.52 μs	3.06 μs	0.68	0.07	False
[Array - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IndexerSetReverse(Int32).Array(Size%3a%20512).html>)	3.31 μs	2.12 μs	0.64	0.07	False
[IList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IndexerSetReverse(Int32).IList(Size%3a%20512).html>)	16.93 μs	12.52 μs	0.74	0.12	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.IndexerSetReverse<Int32>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.IndexerSetReverse<Int32>.List(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 10.375424102242901 < 12.972720205818462. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 20.49318150045513 (T) = (0 -10383.763093682162) / Math.Sqrt((1156621.9966112312 / (299)) + (59983.85629617983 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.121809771717673 = (11824.047637141226 - 10383.763093682162) / 11824.047637141226 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IndexerSetReverse<Int32>.Span(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.0575156268898165 < 4.3225927076692505. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.66806147479276 (T) = (0 -3076.719810871606) / Math.Sqrt((378584.8755421182 / (299)) + (6416.676091185325 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11413601562743389 = (3473.1289059581363 - 3076.719810871606) / 3473.1289059581363 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IndexerSetReverse<Int32>.Array(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.1227228346340596 < 3.186111748351459. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.90489869748444 (T) = (0 -2113.597906107862) / Math.Sqrt((222082.5414493402 / (299)) + (2597.4286175520356 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15598138126106856 = (2504.207678813815 - 2113.597906107862) / 2504.207678813815 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IndexerSetReverse<Int32>.IList(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 12.51532495927588 < 16.074905719440306. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.661934953997623 (T) = (0 -12558.932068058319) / Math.Sqrt((2514970.0911602816 / (299)) + (88848.65190304705 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1171192237446994 = (14224.946794431824 - 12558.932068058319) / 14224.946794431824 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in Span.Sorting

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[BubbleSortArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Span.Sorting.BubbleSortArray(Size%3a%20512).html>)	2.37 ms	1.54 ms	0.65	0.12	False
[BubbleSortSpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Span.Sorting.BubbleSortSpan(Size%3a%20512).html>)	4.25 ms	2.60 ms	0.61	0.13	False
[QuickSortSpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Span.Sorting.QuickSortSpan(Size%3a%20512).html>)	146.74 μs	99.95 μs	0.68	0.01	False
[QuickSortArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Span.Sorting.QuickSortArray(Size%3a%20512).html>)	86.75 μs	60.85 μs	0.70	0.02	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Span.Sorting*'

### Payloads [Baseline]() [Compare]() ### Histogram #### Span.Sorting.BubbleSortArray(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.5393154651428573 < 2.256709424367738. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.418795475632374 (T) = (0 -1570366.7077267398) / Math.Sqrt((115530924397.84517 / (299)) + (1240161358.2144065 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10812227841824079 = (1760742.1619879345 - 1570366.7077267398) / 1760742.1619879345 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Span.Sorting.BubbleSortSpan(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.598615895466667 < 3.9027895046383336. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.233421009624513 (T) = (0 -2574475.341495706) / Math.Sqrt((336769545156.13495 / (299)) + (1197429144.1694527 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.1577979171035783 = (3056838.012845817 - 2574475.341495706) / 3056838.012845817 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Span.Sorting.QuickSortSpan(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 99.95235133333334 < 137.51074165178568. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.257357270933252 (T) = (0 -99591.5136282651) / Math.Sqrt((300307282.06434065 / (299)) + (898554.9779425989 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1263576310661307 = (113995.74605086914 - 99591.5136282651) / 113995.74605086914 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Span.Sorting.QuickSortArray(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 60.845395866666664 < 81.87697536428573. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.393895904126927 (T) = (0 -61347.84103542457) / Math.Sqrt((89217073.43959947 / (299)) + (211654.17143772452 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10716431712707383 = (68711.23344669903 - 61347.84103542457) / 68711.23344669903 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Buffers.Tests.ReadOnlySequenceTests<Byte>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[IterateGetPositionSingleSegment - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Byte).IterateGetPositionSingleSegment.html>)	943.49 ns	665.67 ns	0.71	0.13	False
[SliceMemory - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Byte).SliceMemory.html>)	157.85 ns	104.68 ns	0.66	0.08	False
[SliceSingleSegment - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Byte).SliceSingleSegment.html>)	146.71 ns	96.08 ns	0.65	0.14	False
[SliceTenSegments - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Byte).SliceTenSegments.html>)	378.41 ns	265.06 ns	0.70	0.08	False
[IterateForEachSingleSegment - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Byte).IterateForEachSingleSegment.html>)	417.56 ns	345.54 ns	0.83	0.11	False
[FirstSpanMemory - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Byte).FirstSpanMemory.html>)	113.68 ns	79.06 ns	0.70	0.13	False
[FirstSpanTenSegments - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Byte).FirstSpanTenSegments.html>)	112.08 ns	70.42 ns	0.63	0.10	False
[FirstSpanSingleSegment - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Byte).FirstSpanSingleSegment.html>)	118.99 ns	73.33 ns	0.62	0.12	False
[IterateForEachArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Byte).IterateForEachArray.html>)	378.17 ns	320.47 ns	0.85	0.07	False
[IterateTryGetArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Byte).IterateTryGetArray.html>)	315.64 ns	270.61 ns	0.86	0.13	False
[IterateGetPositionMemory - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Byte).IterateGetPositionMemory.html>)	1.10 μs	756.47 ns	0.69	0.10	False
[FirstSingleSegment - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Byte).FirstSingleSegment.html>)	77.63 ns	49.08 ns	0.63	0.12	False
[SliceArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Byte).SliceArray.html>)	141.95 ns	93.01 ns	0.66	0.10	False
[FirstMemory - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Byte).FirstMemory.html>)	101.99 ns	69.62 ns	0.68	0.09	False
[FirstTenSegments - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Byte).FirstTenSegments.html>)	72.55 ns	47.11 ns	0.65	0.05	False
[FirstArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Byte).FirstArray.html>)	89.85 ns	61.78 ns	0.69	0.18	False
[IterateTryGetTenSegments - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Byte).IterateTryGetTenSegments.html>)	2.62 μs	2.26 μs	0.87	0.04	False
[IterateTryGetMemory - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Byte).IterateTryGetMemory.html>)	492.22 ns	386.95 ns	0.79	0.11	False
[FirstSpanArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Byte).FirstSpanArray.html>)	104.51 ns	70.23 ns	0.67	0.17	False
[IterateForEachTenSegments - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Byte).IterateForEachTenSegments.html>)	2.85 μs	2.32 μs	0.81	0.04	False
[IterateTryGetSingleSegment - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Byte).IterateTryGetSingleSegment.html>)	349.84 ns	273.63 ns	0.78	0.14	False
[IterateGetPositionArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Byte).IterateGetPositionArray.html>)	914.86 ns	634.04 ns	0.69	0.14	False
[IterateForEachMemory - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Byte).IterateForEachMemory.html>)	537.95 ns	441.71 ns	0.82	0.09	False
[IterateGetPositionTenSegments - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Byte).IterateGetPositionTenSegments.html>)	1.39 μs	949.66 ns	0.69	0.14	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Buffers.Tests.ReadOnlySequenceTests<Byte>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Buffers.Tests.ReadOnlySequenceTests<Byte>.IterateGetPositionSingleSegment ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 665.6717703102369 < 899.3194262829469. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.406500763595545 (T) = (0 -672.9464373600922) / Math.Sqrt((11692.642542800933 / (299)) + (486.95006270821096 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11305404684842221 = (758.723161167732 - 672.9464373600922) / 758.723161167732 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Byte>.SliceMemory ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 104.67910420832472 < 149.52483334651697. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.689486668912588 (T) = (0 -106.81094693368337) / Math.Sqrt((409.86588715406486 / (299)) + (4.712632602930333 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11661459186740326 = (120.91092511871214 - 106.81094693368337) / 120.91092511871214 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Byte>.SliceSingleSegment ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 96.07545202575375 < 137.15042659143083. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.041501189558042 (T) = (0 -96.99887418724522) / Math.Sqrt((382.58147123168703 / (299)) + (7.6389050119486335 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11929329485803697 = (110.13754479320077 - 96.99887418724522) / 110.13754479320077 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Byte>.SliceTenSegments ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 265.0602657893303 < 366.4472330342013. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.363106692001308 (T) = (0 -258.46131614727864) / Math.Sqrt((2828.972434054674 / (299)) + (18.703635764564076 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1115281815204573 = (290.90547473929786 - 258.46131614727864) / 290.90547473929786 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Byte>.IterateForEachSingleSegment ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 345.54374615638886 < 395.18828062049477. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.66151503253678 (T) = (0 -346.14189649904523) / Math.Sqrt((771.6573765625745 / (299)) + (50.742402663056694 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07329689202037111 = (373.51973195999494 - 346.14189649904523) / 373.51973195999494 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Byte>.FirstSpanMemory ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 79.0583769584925 < 108.51603957301535. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.267904827928376 (T) = (0 -79.78359169775861) / Math.Sqrt((240.88145420749134 / (299)) + (9.315187356487826 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09269586513963239 = (87.9347824310722 - 79.78359169775861) / 87.9347824310722 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Byte>.FirstSpanTenSegments ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 70.41993385526904 < 106.82891655423047. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.30890355568208 (T) = (0 -70.22127564787166) / Math.Sqrt((299.6621913027576 / (299)) + (2.499657687512828 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13059026059049805 = (80.76890844996232 - 70.22127564787166) / 80.76890844996232 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Byte>.FirstSpanSingleSegment ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 73.3291455351419 < 113.0281314782154. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.077175554378519 (T) = (0 -72.56074054708638) / Math.Sqrt((377.22301908093823 / (299)) + (6.536398591632564 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12805995271847134 = (83.21757989360735 - 72.56074054708638) / 83.21757989360735 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Byte>.IterateForEachArray ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 320.4706248010188 < 363.53110162853403. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.815501194079257 (T) = (0 -321.2814916678579) / Math.Sqrt((477.8768719204297 / (299)) + (27.173115969953997 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07410843062511624 = (346.99688634682275 - 321.2814916678579) / 346.99688634682275 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Byte>.IterateTryGetArray ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 270.6115993007778 < 309.26426896170153. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.992567356864377 (T) = (0 -254.70678823287045) / Math.Sqrt((686.6336729790978 / (299)) + (52.386951448350615 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07217617970596091 = (274.5206392223802 - 254.70678823287045) / 274.5206392223802 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Byte>.IterateGetPositionMemory ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 756.4673005680415 < 1.027538828868814. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.845185880829007 (T) = (0 -767.9225749536256) / Math.Sqrt((13047.853091845773 / (299)) + (197.47735535161027 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1172730107878207 = (869.9434642176117 - 767.9225749536256) / 869.9434642176117 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Byte>.FirstSingleSegment ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 49.0810195975029 < 73.74141501955368. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.498111239087079 (T) = (0 -49.628494461501184) / Math.Sqrt((142.8378589719621 / (299)) + (0.4081050892557638 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11762324648837774 = (56.24410917897952 - 49.628494461501184) / 56.24410917897952 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Byte>.SliceArray ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 93.00969172596962 < 134.84145882220548. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.035288050663885 (T) = (0 -94.22287481408978) / Math.Sqrt((359.66867102205987 / (299)) + (2.005705497918233 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12446832002023847 = (107.61789318265194 - 94.22287481408978) / 107.61789318265194 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Byte>.FirstMemory ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 69.62213125278817 < 95.30848369999065. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.518879439769028 (T) = (0 -69.33025829056959) / Math.Sqrt((182.40773585279754 / (299)) + (0.9797922537385547 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08870437616064075 = (76.07877891312133 - 69.33025829056959) / 76.07877891312133 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Byte>.FirstTenSegments ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 47.114685557726595 < 68.71190552493923. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.387066676937222 (T) = (0 -48.01361003124203) / Math.Sqrt((116.1614047232949 / (299)) + (0.7000421495736637 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09962423444372095 = (53.326190983803066 - 48.01361003124203) / 53.326190983803066 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Byte>.FirstArray ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 61.780860737693956 < 85.93940798939178. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.863716643908281 (T) = (0 -62.00662771650703) / Math.Sqrt((169.84811956310364 / (299)) + (6.117782115733003 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08349255922182927 = (67.65534567167248 - 62.00662771650703) / 67.65534567167248 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Byte>.IterateTryGetTenSegments ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.262388059839834 < 2.4764819338203257. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.37595219697343 (T) = (0 -2163.301406226025) / Math.Sqrt((28498.95552430887 / (299)) + (698.2263400955936 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.05611892682389 = (2291.9215859966657 - 2163.301406226025) / 2291.9215859966657 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Byte>.IterateTryGetMemory ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 386.9465253544166 < 471.0978056522486. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.648567143204788 (T) = (0 -388.6677660342546) / Math.Sqrt((1736.1020171750151 / (299)) + (108.28752264540101 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08302215635883071 = (423.8573142519108 - 388.6677660342546) / 423.8573142519108 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Byte>.FirstSpanArray ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 70.2300605430442 < 99.39064130043774. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.545111373645243 (T) = (0 -71.57331882874999) / Math.Sqrt((216.0764196169868 / (299)) + (3.5848852621137874 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.0958170548277171 = (79.15800581165841 - 71.57331882874999) / 79.15800581165841 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Byte>.IterateForEachTenSegments ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.318067353233831 < 2.693709816255179. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.999568081597282 (T) = (0 -2361.422890095285) / Math.Sqrt((33654.32302524307 / (299)) + (939.5018468647133 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.06323232079458767 = (2520.820201758346 - 2361.422890095285) / 2520.820201758346 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Byte>.IterateTryGetSingleSegment ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 273.6301046281527 < 334.4753362113475. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.205700437474745 (T) = (0 -276.14963983882) / Math.Sqrt((928.6907859204553 / (299)) + (31.298315188689237 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08386960370735333 = (301.430496091309 - 276.14963983882) / 301.430496091309 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Byte>.IterateGetPositionArray ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 634.035340251968 < 872.636510456666. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.366138694910699 (T) = (0 -650.5430691280299) / Math.Sqrt((10570.74305285935 / (299)) + (601.9544581211477 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.11475052902249776 = (734.8697632201836 - 650.5430691280299) / 734.8697632201836 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Byte>.IterateForEachMemory ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 441.71255557650534 < 517.548346188612. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.45634915445436 (T) = (0 -447.03856570407424) / Math.Sqrt((1172.389513589541 / (299)) + (96.51368957521989 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08489674389056559 = (488.5116108150032 - 447.03856570407424) / 488.5116108150032 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Byte>.IterateGetPositionTenSegments ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 949.6610430638351 < 1.316079771272516. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.555899134682363 (T) = (0 -965.3160047120912) / Math.Sqrt((26461.4415492475 / (299)) + (402.92702588599747 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12078142304544469 = (1097.92494154953 - 965.3160047120912) / 1097.92494154953 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in System.Numerics.Tests.Perf_Vector4

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[TransformVector2ByMatrix4x4Benchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector4.TransformVector2ByMatrix4x4Benchmark.html>)	77.99 ns	47.92 ns	0.61	0.24	False
[AbsBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector4.AbsBenchmark.html>)	77.74 ns	45.31 ns	0.58	0.14	False
[MinBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector4.MinBenchmark.html>)	58.97 ns	38.49 ns	0.65	0.21	False
[DistanceSquaredJitOptimizeCanaryBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector4.DistanceSquaredJitOptimizeCanaryBenchmark.html>)	63.85 ns	40.49 ns	0.63	0.18	False
[DistanceSquaredBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector4.DistanceSquaredBenchmark.html>)	61.85 ns	40.60 ns	0.66	0.19	False
[MultiplyByScalarOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector4.MultiplyByScalarOperatorBenchmark.html>)	68.25 ns	52.83 ns	0.77	0.22	False
[NegateOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector4.NegateOperatorBenchmark.html>)	40.67 ns	27.18 ns	0.67	0.27	False
[DistanceBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector4.DistanceBenchmark.html>)	64.74 ns	42.09 ns	0.65	0.19	False
[TransformVector3ByQuaternionBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector4.TransformVector3ByQuaternionBenchmark.html>)	157.34 ns	103.91 ns	0.66	0.19	False
[AddOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector4.AddOperatorBenchmark.html>)	40.02 ns	29.98 ns	0.75	0.31	False
[MultiplyFunctionBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector4.MultiplyFunctionBenchmark.html>)	41.78 ns	28.30 ns	0.68	0.23	False
[OneBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector4.OneBenchmark.html>)	36.49 ns	32.58 ns	0.89	0.25	False
[TransformByMatrix4x4Benchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector4.TransformByMatrix4x4Benchmark.html>)	118.64 ns	70.56 ns	0.59	0.21	False
[DotBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector4.DotBenchmark.html>)	30.05 ns	17.26 ns	0.57	0.30	False
[TransformByQuaternionBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector4.TransformByQuaternionBenchmark.html>)	157.01 ns	96.01 ns	0.61	0.16	False
[ClampBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector4.ClampBenchmark.html>)	115.29 ns	75.45 ns	0.65	0.15	False
[GetHashCodeBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector4.GetHashCodeBenchmark.html>)	400.94 ns	288.43 ns	0.72	0.02	False
[TransformVector2ByQuaternionBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector4.TransformVector2ByQuaternionBenchmark.html>)	134.74 ns	83.51 ns	0.62	0.16	False
[NegateBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector4.NegateBenchmark.html>)	41.75 ns	29.52 ns	0.71	0.31	False
[AddFunctionBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector4.AddFunctionBenchmark.html>)	40.93 ns	28.85 ns	0.70	0.27	False
[MaxBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector4.MaxBenchmark.html>)	62.16 ns	39.09 ns	0.63	0.21	False
[LerpBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector4.LerpBenchmark.html>)	183.69 ns	148.89 ns	0.81	0.16	False
[LengthSquaredBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector4.LengthSquaredBenchmark.html>)	29.69 ns	18.56 ns	0.63	0.31	False
[SubtractFunctionBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector4.SubtractFunctionBenchmark.html>)	40.60 ns	28.25 ns	0.70	0.27	False
[MultiplyOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector4.MultiplyOperatorBenchmark.html>)	41.93 ns	31.46 ns	0.75	0.26	False
[MultiplyByScalarBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector4.MultiplyByScalarBenchmark.html>)	73.46 ns	51.99 ns	0.71	0.12	False
[TransformVector3ByMatrix4x4Benchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector4.TransformVector3ByMatrix4x4Benchmark.html>)	118.99 ns	69.39 ns	0.58	0.19	False
[LengthBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector4.LengthBenchmark.html>)	32.32 ns	19.32 ns	0.60	0.28	False
[SubtractOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector4.SubtractOperatorBenchmark.html>)	40.81 ns	28.78 ns	0.71	0.20	False
[EqualityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector4.EqualityOperatorBenchmark.html>)	12.84 ns	10.08 ns	0.79	0.35	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_Vector4*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_Vector4.TransformVector2ByMatrix4x4Benchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 47.916041894295894 < 75.32739423408398. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 18.793256860668624 (T) = (0 -48.91990274363579) / Math.Sqrt((108.05891461647848 / (299)) + (9.102355704014746 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.21854595118580533 = (62.6011251945889 - 48.91990274363579) / 62.6011251945889 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector4.AbsBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 45.310368119837705 < 73.80650590535396. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 81.49014906145933 (T) = (0 -46.24930367214075) / Math.Sqrt((84.55187775501085 / (299)) + (3.437569225088629 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.5082797747865067 = (94.05613456729462 - 46.24930367214075) / 94.05613456729462 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector4.MinBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 38.49286959881728 < 56.756541596578. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.568374048580804 (T) = (0 -38.984610002483166) / Math.Sqrt((80.88242977224108 / (299)) + (0.9721702434587988 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1055367854653131 = (43.58436363731687 - 38.984610002483166) / 43.58436363731687 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector4.DistanceSquaredJitOptimizeCanaryBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 40.491935111978066 < 59.745676086550304. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.90478036129056 (T) = (0 -41.42638147149688) / Math.Sqrt((83.06806608467987 / (299)) + (3.759100282190525 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11209552407621515 = (46.65634941010569 - 41.42638147149688) / 46.65634941010569 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector4.DistanceSquaredBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 40.59647491202805 < 59.73686082604836. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.003755819021857 (T) = (0 -41.707283262650044) / Math.Sqrt((84.0030114960217 / (299)) + (4.872073670004574 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10426845281394778 = (46.56225784798337 - 41.707283262650044) / 46.56225784798337 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector4.MultiplyByScalarOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 52.83099147174399 < 64.30167288328559. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.843122187226418 (T) = (0 -53.06347031774327) / Math.Sqrt((56.4595265090804 / (299)) + (3.760102577867585 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.0698913099513422 = (57.05082737692441 - 53.06347031774327) / 57.05082737692441 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector4.NegateOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 27.182873593453742 < 38.67480263463036. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.869137526257004 (T) = (0 -28.118255344846112) / Math.Sqrt((33.970332924976404 / (299)) + (1.1292380220611908 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.08212653546042745 = (30.634130336201522 - 28.118255344846112) / 30.634130336201522 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector4.DistanceBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 42.08841934713603 < 61.380901190979294. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.641683473940835 (T) = (0 -42.571755882234676) / Math.Sqrt((84.74566509744801 / (299)) + (1.7982815341306249 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1231272726760175 = (48.54952669374729 - 42.571755882234676) / 48.54952669374729 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector4.TransformVector3ByQuaternionBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 103.90791426455357 < 148.55519303467037. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.22120271752461 (T) = (0 -98.44123427488923) / Math.Sqrt((604.9114341622015 / (299)) + (20.700302764022464 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12655923923686188 = (112.70510685679434 - 98.44123427488923) / 112.70510685679434 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector4.AddOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 29.984587437473834 < 38.85481622476642. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.034230633359805 (T) = (0 -28.612190031349286) / Math.Sqrt((31.505179171713078 / (299)) + (0.5132276576913205 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09660493525997411 = (31.671846734720813 - 28.612190031349286) / 31.671846734720813 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector4.MultiplyFunctionBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 28.30056557919268 < 38.769776417398674. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.460390901770711 (T) = (0 -28.840400557946083) / Math.Sqrt((31.1521093383116 / (299)) + (1.4459379975042235 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08531346546842385 = (31.530365288164713 - 28.840400557946083) / 31.530365288164713 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector4.OneBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 32.57775336021232 < 34.72145028482357. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.685495240487976 (T) = (0 -31.89282030289862) / Math.Sqrt((4.500547925246362 / (299)) + (1.3874613517282979 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.06300513694034537 = (34.037348079749435 - 31.89282030289862) / 34.037348079749435 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector4.TransformByMatrix4x4Benchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 70.55945644718794 < 112.65069154944834. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.32542291420166 (T) = (0 -70.69439059881391) / Math.Sqrt((278.63984218400486 / (299)) + (3.341968560287618 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.19625450952597115 = (87.95618941155134 - 70.69439059881391) / 87.95618941155134 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector4.DotBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.26482022136049 < 27.53791708987587. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.822636541227515 (T) = (0 -17.650026056522993) / Math.Sqrt((25.523427728700913 / (299)) + (2.202962039248557 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13532986556900115 = (20.412438632609526 - 17.650026056522993) / 20.412438632609526 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector4.TransformByQuaternionBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 96.01095258682808 < 148.95806089451554. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.911889123511253 (T) = (0 -98.31134452556908) / Math.Sqrt((628.1849655916897 / (299)) + (17.43153738612345 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.12367354426888354 = (112.18575438710022 - 98.31134452556908) / 112.18575438710022 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector4.ClampBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 75.44945575385684 < 110.61908511114623. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.221428026130914 (T) = (0 -77.21508760184717) / Math.Sqrt((279.3155862379022 / (299)) + (10.964348184777526 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10167405412593034 = (85.95442217436681 - 77.21508760184717) / 85.95442217436681 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector4.GetHashCodeBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 288.43295086592155 < 380.75056292788287. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.914633514528704 (T) = (0 -282.4409608883523) / Math.Sqrt((2155.3719738504165 / (299)) + (19.854930764311323 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10395262465088405 = (315.20762033180256 - 282.4409608883523) / 315.20762033180256 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector4.TransformVector2ByQuaternionBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 83.51302109262532 < 126.98633420190221. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.918354921094155 (T) = (0 -84.90704679161) / Math.Sqrt((427.0366428241594 / (299)) + (7.840090519453287 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12761642672249215 = (97.32765424802515 - 84.90704679161) / 97.32765424802515 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector4.NegateBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 29.516197941903727 < 39.16181193138165. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.316633405781008 (T) = (0 -28.271199189471602) / Math.Sqrt((34.53471932264605 / (299)) + (1.761585087814464 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07903577501013515 = (30.69739130179864 - 28.271199189471602) / 30.69739130179864 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector4.AddFunctionBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 28.851398965175967 < 38.79334092473141. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.437736422820551 (T) = (0 -28.797652627423066) / Math.Sqrt((30.040330018586722 / (299)) + (1.5608528982459384 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08469065517017683 = (31.462207602367705 - 28.797652627423066) / 31.462207602367705 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector4.MaxBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 39.09308292261743 < 57.90544950568458. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.532476815107625 (T) = (0 -39.464578485737356) / Math.Sqrt((100.53586148698989 / (299)) + (2.268771488519677 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11726088437746464 = (44.70695564216127 - 39.464578485737356) / 44.70695564216127 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector4.LerpBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 148.8901181806098 < 175.35092782658126. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.096997195101377 (T) = (0 -141.86439924978902) / Math.Sqrt((297.2452921240396 / (299)) + (12.177170341351024 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07265047716824677 = (152.97834932463445 - 141.86439924978902) / 152.97834932463445 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector4.LengthSquaredBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 18.55601074489744 < 28.221284942576062. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.283941782732638 (T) = (0 -18.03702466888488) / Math.Sqrt((28.433763895878126 / (299)) + (0.5724294940892352 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12981326661814707 = (20.727763337400734 - 18.03702466888488) / 20.727763337400734 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector4.SubtractFunctionBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 28.247942709656936 < 38.678685243735764. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 5.622125345928975 (T) = (0 -29.045341747326102) / Math.Sqrt((32.34635630421016 / (299)) + (4.224032319962383 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07685287809853383 = (31.463394141877973 - 29.045341747326102) / 31.463394141877973 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector4.MultiplyOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 31.45709785680641 < 38.79363444336036. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.2615939211529135 (T) = (0 -28.956952313274105) / Math.Sqrt((30.44995571853606 / (299)) + (1.56675641734466 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08286626151904761 = (31.573314881246734 - 28.956952313274105) / 31.573314881246734 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector4.MultiplyByScalarBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 51.99373011805271 < 65.18068462589959. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.649163745373757 (T) = (0 -53.44583264338149) / Math.Sqrt((42.251496862339465 / (299)) + (4.683512623431066 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.0558950277845642 = (56.61005313632186 - 53.44583264338149) / 56.61005313632186 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector4.TransformVector3ByMatrix4x4Benchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 69.3870258607756 < 112.36994454362392. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.211311328467843 (T) = (0 -71.24820121644566) / Math.Sqrt((297.37494409008264 / (299)) + (4.587223192041076 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.19109343092096592 = (88.07964224788533 - 71.24820121644566) / 88.07964224788533 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector4.LengthBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 19.32219111225385 < 29.95285683993555. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.042820360058114 (T) = (0 -19.351746405263953) / Math.Sqrt((29.542753220705578 / (299)) + (1.4068209124530666 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14126256767281423 = (22.53511454929891 - 19.351746405263953) / 22.53511454929891 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector4.SubtractOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 28.779750848667117 < 38.834883043765245. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.320055119876697 (T) = (0 -29.004203946648733) / Math.Sqrt((31.19637397177483 / (299)) + (1.4451864584139742 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07287957073924993 = (31.28418167829131 - 29.004203946648733) / 31.28418167829131 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector4.EqualityOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 10.082265369623126 < 13.193341317597499. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 5.42516976997077 (T) = (0 -10.207326184286496) / Math.Sqrt((3.539882189736595 / (299)) + (0.2597377656310638 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.06386764444490259 = (10.903721171173352 - 10.207326184286496) / 10.903721171173352 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Xml.Linq.Perf_XElement

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[GetElement - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Xml.Linq.Perf_XElement.GetElement.html>)	651.41 ns	514.22 ns	0.79	0.17	False
[CreateElement - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Xml.Linq.Perf_XElement.CreateElement.html>)	695.92 ns	542.26 ns	0.78	0.09	False
[CreateWithElements - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Xml.Linq.Perf_XElement.CreateWithElements.html>)	920.63 ns	758.04 ns	0.82	0.05	False
[GetValue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Xml.Linq.Perf_XElement.GetValue.html>)	899.31 ns	700.99 ns	0.78	0.09	False
[GetAttribute - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Xml.Linq.Perf_XElement.GetAttribute.html>)	585.22 ns	435.22 ns	0.74	0.11	False
[GetElementWithNamespace - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Xml.Linq.Perf_XElement.GetElementWithNamespace.html>)	1.37 μs	1.05 μs	0.77	0.04	False
[CreateElementWithNamespace - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Xml.Linq.Perf_XElement.CreateElementWithNamespace.html>)	1.48 μs	1.16 μs	0.78	0.04	False
[CreateElementsWithNamespace - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Xml.Linq.Perf_XElement.CreateElementsWithNamespace.html>)	1.74 μs	1.39 μs	0.80	0.02	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Xml.Linq.Perf_XElement*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Xml.Linq.Perf_XElement.GetElement ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 514.2216229587914 < 615.0094172494124. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.730349874202613 (T) = (0 -514.5548578949376) / Math.Sqrt((2440.510597393197 / (299)) + (195.80308980597644 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10526968713556867 = (575.0949202197227 - 514.5548578949376) / 575.0949202197227 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Xml.Linq.Perf_XElement.CreateElement ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 542.257018924558 < 647.2510569255554. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 21.255353780238345 (T) = (0 -558.6083516334302) / Math.Sqrt((1581.1767902010788 / (299)) + (161.54383967662056 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09810797252537633 = (619.3738658468711 - 558.6083516334302) / 619.3738658468711 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Xml.Linq.Perf_XElement.CreateWithElements ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 758.0447037597718 < 881.1815570808066. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 20.51027722448377 (T) = (0 -761.0625144389015) / Math.Sqrt((2937.6954784839113 / (299)) + (169.036389054376 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.08824650647650058 = (834.7239904700031 - 761.0625144389015) / 834.7239904700031 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Xml.Linq.Perf_XElement.GetValue ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 700.9927827796389 < 850.5126292286564. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.287941113048316 (T) = (0 -700.2377900172944) / Math.Sqrt((4436.841044552863 / (299)) + (434.0877843331777 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09982949696253096 = (777.8946184689052 - 700.2377900172944) / 777.8946184689052 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Xml.Linq.Perf_XElement.GetAttribute ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 435.2223519624447 < 534.7364121771419. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 20.24731934042188 (T) = (0 -454.71530814228674) / Math.Sqrt((1402.7560903754818 / (299)) + (123.70679442804897 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.10527355806002568 = (508.2171341179529 - 454.71530814228674) / 508.2171341179529 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Xml.Linq.Perf_XElement.GetElementWithNamespace ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.0531671866735657 < 1.310894236342138. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.74894170577354 (T) = (0 -1079.0408132895484) / Math.Sqrt((11365.850015710344 / (299)) + (391.48633440143084 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09950655888302465 = (1198.27726002213 - 1079.0408132895484) / 1198.27726002213 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Xml.Linq.Perf_XElement.CreateElementWithNamespace ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.155260534997422 < 1.4013629046508573. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.934540441194436 (T) = (0 -1168.826227770343) / Math.Sqrt((11029.96754781473 / (299)) + (335.24196621614175 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09140467701528479 = (1286.4101302335291 - 1168.826227770343) / 1286.4101302335291 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Xml.Linq.Perf_XElement.CreateElementsWithNamespace ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.3867806450291875 < 1.6656900318849455. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.10125896049374 (T) = (0 -1407.173665491721) / Math.Sqrt((16573.183522352683 / (299)) + (308.1147332428558 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08664404758035309 = (1540.662938434748 - 1407.173665491721) / 1540.662938434748 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Collections.CreateAddAndClear<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ImmutableSortedDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CreateAddAndClear(String).ImmutableSortedDictionary(Size%3a%20512).html>)	3.25 ms	2.71 ms	0.83	0.01	False
[ConcurrentBag - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CreateAddAndClear(String).ConcurrentBag(Size%3a%20512).html>)	105.28 μs	79.14 μs	0.75	0.07	False
[ICollection - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CreateAddAndClear(String).ICollection(Size%3a%20512).html>)	28.02 μs	22.24 μs	0.79	0.03	False
[SortedSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CreateAddAndClear(String).SortedSet(Size%3a%20512).html>)	1.85 ms	1.51 ms	0.82	0.07	False
[ImmutableQueue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CreateAddAndClear(String).ImmutableQueue(Size%3a%20512).html>)	72.27 μs	62.94 μs	0.87	0.04	False
[ConcurrentQueue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CreateAddAndClear(String).ConcurrentQueue(Size%3a%20512).html>)	74.13 μs	59.58 μs	0.80	0.07	False
[SortedList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CreateAddAndClear(String).SortedList(Size%3a%20512).html>)	1.96 ms	1.58 ms	0.81	0.05	False
[ImmutableHashSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CreateAddAndClear(String).ImmutableHashSet(Size%3a%20512).html>)	2.38 ms	1.96 ms	0.83	0.01	False
[ImmutableList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CreateAddAndClear(String).ImmutableList(Size%3a%20512).html>)	1.13 ms	918.39 μs	0.81	0.03	False
[LinkedList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CreateAddAndClear(String).LinkedList(Size%3a%20512).html>)	74.77 μs	62.37 μs	0.83	0.07	False
[IDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CreateAddAndClear(String).IDictionary(Size%3a%20512).html>)	240.27 μs	170.46 μs	0.71	0.01	False
[HashSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CreateAddAndClear(String).HashSet(Size%3a%20512).html>)	221.65 μs	149.49 μs	0.67	0.02	False
[List - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CreateAddAndClear(String).List(Size%3a%20512).html>)	23.07 μs	16.66 μs	0.72	0.07	False
[Array - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CreateAddAndClear(String).Array(Size%3a%20512).html>)	10.40 μs	8.19 μs	0.79	0.10	False
[ConcurrentStack - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CreateAddAndClear(String).ConcurrentStack(Size%3a%20512).html>)	73.35 μs	61.54 μs	0.84	0.07	False
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CreateAddAndClear(String).Dictionary(Size%3a%20512).html>)	240.19 μs	161.26 μs	0.67	0.02	False
[ImmutableDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CreateAddAndClear(String).ImmutableDictionary(Size%3a%20512).html>)	2.45 ms	1.98 ms	0.81	0.02	False
[Stack - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CreateAddAndClear(String).Stack(Size%3a%20512).html>)	23.78 μs	18.32 μs	0.77	0.06	False
[ImmutableSortedSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CreateAddAndClear(String).ImmutableSortedSet(Size%3a%20512).html>)	3.47 ms	2.68 ms	0.77	0.03	False
[Span - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CreateAddAndClear(String).Span(Size%3a%20512).html>)	8.93 μs	5.89 μs	0.66	0.09	False
[Queue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CreateAddAndClear(String).Queue(Size%3a%20512).html>)	39.35 μs	30.35 μs	0.77	0.04	False
[SortedDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CreateAddAndClear(String).SortedDictionary(Size%3a%20512).html>)	1.99 ms	1.68 ms	0.85	0.04	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.CreateAddAndClear<String>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.CreateAddAndClear<String>.ImmutableSortedDictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.7062380465277776 < 3.0774050501073718. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 24.73893079997923 (T) = (0 -2690217.9181717276) / Math.Sqrt((29034300723.969013 / (299)) + (830946293.6838149 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08866830981941975 = (2951963.535514343 - 2690217.9181717276) / 2951963.535514343 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CreateAddAndClear<String>.ConcurrentBag(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 79.1363119415307 < 96.16068059806369. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.1241075403466 (T) = (0 -79844.88213962373) / Math.Sqrt((57352833.43249992 / (299)) + (3032519.164914336 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09613937676584904 = (88337.60436861005 - 79844.88213962373) / 88337.60436861005 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CreateAddAndClear<String>.ICollection(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 22.24210518465909 < 26.686867248017364. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.678869852861295 (T) = (0 -22310.034500202342) / Math.Sqrt((5725405.888311179 / (299)) + (51484.287357387315 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.06352610677531356 = (23823.445225343337 - 22310.034500202342) / 23823.445225343337 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CreateAddAndClear<String>.SortedSet(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.5118336299107142 < 1.7601493724163104. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.79128089605475 (T) = (0 -1545106.8509171256) / Math.Sqrt((13841491730.767746 / (299)) + (716246448.2425438 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07283593620027015 = (1666486.9910778522 - 1545106.8509171256) / 1666486.9910778522 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CreateAddAndClear<String>.ImmutableQueue(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 62.9389390832561 < 67.2341029530078. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 18.602379919507584 (T) = (0 -63050.493540570096) / Math.Sqrt((5314047.737959305 / (299)) + (1805186.4917499437 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.061894538587746115 = (67210.45355140761 - 63050.493540570096) / 67210.45355140761 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CreateAddAndClear<String>.ConcurrentQueue(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 59.57989898584906 < 70.77034743303572. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.186173074066472 (T) = (0 -59159.1907229011) / Math.Sqrt((36455987.91483209 / (299)) + (819416.4774013162 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08140085062711583 = (64401.53005071724 - 59159.1907229011) / 64401.53005071724 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CreateAddAndClear<String>.SortedList(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.5795157379807692 < 1.786794679680886. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.420249549705414 (T) = (0 -1589612.175194086) / Math.Sqrt((9879849576.901274 / (299)) + (1093902971.6591134 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07361281927127857 = (1715926.351597022 - 1589612.175194086) / 1715926.351597022 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CreateAddAndClear<String>.ImmutableHashSet(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.96336941796875 < 2.258346025148809. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 25.395005934494126 (T) = (0 -1954689.0156740663) / Math.Sqrt((18037793628.016357 / (299)) + (395821319.66686004 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09645985447538591 = (2163367.0903899167 - 1954689.0156740663) / 2163367.0903899167 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CreateAddAndClear<String>.ImmutableList(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 918.3907987745099 < 1.0764871678826529. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 22.02076523017845 (T) = (0 -900932.5654950782) / Math.Sqrt((5146745065.861279 / (299)) + (266441628.50892788 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10279192557454515 = (1004151.2010154483 - 900932.5654950782) / 1004151.2010154483 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CreateAddAndClear<String>.LinkedList(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 62.37226017065092 < 70.75384100290249. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.904603080295363 (T) = (0 -63655.72354523867) / Math.Sqrt((13965716.36578661 / (299)) + (1294721.0055209182 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.05826740405424632 = (67594.2659511654 - 63655.72354523867) / 67594.2659511654 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CreateAddAndClear<String>.IDictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 170.46012204301078 < 229.21608276976494. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.62173313809673 (T) = (0 -164722.76151332416) / Math.Sqrt((918112244.2332793 / (299)) + (3973974.747465297 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12785820913322696 = (188871.53813557702 - 164722.76151332416) / 188871.53813557702 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CreateAddAndClear<String>.HashSet(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 149.48677607142852 < 211.3721636622585. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.569110270437097 (T) = (0 -148589.96053444303) / Math.Sqrt((824209490.8747485 / (299)) + (1986109.7340357415 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.13241450613185263 = (171268.37825739998 - 148589.96053444303) / 171268.37825739998 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CreateAddAndClear<String>.List(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 16.664891250921603 < 21.80977794193501. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.391769898793086 (T) = (0 -16853.741524918216) / Math.Sqrt((6716777.393935995 / (299)) + (1689284.880968866 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08004052638036807 = (18320.091273810387 - 16853.741524918216) / 18320.091273810387 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CreateAddAndClear<String>.Array(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 8.187833931408898 < 9.89853936377598. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.988481853846999 (T) = (0 -8329.087503495233) / Math.Sqrt((693173.8893756305 / (299)) + (17589.565489328714 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.07423294663361675 = (8996.958223138341 - 8329.087503495233) / 8996.958223138341 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CreateAddAndClear<String>.ConcurrentStack(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 61.53916123007969 < 68.28663330046255. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.358534167501013 (T) = (0 -62309.57071116382) / Math.Sqrt((11679433.083822457 / (299)) + (1485574.0203109495 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.055727637874466475 = (65986.86270019227 - 62309.57071116382) / 65986.86270019227 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CreateAddAndClear<String>.Dictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 161.25735065353462 < 228.52751146079882. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.615012448544652 (T) = (0 -162578.5769692889) / Math.Sqrt((907152014.5008092 / (299)) + (3151337.6018680655 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12832325928965357 = (186512.46428440942 - 162578.5769692889) / 186512.46428440942 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CreateAddAndClear<String>.ImmutableDictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.9839603876201923 < 2.327318717168899. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 22.569778565374776 (T) = (0 -2004351.1519146706) / Math.Sqrt((21112095364.224285 / (299)) + (589616908.2448664 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09208916527467254 = (2207651.9799667904 - 2004351.1519146706) / 2207651.9799667904 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CreateAddAndClear<String>.Stack(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 18.31900461606096 < 22.318851422169484. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 18.763322439296918 (T) = (0 -18578.611162328074) / Math.Sqrt((3139140.4422096796 / (299)) + (66207.82642058418 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.0984116040283212 = (20606.533142327262 - 18578.611162328074) / 20606.533142327262 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CreateAddAndClear<String>.ImmutableSortedSet(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.6822420163690475 < 3.0383053293526787. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 22.107707234731762 (T) = (0 -2648532.8840238918) / Math.Sqrt((30659703034.824554 / (299)) + (1012470701.0033334 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.08408088337721503 = (2891666.7814399074 - 2648532.8840238918) / 2891666.7814399074 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CreateAddAndClear<String>.Span(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.885487749073216 < 8.48936435082476. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.868476292350662 (T) = (0 -5933.6729050265985) / Math.Sqrt((1346968.4602797213 / (299)) + (9544.141811382751 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.13783133527273414 = (6882.264628468754 - 5933.6729050265985) / 6882.264628468754 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CreateAddAndClear<String>.Queue(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 30.348460543971928 < 36.76386590618892. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.353174943341223 (T) = (0 -30449.730793707484) / Math.Sqrt((6976890.187503022 / (299)) + (1054996.8490930418 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10515256617754018 = (34027.84613644966 - 30449.730793707484) / 34027.84613644966 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CreateAddAndClear<String>.SortedDictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.6821422833333335 < 1.8896664548558408. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 19.705831276457108 (T) = (0 -1650278.2862902458) / Math.Sqrt((13134368057.233639 / (299)) + (633536126.9402121 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.0815153585225269 = (1796740.2085631073 - 1650278.2862902458) / 1796740.2085631073 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Threading.Tests.Perf_CancellationToken

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[CreateLinkedTokenSource1 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Threading.Tests.Perf_CancellationToken.CreateLinkedTokenSource1.html>)	713.30 ns	599.99 ns	0.84	0.02	False
[RegisterAndUnregister_Serial - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Threading.Tests.Perf_CancellationToken.RegisterAndUnregister_Serial.html>)	440.91 ns	371.13 ns	0.84	0.09	False
[CreateManyRegisterMultipleDispose - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Threading.Tests.Perf_CancellationToken.CreateManyRegisterMultipleDispose.html>)	2.02 μs	1.60 μs	0.80	0.07	False
[CancelAfter - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Threading.Tests.Perf_CancellationToken.CancelAfter.html>)	1.45 μs	1.20 μs	0.83	0.16	False
[CreateLinkedTokenSource2 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Threading.Tests.Perf_CancellationToken.CreateLinkedTokenSource2.html>)	1.11 μs	957.53 ns	0.86	0.02	False
[CreateLinkedTokenSource3 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Threading.Tests.Perf_CancellationToken.CreateLinkedTokenSource3.html>)	1.63 μs	1.40 μs	0.86	0.04	False
[CreateRegisterDispose - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Threading.Tests.Perf_CancellationToken.CreateRegisterDispose.html>)	854.08 ns	744.06 ns	0.87	0.08	False
[Cancel - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Threading.Tests.Perf_CancellationToken.Cancel.html>)	1.04 μs	868.66 ns	0.83	0.06	False
[CreateManyRegisterDispose - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Threading.Tests.Perf_CancellationToken.CreateManyRegisterDispose.html>)	409.15 ns	323.81 ns	0.79	0.15	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Threading.Tests.Perf_CancellationToken*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Threading.Tests.Perf_CancellationToken.CreateLinkedTokenSource1 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 599.9929617995941 < 669.8990268170102. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 19.15866588520305 (T) = (0 -602.9628644437923) / Math.Sqrt((920.394089237728 / (299)) + (96.2782625040545 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.06506723883262344 = (644.9264476419891 - 602.9628644437923) / 644.9264476419891 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Threading.Tests.Perf_CancellationToken.RegisterAndUnregister_Serial ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 371.13340760636703 < 420.39479932356573. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 18.6664541612244 (T) = (0 -371.3555938763826) / Math.Sqrt((636.3315128859722 / (299)) + (54.227911478271594 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08126464773458884 = (404.2030090174462 - 371.3555938763826) / 404.2030090174462 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Threading.Tests.Perf_CancellationToken.CreateManyRegisterMultipleDispose ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.6046612181333335 < 1.889984373317857. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 19.550390692111655 (T) = (0 -1603.929322714812) / Math.Sqrt((16286.421533917803 / (299)) + (1206.746987231517 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09606548411576571 = (1774.3866336886567 - 1603.929322714812) / 1774.3866336886567 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Threading.Tests.Perf_CancellationToken.CancelAfter ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.2047673927326545 < 1.3579176606833447. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 18.780122202834377 (T) = (0 -1216.481176107371) / Math.Sqrt((3884.783686861203 / (299)) + (764.5818556964266 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.0741264198903694 = (1313.873948064627 - 1216.481176107371) / 1313.873948064627 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Threading.Tests.Perf_CancellationToken.CreateLinkedTokenSource2 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 957.5336594677716 < 1.0607442633599782. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 18.926121910548034 (T) = (0 -957.8188943071646) / Math.Sqrt((3011.603429301172 / (299)) + (173.3511152477738 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.06717643746408015 = (1026.7953477754077 - 957.8188943071646) / 1026.7953477754077 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Threading.Tests.Perf_CancellationToken.CreateLinkedTokenSource3 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.3982883830419897 < 1.5646566629768281. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 18.570350642757532 (T) = (0 -1372.5821494104068) / Math.Sqrt((7923.124395799176 / (299)) + (185.64053371423464 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.06879182991770001 = (1473.9799257657912 - 1372.5821494104068) / 1473.9799257657912 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Threading.Tests.Perf_CancellationToken.CreateRegisterDispose ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 744.0571005301175 < 811.7082816444143. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 25.316857504551002 (T) = (0 -729.0327982944165) / Math.Sqrt((1500.8423589258157 / (299)) + (109.43640698464284 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08400220651899566 = (795.8892515711447 - 729.0327982944165) / 795.8892515711447 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Threading.Tests.Perf_CancellationToken.Cancel ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 868.6594302493401 < 0.9805288662784043. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 25.636571358546156 (T) = (0 -877.7939561276885) / Math.Sqrt((2011.6797976457653 / (299)) + (222.32350359534396 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.08746424900767773 = (961.928291766263 - 877.7939561276885) / 961.928291766263 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Threading.Tests.Perf_CancellationToken.CreateManyRegisterDispose ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 323.81381839999995 < 381.35671476. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 18.31150204782156 (T) = (0 -315.7275603007751) / Math.Sqrt((761.0277615343759 / (299)) + (70.91460040341046 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.101713502858272 = (351.47757570150907 - 315.7275603007751) / 351.47757570150907 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in System.IO.Tests.Perf_File

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[CopyTo - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_File.CopyTo(size%3a%204096).html>)	46.70 μs	43.98 μs	0.94	0.02	False
[CopyToOverwrite - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_File.CopyToOverwrite(size%3a%204096).html>)	48.72 μs	44.75 μs	0.92	0.25	False
[AppendAllTextAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_File.AppendAllTextAsync(size%3a%2010000).html>)	169.73 μs	122.88 μs	0.72	0.03	False
[WriteAllTextAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_File.WriteAllTextAsync(size%3a%2010000).html>)	251.55 μs	185.67 μs	0.74	0.06	False
[WriteAllTextAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_File.WriteAllTextAsync(size%3a%20100000).html>)	1.74 ms	1.15 ms	0.66	0.18	False
[CopyTo - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_File.CopyTo(size%3a%20512).html>)	48.42 μs	42.79 μs	0.88	0.03	False
[CopyToOverwrite - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_File.CopyToOverwrite(size%3a%20512).html>)	48.94 μs	44.63 μs	0.91	0.28	False
[WriteAllText - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_File.WriteAllText(size%3a%2010000).html>)	175.51 μs	118.13 μs	0.67	0.03	False
[WriteAllText - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_File.WriteAllText(size%3a%20100000).html>)	1.39 ms	843.19 μs	0.61	0.11	False
[AppendAllText - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_File.AppendAllText(size%3a%2010000).html>)	120.83 μs	83.88 μs	0.69	0.06	False
[ReadAllLines - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_File.ReadAllLines.html>)	169.37 μs	135.26 μs	0.80	0.02	False
[AppendAllLines - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_File.AppendAllLines.html>)	53.43 μs	44.19 μs	0.83	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Tests.Perf_File*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.IO.Tests.Perf_File.CopyTo(size: 4096) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 43.981910221064346 < 45.129422589685824. IsChangePoint: Marked as a change because one of 4/27/2022 1:24:17 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.383759617912034 (T) = (0 -43202.813038184555) / Math.Sqrt((5379900.110307229 / (299)) + (435242.8821113648 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.05768047824642199 = (45847.30767095616 - 43202.813038184555) / 45847.30767095616 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_File.CopyToOverwrite(size: 4096) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 44.746200590077066 < 46.53583133165805. IsChangePoint: Marked as a change because one of 4/27/2022 1:24:17 PM, 5/25/2022 8:13:38 AM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.478446572713223 (T) = (0 -45711.89412080007) / Math.Sqrt((5764728.414258763 / (299)) + (2593400.713438465 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.05042639253306625 = (48139.38989178557 - 45711.89412080007) / 48139.38989178557 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_File.AppendAllTextAsync(size: 10000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 122.88274496428572 < 160.2305381392857. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.134972924919657 (T) = (0 -122908.49833931723) / Math.Sqrt((381761880.082115 / (299)) + (2805296.4524410027 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07888688534260685 = (133434.750177271 - 122908.49833931723) / 133434.750177271 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_File.WriteAllTextAsync(size: 10000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 185.67260089285716 < 243.07869683381932. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.079388442183479 (T) = (0 -185689.2734256071) / Math.Sqrt((958481182.5502672 / (299)) + (6733695.184597604 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08187028082750013 = (202247.31815997284 - 185689.2734256071) / 202247.31815997284 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_File.WriteAllTextAsync(size: 100000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.1463501576236266 < 1.6548252569294204. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 4.852236596368303 (T) = (0 -1182084.624519243) / Math.Sqrt((148611032156.9189 / (299)) + (49273131577.03085 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1321824226310203 = (1362134.9179202472 - 1182084.624519243) / 1362134.9179202472 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_File.CopyTo(size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 42.793200034340664 < 45.612974902360136. IsChangePoint: Marked as a change because one of 4/27/2022 1:24:17 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.312028189757157 (T) = (0 -43309.19568222983) / Math.Sqrt((5391815.110674215 / (299)) + (306357.11477573763 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.054699211014921485 = (45815.253924339486 - 43309.19568222983) / 45815.253924339486 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_File.CopyToOverwrite(size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 44.62595226156365 < 46.49664155892506. IsChangePoint: Marked as a change because one of 4/28/2022 7:34:39 PM, 5/25/2022 10:02:21 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.240415075798227 (T) = (0 -45518.448487324946) / Math.Sqrt((5468204.571889588 / (299)) + (2247033.1746028406 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.056652608176776344 = (48252.053148046194 - 45518.448487324946) / 48252.053148046194 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_File.WriteAllText(size: 10000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 118.13170134711778 < 166.78812442085504. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.90078933585084 (T) = (0 -118762.9025052461) / Math.Sqrt((553476513.2520143 / (299)) + (766826.8136851437 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1113800999369514 = (133648.70907889833 - 118762.9025052461) / 133648.70907889833 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_File.WriteAllText(size: 100000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 843.1859436431622 < 1.326090357122565. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.899559199718587 (T) = (0 -848830.6074945647) / Math.Sqrt((53323179609.9874 / (299)) + (403245974.0513862 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1371242105166664 = (983722.8229602099 - 848830.6074945647) / 983722.8229602099 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_File.AppendAllText(size: 10000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 83.87519012499999 < 114.63394669230767. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.589150795040585 (T) = (0 -81110.74988722522) / Math.Sqrt((279352701.5592273 / (299)) + (2072405.117412454 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10435509571140847 = (90561.28103765775 - 81110.74988722522) / 90561.28103765775 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_File.ReadAllLines ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 135.25607338362067 < 162.29081812047104. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.264463235086623 (T) = (0 -134672.97795476468) / Math.Sqrt((221806865.28885967 / (299)) + (764292.4744529625 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.062131034668915675 = (143594.66293590676 - 134672.97795476468) / 143594.66293590676 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_File.AppendAllLines ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 44.18996582051282 < 50.376888249791655. IsChangePoint: Marked as a change because one of 4/27/2022 1:24:17 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.280453293770291 (T) = (0 -44602.683985458636) / Math.Sqrt((11751522.362651164 / (299)) + (109801.01764388685 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.052966547484331966 = (47097.26342504328 - 44602.683985458636) / 47097.26342504328 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Text.Json.Tests.Perf_Depth

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ReadSpanEmptyLoop - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Depth.ReadSpanEmptyLoop(Depth%3a%201).html>)	1.59 μs	1.15 μs	0.72	0.05	False
[ReadSpanEmptyLoop - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Depth.ReadSpanEmptyLoop(Depth%3a%2065).html>)	54.89 μs	37.92 μs	0.69	0.05	False
[ReadSpanEmptyLoop - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Depth.ReadSpanEmptyLoop(Depth%3a%2064).html>)	52.80 μs	36.84 μs	0.70	0.08	False
[ReadSpanEmptyLoop - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Depth.ReadSpanEmptyLoop(Depth%3a%20512).html>)	468.44 μs	316.30 μs	0.68	0.07	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Tests.Perf_Depth*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Tests.Perf_Depth.ReadSpanEmptyLoop(Depth: 1) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.1483787579755598 < 1.5096169402436639. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.470202929845787 (T) = (0 -1150.5203247817747) / Math.Sqrt((40152.76081638536 / (299)) + (432.05196179323156 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07181651797541064 = (1239.539753791153 - 1150.5203247817747) / 1239.539753791153 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Depth.ReadSpanEmptyLoop(Depth: 65) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 37.91959434738956 < 52.27065229675273. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.523582750811121 (T) = (0 -37381.57309096746) / Math.Sqrt((57391139.78981055 / (299)) + (636417.1459749889 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.0831992725394286 = (40773.934805342 - 37381.57309096746) / 40773.934805342 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Depth.ReadSpanEmptyLoop(Depth: 64) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 36.8421067986482 < 50.62475801960391. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.195970954829291 (T) = (0 -36801.629705176856) / Math.Sqrt((54735820.11318617 / (299)) + (783870.5285160834 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.0798679341942073 = (39996.02999700738 - 36801.629705176856) / 39996.02999700738 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Depth.ReadSpanEmptyLoop(Depth: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 316.29955850000005 < 436.13519909016105. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.159004738844184 (T) = (0 -317294.9411353899) / Math.Sqrt((3881228282.69339 / (299)) + (31728975.722669832 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08646227614775072 = (347325.4939023268 - 317294.9411353899) / 347325.4939023268 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in System.Collections.Tests.Perf_BitArray

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[BitArrayCopyToIntArray - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayCopyToIntArray(Size%3a%204).html>)	205.12 ns	159.58 ns	0.78	0.17	False
[BitArrayLeftShift - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayLeftShift(Size%3a%204).html>)	121.57 ns	75.58 ns	0.62	0.17	False
[BitArrayOr - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayOr(Size%3a%20512).html>)	1.69 μs	1.16 μs	0.69	0.33	False
[BitArrayGet - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayGet(Size%3a%20512).html>)	137.41 μs	76.31 μs	0.56	0.12	False
[BitArrayCopyToBoolArray - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayCopyToBoolArray(Size%3a%20512).html>)	139.03 μs	84.14 μs	0.61	0.06	False
[BitArraySetAll - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArraySetAll(Size%3a%204).html>)	114.55 ns	76.09 ns	0.66	0.23	False
[BitArrayLengthValueCtor - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayLengthValueCtor(Size%3a%204).html>)	201.94 ns	159.11 ns	0.79	0.12	False
[BitArrayByteArrayCtor - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayByteArrayCtor(Size%3a%204).html>)	213.68 ns	165.07 ns	0.77	0.12	False
[BitArrayXor - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayXor(Size%3a%20512).html>)	1.69 μs	1.16 μs	0.68	0.31	False
[BitArrayAnd - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayAnd(Size%3a%204).html>)	71.49 ns	47.04 ns	0.66	0.23	False
[BitArrayCopyToBoolArray - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayCopyToBoolArray(Size%3a%204).html>)	1.30 μs	842.72 ns	0.65	0.09	False
[BitArraySetLengthGrow - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArraySetLengthGrow(Size%3a%20512).html>)	7.93 μs	5.18 μs	0.65	0.10	False
[BitArraySet - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArraySet(Size%3a%204).html>)	171.82 ns	100.38 ns	0.58	0.07	False
[BitArrayGet - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayGet(Size%3a%204).html>)	1.17 μs	616.68 ns	0.53	0.16	False
[BitArraySetAll - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArraySetAll(Size%3a%20512).html>)	805.08 ns	526.58 ns	0.65	0.16	False
[BitArrayBoolArrayCtor - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayBoolArrayCtor(Size%3a%204).html>)	203.34 ns	168.72 ns	0.83	0.13	False
[BitArrayLengthCtor - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayLengthCtor(Size%3a%204).html>)	109.46 ns	97.48 ns	0.89	0.08	False
[BitArraySetLengthGrow - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArraySetLengthGrow(Size%3a%204).html>)	452.93 ns	335.04 ns	0.74	0.10	False
[BitArrayCopyToIntArray - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayCopyToIntArray(Size%3a%20512).html>)	213.86 ns	172.69 ns	0.81	0.13	False
[BitArrayCopyToByteArray - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayCopyToByteArray(Size%3a%204).html>)	203.33 ns	147.38 ns	0.72	0.22	False
[BitArrayBoolArrayCtor - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayBoolArrayCtor(Size%3a%20512).html>)	12.14 μs	8.24 μs	0.68	0.06	False
[BitArrayNot - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayNot(Size%3a%20512).html>)	1.21 μs	701.17 ns	0.58	0.06	False
[BitArrayLengthCtor - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayLengthCtor(Size%3a%20512).html>)	121.75 ns	104.70 ns	0.86	0.11	False
[BitArrayRightShift - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayRightShift(Size%3a%204).html>)	149.16 ns	90.47 ns	0.61	0.16	False
[BitArrayNot - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayNot(Size%3a%204).html>)	40.91 ns	31.51 ns	0.77	0.24	False
[BitArrayOr - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayOr(Size%3a%204).html>)	68.73 ns	48.32 ns	0.70	0.23	False
[BitArrayLeftShift - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayLeftShift(Size%3a%20512).html>)	4.35 μs	2.50 μs	0.57	0.10	False
[BitArraySet - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArraySet(Size%3a%20512).html>)	27.96 μs	11.87 μs	0.42	0.11	False
[BitArrayAnd - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayAnd(Size%3a%20512).html>)	1.70 μs	1.16 μs	0.68	0.33	False
[BitArrayCopyToByteArray - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayCopyToByteArray(Size%3a%20512).html>)	7.37 μs	4.79 μs	0.65	0.13	False
[BitArraySetLengthShrink - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArraySetLengthShrink(Size%3a%20512).html>)	7.48 μs	4.79 μs	0.64	0.10	False
[BitArrayRightShift - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayRightShift(Size%3a%20512).html>)	4.62 μs	2.53 μs	0.55	0.09	False
[BitArrayByteArrayCtor - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayByteArrayCtor(Size%3a%20512).html>)	7.87 μs	4.77 μs	0.61	0.10	False
[BitArraySetLengthShrink - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArraySetLengthShrink(Size%3a%204).html>)	258.97 ns	197.33 ns	0.76	0.12	False
[BitArrayXor - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayXor(Size%3a%204).html>)	83.25 ns	47.05 ns	0.57	0.17	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.Tests.Perf_BitArray*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.Tests.Perf_BitArray.BitArrayCopyToIntArray(Size: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 159.57561388719608 < 192.49795202183387. IsChangePoint: Marked as a change because one of 4/21/2022 12:21:56 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.894454446032663 (T) = (0 -162.49907025778552) / Math.Sqrt((251.6420479817535 / (299)) + (16.46913926520852 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.08387819911975031 = (177.37714581363454 - 162.49907025778552) / 177.37714581363454 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayLeftShift(Size: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 75.58186768163193 < 110.32066742455368. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.135250693354529 (T) = (0 -75.61262144226221) / Math.Sqrt((292.6294268776728 / (299)) + (4.444781149021916 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11053757210596048 = (85.0093484232814 - 75.61262144226221) / 85.0093484232814 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayOr(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.1617016659705344 < 1.5655076072509169. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.331121574915603 (T) = (0 -1137.7064116221002) / Math.Sqrt((54767.64195851877 / (299)) + (1581.4597032353422 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.096226631838695 = (1258.8403815623863 - 1137.7064116221002) / 1258.8403815623863 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayGet(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 76.31410816637631 < 130.5308478432158. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.857737995815139 (T) = (0 -76113.83095731426) / Math.Sqrt((750905010.438299 / (299)) + (11224.280055775605 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15571261121868363 = (90151.56683458283 - 76113.83095731426) / 90151.56683458283 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayCopyToBoolArray(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 84.13572358870968 < 132.0734625641988. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.81083962837632 (T) = (0 -84710.29125060157) / Math.Sqrt((537655030.5613083 / (299)) + (354598.4831132221 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.13464013911619105 = (97890.24783757048 - 84710.29125060157) / 97890.24783757048 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArraySetAll(Size: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 76.08740174378605 < 108.98250326925866. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.479726099863917 (T) = (0 -77.54719533133121) / Math.Sqrt((258.8332292264089 / (299)) + (14.191962557085303 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11451061126136011 = (87.5755218724817 - 77.54719533133121) / 87.5755218724817 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayLengthValueCtor(Size: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 159.1122967778759 < 192.32007426132068. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.051396336714935 (T) = (0 -161.2743639833264) / Math.Sqrt((242.84404354572857 / (299)) + (23.412789808706712 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08812334694941211 = (176.8598455106838 - 161.2743639833264) / 176.8598455106838 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayByteArrayCtor(Size: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 165.07286162513464 < 202.68158990132565. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.268574447564273 (T) = (0 -167.8760709039956) / Math.Sqrt((359.79003325686506 / (299)) + (8.94093990562727 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07267040436298418 = (181.03171913614548 - 167.8760709039956) / 181.03171913614548 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayXor(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.1583394515966177 < 1.6092774162930554. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.593616461975715 (T) = (0 -1138.959105014312) / Math.Sqrt((54879.30095122186 / (299)) + (996.636556756277 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09677786440664697 = (1260.9955625878194 - 1138.959105014312) / 1260.9955625878194 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayAnd(Size: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 47.04450062068273 < 64.54429852121193. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.600766717053006 (T) = (0 -47.9032792329524) / Math.Sqrt((61.63774150164623 / (299)) + (2.7019795784134897 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13324790663756078 = (55.267566816156815 - 47.9032792329524) / 55.267566816156815 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayCopyToBoolArray(Size: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 842.7185103224751 < 1.2736342826076663. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.603583739726883 (T) = (0 -844.9706164195978) / Math.Sqrt((41923.02284789448 / (299)) + (90.22063397165705 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1405533073493157 = (983.1565164484609 - 844.9706164195978) / 983.1565164484609 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArraySetLengthGrow(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.1804213727864035 < 7.5423557445401155. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.452378670887236 (T) = (0 -5288.707838209622) / Math.Sqrt((1430274.0444768162 / (299)) + (8693.90294501488 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09010448654542709 = (5812.434241081313 - 5288.707838209622) / 5812.434241081313 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArraySet(Size: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 100.3773686961055 < 162.9168046929479. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.688618433546598 (T) = (0 -101.80779978345689) / Math.Sqrt((798.5346134114118 / (299)) + (1.8474208262723588 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15880247815159765 = (121.02722266674049 - 101.80779978345689) / 121.02722266674049 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayGet(Size: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 616.6752242060287 < 1.0719776493500486. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.213073790362852 (T) = (0 -617.691063675206) / Math.Sqrt((50065.84051330941 / (299)) + (84.6846545611829 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.16239102301200628 = (737.4456108343022 - 617.691063675206) / 737.4456108343022 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArraySetAll(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 526.5773399232224 < 764.7690758307981. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.899015444956818 (T) = (0 -524.6995952432522) / Math.Sqrt((13120.012225057735 / (299)) + (139.57483898439935 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13377078122967523 = (605.728349810344 - 524.6995952432522) / 605.728349810344 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayBoolArrayCtor(Size: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 168.71997443651028 < 193.58649749175308. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.990720071343414 (T) = (0 -161.28304539444437) / Math.Sqrt((241.67703989102424 / (299)) + (11.771921626572958 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1011837325477177 = (179.43939293800867 - 161.28304539444437) / 179.43939293800867 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayLengthCtor(Size: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 97.47841807165439 < 105.09734280074913. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 21.67801653882741 (T) = (0 -98.91852602127712) / Math.Sqrt((18.150350269874973 / (299)) + (2.7058959423890627 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.06773066717035783 = (106.10509488823114 - 98.91852602127712) / 106.10509488823114 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArraySetLengthGrow(Size: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 335.0375583615079 < 430.04980820645676. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.955991856911734 (T) = (0 -344.1766841432631) / Math.Sqrt((1710.7670542300677 / (299)) + (41.477594818501935 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09353534336405839 = (379.6912340968335 - 344.1766841432631) / 379.6912340968335 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayCopyToIntArray(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 172.68546941035095 < 207.04518851185918. IsChangePoint: Marked as a change because one of 4/21/2022 3:06:05 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.655487103438624 (T) = (0 -175.75810746057113) / Math.Sqrt((242.67496231325526 / (299)) + (15.748323658061324 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.08035236088098675 = (191.11461823458882 - 175.75810746057113) / 191.11461823458882 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayCopyToByteArray(Size: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 147.38058862389104 < 191.1490784566388. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.411270339139175 (T) = (0 -147.18195126462157) / Math.Sqrt((579.8168343490447 / (299)) + (19.709360595840625 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08824639223438219 = (161.42733081727192 - 147.18195126462157) / 161.42733081727192 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayBoolArrayCtor(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 8.243682202192586 < 11.544232266247976. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.847198800751978 (T) = (0 -8279.018181080204) / Math.Sqrt((2999742.2436656468 / (299)) + (12208.017889971765 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.08757703918267268 = (9073.662694397839 - 8279.018181080204) / 9073.662694397839 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayNot(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 701.1697358287123 < 1.1933519550646676. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.094552103266215 (T) = (0 -703.9605224301366) / Math.Sqrt((40253.81013437035 / (299)) + (87.28669135265284 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.20014720502565267 = (880.1125992848645 - 703.9605224301366) / 880.1125992848645 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayLengthCtor(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 104.70166774349862 < 110.88710814551091. IsChangePoint: Marked as a change because one of 5/25/2022 12:28:02 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.938435994649634 (T) = (0 -103.42466140832502) / Math.Sqrt((18.457115938775377 / (299)) + (5.855034276753434 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.059125918234265315 = (109.9240200285126 - 103.42466140832502) / 109.9240200285126 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayRightShift(Size: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 90.46794606653971 < 138.04878466846705. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.53351051749122 (T) = (0 -91.88705607524658) / Math.Sqrt((524.9626670357331 / (299)) + (7.746165673447127 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1250203224023687 = (105.01621743665436 - 91.88705607524658) / 105.01621743665436 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayNot(Size: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 31.508251881728192 < 38.90975771747264. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.67616010244187 (T) = (0 -31.782033252971097) / Math.Sqrt((12.266334131724106 / (299)) + (4.114846892077577 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10206746296170818 = (35.3946782659194 - 31.782033252971097) / 35.3946782659194 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayOr(Size: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 48.318039601201484 < 65.33252177724191. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.300123819641867 (T) = (0 -48.32192291131463) / Math.Sqrt((58.38132011522265 / (299)) + (6.472446601700841 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12464561849637726 = (55.20269725309491 - 48.32192291131463) / 55.20269725309491 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayLeftShift(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.498429818689541 < 4.1610768607021384. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.05628039394217 (T) = (0 -2526.5435345806545) / Math.Sqrt((591387.1312565359 / (299)) + (13930.494710833284 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15811975303457101 = (3001.0723540404015 - 2526.5435345806545) / 3001.0723540404015 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArraySet(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 11.873259517009394 < 19.724559130614313. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.567595802176816 (T) = (0 -11886.709058507757) / Math.Sqrt((14723487.383812249 / (299)) + (4399.5458305221355 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.15164882821126838 = (14011.543160180785 - 11886.709058507757) / 14011.543160180785 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayAnd(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.1591543866988547 < 1.6080841504176075. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.703046499336647 (T) = (0 -1141.073687666513) / Math.Sqrt((54967.094594790644 / (299)) + (911.9854053301059 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09738811482667728 = (1264.1908514725574 - 1141.073687666513) / 1264.1908514725574 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayCopyToByteArray(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 4.788427918667468 < 7.01897497894809. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 4.854199334841829 (T) = (0 -4933.286969869163) / Math.Sqrt((1351584.1865812063 / (299)) + (87396.53658541598 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.0714168158367672 = (5312.703324812692 - 4933.286969869163) / 5312.703324812692 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArraySetLengthShrink(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 4.791957237246466 < 7.111905490578482. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.327825821639267 (T) = (0 -4892.10837397196) / Math.Sqrt((1412632.646831154 / (299)) + (4934.995839411712 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09414595508298389 = (5400.548136228854 - 4892.10837397196) / 5400.548136228854 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayRightShift(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.5335170049075435 < 4.431771490077695. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.251374367886015 (T) = (0 -2577.708173494272) / Math.Sqrt((734936.1456444844 / (299)) + (2011.7056051482166 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.17896677143904838 = (3139.5905595834347 - 2577.708173494272) / 3139.5905595834347 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayByteArrayCtor(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 4.769515370202602 < 7.061618544836591. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.9264245840764405 (T) = (0 -4861.710687209664) / Math.Sqrt((1400049.937505399 / (299)) + (13704.84907161144 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.09098864741209514 = (5348.349801538389 - 4861.710687209664) / 5348.349801538389 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArraySetLengthShrink(Size: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 197.32817633951902 < 247.3511994060414. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.444551044115187 (T) = (0 -200.72181332981998) / Math.Sqrt((560.716897446409 / (299)) + (17.843644149546463 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08410877613955611 = (219.15464205867787 - 200.72181332981998) / 219.15464205867787 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayXor(Size: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 47.05205225186277 < 64.84726428943978. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.811377760189792 (T) = (0 -48.33269925892293) / Math.Sqrt((56.77720860607482 / (299)) + (7.308657248955048 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12191225765255179 = (55.04313171450501 - 48.33269925892293) / 55.04313171450501 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Text.Json.Document.Tests.Perf_ParseThenWrite

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ParseThenWrite - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented%3a%20True%2c%20TestCase%3a%20LotsOfStrings).html>)	152.73 μs	111.76 μs	0.73	0.01	False
[ParseThenWrite - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented%3a%20False%2c%20TestCase%3a%20Json4KB).html>)	744.26 μs	547.90 μs	0.74	0.01	False
[ParseThenWrite - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented%3a%20False%2c%20TestCase%3a%20BroadTree).html>)	842.93 μs	639.02 μs	0.76	0.02	False
[ParseThenWrite - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented%3a%20False%2c%20TestCase%3a%20LotsOfNumbers).html>)	166.20 μs	126.72 μs	0.76	0.01	False
[ParseThenWrite - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented%3a%20True%2c%20TestCase%3a%20DeepTree).html>)	685.34 μs	495.99 μs	0.72	0.01	False
[ParseThenWrite - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented%3a%20True%2c%20TestCase%3a%20Json400KB).html>)	78.56 ms	57.15 ms	0.73	0.01	False
[ParseThenWrite - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented%3a%20True%2c%20TestCase%3a%20LotsOfNumbers).html>)	195.71 μs	145.03 μs	0.74	0.01	False
[ParseThenWrite - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented%3a%20False%2c%20TestCase%3a%20LotsOfStrings).html>)	131.83 μs	99.00 μs	0.75	0.01	False
[ParseThenWrite - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented%3a%20False%2c%20TestCase%3a%20Json400KB).html>)	70.20 ms	50.64 ms	0.72	0.02	False
[ParseThenWrite - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented%3a%20True%2c%20TestCase%3a%20Json400B).html>)	111.51 μs	88.33 μs	0.79	0.01	False
[ParseThenWrite - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented%3a%20True%2c%20TestCase%3a%20BroadTree).html>)	1.02 ms	780.80 μs	0.77	0.02	False
[ParseThenWrite - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented%3a%20True%2c%20TestCase%3a%20Json4KB).html>)	852.55 μs	619.47 μs	0.73	0.01	False
[ParseThenWrite - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented%3a%20False%2c%20TestCase%3a%20Json400B).html>)	99.69 μs	78.42 μs	0.79	0.01	False
[ParseThenWrite - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented%3a%20False%2c%20TestCase%3a%20DeepTree).html>)	547.08 μs	400.55 μs	0.73	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Document.Tests.Perf_ParseThenWrite*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: True, TestCase: LotsOfStrings) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 111.76245016464033 < 143.1019877530956. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.327496856145082 (T) = (0 -112559.25178204535) / Math.Sqrt((272394959.5388762 / (299)) + (1146780.6708826714 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.06664551076816798 = (120596.46477372567 - 112559.25178204535) / 120596.46477372567 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: False, TestCase: Json4KB) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 547.8950966954023 < 709.7397260137691. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.870992824039279 (T) = (0 -548311.0177825581) / Math.Sqrt((6730664074.783177 / (299)) + (17001871.648995135 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.0791880827090269 = (595464.7279063113 - 548311.0177825581) / 595464.7279063113 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: False, TestCase: BroadTree) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 639.0199627329193 < 799.9452085863095. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.861740484780753 (T) = (0 -637914.278116258) / Math.Sqrt((7712752787.687625 / (299)) + (43877332.414808415 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07383506671330795 = (688769.6296732854 - 637914.278116258) / 688769.6296732854 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: False, TestCase: LotsOfNumbers) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 126.72436723790322 < 157.83381549684123. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.048735034283379 (T) = (0 -126349.27270513322) / Math.Sqrt((317106314.52591354 / (299)) + (1524592.834179608 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.06231349318651661 = (134745.75115141924 - 126349.27270513322) / 134745.75115141924 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: True, TestCase: DeepTree) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 495.9873916015625 < 648.1401267444681. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.280154423125293 (T) = (0 -501432.67596661235) / Math.Sqrt((5929214987.700472 / (299)) + (17976919.816937465 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07670654607777067 = (543091.336602121 - 501432.67596661235) / 543091.336602121 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: True, TestCase: Json400KB) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 57.14951701785714 < 74.568575435. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.5297376125907 (T) = (0 -57590565.65166168) / Math.Sqrt((76686276855582.84 / (299)) + (294849376753.9998 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07806314898043946 = (62466930.99204448 - 57590565.65166168) / 62466930.99204448 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: True, TestCase: LotsOfNumbers) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 145.02502583498676 < 185.64628722713084. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.8685741781984815 (T) = (0 -148076.95244103036) / Math.Sqrt((420296596.0511084 / (299)) + (2354118.4087354005 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.06009438777431829 = (157544.49225001057 - 148076.95244103036) / 157544.49225001057 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: False, TestCase: LotsOfStrings) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 98.99506682389936 < 124.69290332880702. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.224125660016057 (T) = (0 -99487.59344772111) / Math.Sqrt((185947718.81927225 / (299)) + (862300.8870980894 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.0689154102219088 = (106851.29422175525 - 99487.59344772111) / 106851.29422175525 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: False, TestCase: Json400KB) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 50.644222516666666 < 66.02748878272664. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.037982202456153 (T) = (0 -50790842.750499435) / Math.Sqrt((64112398775165.81 / (299)) + (126841079565.5348 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.08426230461914372 = (55464401.00336316 - 50790842.750499435) / 55464401.00336316 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: True, TestCase: Json400B) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 88.33401977996255 < 105.99173608862326. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.690914450635303 (T) = (0 -87812.6209898364) / Math.Sqrt((107964433.00840256 / (299)) + (331918.6167521921 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.056574427563888655 = (93078.48287712496 - 87812.6209898364) / 93078.48287712496 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: True, TestCase: BroadTree) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 780.7951272321428 < 0.9750336974400112. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.702969228342264 (T) = (0 -778282.506972394) / Math.Sqrt((12437639879.862123 / (299)) + (41086849.752137296 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.06782032252990929 = (834906.1085354603 - 778282.506972394) / 834906.1085354603 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: True, TestCase: Json4KB) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 619.4651487499999 < 798.1814128571426. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.251145149860074 (T) = (0 -621081.6915804552) / Math.Sqrt((8936466397.499802 / (299)) + (27046126.38233106 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07585998614289459 = (672064.4948466538 - 621081.6915804552) / 672064.4948466538 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: False, TestCase: Json400B) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 78.4191715625 < 95.12803413036472. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.2156568684979 (T) = (0 -78627.8541848321) / Math.Sqrt((82450154.12637964 / (299)) + (320217.0633442742 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.058542030274950294 = (83517.11570065646 - 78627.8541848321) / 83517.11570065646 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: False, TestCase: DeepTree) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 400.5460939349113 < 520.4868904641319. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.006691917546258 (T) = (0 -406857.2237291728) / Math.Sqrt((3448162098.9556646 / (299)) + (13230485.080055118 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07780924009622575 = (441185.53494466393 - 406857.2237291728) / 441185.53494466393 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in System.Buffers.Tests.RentReturnArrayPoolTests<Object>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[SingleParallel - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Object).SingleParallel(RentalSize%3a%204096%2c%20ManipulateArray%3a%20True%2c%20Async%3a%20True%2c%20UseSharedPool%3a%20False).html>)	68.22 μs	50.63 μs	0.74	0.20	False
[SingleSerial - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Object).SingleSerial(RentalSize%3a%204096%2c%20ManipulateArray%3a%20False%2c%20Async%3a%20False%2c%20UseSharedPool%3a%20True).html>)	309.07 ns	228.30 ns	0.74	0.08	False
[ProducerConsumer - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Object).ProducerConsumer(RentalSize%3a%204096%2c%20ManipulateArray%3a%20True%2c%20Async%3a%20False%2c%20UseSharedPool%3a%20False).html>)	37.71 μs	23.69 μs	0.63	0.25	False
[ProducerConsumer - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Object).ProducerConsumer(RentalSize%3a%204096%2c%20ManipulateArray%3a%20True%2c%20Async%3a%20True%2c%20UseSharedPool%3a%20False).html>)	37.78 μs	23.58 μs	0.62	0.15	False
[SingleSerial - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Object).SingleSerial(RentalSize%3a%204096%2c%20ManipulateArray%3a%20True%2c%20Async%3a%20True%2c%20UseSharedPool%3a%20False).html>)	43.02 μs	27.89 μs	0.65	0.08	False
[SingleParallel - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Object).SingleParallel(RentalSize%3a%204096%2c%20ManipulateArray%3a%20False%2c%20Async%3a%20False%2c%20UseSharedPool%3a%20True).html>)	617.02 ns	484.97 ns	0.79	0.23	False
[SingleParallel - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Object).SingleParallel(RentalSize%3a%204096%2c%20ManipulateArray%3a%20True%2c%20Async%3a%20False%2c%20UseSharedPool%3a%20True).html>)	64.34 μs	44.11 μs	0.69	0.23	False
[SingleSerial - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Object).SingleSerial(RentalSize%3a%204096%2c%20ManipulateArray%3a%20True%2c%20Async%3a%20False%2c%20UseSharedPool%3a%20False).html>)	37.44 μs	23.39 μs	0.62	0.06	False
[SingleSerial - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Object).SingleSerial(RentalSize%3a%204096%2c%20ManipulateArray%3a%20False%2c%20Async%3a%20True%2c%20UseSharedPool%3a%20True).html>)	2.35 μs	2.09 μs	0.89	0.01	False
[SingleParallel - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Object).SingleParallel(RentalSize%3a%204096%2c%20ManipulateArray%3a%20True%2c%20Async%3a%20True%2c%20UseSharedPool%3a%20True).html>)	67.47 μs	48.42 μs	0.72	0.23	False
[SingleSerial - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Object).SingleSerial(RentalSize%3a%204096%2c%20ManipulateArray%3a%20True%2c%20Async%3a%20True%2c%20UseSharedPool%3a%20True).html>)	42.24 μs	32.00 μs	0.76	0.03	False
[SingleSerial - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Object).SingleSerial(RentalSize%3a%204096%2c%20ManipulateArray%3a%20False%2c%20Async%3a%20False%2c%20UseSharedPool%3a%20False).html>)	591.59 ns	482.34 ns	0.82	0.07	False
[SingleSerial - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Object).SingleSerial(RentalSize%3a%204096%2c%20ManipulateArray%3a%20True%2c%20Async%3a%20False%2c%20UseSharedPool%3a%20True).html>)	37.26 μs	23.03 μs	0.62	0.08	False
[SingleSerial - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Object).SingleSerial(RentalSize%3a%204096%2c%20ManipulateArray%3a%20False%2c%20Async%3a%20True%2c%20UseSharedPool%3a%20False).html>)	2.73 μs	2.33 μs	0.85	0.03	False
[SingleParallel - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Object).SingleParallel(RentalSize%3a%204096%2c%20ManipulateArray%3a%20True%2c%20Async%3a%20False%2c%20UseSharedPool%3a%20False).html>)	68.57 μs	44.73 μs	0.65	0.27	False
[ProducerConsumer - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Object).ProducerConsumer(RentalSize%3a%204096%2c%20ManipulateArray%3a%20True%2c%20Async%3a%20True%2c%20UseSharedPool%3a%20True).html>)	40.34 μs	25.49 μs	0.63	0.17	False
[ProducerConsumer - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Object).ProducerConsumer(RentalSize%3a%204096%2c%20ManipulateArray%3a%20True%2c%20Async%3a%20False%2c%20UseSharedPool%3a%20True).html>)	40.98 μs	27.49 μs	0.67	0.41	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Buffers.Tests.RentReturnArrayPoolTests<Object>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Buffers.Tests.RentReturnArrayPoolTests<Object>.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 50.625657251999996 < 66.75504232411666. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.488430331104835 (T) = (0 -50417.02904680903) / Math.Sqrt((63213245.11855186 / (299)) + (2469963.157806292 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1034333570763969 = (56233.44281737358 - 50417.02904680903) / 56233.44281737358 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Object>.SingleSerial(RentalSize: 4096, ManipulateArray: False, Async: False, UseSharedPool: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 228.30275228571426 < 296.63481533653845. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.712653051445415 (T) = (0 -230.847895390186) / Math.Sqrt((1091.2196833781068 / (299)) + (34.08094823693192 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07988490415891726 = (250.89023800785114 - 230.847895390186) / 250.89023800785114 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Object>.ProducerConsumer(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 23.688489969333336 < 35.839876358. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 4.746214453033518 (T) = (0 -24552.967744183687) / Math.Sqrt((40291258.05954415 / (299)) + (11191438.55591242 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10057115983506884 = (27298.39943722655 - 24552.967744183687) / 27298.39943722655 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Object>.ProducerConsumer(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 23.577913522000003 < 35.919591279093595. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.832495078095558 (T) = (0 -24068.58023591499) / Math.Sqrt((44719528.95377303 / (299)) + (4373563.528724368 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11961797173148918 = (27338.790960160568 - 24068.58023591499) / 27338.790960160568 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Object>.SingleSerial(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 27.89351466615385 < 40.85777987824588. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.771312717010014 (T) = (0 -28235.368716103952) / Math.Sqrt((40779495.98703867 / (299)) + (621666.1307245864 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10665140881359254 = (31606.21620123238 - 28235.368716103952) / 31606.21620123238 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Object>.SingleParallel(RentalSize: 4096, ManipulateArray: False, Async: False, UseSharedPool: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 484.9651287777778 < 574.1235770175596. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.144191435167581 (T) = (0 -482.9366866246238) / Math.Sqrt((2026.8337141124741 / (299)) + (297.66159756179786 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.06177980771211253 = (514.7370421083812 - 482.9366866246238) / 514.7370421083812 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Object>.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 44.10717546533334 < 62.65698484280835. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.859373915155734 (T) = (0 -46242.31395120893) / Math.Sqrt((67146153.3932914 / (299)) + (1695337.901596447 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1059854267942039 = (51724.34022567579 - 46242.31395120893) / 51724.34022567579 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Object>.SingleSerial(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 23.387589434285715 < 35.60532188525001. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.516076966705846 (T) = (0 -23422.295071978424) / Math.Sqrt((38305834.80453709 / (299)) + (4095.249926324524 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11518205906586854 = (26471.315723154003 - 23422.295071978424) / 26471.315723154003 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Object>.SingleSerial(RentalSize: 4096, ManipulateArray: False, Async: True, UseSharedPool: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.0926029913333326 < 2.238432266133333. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.758413251460203 (T) = (0 -2066.8672390152187) / Math.Sqrt((11898.130814698696 / (299)) + (1041.5278572437146 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.051882292505835856 = (2179.9690298769583 - 2066.8672390152187) / 2179.9690298769583 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Object>.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 48.42043205357144 < 65.33230295615. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/6/2022 5:03:41 AM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.296340614769928 (T) = (0 -49518.981453576635) / Math.Sqrt((64877143.14709977 / (299)) + (1907575.584587129 / (53))) is greater than 1.9667650028636081 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (53) - 2, .975) and 0.10292723826839226 = (55200.62983295892 - 49518.981453576635) / 55200.62983295892 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Object>.SingleSerial(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 31.997352378461542 < 40.10684662291621. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.131776705952236 (T) = (0 -27558.158518179247) / Math.Sqrt((40330218.436235555 / (299)) + (755642.2890373276 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.10221644515502411 = (30695.77112374021 - 27558.158518179247) / 30695.77112374021 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Object>.SingleSerial(RentalSize: 4096, ManipulateArray: False, Async: False, UseSharedPool: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 482.3380195 < 569.033318475. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.421584260492653 (T) = (0 -457.1516659425164) / Math.Sqrt((3287.3559347573578 / (299)) + (69.29731967270347 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.08042654759620439 = (497.13447549785906 - 457.1516659425164) / 497.13447549785906 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Object>.SingleSerial(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 23.033789235384617 < 35.37163922783929. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 4.081771631230312 (T) = (0 -23729.160076440236) / Math.Sqrt((38777599.25508401 / (299)) + (14121237.397152064 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09608262024593905 = (26251.47010990816 - 23729.160076440236) / 26251.47010990816 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Object>.SingleSerial(RentalSize: 4096, ManipulateArray: False, Async: True, UseSharedPool: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.3269579850000004 < 2.589791859797619. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.09184241696294 (T) = (0 -2378.7881934168827) / Math.Sqrt((15835.153481332407 / (299)) + (1542.3120771057397 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.0573893528394429 = (2523.616936200062 - 2378.7881934168827) / 2523.616936200062 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Object>.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 44.731170286923074 < 62.320698587725005. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.894559836699123 (T) = (0 -46793.790825697026) / Math.Sqrt((66642689.83820514 / (299)) + (3108983.633388948 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.10070377007428989 = (52033.78961075219 - 46793.790825697026) / 52033.78961075219 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Object>.ProducerConsumer(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 25.48812707157895 < 38.199043670349994. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.583552294934476 (T) = (0 -25976.107207066954) / Math.Sqrt((40722252.71103823 / (299)) + (3139611.999461495 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11348267212962156 = (29301.296647486437 - 25976.107207066954) / 29301.296647486437 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Object>.ProducerConsumer(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 27.4871292645 < 39.778983872375. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.5490457819290775 (T) = (0 -27067.33142471833) / Math.Sqrt((40174449.664206624 / (299)) + (2902277.5895637623 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1076590991269855 = (30332.949434725255 - 27067.33142471833) / 30332.949434725255 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Tests.Perf_Double

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ToStringWithFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Double.ToStringWithFormat(value%3a%20-1.7976931348623157E%2b308%2c%20format%3a%20%22G17%22).html>)	3.30 μs	2.55 μs	0.77	0.25	False
[ToStringWithFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Double.ToStringWithFormat(value%3a%2012345%2c%20format%3a%20%22F50%22).html>)	7.08 μs	5.60 μs	0.79	0.02	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Double.Parse(value%3a%20%2212345%22).html>)	1.23 μs	750.59 ns	0.61	0.08	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Double.Parse(value%3a%20%221.7976931348623157e%2b308%22).html>)	2.25 μs	1.50 μs	0.67	0.02	False
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Double.ToString(value%3a%2012345).html>)	2.30 μs	1.77 μs	0.77	0.06	False
[ToStringWithFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Double.ToStringWithFormat(value%3a%201.7976931348623157E%2b308%2c%20format%3a%20%22G%22).html>)	4.80 μs	3.71 μs	0.77	0.07	False
[ToStringWithFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Double.ToStringWithFormat(value%3a%20-1.7976931348623157E%2b308%2c%20format%3a%20%22E%22).html>)	2.33 μs	1.84 μs	0.79	0.06	False
[ToStringWithFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Double.ToStringWithFormat(value%3a%201.7976931348623157E%2b308%2c%20format%3a%20%22R%22).html>)	4.89 μs	3.81 μs	0.78	0.07	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Double.Parse(value%3a%20%22-1.7976931348623157e%2b308%22).html>)	2.32 μs	1.51 μs	0.65	0.02	False
[TryParse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Double.TryParse(value%3a%20%221.7976931348623157e%2b308%22).html>)	2.27 μs	1.52 μs	0.67	0.03	False
[ToStringWithFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Double.ToStringWithFormat(value%3a%201.7976931348623157E%2b308%2c%20format%3a%20%22F50%22).html>)	749.61 μs	438.26 μs	0.58	0.09	False
[TryParse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Double.TryParse(value%3a%20%22-1.7976931348623157e%2b308%22).html>)	2.37 μs	1.53 μs	0.65	0.03	False
[ToStringWithFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Double.ToStringWithFormat(value%3a%2012345%2c%20format%3a%20%22G17%22).html>)	4.84 μs	3.88 μs	0.80	0.07	False
[ToStringWithFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Double.ToStringWithFormat(value%3a%2012345%2c%20format%3a%20%22G%22).html>)	2.37 μs	1.78 μs	0.75	0.05	False
[ToStringWithFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Double.ToStringWithFormat(value%3a%201.7976931348623157E%2b308%2c%20format%3a%20%22E%22).html>)	2.37 μs	1.79 μs	0.75	0.04	False
[ToStringWithFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Double.ToStringWithFormat(value%3a%2012345%2c%20format%3a%20%22E%22).html>)	2.33 μs	1.85 μs	0.79	0.07	False
[ToStringWithCultureInfo - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Double.ToStringWithCultureInfo(value%3a%201.7976931348623157E%2b308%2c%20culture%3a%20zh).html>)	4.53 μs	3.48 μs	0.77	0.08	False
[ToStringWithFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Double.ToStringWithFormat(value%3a%2012345%2c%20format%3a%20%22R%22).html>)	2.36 μs	1.88 μs	0.80	0.05	False
[ToStringWithFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Double.ToStringWithFormat(value%3a%20-1.7976931348623157E%2b308%2c%20format%3a%20%22G%22).html>)	4.93 μs	3.80 μs	0.77	0.06	False
[IsNaN - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Double.IsNaN(value%3a%20NaN).html>)	14.85 ms	7.83 ms	0.53	0.07	False
[TryParse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Double.TryParse(value%3a%20%2212345%22).html>)	1.12 μs	757.49 ns	0.67	0.05	False
[ToStringWithCultureInfo - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Double.ToStringWithCultureInfo(value%3a%20-1.7976931348623157E%2b308%2c%20culture%3a%20zh).html>)	4.65 μs	3.62 μs	0.78	0.10	False
[ToStringWithCultureInfo - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Double.ToStringWithCultureInfo(value%3a%2012345%2c%20culture%3a%20zh).html>)	2.32 μs	1.81 μs	0.78	0.03	False
[ToStringWithFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Double.ToStringWithFormat(value%3a%20-1.7976931348623157E%2b308%2c%20format%3a%20%22F50%22).html>)	761.67 μs	438.33 μs	0.58	0.06	False
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Double.ToString(value%3a%201.7976931348623157E%2b308).html>)	4.65 μs	3.63 μs	0.78	0.06	False
[IsNaN - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Double.IsNaN(value%3a%200).html>)	14.85 ms	7.83 ms	0.53	0.04	False
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Double.ToString(value%3a%20-1.7976931348623157E%2b308).html>)	4.57 μs	3.54 μs	0.78	0.06	False
[ToStringWithFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Double.ToStringWithFormat(value%3a%20-1.7976931348623157E%2b308%2c%20format%3a%20%22R%22).html>)	4.98 μs	3.94 μs	0.79	0.04	False
[ToStringWithFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Double.ToStringWithFormat(value%3a%201.7976931348623157E%2b308%2c%20format%3a%20%22G17%22).html>)	3.21 μs	2.39 μs	0.75	0.21	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Double*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Tests.Perf_Double.ToStringWithFormat(value: -1.7976931348623157E+308, format: "G17") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.545976118820824 < 3.1647099407275636. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.59677228512496 (T) = (0 -2552.7745442219884) / Math.Sqrt((105931.52993315643 / (299)) + (7242.550206297208 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07636007460947004 = (2763.820049401431 - 2552.7745442219884) / 2763.820049401431 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Double.ToStringWithFormat(value: 12345, format: "F50") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.596886421251348 < 6.699277562348471. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.000578169768588 (T) = (0 -5548.144026318279) / Math.Sqrt((308416.98210518836 / (299)) + (6759.592896302592 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09421211893015516 = (6125.213355432898 - 5548.144026318279) / 6125.213355432898 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Double.Parse(value: "12345") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 750.5893841684011 < 1.063032476574975. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.006049206221912 (T) = (0 -772.4018184606019) / Math.Sqrt((23068.10218790028 / (299)) + (342.4981716094036 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09616485963524726 = (854.5826378789505 - 772.4018184606019) / 854.5826378789505 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Double.Parse(value: "1.7976931348623157e+308") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.4997707034294618 < 2.160753487461338. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.937097321608301 (T) = (0 -1518.443991566193) / Math.Sqrt((112141.95439064561 / (299)) + (166.13169726676946 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09225426502578445 = (1672.763564798599 - 1518.443991566193) / 1672.763564798599 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Double.ToString(value: 12345) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.7665589664365347 < 2.2016395584646893. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.09492225973151 (T) = (0 -1797.485043063297) / Math.Sqrt((56389.16063585595 / (299)) + (978.1044758420118 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.06072080722098441 = (1913.685576005506 - 1797.485043063297) / 1913.685576005506 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Double.ToStringWithFormat(value: 1.7976931348623157E+308, format: "G") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.712455560331281 < 4.669933802293442. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.177685325186909 (T) = (0 -3792.3373842442866) / Math.Sqrt((208878.8187068669 / (299)) + (4752.045475781093 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.0634405583506063 = (4049.222308373214 - 3792.3373842442866) / 4049.222308373214 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Double.ToStringWithFormat(value: -1.7976931348623157E+308, format: "E") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.8367567983774036 < 2.2673011999055284. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.9045034804977545 (T) = (0 -1834.2296164064735) / Math.Sqrt((61397.901820269646 / (299)) + (984.7626878566576 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.06049437191658376 = (1952.3348893058649 - 1834.2296164064735) / 1952.3348893058649 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Double.ToStringWithFormat(value: 1.7976931348623157E+308, format: "R") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.806954594930013 < 4.625697801497404. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.151515301393811 (T) = (0 -3829.45149145302) / Math.Sqrt((205574.31495024118 / (299)) + (5470.216871440944 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.0691467449741416 = (4113.915346782174 - 3829.45149145302) / 4113.915346782174 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Double.Parse(value: "-1.7976931348623157e+308") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.5133066895088922 < 2.2079659715298727. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.360253069935568 (T) = (0 -1536.1221328368729) / Math.Sqrt((126555.67240450754 / (299)) + (425.18655024688945 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09047283095687236 = (1688.9238552961067 - 1536.1221328368729) / 1688.9238552961067 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Double.TryParse(value: "1.7976931348623157e+308") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.5234232912192562 < 2.1568569792061836. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.013996089089024 (T) = (0 -1525.8809509153573) / Math.Sqrt((146174.9290013772 / (299)) + (291.4820438832775 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09271127240823379 = (1681.803051786538 - 1525.8809509153573) / 1681.803051786538 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Double.ToStringWithFormat(value: 1.7976931348623157E+308, format: "F50") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 438.25766426282047 < 712.1929216318966. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.49951740149735 (T) = (0 -444237.76780930394) / Math.Sqrt((17689789096.028503 / (299)) + (149382486.13737905 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.13081653940088311 = (511097.81530253304 - 444237.76780930394) / 511097.81530253304 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Double.TryParse(value: "-1.7976931348623157e+308") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.5301112981505722 < 2.1955752665848447. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.158773569590843 (T) = (0 -1540.1588214096942) / Math.Sqrt((128292.6654570608 / (299)) + (574.6818609762929 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.08879325344517754 = (1690.2408012592903 - 1540.1588214096942) / 1690.2408012592903 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Double.ToStringWithFormat(value: 12345, format: "G17") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.883481108810241 < 4.621865173649796. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 18.350365480730655 (T) = (0 -3899.493721969005) / Math.Sqrt((104274.32935415223 / (299)) + (3921.402124124958 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08784041547684879 = (4275.012605395732 - 3899.493721969005) / 4275.012605395732 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Double.ToStringWithFormat(value: 12345, format: "G") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.7753867665729128 < 2.258513080064014. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.501443771554426 (T) = (0 -1818.236090398523) / Math.Sqrt((55580.36154605596 / (299)) + (931.8224422972985 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.062388830744110474 = (1939.22187578196 - 1818.236090398523) / 1939.22187578196 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Double.ToStringWithFormat(value: 1.7976931348623157E+308, format: "E") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.7856964669304694 < 2.183523879268248. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.723707264837966 (T) = (0 -1799.0178902087398) / Math.Sqrt((51557.568674859795 / (299)) + (706.0909735946699 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.061917147615752524 = (1917.7601270893344 - 1799.0178902087398) / 1917.7601270893344 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Double.ToStringWithFormat(value: 12345, format: "E") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.851531860977564 < 2.197593057593796. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.243565477584315 (T) = (0 -1820.0656867195069) / Math.Sqrt((55737.64604079118 / (299)) + (785.4155857142526 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.06707923882974254 = (1950.9327720785345 - 1820.0656867195069) / 1950.9327720785345 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Double.ToStringWithCultureInfo(value: 1.7976931348623157E+308, culture: zh) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.4791712166889983 < 4.448662073649488. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.388848476645089 (T) = (0 -3588.914671541588) / Math.Sqrt((200086.01612796524 / (299)) + (6436.242284054922 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08160842214348146 = (3907.826201888677 - 3588.914671541588) / 3907.826201888677 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Double.ToStringWithFormat(value: 12345, format: "R") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.883720886673982 < 2.2407639341539936. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.530515181702274 (T) = (0 -1836.6117529685557) / Math.Sqrt((54096.331571791736 / (299)) + (709.6054408135856 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.060702809354657376 = (1955.3042117657294 - 1836.6117529685557) / 1955.3042117657294 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Double.ToStringWithFormat(value: -1.7976931348623157E+308, format: "G") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.796756171518265 < 4.685045401531547. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.43417800856463 (T) = (0 -3840.264304877489) / Math.Sqrt((213542.03690182374 / (299)) + (5909.230095390273 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.06578507264903513 = (4110.686087800846 - 3840.264304877489) / 4110.686087800846 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Double.IsNaN(value: NaN) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 7.829119289583334 < 14.107133977918954. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.910065803726772 (T) = (0 -7886239.887045191) / Math.Sqrt((8157217195869.643 / (299)) + (53895711955.25516 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1886403372046745 = (9719783.036631662 - 7886239.887045191) / 9719783.036631662 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Double.TryParse(value: "12345") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 757.4924562392727 < 1.0632501567996078. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.799171158432648 (T) = (0 -773.8133068549091) / Math.Sqrt((21941.991996159533 / (299)) + (146.36230981298445 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.09024215290759427 = (850.5706318753099 - 773.8133068549091) / 850.5706318753099 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Double.ToStringWithCultureInfo(value: -1.7976931348623157E+308, culture: zh) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.6162049616612175 < 4.48008979194367. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.260669175375758 (T) = (0 -3672.905443959999) / Math.Sqrt((200923.9522008434 / (299)) + (8730.676817900141 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07440048122196019 = (3968.13672592322 - 3672.905443959999) / 3968.13672592322 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Double.ToStringWithCultureInfo(value: 12345, culture: zh) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.8139980340375588 < 2.2040738440947703. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.702676509453413 (T) = (0 -1779.851967461153) / Math.Sqrt((51279.63367814007 / (299)) + (1370.8379680250414 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.06406542268013213 = (1901.6841674531545 - 1779.851967461153) / 1901.6841674531545 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Double.ToStringWithFormat(value: -1.7976931348623157E+308, format: "F50") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 438.32606828703706 < 713.7765380794032. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.077461905396166 (T) = (0 -441505.14895086415) / Math.Sqrt((17352283066.066315 / (299)) + (19225080.265023645 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.13577023671868452 = (510865.47548947326 - 441505.14895086415) / 510865.47548947326 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Double.ToString(value: 1.7976931348623157E+308) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.6296164021317834 < 4.542736318588638. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.017793156734738 (T) = (0 -3638.213458343383) / Math.Sqrt((180098.06130059552 / (299)) + (6570.479017310541 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07523911848078073 = (3934.220760253655 - 3638.213458343383) / 3934.220760253655 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Double.IsNaN(value: 0) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 7.830042109375 < 14.126829359557291. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.21510320309113 (T) = (0 -7855051.478206584) / Math.Sqrt((8170475141500.862 / (299)) + (274496291.12098527 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.19096339578273802 = (9709142.25297173 - 7855051.478206584) / 9709142.25297173 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Double.ToString(value: -1.7976931348623157E+308) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.543335340840158 < 4.4933465711748575. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.28933334445058 (T) = (0 -3682.000779714857) / Math.Sqrt((192555.11060231092 / (299)) + (5568.7262645383 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.07732646007092744 = (3990.578054289818 - 3682.000779714857) / 3990.578054289818 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Double.ToStringWithFormat(value: -1.7976931348623157E+308, format: "R") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.9352536153813844 < 4.6709704301249815. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.509698738084245 (T) = (0 -3901.3340899835034) / Math.Sqrt((202449.2659212182 / (299)) + (5075.334575269396 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.0632660841686778 = (4164.8263440116725 - 3901.3340899835034) / 4164.8263440116725 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Double.ToStringWithFormat(value: 1.7976931348623157E+308, format: "G17") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.3911517062256813 < 3.0550636155871156. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.226127574786732 (T) = (0 -2496.620163242111) / Math.Sqrt((107268.1892062224 / (299)) + (13846.964558697287 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07502688003689152 = (2699.127260413455 - 2496.620163242111) / 2699.127260413455 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in Benchstone.BenchI.HeapSort

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Test - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Benchstone.BenchI.HeapSort.Test.html>)	1.75 ms	1.17 ms	0.67	0.06	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Benchstone.BenchI.HeapSort*'

### Payloads [Baseline]() [Compare]() ### Histogram #### Benchstone.BenchI.HeapSort.Test ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.1719336895604398 < 1.6673626126041663. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.443917967563355 (T) = (0 -1182323.9674111733) / Math.Sqrt((57001671054.40689 / (299)) + (669462006.2482128 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1116882525364106 = (1330978.6466148642 - 1182323.9674111733) / 1330978.6466148642 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.IO.Tests.Perf_FileStream

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Flush - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_FileStream.Flush(fileSize%3a%201024%2c%20options%3a%20None).html>)	2.20 ms	2.02 ms	0.92	0.07	False
[ReadByte - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_FileStream.ReadByte(fileSize%3a%201024%2c%20options%3a%20Asynchronous).html>)	71.49 μs	58.49 μs	0.82	0.07	False
[ReadByte - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_FileStream.ReadByte(fileSize%3a%201024%2c%20options%3a%20None).html>)	71.30 μs	59.04 μs	0.83	0.07	False
[SeekBackward - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_FileStream.SeekBackward(fileSize%3a%201024%2c%20options%3a%20None).html>)	1.30 ms	1.14 ms	0.87	0.02	False
[WriteByte - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_FileStream.WriteByte(fileSize%3a%201024%2c%20options%3a%20Asynchronous).html>)	106.97 μs	90.28 μs	0.84	0.06	False
[SeekForward - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_FileStream.SeekForward(fileSize%3a%201024%2c%20options%3a%20None).html>)	358.73 μs	276.55 μs	0.77	0.05	False
[SeekBackward - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_FileStream.SeekBackward(fileSize%3a%201024%2c%20options%3a%20Asynchronous).html>)	1.32 ms	1.20 ms	0.90	0.03	False
[SeekForward - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_FileStream.SeekForward(fileSize%3a%201024%2c%20options%3a%20Asynchronous).html>)	363.66 μs	282.00 μs	0.78	0.03	False
[Read - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_FileStream.Read(fileSize%3a%201048576%2c%20userBufferSize%3a%204096%2c%20options%3a%20None).html>)	414.47 μs	390.92 μs	0.94	0.02	False
[WriteByte - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_FileStream.WriteByte(fileSize%3a%201024%2c%20options%3a%20None).html>)	106.71 μs	90.44 μs	0.85	0.05	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Tests.Perf_FileStream*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.IO.Tests.Perf_FileStream.Flush(fileSize: 1024, options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.01604552734375 < 2.077372990284598. IsChangePoint: Marked as a change because one of 4/27/2022 1:24:17 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.584216768077027 (T) = (0 -2027602.4558585063) / Math.Sqrt((10921221131.913696 / (299)) + (1094983712.1042264 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.05771578477772572 = (2151794.992533349 - 2027602.4558585063) / 2151794.992533349 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_FileStream.ReadByte(fileSize: 1024, options: Asynchronous) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 58.489515480649175 < 68.03149541535264. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.136907972431219 (T) = (0 -59162.50321282614) / Math.Sqrt((25098512.45292949 / (299)) + (824353.4022327511 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.06519900687110076 = (63288.875009430216 - 59162.50321282614) / 63288.875009430216 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_FileStream.ReadByte(fileSize: 1024, options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 59.037933647798745 < 68.10146592661181. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.076479108366193 (T) = (0 -59146.63223444862) / Math.Sqrt((25815524.677958976 / (299)) + (921635.2422520106 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.06619253871292757 = (63339.21572325676 - 59146.63223444862) / 63339.21572325676 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_FileStream.SeekBackward(fileSize: 1024, options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.1400944024234694 < 1.241912087842691. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 18.658351294628044 (T) = (0 -1177805.575771161) / Math.Sqrt((1776749941.315152 / (299)) + (440494890.5405875 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.0558651674399863 = (1247497.2166608353 - 1177805.575771161) / 1247497.2166608353 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_FileStream.WriteByte(fileSize: 1024, options: Asynchronous) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 90.28027230952381 < 101.77087094142409. IsChangePoint: Marked as a change because one of 4/27/2022 1:24:17 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.697275440904434 (T) = (0 -90995.92363599269) / Math.Sqrt((37422320.43327384 / (299)) + (1365590.117872457 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.06625749449762208 = (97452.909233295 - 90995.92363599269) / 97452.909233295 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_FileStream.SeekForward(fileSize: 1024, options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 276.55072431077696 < 342.508209205638. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.89294649097732 (T) = (0 -280009.17203966586) / Math.Sqrt((866943375.1565053 / (299)) + (29222943.8444692 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08956790705008669 = (307556.3506690557 - 280009.17203966586) / 307556.3506690557 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_FileStream.SeekBackward(fileSize: 1024, options: Asynchronous) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.1980204752747254 < 1.2549840780691963. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 19.769320350867233 (T) = (0 -1175852.858660674) / Math.Sqrt((2007160076.6655512 / (299)) + (362054837.4633307 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.057522454012642193 = (1247618.9630903383 - 1175852.858660674) / 1247618.9630903383 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_FileStream.SeekForward(fileSize: 1024, options: Asynchronous) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 282.0035543011676 < 344.09154990590105. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.816838025773066 (T) = (0 -277768.26899691427) / Math.Sqrt((858572476.6387403 / (299)) + (11209029.054190636 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09592891299549404 = (307241.6240157118 - 277768.26899691427) / 307241.6240157118 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_FileStream.Read(fileSize: 1048576, userBufferSize: 4096, options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 390.92481294642863 < 405.31056650188697. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 18.747521339558997 (T) = (0 -386396.09367081523) / Math.Sqrt((210826699.5791099 / (299)) + (26744538.041047383 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.05012040914549585 = (406784.28865201364 - 386396.09367081523) / 406784.28865201364 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_FileStream.WriteByte(fileSize: 1024, options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 90.44077195420186 < 102.1451610973938. IsChangePoint: Marked as a change because one of 4/27/2022 1:24:17 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.017032087375956 (T) = (0 -91124.28790890405) / Math.Sqrt((36787631.85121926 / (299)) + (2007453.4799563026 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.06560063303030515 = (97521.77829959881 - 91124.28790890405) / 97521.77829959881 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Collections.IterateForEachNonGeneric<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[SortedList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateForEachNonGeneric(String).SortedList(Size%3a%20512).html>)	70.27 μs	64.01 μs	0.91	0.08	False
[Stack - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateForEachNonGeneric(String).Stack(Size%3a%20512).html>)	41.60 μs	31.56 μs	0.76	0.12	False
[Queue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateForEachNonGeneric(String).Queue(Size%3a%20512).html>)	46.75 μs	36.57 μs	0.78	0.12	False
[ArrayList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateForEachNonGeneric(String).ArrayList(Size%3a%20512).html>)	36.69 μs	28.03 μs	0.76	0.10	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.IterateForEachNonGeneric<String>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.IterateForEachNonGeneric<String>.SortedList(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 64.01008067835367 < 66.9208075541177. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.399118468067915 (T) = (0 -58063.59183810295) / Math.Sqrt((22835321.203754578 / (299)) + (1451859.1175446208 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07819274098743986 = (62988.86374609445 - 58063.59183810295) / 62988.86374609445 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateForEachNonGeneric<String>.Stack(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 31.563542062441602 < 39.11993494018598. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.220401648881001 (T) = (0 -31175.716051849366) / Math.Sqrt((19489772.98344223 / (299)) + (271387.67035992065 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07262746257943367 = (33617.251744981404 - 31175.716051849366) / 33617.251744981404 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateForEachNonGeneric<String>.Queue(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 36.56770218387155 < 44.31645673086462. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.917748458370557 (T) = (0 -37091.863416255816) / Math.Sqrt((13534290.436713457 / (299)) + (1187411.6428604228 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.0882057019465999 = (40680.07827581687 - 37091.863416255816) / 40680.07827581687 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateForEachNonGeneric<String>.ArrayList(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 28.026149141278374 < 34.89535730588235. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.283907863510157 (T) = (0 -28233.857646465214) / Math.Sqrt((14178430.37183441 / (299)) + (199108.8426622049 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.06212798869607547 = (30104.169125605582 - 28233.857646465214) / 30104.169125605582 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Tests.Perf_Uri

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Unescape - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Uri.Unescape.html>)	1.69 μs	1.15 μs	0.68	0.02	False
[PathAndQuery - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Uri.PathAndQuery.html>)	42.42 ns	29.95 ns	0.71	0.24	False
[GetComponents - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Uri.GetComponents.html>)	696.32 ns	526.89 ns	0.76	0.13	False
[Ctor - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Uri.Ctor.html>)	2.05 μs	1.38 μs	0.68	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Uri*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Tests.Perf_Uri.Unescape ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.1500436292431513 < 1.5440853793471059. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.422190694839381 (T) = (0 -1151.9830739893823) / Math.Sqrt((42413.24794860329 / (299)) + (214.05126224784425 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08984806545014684 = (1265.7041426376081 - 1151.9830739893823) / 1265.7041426376081 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Uri.PathAndQuery ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 29.947524899407462 < 40.88190186250573. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 18.223396788427838 (T) = (0 -32.91930531713693) / Math.Sqrt((16.5133682234696 / (299)) + (2.5015533225701185 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14891332980164126 = (38.67914569671804 - 32.91930531713693) / 38.67914569671804 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Uri.GetComponents ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 526.8854651316486 < 664.131597337666. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 18.274364995112403 (T) = (0 -531.4508923716995) / Math.Sqrt((3054.640438098772 / (299)) + (143.58533698126826 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10947036596603209 = (596.7806932648668 - 531.4508923716995) / 596.7806932648668 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Uri.Ctor ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.3834304860614726 < 1.9486752442863273. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 5.973331734492117 (T) = (0 -1355.8082947823875) / Math.Sqrt((100418.14276681359 / (299)) + (278.0145921563883 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07521685466901963 = (1466.0824017258046 - 1355.8082947823875) / 1466.0824017258046 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Tests.Perf_DateTimeOffset

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_DateTimeOffset.ToString(format%3a%20%22r%22).html>)	979.58 ns	732.69 ns	0.75	0.04	False
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_DateTimeOffset.ToString(format%3a%20null).html>)	10.84 μs	9.30 μs	0.86	0.01	False
[GetNow - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_DateTimeOffset.GetNow.html>)	3.51 μs	2.70 μs	0.77	0.08	False
[op_Subtraction - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_DateTimeOffset.op_Subtraction.html>)	128.03 ns	104.34 ns	0.81	0.15	False
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_DateTimeOffset.ToString(format%3a%20%22o%22).html>)	1.32 μs	952.25 ns	0.72	0.02	False
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_DateTimeOffset.ToString(value%3a%2012%2f30%2f2017%203%3a45%3a22%20AM%20-08%3a00).html>)	10.99 μs	9.19 μs	0.84	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_DateTimeOffset*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Tests.Perf_DateTimeOffset.ToString(format: "r") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 732.6905932182966 < 931.1607447266156. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.3118873091499 (T) = (0 -738.0810896549717) / Math.Sqrt((10824.051799516692 / (299)) + (195.99580870819912 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07363985825364484 = (796.7539366099629 - 738.0810896549717) / 796.7539366099629 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_DateTimeOffset.ToString(format: null) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 9.297255609646497 < 10.308022185477373. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/1/2022 6:40:18 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 39.94960403320775 (T) = (0 -9214.743367338939) / Math.Sqrt((259067.6324520336 / (299)) + (10154.096926383349 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12323339395329831 = (10509.915984240974 - 9214.743367338939) / 10509.915984240974 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_DateTimeOffset.GetNow ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.6963373548375165 < 3.2684831633638276. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 4.0846717725642545 (T) = (0 -2687.8966148439063) / Math.Sqrt((156581.18861532537 / (299)) + (101555.42847191481 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.06843865491967924 = (2885.3672697337515 - 2687.8966148439063) / 2885.3672697337515 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_DateTimeOffset.op_Subtraction ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 104.33986620881869 < 120.51756779338446. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.412609023346121 (T) = (0 -103.98471743824858) / Math.Sqrt((93.88813698956372 / (299)) + (5.485438947497547 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.06580816209469179 = (111.30981156012702 - 103.98471743824858) / 111.30981156012702 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_DateTimeOffset.ToString(format: "o") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 952.2543534782131 < 1.2356602113926307. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.63687458130104 (T) = (0 -973.428860078275) / Math.Sqrt((17141.092008851378 / (299)) + (139.4326558349687 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08463359983294434 = (1063.4308402631152 - 973.428860078275) / 1063.4308402631152 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_DateTimeOffset.ToString(value: 12/30/2017 3:45:22 AM -08:00) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 9.191676729910714 < 10.383433864185536. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/1/2022 6:40:18 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 39.977699601935 (T) = (0 -9246.17176990316) / Math.Sqrt((261279.30073834816 / (299)) + (8435.403052059408 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12170954424914901 = (10527.464700727736 - 9246.17176990316) / 10527.464700727736 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Numerics.Tests.Perf_Vector3

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[LengthBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector3.LengthBenchmark.html>)	25.66 ns	15.70 ns	0.61	0.34	False
[AddOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector3.AddOperatorBenchmark.html>)	33.81 ns	23.91 ns	0.71	0.28	False
[AbsBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector3.AbsBenchmark.html>)	61.83 ns	35.89 ns	0.58	0.19	False
[MultiplyByScalarOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector3.MultiplyByScalarOperatorBenchmark.html>)	56.88 ns	44.63 ns	0.78	0.17	False
[UnitXBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector3.UnitXBenchmark.html>)	25.36 ns	19.38 ns	0.76	0.33	False
[NegateOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector3.NegateOperatorBenchmark.html>)	33.74 ns	24.02 ns	0.71	0.34	False
[AddFunctionBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector3.AddFunctionBenchmark.html>)	33.88 ns	23.81 ns	0.70	0.24	False
[DistanceBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector3.DistanceBenchmark.html>)	50.97 ns	35.22 ns	0.69	0.18	False
[MinBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector3.MinBenchmark.html>)	54.47 ns	38.76 ns	0.71	0.20	False
[TransformNormalByMatrix4x4Benchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector3.TransformNormalByMatrix4x4Benchmark.html>)	78.04 ns	43.33 ns	0.56	0.19	False
[TransformByMatrix4x4Benchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector3.TransformByMatrix4x4Benchmark.html>)	81.96 ns	49.44 ns	0.60	0.22	False
[OneBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector3.OneBenchmark.html>)	33.15 ns	27.44 ns	0.83	0.24	False
[SubtractFunctionBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector3.SubtractFunctionBenchmark.html>)	33.80 ns	24.37 ns	0.72	0.27	False
[MaxBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector3.MaxBenchmark.html>)	47.57 ns	31.81 ns	0.67	0.18	False
[NegateBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector3.NegateBenchmark.html>)	34.39 ns	23.78 ns	0.69	0.28	False
[GetHashCodeBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector3.GetHashCodeBenchmark.html>)	260.95 ns	188.27 ns	0.72	0.05	False
[LengthSquaredBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector3.LengthSquaredBenchmark.html>)	23.51 ns	14.84 ns	0.63	0.34	False
[ClampBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector3.ClampBenchmark.html>)	109.64 ns	72.66 ns	0.66	0.14	False
[CreateFromScalar - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector3.CreateFromScalar.html>)	25.43 ns	20.78 ns	0.82	0.28	False
[EqualityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector3.EqualityOperatorBenchmark.html>)	13.81 ns	11.60 ns	0.84	0.33	False
[MultiplyOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector3.MultiplyOperatorBenchmark.html>)	33.97 ns	24.02 ns	0.71	0.35	False
[LerpBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector3.LerpBenchmark.html>)	156.54 ns	120.16 ns	0.77	0.11	False
[SubtractOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector3.SubtractOperatorBenchmark.html>)	34.32 ns	23.93 ns	0.70	0.30	False
[ReflectBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector3.ReflectBenchmark.html>)	106.25 ns	76.62 ns	0.72	0.14	False
[TransformByQuaternionBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector3.TransformByQuaternionBenchmark.html>)	152.41 ns	92.67 ns	0.61	0.16	False
[DotBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector3.DotBenchmark.html>)	22.82 ns	14.64 ns	0.64	0.38	False
[UnitZBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector3.UnitZBenchmark.html>)	25.52 ns	21.06 ns	0.83	0.33	False
[CrossBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector3.CrossBenchmark.html>)	52.82 ns	33.66 ns	0.64	0.20	False
[UnitYBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector3.UnitYBenchmark.html>)	25.91 ns	20.99 ns	0.81	0.27	False
[MultiplyFunctionBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector3.MultiplyFunctionBenchmark.html>)	33.88 ns	23.80 ns	0.70	0.29	False
[DistanceSquaredBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector3.DistanceSquaredBenchmark.html>)	48.87 ns	33.40 ns	0.68	0.24	False
[MultiplyByScalarBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Vector3.MultiplyByScalarBenchmark.html>)	56.90 ns	45.85 ns	0.81	0.20	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_Vector3*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_Vector3.LengthBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 15.695677042912036 < 24.037647545535304. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.20200605899605 (T) = (0 -15.879651340118313) / Math.Sqrt((14.970798618901116 / (299)) + (0.9608624265710369 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14279241204295945 = (18.52486091258694 - 15.879651340118313) / 18.52486091258694 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector3.AddOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 23.911862599640802 < 32.11091102690516. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.333156033820627 (T) = (0 -24.37303744949354) / Math.Sqrt((16.077578232702972 / (299)) + (0.5456963679231713 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09665464222638945 = (26.98086312145717 - 24.37303744949354) / 26.98086312145717 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector3.AbsBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 35.89055363779571 < 57.564769479083914. IsChangePoint: Marked as a change because one of 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 88.46000132021594 (T) = (0 -37.24644186182345) / Math.Sqrt((8.47988110742071 / (299)) + (3.5268806084327453 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.41937114670163705 = (64.14845154566221 - 37.24644186182345) / 64.14845154566221 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector3.MultiplyByScalarOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 44.628173447321615 < 54.17072270670425. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.37615815717834 (T) = (0 -45.21834236316835) / Math.Sqrt((21.97851070733332 / (299)) + (2.041706839060692 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.08343853100276202 = (49.334762471129594 - 45.21834236316835) / 49.334762471129594 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector3.UnitXBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 19.37877049948414 < 24.323282057429108. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.935088968805301 (T) = (0 -21.59330766021824) / Math.Sqrt((5.489359044898525 / (299)) + (0.6852833899988485 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08137235017239515 = (23.506050208994438 - 21.59330766021824) / 23.506050208994438 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector3.NegateOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 24.019918859517762 < 32.05738319881218. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.153631270838864 (T) = (0 -23.980168105949783) / Math.Sqrt((21.87471273525464 / (299)) + (0.5958355702355074 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07957626483254637 = (26.05340039562001 - 23.980168105949783) / 26.05340039562001 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector3.AddFunctionBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 23.812319976380902 < 32.05833269205317. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.732485008403217 (T) = (0 -24.69013386009664) / Math.Sqrt((16.702270094365655 / (299)) + (3.346933773430626 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08485397342838634 = (26.97944715183063 - 24.69013386009664) / 26.97944715183063 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector3.DistanceBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 35.21606982708127 < 48.42277442587242. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.801524893416437 (T) = (0 -35.04767825602316) / Math.Sqrt((43.51422452987047 / (299)) + (2.8101385685427966 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1199848554249523 = (39.82622171002228 - 35.04767825602316) / 39.82622171002228 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector3.MinBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 38.75523314002748 < 51.71142629592438. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.231102551963774 (T) = (0 -39.67354580863382) / Math.Sqrt((36.74821625614951 / (299)) + (3.182855803832787 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09855600193535144 = (44.01110428802097 - 39.67354580863382) / 44.01110428802097 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector3.TransformNormalByMatrix4x4Benchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 43.32721016019592 < 69.38228992706802. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 21.429295016558054 (T) = (0 -43.82713855240754) / Math.Sqrt((80.05702972399435 / (299)) + (6.82289144716422 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.2338265726137968 = (57.20263452874319 - 43.82713855240754) / 57.20263452874319 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector3.TransformByMatrix4x4Benchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 49.439342224638644 < 78.2186955721053. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 20.830183988159064 (T) = (0 -49.55919180271045) / Math.Sqrt((117.31362859263425 / (299)) + (3.7284710352263444 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.22163044887509228 = (63.67051708418835 - 49.55919180271045) / 63.67051708418835 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector3.OneBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 27.43648049072157 < 31.48546226745999. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.597297505498876 (T) = (0 -28.14056453239079) / Math.Sqrt((4.315709318871354 / (299)) + (1.3956448241942778 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10475012193613481 = (31.433195604840176 - 28.14056453239079) / 31.433195604840176 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector3.SubtractFunctionBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 24.369380085426375 < 32.13184790741111. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.62141568842514 (T) = (0 -24.71886268661707) / Math.Sqrt((17.96174955158828 / (299)) + (0.4773339966805722 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08370238494807296 = (26.976892966393063 - 24.71886268661707) / 26.976892966393063 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector3.MaxBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 31.808394814177632 < 45.70894612763411. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 9:07:46 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.342550281750153 (T) = (0 -32.44657540624436) / Math.Sqrt((45.181800797101545 / (299)) + (1.1544845900933236 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.10681203752808749 = (36.32670475814287 - 32.44657540624436) / 36.32670475814287 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector3.NegateBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 23.779190878487952 < 32.41830757103676. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.1617013420423765 (T) = (0 -24.256173996317138) / Math.Sqrt((21.01158008618617 / (299)) + (0.774575163281059 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.0686147414269435 = (26.043115642048267 - 24.256173996317138) / 26.043115642048267 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector3.GetHashCodeBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 188.26797113461126 < 247.5476537212594. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.828729127199889 (T) = (0 -189.3403124649898) / Math.Sqrt((709.8232944172596 / (299)) + (10.292408907633915 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11137661719032488 = (213.07149477242893 - 189.3403124649898) / 213.07149477242893 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector3.LengthSquaredBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 14.835574333687898 < 22.21710737042422. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.500792549868594 (T) = (0 -14.651843251209872) / Math.Sqrt((16.69423796286966 / (299)) + (1.347624136893219 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.1119877823050976 = (16.499596468664645 - 14.651843251209872) / 16.499596468664645 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector3.ClampBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 72.65985627028893 < 96.86255706655386. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.839297917217094 (T) = (0 -73.76401255313927) / Math.Sqrt((209.70786540885018 / (299)) + (31.64807040432387 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09483198261953343 = (81.49206681717551 - 73.76401255313927) / 81.49206681717551 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector3.CreateFromScalar ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 20.778648495063994 < 23.948814814251453. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.381964284408754 (T) = (0 -21.652928294130447) / Math.Sqrt((2.3960053659973966 / (299)) + (0.3032922482990354 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07147013460836153 = (23.31958195550081 - 21.652928294130447) / 23.31958195550081 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector3.EqualityOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 11.604885657310017 < 13.233106170344575. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 4.651778337399375 (T) = (0 -9.902912984320277) / Math.Sqrt((3.0876002231141926 / (299)) + (2.108298359676591 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09328904075689883 = (10.921796944626072 - 9.902912984320277) / 10.921796944626072 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector3.MultiplyOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 24.019273473194932 < 32.08155590133624. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.417764267403845 (T) = (0 -24.786662488739285) / Math.Sqrt((17.858229063869878 / (299)) + (1.2168965522843538 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07869082205547147 = (26.903739897652116 - 24.786662488739285) / 26.903739897652116 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector3.LerpBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 120.16128063504857 < 148.81977987663248. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.809060682348544 (T) = (0 -122.00088351145584) / Math.Sqrt((177.26643692498388 / (299)) + (7.1975813185272735 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08770462013297263 = (133.7295860571367 - 122.00088351145584) / 133.7295860571367 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector3.SubtractOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 23.933642131614953 < 32.11307800400175. IsChangePoint: Marked as a change because one of 5/25/2022 12:28:02 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.987170633710931 (T) = (0 -24.743862387959307) / Math.Sqrt((16.746543438194866 / (299)) + (1.882625494274644 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.0779485438842703 = (26.835663263519237 - 24.743862387959307) / 26.835663263519237 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector3.ReflectBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 76.62379482072703 < 100.90386719475032. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.29566022315529 (T) = (0 -76.6962968332199) / Math.Sqrt((146.3670412239798 / (299)) + (5.858722906160554 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10194907515689107 = (85.4030597948762 - 76.6962968332199) / 85.4030597948762 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector3.TransformByQuaternionBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 92.66952884294831 < 144.69664994354784. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.144783115554628 (T) = (0 -95.23368095007449) / Math.Sqrt((605.3377909867112 / (299)) + (8.496932069777172 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13580629068232145 = (110.19946098111029 - 95.23368095007449) / 110.19946098111029 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector3.DotBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 14.643874808871887 < 21.473491854588193. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 3.960989818837905 (T) = (0 -14.620772148825612) / Math.Sqrt((14.362242849299326 / (299)) + (6.021589299694502 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09708355265691998 = (16.192829571162054 - 14.620772148825612) / 16.192829571162054 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector3.UnitZBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 21.06272446652452 < 24.277580589949235. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.66790577116076 (T) = (0 -21.610616063441274) / Math.Sqrt((3.7918827598148863 / (299)) + (0.8170651616083348 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07537683955805433 = (23.37234993455276 - 21.610616063441274) / 23.37234993455276 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector3.CrossBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 33.66178915072524 < 50.190650836402234. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.2000636186103755 (T) = (0 -34.517603304980575) / Math.Sqrt((66.89620021331588 / (299)) + (6.441929799480084 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10856121100644324 = (38.72122655101344 - 34.517603304980575) / 38.72122655101344 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector3.UnitYBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 20.99210087219277 < 24.343650120825384. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.979935066519413 (T) = (0 -21.655637073016095) / Math.Sqrt((3.3609926813393924 / (299)) + (0.72365701526676 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07305660238513172 = (23.362415794468717 - 21.655637073016095) / 23.362415794468717 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector3.MultiplyFunctionBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 23.79709219647692 < 32.154118637416616. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.627878962549527 (T) = (0 -24.65033299979935) / Math.Sqrt((16.695261702525983 / (299)) + (2.176254774001855 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08694597082574373 = (26.997671783007746 - 24.65033299979935) / 26.997671783007746 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector3.DistanceSquaredBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 33.39559168307967 < 46.631801479896225. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.468282908134025 (T) = (0 -34.32167695234379) / Math.Sqrt((43.099646906264155 / (299)) + (8.712614632219612 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10644767598395272 = (38.4103717598606 - 34.32167695234379) / 38.4103717598606 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Vector3.MultiplyByScalarBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 45.85145909184565 < 54.015096493220305. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.297730406979863 (T) = (0 -45.07868017150988) / Math.Sqrt((22.656096206234547 / (299)) + (0.7813778547593007 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08676376272886983 = (49.36146676155876 - 45.07868017150988) / 49.36146676155876 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in PerfLabTests.LowLevelPerf

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[GenericClassGenericInstanceMethod - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.LowLevelPerf.GenericClassGenericInstanceMethod.html>)	2.15 ms	1.68 ms	0.78	0.13	False
[EmptyInstanceFunction - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.LowLevelPerf.EmptyInstanceFunction.html>)	15.94 ms	13.34 ms	0.84	0.16	False
[ForeachOverList100Elements - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.LowLevelPerf.ForeachOverList100Elements.html>)	404.63 ms	283.19 ms	0.70	0.13	False
[ObjectStringIsString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.LowLevelPerf.ObjectStringIsString.html>)	1.32 ms	879.72 μs	0.66	0.14	False
[InterfaceInterfaceMethod - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.LowLevelPerf.InterfaceInterfaceMethod.html>)	29.25 ms	25.20 ms	0.86	0.13	False
[GenericClassGenericStaticField - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.LowLevelPerf.GenericClassGenericStaticField.html>)	897.04 μs	541.59 μs	0.60	0.09	False
[EmptyStaticFunction5Arg - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.LowLevelPerf.EmptyStaticFunction5Arg.html>)	21.41 ms	14.85 ms	0.69	0.13	False
[StructWithInterfaceInterfaceMethod - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.LowLevelPerf.StructWithInterfaceInterfaceMethod.html>)	2.02 ms	1.56 ms	0.77	0.11	False
[IntegerFormatting - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.LowLevelPerf.IntegerFormatting.html>)	6.49 ms	6.00 ms	0.92	0.01	False
[GenericClassWithIntGenericInstanceField - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.LowLevelPerf.GenericClassWithIntGenericInstanceField.html>)	1.05 ms	665.69 μs	0.63	0.07	False
[ClassVirtualMethod - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.LowLevelPerf.ClassVirtualMethod.html>)	2.54 ms	2.08 ms	0.82	0.19	False
[InstanceDelegate - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.LowLevelPerf.InstanceDelegate.html>)	2.25 ms	1.69 ms	0.75	0.19	False
[StaticDelegate - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.LowLevelPerf.StaticDelegate.html>)	2.21 ms	1.74 ms	0.79	0.21	False
[InterfaceInterfaceMethodLongHierarchy - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.LowLevelPerf.InterfaceInterfaceMethodLongHierarchy.html>)	2.52 ms	2.19 ms	0.87	0.07	False
[SealedClassInterfaceMethod - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.LowLevelPerf.SealedClassInterfaceMethod.html>)	2.64 ms	2.08 ms	0.79	0.18	False
[StaticIntPlus - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.LowLevelPerf.StaticIntPlus.html>)	1.14 ms	727.08 μs	0.64	0.16	False
[TypeReflectionObjectGetType - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.LowLevelPerf.TypeReflectionObjectGetType.html>)	948.37 μs	603.67 μs	0.64	0.13	False
[GenericClassGenericStaticMethod - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.LowLevelPerf.GenericClassGenericStaticMethod.html>)	2.06 ms	1.65 ms	0.80	0.10	False
[TypeReflectionArrayGetType - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.LowLevelPerf.TypeReflectionArrayGetType.html>)	949.48 μs	604.87 μs	0.64	0.14	False
[GenericGenericMethod - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.LowLevelPerf.GenericGenericMethod.html>)	1.92 ms	1.50 ms	0.78	0.14	False
[MeasureEvents - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.LowLevelPerf.MeasureEvents.html>)	204.94 ms	156.24 ms	0.76	0.10	False
[GenericClassWithSTringGenericInstanceMethod - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.LowLevelPerf.GenericClassWithSTringGenericInstanceMethod.html>)	843.46 μs	640.63 μs	0.76	0.11	False
[EmptyStaticFunction - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.LowLevelPerf.EmptyStaticFunction.html>)	13.96 ms	12.41 ms	0.89	0.12	False
[InterfaceInterfaceMethodSwitchCallType - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.LowLevelPerf.InterfaceInterfaceMethodSwitchCallType.html>)	4.54 ms	3.94 ms	0.87	0.10	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'PerfLabTests.LowLevelPerf*'

### Payloads [Baseline]() [Compare]() ### Histogram #### PerfLabTests.LowLevelPerf.GenericClassGenericInstanceMethod ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.6791287830357142 < 2.0228784848675736. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 23.86109926579402 (T) = (0 -1568451.7495208562) / Math.Sqrt((29241083600.961323 / (299)) + (1381720892.9756784 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.1445570319341618 = (1833496.5720358135 - 1568451.7495208562) / 1833496.5720358135 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.LowLevelPerf.EmptyInstanceFunction ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 13.337391822916667 < 15.219774874851192. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 36.77433578702217 (T) = (0 -13314877.854092369) / Math.Sqrt((441575457716.59863 / (299)) + (78827897122.6247 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12967109686632536 = (15298673.646424131 - 13314877.854092369) / 15298673.646424131 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.LowLevelPerf.ForeachOverList100Elements ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 283.18635026666664 < 384.36378384464285. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.885210982859467 (T) = (0 -285499042.1051216) / Math.Sqrt((2050048839058242.2 / (299)) + (20368689169405.56 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13006125152746525 = (328182923.92011464 - 285499042.1051216) / 328182923.92011464 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.LowLevelPerf.ObjectStringIsString ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 879.7239472222225 < 1.2573645670559563. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.897024135761571 (T) = (0 -888046.8187810363) / Math.Sqrt((31982458568.18493 / (299)) + (661848355.7405257 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.13675907169090804 = (1028735.7673373225 - 888046.8187810363) / 1028735.7673373225 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.LowLevelPerf.InterfaceInterfaceMethod ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 25.19652630666667 < 27.80088705958333. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 24.473856677222674 (T) = (0 -25388584.56122994) / Math.Sqrt((1307623759912.1938 / (299)) + (301859442023.802 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08696745208476693 = (27806877.88097018 - 25388584.56122994) / 27806877.88097018 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.LowLevelPerf.GenericClassGenericStaticField ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 541.5880748152709 < 852.3331837330841. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.254391993516862 (T) = (0 -544645.0295868972) / Math.Sqrt((20487569145.157246 / (299)) + (265778549.99912167 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.15036558534480182 = (641034.567565071 - 544645.0295868972) / 641034.567565071 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.LowLevelPerf.EmptyStaticFunction5Arg ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 14.854532723214286 < 19.304453933952992. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 23.501390514409948 (T) = (0 -15048499.04391868) / Math.Sqrt((2419109391603.737 / (299)) + (281510984026.4666 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15172733944530284 = (17740167.45285444 - 15048499.04391868) / 17740167.45285444 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.LowLevelPerf.StructWithInterfaceInterfaceMethod ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.5586024224999997 < 1.9211330228245906. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 19.977622414302363 (T) = (0 -1559871.0230822829) / Math.Sqrt((23856778629.070232 / (299)) + (1487592473.9531233 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11690206086093195 = (1766362.4315588379 - 1559871.0230822829) / 1766362.4315588379 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.LowLevelPerf.IntegerFormatting ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.00370336607143 < 6.152401667305307. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 40.36083595242027 (T) = (0 -6009990.742413212) / Math.Sqrt((9418312353.140278 / (299)) + (4857331066.166695 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.06847551144158137 = (6451779.65392405 - 6009990.742413212) / 6451779.65392405 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.LowLevelPerf.GenericClassWithIntGenericInstanceField ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 665.6879659280936 < 0.9997962250763891. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.299149799107207 (T) = (0 -667984.041668838) / Math.Sqrt((22553528053.3961 / (299)) + (48972069.53339742 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1481482397161072 = (784155.2636414368 - 667984.041668838) / 784155.2636414368 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.LowLevelPerf.ClassVirtualMethod ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.0759067854166666 < 2.4132229028457775. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.300807518871121 (T) = (0 -2115635.9048073776) / Math.Sqrt((33135249869.989895 / (299)) + (4406581368.560682 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.05706584206365057 = (2243672.9934967407 - 2115635.9048073776) / 2243672.9934967407 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.LowLevelPerf.InstanceDelegate ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.694841828703704 < 2.1452201293377975. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.931752790852242 (T) = (0 -1723899.4709790356) / Math.Sqrt((36980288129.169716 / (299)) + (3428114678.474015 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11193448394108645 = (1941185.013724453 - 1723899.4709790356) / 1941185.013724453 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.LowLevelPerf.StaticDelegate ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.7407219648148147 < 2.100067482903911. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 28.175679158729945 (T) = (0 -1740934.2250302131) / Math.Sqrt((21118753228.214165 / (299)) + (1057903605.4932097 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.13301511721143577 = (2008032.9652700336 - 1740934.2250302131) / 2008032.9652700336 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.LowLevelPerf.InterfaceInterfaceMethodLongHierarchy ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.188757456473214 < 2.391996177723214. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 19.587044148844907 (T) = (0 -2186591.4877563897) / Math.Sqrt((13217644836.887482 / (299)) + (904644510.5112133 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.06506664977086839 = (2338767.2364243977 - 2186591.4877563897) / 2338767.2364243977 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.LowLevelPerf.SealedClassInterfaceMethod ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.0764835390625 < 2.4085520301434946. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.073558437286989 (T) = (0 -2113215.0126127247) / Math.Sqrt((35228837352.74774 / (299)) + (3195607256.63718 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.05930179287097534 = (2246432.486633707 - 2113215.0126127247) / 2246432.486633707 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.LowLevelPerf.StaticIntPlus ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 727.0843307629871 < 1.079962642328869. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.546941041550097 (T) = (0 -722031.1290561411) / Math.Sqrt((25241464226.9732 / (299)) + (620036607.2759055 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15493762246411644 = (854411.6366433338 - 722031.1290561411) / 854411.6366433338 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.LowLevelPerf.TypeReflectionObjectGetType ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 603.6678378205129 < 901.2397525947399. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.779514755781749 (T) = (0 -606196.8415859987) / Math.Sqrt((17135137486.582886 / (299)) + (110626136.55419365 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.15813381673822333 = (720063.1806320018 - 606196.8415859987) / 720063.1806320018 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.LowLevelPerf.GenericClassGenericStaticMethod ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.6514239673076927 < 1.9613444439043897. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 34.39199822446542 (T) = (0 -1623480.2511146495) / Math.Sqrt((11598681692.501217 / (299)) + (1304522384.1836638 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.14346072141009159 = (1895394.982688161 - 1623480.2511146495) / 1895394.982688161 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.LowLevelPerf.TypeReflectionArrayGetType ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 604.8664391025642 < 901.684593270746. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.62746869509859 (T) = (0 -608291.3206607323) / Math.Sqrt((22461865458.815662 / (299)) + (456405844.14838 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15926395523732875 = (723522.352169931 - 608291.3206607323) / 723522.352169931 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.LowLevelPerf.GenericGenericMethod ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.4950111901515148 < 1.7879426678331678. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 28.628800460610623 (T) = (0 -1487614.748032306) / Math.Sqrt((13413851400.439983 / (299)) + (904577171.9654653 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1306809056759576 = (1711241.3125919346 - 1487614.748032306) / 1711241.3125919346 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.LowLevelPerf.MeasureEvents ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 156.23919760714287 < 180.05142761414837. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.685945915838687 (T) = (0 -157788593.7551119) / Math.Sqrt((117599128233744.8 / (299)) + (73041757718024.05 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1081527809360188 = (176923345.5935597 - 157788593.7551119) / 176923345.5935597 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.LowLevelPerf.GenericClassWithSTringGenericInstanceMethod ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 640.6272838541668 < 801.9236761160714. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.8634289912594 (T) = (0 -639550.0470023197) / Math.Sqrt((5100605293.620532 / (299)) + (314496861.2041757 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11762312708442046 = (724803.7280137418 - 639550.0470023197) / 724803.7280137418 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.LowLevelPerf.EmptyStaticFunction ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 12.407814493750001 < 13.273214666874999. IsChangePoint: Marked as a change because one of 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 37.480245981249894 (T) = (0 -12464471.24673769) / Math.Sqrt((156560958782.5865 / (299)) + (74375336635.09468 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11457061426474631 = (14077318.245302295 - 12464471.24673769) / 14077318.245302295 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.LowLevelPerf.InterfaceInterfaceMethodSwitchCallType ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.935211715401786 < 4.289541665797991. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 18.785284044055285 (T) = (0 -3973723.457914653) / Math.Sqrt((28680186544.967995 / (299)) + (7181544184.746717 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.0661000353111993 = (4254977.629471052 - 3973723.457914653) / 4254977.629471052 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Text.Json.Tests.Perf_Strings

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[WriteStringsUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted%3a%20True%2c%20SkipValidation%3a%20False%2c%20Escaped%3a%20OneEscaped).html>)	643.18 ms	441.87 ms	0.69	0.05	False
[WriteStringsUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted%3a%20False%2c%20SkipValidation%3a%20True%2c%20Escaped%3a%20NoneEscaped).html>)	324.58 ms	190.43 ms	0.59	0.03	False
[WriteStringsUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted%3a%20True%2c%20SkipValidation%3a%20False%2c%20Escaped%3a%20AllEscaped).html>)	1.05 secs	669.93 ms	0.64	0.05	False
[WriteStringsUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted%3a%20True%2c%20SkipValidation%3a%20True%2c%20Escaped%3a%20AllEscaped).html>)	1.05 secs	659.11 ms	0.63	0.07	False
[WriteStringsUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted%3a%20False%2c%20SkipValidation%3a%20False%2c%20Escaped%3a%20AllEscaped).html>)	789.23 ms	561.16 ms	0.71	0.11	False
[WriteStringsUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted%3a%20False%2c%20SkipValidation%3a%20False%2c%20Escaped%3a%20NoneEscaped).html>)	335.95 ms	190.27 ms	0.57	0.04	False
[WriteStringsUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted%3a%20False%2c%20SkipValidation%3a%20False%2c%20Escaped%3a%20OneEscaped).html>)	633.13 ms	448.09 ms	0.71	0.05	False
[WriteStringsUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted%3a%20True%2c%20SkipValidation%3a%20False%2c%20Escaped%3a%20NoneEscaped).html>)	338.86 ms	196.50 ms	0.58	0.04	False
[WriteStringsUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted%3a%20True%2c%20SkipValidation%3a%20False%2c%20Escaped%3a%20NoneEscaped).html>)	698.95 ms	489.24 ms	0.70	0.11	False
[WriteStringsUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted%3a%20False%2c%20SkipValidation%3a%20False%2c%20Escaped%3a%20OneEscaped).html>)	388.41 ms	243.57 ms	0.63	0.03	False
[WriteStringsUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted%3a%20False%2c%20SkipValidation%3a%20True%2c%20Escaped%3a%20AllEscaped).html>)	1.04 secs	652.88 ms	0.63	0.10	False
[WriteStringsUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted%3a%20True%2c%20SkipValidation%3a%20True%2c%20Escaped%3a%20AllEscaped).html>)	796.13 ms	570.31 ms	0.72	0.16	False
[WriteStringsUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted%3a%20False%2c%20SkipValidation%3a%20True%2c%20Escaped%3a%20OneEscaped).html>)	632.46 ms	430.04 ms	0.68	0.07	False
[WriteStringsUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted%3a%20False%2c%20SkipValidation%3a%20True%2c%20Escaped%3a%20OneEscaped).html>)	384.16 ms	238.28 ms	0.62	0.04	False
[WriteStringsUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted%3a%20False%2c%20SkipValidation%3a%20False%2c%20Escaped%3a%20NoneEscaped).html>)	689.41 ms	466.62 ms	0.68	0.13	False
[WriteStringsUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted%3a%20False%2c%20SkipValidation%3a%20True%2c%20Escaped%3a%20AllEscaped).html>)	873.77 ms	523.37 ms	0.60	0.12	False
[WriteStringsUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted%3a%20True%2c%20SkipValidation%3a%20False%2c%20Escaped%3a%20OneEscaped).html>)	403.38 ms	258.41 ms	0.64	0.03	False
[WriteStringsUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted%3a%20True%2c%20SkipValidation%3a%20True%2c%20Escaped%3a%20OneEscaped).html>)	394.54 ms	253.31 ms	0.64	0.04	False
[WriteStringsUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted%3a%20True%2c%20SkipValidation%3a%20False%2c%20Escaped%3a%20AllEscaped).html>)	800.32 ms	534.66 ms	0.67	0.12	False
[WriteStringsUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted%3a%20False%2c%20SkipValidation%3a%20True%2c%20Escaped%3a%20NoneEscaped).html>)	694.86 ms	464.64 ms	0.67	0.09	False
[WriteStringsUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted%3a%20True%2c%20SkipValidation%3a%20True%2c%20Escaped%3a%20NoneEscaped).html>)	335.80 ms	195.85 ms	0.58	0.05	False
[WriteStringsUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted%3a%20True%2c%20SkipValidation%3a%20True%2c%20Escaped%3a%20OneEscaped).html>)	665.48 ms	459.58 ms	0.69	0.03	False
[WriteStringsUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted%3a%20False%2c%20SkipValidation%3a%20False%2c%20Escaped%3a%20AllEscaped).html>)	1.04 secs	646.78 ms	0.62	0.11	False
[WriteStringsUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted%3a%20True%2c%20SkipValidation%3a%20True%2c%20Escaped%3a%20NoneEscaped).html>)	698.58 ms	471.28 ms	0.67	0.15	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Tests.Perf_Strings*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted: True, SkipValidation: False, Escaped: OneEscaped) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 441.86849939999996 < 612.5609462487179. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.783325828846984 (T) = (0 -444282496.9415554) / Math.Sqrt((7144981576179051 / (299)) + (38052000792954.63 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09842034651365754 = (492782301.8449313 - 444282496.9415554) / 492782301.8449313 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: False, SkipValidation: True, Escaped: NoneEscaped) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 190.42506766666665 < 307.9112820047619. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.212901482457443 (T) = (0 -190832677.82175153) / Math.Sqrt((2940133143314930.5 / (299)) + (16679688506584.848 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.14558282114261945 = (223348362.53755304 - 190832677.82175153) / 223348362.53755304 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: True, SkipValidation: False, Escaped: AllEscaped) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 669.9270271538461 < 1.0036822075377747. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.371922385963607 (T) = (0 -664905044.4445677) / Math.Sqrt((24045042522642148 / (299)) + (79365243152651.23 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14407367971294013 = (776825094.2692969 - 664905044.4445677) / 776825094.2692969 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: True, SkipValidation: True, Escaped: AllEscaped) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 659.1077009333333 < 0.997125444781282. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.598221858025322 (T) = (0 -666275162.5307225) / Math.Sqrt((23733973123672120 / (299)) + (230945412706723.75 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.13729182696719847 = (772306538.1291915 - 666275162.5307225) / 772306538.1291915 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted: False, SkipValidation: False, Escaped: AllEscaped) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 561.1643055 < 754.0175232090476. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.228673944073119 (T) = (0 -523262404.2221057) / Math.Sqrt((12005345069832072 / (299)) + (194023354115649.47 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12412913296280884 = (597419578.5186299 - 523262404.2221057) / 597419578.5186299 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: False, SkipValidation: False, Escaped: NoneEscaped) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 190.2695172142857 < 310.33279265423073. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.039396012240351 (T) = (0 -192764486.4002998) / Math.Sqrt((3003606850828921.5 / (299)) + (19739256140994.77 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.14382990859961772 = (225147419.1127225 - 192764486.4002998) / 225147419.1127225 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted: False, SkipValidation: False, Escaped: OneEscaped) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 448.0899559230769 < 601.2763741465659. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.776900239617738 (T) = (0 -435092293.70742416) / Math.Sqrt((6979482823894362 / (299)) + (61722530697925.77 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09999104574415905 = (483431072.1576918 - 435092293.70742416) / 483431072.1576918 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: True, SkipValidation: False, Escaped: NoneEscaped) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 196.5045022 < 320.10870045999997. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.33990782907914 (T) = (0 -199582807.58438644) / Math.Sqrt((3147834198114241.5 / (299)) + (5427641964338.127 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14447324586706342 = (233286459.6229496 - 199582807.58438644) / 233286459.6229496 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted: True, SkipValidation: False, Escaped: NoneEscaped) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 489.2356578 < 665.8539420686905. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.207946575673171 (T) = (0 -481316268.6176823) / Math.Sqrt((8703040252214387 / (299)) + (261855190414803.84 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10018055526907002 = (534903164.66945064 - 481316268.6176823) / 534903164.66945064 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: False, SkipValidation: False, Escaped: OneEscaped) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 243.5654555 < 367.92974339666665. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.020567106848377 (T) = (0 -242977420.81787348) / Math.Sqrt((3279054808638865.5 / (299)) + (9046220505239.336 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1314200982585715 = (279741012.11727846 - 242977420.81787348) / 279741012.11727846 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: False, SkipValidation: True, Escaped: AllEscaped) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 652.8752343846154 < 0.9881647303653847. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.446266000176575 (T) = (0 -657496027.8678358) / Math.Sqrt((23937755124757716 / (299)) + (364255796324429.3 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.13947577968599842 = (764064522.9345413 - 657496027.8678358) / 764064522.9345413 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted: True, SkipValidation: True, Escaped: AllEscaped) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 570.3088975 < 760.0868730349999. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.789346353827536 (T) = (0 -527676390.34439784) / Math.Sqrt((12346925828805608 / (299)) + (152300599002199.53 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1290891658389728 = (605890258.3899112 - 527676390.34439784) / 605890258.3899112 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted: False, SkipValidation: True, Escaped: OneEscaped) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 430.0416329230769 < 600.2583398316666. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.551500138301206 (T) = (0 -430942598.04987913) / Math.Sqrt((6849330179207157 / (299)) + (15350715791800.842 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10545528335153695 = (481745171.62704384 - 430942598.04987913) / 481745171.62704384 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: False, SkipValidation: True, Escaped: OneEscaped) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 238.28147153333333 < 364.4015241964285. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.773412412240633 (T) = (0 -240393861.58137104) / Math.Sqrt((3335926691867848.5 / (299)) + (10784632215873.22 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13117501343673815 = (276688476.15936655 - 240393861.58137104) / 276688476.15936655 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted: False, SkipValidation: False, Escaped: NoneEscaped) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 466.62062585714284 < 659.25944944. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.200273643024104 (T) = (0 -474679372.1430646) / Math.Sqrt((8581364623515761 / (299)) + (292143097352472.3 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10142894158630304 = (528260250.2033011 - 474679372.1430646) / 528260250.2033011 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted: False, SkipValidation: True, Escaped: AllEscaped) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 523.365867 < 751.5213030635897. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.68503512771147 (T) = (0 -520994342.118907) / Math.Sqrt((14786894901676736 / (299)) + (160955712570602.5 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12919193225701897 = (598288373.0846169 - 520994342.118907) / 598288373.0846169 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: True, SkipValidation: False, Escaped: OneEscaped) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 258.4066286153846 < 383.18561599217026. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.804176312508035 (T) = (0 -260050284.28795794) / Math.Sqrt((3598545169617752 / (299)) + (15868216651400.113 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11685967773848546 = (294460888.86761546 - 260050284.28795794) / 294460888.86761546 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: True, SkipValidation: True, Escaped: OneEscaped) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 253.30645035714286 < 379.87777081499996. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.003239588270743 (T) = (0 -256052542.98140052) / Math.Sqrt((3492901278751456.5 / (299)) + (16809250948788.75 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11912248382841885 = (290678940.3528441 - 256052542.98140052) / 290678940.3528441 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted: True, SkipValidation: False, Escaped: AllEscaped) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 534.6561144285714 < 763.0834933433333. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.465662420346908 (T) = (0 -530357435.7937592) / Math.Sqrt((12084611929763714 / (299)) + (121435942218873.62 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.12373804538818628 = (605249871.9161086 - 530357435.7937592) / 605249871.9161086 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted: False, SkipValidation: True, Escaped: NoneEscaped) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 464.6416576666667 < 655.4718423483333. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.945953646516559 (T) = (0 -469035479.8641714) / Math.Sqrt((8581371482505558 / (299)) + (99811708656344.97 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10480550121122297 = (523948125.7970077 - 469035479.8641714) / 523948125.7970077 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: True, SkipValidation: True, Escaped: NoneEscaped) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 195.8479447142857 < 319.1650127666667. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.705469331719396 (T) = (0 -199217662.47689694) / Math.Sqrt((3129496993227444.5 / (299)) + (23632248439648.082 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13849429271278882 = (231243578.29759705 - 199217662.47689694) / 231243578.29759705 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted: True, SkipValidation: True, Escaped: OneEscaped) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 459.5826008 < 610.162229857143. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.009497117733398 (T) = (0 -440891782.40188485) / Math.Sqrt((7154729498233820 / (299)) + (41593421813238.5 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10136354246557193 = (490623075.3329899 - 440891782.40188485) / 490623075.3329899 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: False, SkipValidation: False, Escaped: AllEscaped) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 646.7750944666667 < 0.9873577689214285. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.334471739338463 (T) = (0 -654701606.1871527) / Math.Sqrt((24102537539262076 / (299)) + (161345933971082.88 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1469037720448781 = (767441684.4585955 - 654701606.1871527) / 767441684.4585955 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted: True, SkipValidation: True, Escaped: NoneEscaped) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 471.2828403333333 < 667.650115674107. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.929952254840181 (T) = (0 -480595193.45823526) / Math.Sqrt((8689312885672396 / (299)) + (433314068365594.7 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10129853450317945 = (534766228.73041874 - 480595193.45823526) / 534766228.73041874 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Numerics.Tests.Perf_VectorOf<Byte>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[GreaterThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Byte).GreaterThanAnyBenchmark.html>)	545.70 ns	303.45 ns	0.56	0.13	False
[MaxBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Byte).MaxBenchmark.html>)	550.90 ns	307.78 ns	0.56	0.11	False
[InequalityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Byte).InequalityOperatorBenchmark.html>)	35.60 ns	21.31 ns	0.60	0.31	False
[MultiplyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Byte).MultiplyBenchmark.html>)	466.38 ns	257.07 ns	0.55	0.11	False
[GreaterThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Byte).GreaterThanAllBenchmark.html>)	560.07 ns	311.18 ns	0.56	0.10	False
[OnesComplementOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Byte).OnesComplementOperatorBenchmark.html>)	232.51 ns	134.47 ns	0.58	0.13	False
[ConditionalSelectBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Byte).ConditionalSelectBenchmark.html>)	355.39 ns	223.14 ns	0.63	0.22	False
[GreaterThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Byte).GreaterThanOrEqualAnyBenchmark.html>)	576.77 ns	323.89 ns	0.56	0.08	False
[EqualsAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Byte).EqualsAnyBenchmark.html>)	547.57 ns	298.45 ns	0.55	0.12	False
[MinBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Byte).MinBenchmark.html>)	562.44 ns	319.35 ns	0.57	0.06	False
[LessThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Byte).LessThanOrEqualAllBenchmark.html>)	594.91 ns	334.41 ns	0.56	0.09	False
[OneBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Byte).OneBenchmark.html>)	192.55 ns	111.87 ns	0.58	0.09	False
[SquareRootBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Byte).SquareRootBenchmark.html>)	386.70 ns	232.17 ns	0.60	0.07	False
[LessThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Byte).LessThanAnyBenchmark.html>)	511.83 ns	302.18 ns	0.59	0.09	False
[EqualsAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Byte).EqualsAllBenchmark.html>)	34.45 ns	20.88 ns	0.61	0.25	False
[DivisionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Byte).DivisionOperatorBenchmark.html>)	478.44 ns	286.01 ns	0.60	0.10	False
[MultiplyOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Byte).MultiplyOperatorBenchmark.html>)	467.28 ns	267.84 ns	0.57	0.10	False
[AddOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Byte).AddOperatorBenchmark.html>)	466.06 ns	253.52 ns	0.54	0.07	False
[SubtractBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Byte).SubtractBenchmark.html>)	470.69 ns	267.56 ns	0.57	0.10	False
[LessThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Byte).LessThanBenchmark.html>)	480.88 ns	277.58 ns	0.58	0.05	False
[DivideBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Byte).DivideBenchmark.html>)	474.47 ns	287.43 ns	0.61	0.09	False
[AddBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Byte).AddBenchmark.html>)	468.20 ns	255.65 ns	0.55	0.08	False
[GreaterThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Byte).GreaterThanOrEqualAllBenchmark.html>)	586.03 ns	337.24 ns	0.58	0.08	False
[LessThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Byte).LessThanOrEqualAnyBenchmark.html>)	536.59 ns	296.84 ns	0.55	0.09	False
[EqualityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Byte).EqualityOperatorBenchmark.html>)	34.02 ns	20.79 ns	0.61	0.30	False
[LessThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Byte).LessThanOrEqualBenchmark.html>)	505.72 ns	275.90 ns	0.55	0.07	False
[OnesComplementBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Byte).OnesComplementBenchmark.html>)	232.14 ns	135.19 ns	0.58	0.13	False
[NegateBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Byte).NegateBenchmark.html>)	471.27 ns	258.33 ns	0.55	0.06	False
[AndNotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Byte).AndNotBenchmark.html>)	269.77 ns	160.14 ns	0.59	0.14	False
[GreaterThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Byte).GreaterThanOrEqualBenchmark.html>)	518.68 ns	291.08 ns	0.56	0.08	False
[GetHashCodeBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Byte).GetHashCodeBenchmark.html>)	1.86 μs	1.43 μs	0.77	0.02	False
[EqualsStaticBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Byte).EqualsStaticBenchmark.html>)	494.34 ns	264.70 ns	0.54	0.07	False
[GreaterThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Byte).GreaterThanBenchmark.html>)	491.61 ns	265.28 ns	0.54	0.08	False
[DotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Byte).DotBenchmark.html>)	486.83 ns	263.61 ns	0.54	0.07	False
[LessThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Byte).LessThanAllBenchmark.html>)	567.41 ns	335.80 ns	0.59	0.07	False
[UnaryNegateOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Byte).UnaryNegateOperatorBenchmark.html>)	470.78 ns	258.42 ns	0.55	0.05	False
[SubtractionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Byte).SubtractionOperatorBenchmark.html>)	474.94 ns	256.94 ns	0.54	0.07	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_VectorOf<Byte>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorOf<Byte>.GreaterThanAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 303.453907814096 < 518.1527879188868. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.866682391096713 (T) = (0 -301.23011086985207) / Math.Sqrt((11514.02689100949 / (299)) + (59.95167854018431 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.18497117719918554 = (369.59442714514887 - 301.23011086985207) / 369.59442714514887 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Byte>.MaxBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 307.7760042134336 < 522.4150718099294. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.569763118968256 (T) = (0 -306.712155649316) / Math.Sqrt((9268.48533576963 / (299)) + (410.48653535793574 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.17608780078658431 = (372.26315612529146 - 306.712155649316) / 372.26315612529146 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Byte>.InequalityOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 21.30818888325245 < 34.0892213683133. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 5.864564605234138 (T) = (0 -22.02906070312098) / Math.Sqrt((45.03896507087745 / (299)) + (0.7453161655446982 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09730292489590137 = (24.403602615617867 - 22.02906070312098) / 24.403602615617867 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Byte>.MultiplyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 257.0747460863756 < 443.1175216234553. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.641913111181463 (T) = (0 -260.51899907866164) / Math.Sqrt((7773.626578802208 / (299)) + (60.8954722668543 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1615087791516346 = (310.69973376116536 - 260.51899907866164) / 310.69973376116536 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Byte>.GreaterThanAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 311.1816145281936 < 531.2033356956875. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.325229424743405 (T) = (0 -314.91080906117656) / Math.Sqrt((10310.819957496202 / (299)) + (71.94204931963743 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1897287667435997 = (388.64863534100925 - 314.91080906117656) / 388.64863534100925 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Byte>.OnesComplementOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 134.468253740334 < 220.46563407852645. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.50065554993147 (T) = (0 -136.52210521917291) / Math.Sqrt((1678.8358961052156 / (299)) + (7.3816994250830055 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1556785269149789 = (161.69446066596186 - 136.52210521917291) / 161.69446066596186 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Byte>.ConditionalSelectBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 223.13748580182605 < 329.7629249202741. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.783922126355655 (T) = (0 -222.0027344054488) / Math.Sqrt((2746.6014974813042 / (299)) + (47.995626403724145 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13340359409518326 = (256.1777695969727 - 222.0027344054488) / 256.1777695969727 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Byte>.GreaterThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 323.89429112378104 < 544.7997842234048. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.150548365885394 (T) = (0 -328.53727017728283) / Math.Sqrt((11292.933137104785 / (299)) + (504.0006183954947 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.14549214319336276 = (384.4754235555567 - 328.53727017728283) / 384.4754235555567 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Byte>.EqualsAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 298.4548518293169 < 518.1086993939911. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.733499491945802 (T) = (0 -301.99353637492146) / Math.Sqrt((10126.19036112402 / (299)) + (48.562929303993975 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1731914274560153 = (365.2520624522866 - 301.99353637492146) / 365.2520624522866 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Byte>.MinBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 319.3526242313347 < 533.4776609049504. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.625728623649277 (T) = (0 -321.6500312292227) / Math.Sqrt((9861.203796551088 / (299)) + (60.919555138111484 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14869940440595042 = (377.83367343326097 - 321.6500312292227) / 377.83367343326097 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Byte>.LessThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 334.4082731974058 < 567.7139012557399. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.111758237755485 (T) = (0 -334.790736207773) / Math.Sqrt((10894.216172869672 / (299)) + (6.874198471158705 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.19147094763371428 = (414.07384833971764 - 334.790736207773) / 414.07384833971764 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Byte>.OneBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 111.87196889832022 < 183.13330168787775. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.408812704450291 (T) = (0 -112.67043129419055) / Math.Sqrt((1189.3278229830923 / (299)) + (2.0631877008447614 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.15620096703988282 = (133.52756627242545 - 112.67043129419055) / 133.52756627242545 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Byte>.SquareRootBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 232.17159786368697 < 366.3165756631317. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.711398879112043 (T) = (0 -233.8421583119654) / Math.Sqrt((3531.2689128162756 / (299)) + (5.659657946986368 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13650900708851854 = (270.8101882145945 - 233.8421583119654) / 270.8101882145945 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Byte>.LessThanAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 302.18174060135124 < 487.69387646978964. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.2284723542569 (T) = (0 -298.2507122877632) / Math.Sqrt((8392.737954520608 / (299)) + (15.1264198296258 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.15439412954008463 = (352.706529964779 - 298.2507122877632) / 352.706529964779 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Byte>.EqualsAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 20.876939746710725 < 32.715311683117335. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.087760042950419 (T) = (0 -21.361258323341996) / Math.Sqrt((42.001708746296465 / (299)) + (2.829273761126641 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11099187881140815 = (24.02819256002103 - 21.361258323341996) / 24.02819256002103 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Byte>.DivisionOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 286.01438091369596 < 454.6025675069178. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.138380001889516 (T) = (0 -287.8560157537997) / Math.Sqrt((6227.095245200181 / (299)) + (7.462873962704133 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1504899427547502 = (338.84945010215097 - 287.8560157537997) / 338.84945010215097 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Byte>.MultiplyOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 267.8377340137756 < 443.82680751490216. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.779549592130685 (T) = (0 -256.89263971679196) / Math.Sqrt((8068.097249759838 / (299)) + (26.060739675041674 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.16628333497310577 = (308.12942872924947 - 256.89263971679196) / 308.12942872924947 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Byte>.AddOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 253.51569578998127 < 440.78230780284935. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.038171372715464 (T) = (0 -255.12105526058943) / Math.Sqrt((8189.330407220687 / (299)) + (5.324577114191965 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.17100702123165748 = (307.7481496159711 - 255.12105526058943) / 307.7481496159711 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Byte>.SubtractBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 267.55809212989806 < 448.1737773346396. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.08860810274274 (T) = (0 -263.48411225756365) / Math.Sqrt((8434.80027098341 / (299)) + (92.01844122274849 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15858090881651604 = (313.14254099816594 - 263.48411225756365) / 313.14254099816594 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Byte>.LessThanBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 277.5759532533048 < 456.837446851772. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.982899919054375 (T) = (0 -279.91226303942545) / Math.Sqrt((6850.21968693106 / (299)) + (60.57225073167527 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.14876365291878704 = (328.83025260752896 - 279.91226303942545) / 328.83025260752896 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Byte>.DivideBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 287.4278151583151 < 453.4586996717914. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.828127158628208 (T) = (0 -290.70696728965834) / Math.Sqrt((6177.894358824669 / (299)) + (52.462803293675925 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.14761155218901773 = (341.0498676234087 - 290.70696728965834) / 341.0498676234087 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Byte>.AddBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 255.6525008489974 < 452.6038257766458. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.874681012210935 (T) = (0 -258.61036093031254) / Math.Sqrt((8011.557613418978 / (299)) + (63.14137746300215 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.16789211491718795 = (310.7894607975929 - 258.61036093031254) / 310.7894607975929 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Byte>.GreaterThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 337.243381230591 < 557.064805768036. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.653823948315129 (T) = (0 -340.892010513379) / Math.Sqrt((10551.723913925705 / (299)) + (368.59497398184607 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.15505720959395192 = (403.4498126785116 - 340.892010513379) / 403.4498126785116 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Byte>.LessThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 296.83654224439465 < 510.7417083144497. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.506067449006709 (T) = (0 -297.48922087105876) / Math.Sqrt((9779.060489289292 / (299)) + (6.134735827500334 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.18137580474459525 = (363.40145160044324 - 297.48922087105876) / 363.40145160044324 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Byte>.EqualityOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 20.790116766692243 < 32.7400764414282. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.21376379757025 (T) = (0 -21.101888235376634) / Math.Sqrt((39.82033195890283 / (299)) + (0.5952566621998513 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12869822830436375 = (24.218805608888353 - 21.101888235376634) / 24.218805608888353 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Byte>.LessThanOrEqualBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 275.8977627255918 < 480.8747212748902. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.295357424450254 (T) = (0 -279.1974890431068) / Math.Sqrt((8536.888661304101 / (299)) + (47.46549275403439 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.17989690149254145 = (340.44193900892526 - 279.1974890431068) / 340.44193900892526 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Byte>.OnesComplementBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 135.18955331105616 < 221.1140285975269. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.206192612091073 (T) = (0 -136.9267858828782) / Math.Sqrt((1604.3418100549145 / (299)) + (25.631635922755784 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15245045711953348 = (161.55608487206695 - 136.9267858828782) / 161.55608487206695 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Byte>.NegateBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 258.3260124536955 < 447.76034035262444. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.850343173840926 (T) = (0 -259.68182505339115) / Math.Sqrt((8192.46265274489 / (299)) + (3.3925022833773286 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.16581486971941395 = (311.2999928038093 - 259.68182505339115) / 311.2999928038093 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Byte>.AndNotBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 160.1445560856223 < 256.6553190713752. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.034984354448847 (T) = (0 -162.87893606892615) / Math.Sqrt((2144.4292142727822 / (299)) + (16.501690181790675 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14409276030714652 = (190.2997527248117 - 162.87893606892615) / 190.2997527248117 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Byte>.GreaterThanOrEqualBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 291.07626051701993 < 492.9580352027185. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.736167323358769 (T) = (0 -293.55695724362494) / Math.Sqrt((8917.629790981997 / (299)) + (170.6507230280877 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14575552280631154 = (343.6451333089097 - 293.55695724362494) / 343.6451333089097 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Byte>.GetHashCodeBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.4252376652814505 < 1.7467060522222977. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.7332287940049 (T) = (0 -1380.9463966879237) / Math.Sqrt((31130.009924398342 / (299)) + (548.9427250389068 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10223016152489557 = (1538.1964703041401 - 1380.9463966879237) / 1538.1964703041401 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Byte>.EqualsStaticBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 264.6988713308705 < 470.2190275273593. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.059000221708867 (T) = (0 -269.6842189111172) / Math.Sqrt((8205.739994964515 / (299)) + (117.21823191301219 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.16863727720939606 = (324.3881539526795 - 269.6842189111172) / 324.3881539526795 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Byte>.GreaterThanBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 265.2756048359778 < 469.89993839739924. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.192287376073269 (T) = (0 -268.74805317538096) / Math.Sqrt((8337.10472397037 / (299)) + (174.79349046908266 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1744861330281908 = (325.5524394292925 - 268.74805317538096) / 325.5524394292925 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Byte>.DotBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 263.61172689711873 < 462.78728775459865. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.404465324654985 (T) = (0 -268.0584392664427) / Math.Sqrt((9199.272414759642 / (299)) + (414.9966242605374 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.128634437666894 = (307.63028842763606 - 268.0584392664427) / 307.63028842763606 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Byte>.LessThanAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 335.80123430830866 < 544.9353379176407. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.234716244051295 (T) = (0 -337.8772556332883) / Math.Sqrt((9420.549018718442 / (299)) + (18.92235220710208 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.16966985360840342 = (406.91917197227735 - 337.8772556332883) / 406.91917197227735 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Byte>.UnaryNegateOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 258.4154012302408 < 447.7704051027731. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.782811089816908 (T) = (0 -259.8495015249858) / Math.Sqrt((8166.511268464737 / (299)) + (5.115359837487837 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1646361394882681 = (311.0614593331889 - 259.8495015249858) / 311.0614593331889 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Byte>.SubtractionOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 256.9390297627243 < 450.6327962022845. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.831080428570097 (T) = (0 -257.8290539730659) / Math.Sqrt((8384.608899342997 / (299)) + (4.158004792320762 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.16818142299536712 = (309.9582782840758 - 257.8290539730659) / 309.9582782840758 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Memory.ReadOnlySequence

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Slice_Start_And_EndPosition - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySequence.Slice_Start_And_EndPosition(Segment%3a%20Multiple).html>)	162.72 ns	113.97 ns	0.70	0.17	False
[Slice_Start_And_Length - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySequence.Slice_Start_And_Length(Segment%3a%20Multiple).html>)	182.10 ns	123.30 ns	0.68	0.20	False
[Slice_Repeat_StartPosition_And_EndPosition - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySequence.Slice_Repeat_StartPosition_And_EndPosition(Segment%3a%20Single).html>)	511.84 ns	346.63 ns	0.68	0.15	False
[Slice_Repeat_StartPosition_And_EndPosition - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySequence.Slice_Repeat_StartPosition_And_EndPosition(Segment%3a%20Multiple).html>)	736.42 ns	454.39 ns	0.62	0.13	False
[Slice_Repeat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySequence.Slice_Repeat(Segment%3a%20Single).html>)	572.27 ns	403.16 ns	0.70	0.13	False
[Slice_Repeat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySequence.Slice_Repeat(Segment%3a%20Multiple).html>)	775.95 ns	547.40 ns	0.71	0.09	False
[Slice_StartPosition_And_Length - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySequence.Slice_StartPosition_And_Length(Segment%3a%20Single).html>)	122.65 ns	88.33 ns	0.72	0.17	False
[Slice_Start_And_EndPosition - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySequence.Slice_Start_And_EndPosition(Segment%3a%20Single).html>)	124.11 ns	91.09 ns	0.73	0.19	False
[Slice_StartPosition_And_EndPosition - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySequence.Slice_StartPosition_And_EndPosition(Segment%3a%20Single).html>)	88.78 ns	60.47 ns	0.68	0.19	False
[Slice_Start_And_Length - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySequence.Slice_Start_And_Length(Segment%3a%20Single).html>)	111.17 ns	75.33 ns	0.68	0.10	False
[Slice_StartPosition - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySequence.Slice_StartPosition(Segment%3a%20Multiple).html>)	118.32 ns	77.95 ns	0.66	0.18	False
[Slice_StartPosition - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySequence.Slice_StartPosition(Segment%3a%20Single).html>)	88.62 ns	59.95 ns	0.68	0.20	False
[Slice_StartPosition_And_EndPosition - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySequence.Slice_StartPosition_And_EndPosition(Segment%3a%20Multiple).html>)	129.66 ns	81.14 ns	0.63	0.19	False
[Slice_StartPosition_And_Length - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySequence.Slice_StartPosition_And_Length(Segment%3a%20Multiple).html>)	161.14 ns	118.16 ns	0.73	0.13	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Memory.ReadOnlySequence*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Memory.ReadOnlySequence.Slice_Start_And_EndPosition(Segment: Multiple) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 113.96692458238468 < 155.31045429074868. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.203436214123391 (T) = (0 -116.6883872690175) / Math.Sqrt((370.733149805078 / (299)) + (13.143294546591628 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09599098399414112 = (129.07878705079335 - 116.6883872690175) / 129.07878705079335 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySequence.Slice_Start_And_Length(Segment: Multiple) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 123.30314194591467 < 172.8313323435567. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.96289628384857 (T) = (0 -126.91107164484744) / Math.Sqrt((559.213982973136 / (299)) + (9.666076060146233 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.11005050691281175 = (142.60480244176506 - 126.91107164484744) / 142.60480244176506 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySequence.Slice_Repeat_StartPosition_And_EndPosition(Segment: Single) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 346.62902173576975 < 492.5100148776902. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.334907119924356 (T) = (0 -361.367081140983) / Math.Sqrt((3877.037503108922 / (299)) + (169.4777597560928 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1026344779072997 = (402.697754977545 - 361.367081140983) / 402.697754977545 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySequence.Slice_Repeat_StartPosition_And_EndPosition(Segment: Multiple) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 454.3864701523815 < 640.6915502415414. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.989010775078214 (T) = (0 -463.5640454043952) / Math.Sqrt((7819.6835726830595 / (299)) + (154.02931214884504 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10382016295778475 = (517.2667652670684 - 463.5640454043952) / 517.2667652670684 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySequence.Slice_Repeat(Segment: Single) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 403.16057397860106 < 542.1457735059423. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.360173952220496 (T) = (0 -397.6828445738198) / Math.Sqrt((5931.240599700658 / (299)) + (112.41704504570956 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09917861870528309 = (441.4669243332625 - 397.6828445738198) / 441.4669243332625 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySequence.Slice_Repeat(Segment: Multiple) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 547.4003379662107 < 744.0011206559288. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.48413480808747 (T) = (0 -553.699606563157) / Math.Sqrt((9046.727414272604 / (299)) + (239.55063102595986 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09145267378444082 = (609.4339728779169 - 553.699606563157) / 609.4339728779169 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySequence.Slice_StartPosition_And_Length(Segment: Single) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 88.32581733207836 < 117.522138475551. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.06895650719999 (T) = (0 -90.02773061801234) / Math.Sqrt((180.7172916021627 / (299)) + (6.062234495594913 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11669121920965658 = (101.92101853381298 - 90.02773061801234) / 101.92101853381298 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySequence.Slice_Start_And_EndPosition(Segment: Single) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 91.09101227866267 < 117.5333367484946. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.2929422841553 (T) = (0 -90.89118706012387) / Math.Sqrt((189.2978189735926 / (299)) + (4.378218575386411 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10247885891760686 = (101.26913216830843 - 90.89118706012387) / 101.26913216830843 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySequence.Slice_StartPosition_And_EndPosition(Segment: Single) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 60.46860921809711 < 84.26654257417275. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.713813944925178 (T) = (0 -62.02871741050343) / Math.Sqrt((134.4332147971078 / (299)) + (4.718147349069407 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.10294305746332671 = (69.14691193972627 - 62.02871741050343) / 69.14691193972627 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySequence.Slice_Start_And_Length(Segment: Single) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 75.33305447504523 < 105.49824410412714. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.762737003178351 (T) = (0 -76.37913175107094) / Math.Sqrt((221.82514227420367 / (299)) + (5.09963715552099 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10456210949701585 = (85.29807880719383 - 76.37913175107094) / 85.29807880719383 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySequence.Slice_StartPosition(Segment: Multiple) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 77.94549696119815 < 112.9262920335486. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.18906538029395 (T) = (0 -81.2608529700313) / Math.Sqrt((254.0483805190746 / (299)) + (25.293657322060493 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10339815139472319 = (90.63203817440026 - 81.2608529700313) / 90.63203817440026 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySequence.Slice_StartPosition(Segment: Single) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 59.95265331529401 < 83.95065872048289. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.320711255834037 (T) = (0 -62.71490209509508) / Math.Sqrt((141.50903137046407 / (299)) + (13.090666775561271 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07834077316323207 = (68.04565100524113 - 62.71490209509508) / 68.04565100524113 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySequence.Slice_StartPosition_And_EndPosition(Segment: Multiple) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 81.13784716795838 < 114.86815923032724. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.344731816929482 (T) = (0 -83.14257271115522) / Math.Sqrt((279.7967054260684 / (299)) + (5.650596478979245 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10268570807302112 = (92.65713636702128 - 83.14257271115522) / 92.65713636702128 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySequence.Slice_StartPosition_And_Length(Segment: Multiple) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 118.15675983811713 < 153.62655100942018. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.002491992031215 (T) = (0 -116.40761414503811) / Math.Sqrt((346.97034248070895 / (299)) + (18.380526638331627 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10339692023553024 = (129.83182499843457 - 116.40761414503811) / 129.83182499843457 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in PerfLabTests.CastingPerf2.CastingPerf

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[FooObjCastIfIsa - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.CastingPerf2.CastingPerf.FooObjCastIfIsa.html>)	1.84 ms	1.34 ms	0.73	0.13	False
[IFooObjIsDescendantOfIFoo - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.CastingPerf2.CastingPerf.IFooObjIsDescendantOfIFoo.html>)	1.23 ms	875.02 μs	0.71	0.18	False
[FooObjIsDescendant - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.CastingPerf2.CastingPerf.FooObjIsDescendant.html>)	1.29 ms	898.01 μs	0.70	0.09	False
[ObjInt - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.CastingPerf2.CastingPerf.ObjInt.html>)	4.46 ms	3.91 ms	0.88	0.06	False
[ObjFooIsObj - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.CastingPerf2.CastingPerf.ObjFooIsObj.html>)	1.96 ms	1.24 ms	0.63	0.15	False
[ObjrefValueTypeObj - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.CastingPerf2.CastingPerf.ObjrefValueTypeObj.html>)	3.02 ms	2.24 ms	0.74	0.20	False
[IntObj - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.CastingPerf2.CastingPerf.IntObj.html>)	2.82 ms	2.04 ms	0.72	0.12	False
[FooObjIsNull - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.CastingPerf2.CastingPerf.FooObjIsNull.html>)	1.96 ms	1.24 ms	0.63	0.12	False
[IFooFooIsIFoo - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.CastingPerf2.CastingPerf.IFooFooIsIFoo.html>)	1.96 ms	1.25 ms	0.64	0.11	False
[IFooObjIsIFooInterAlia - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.CastingPerf2.CastingPerf.IFooObjIsIFooInterAlia.html>)	1.23 ms	875.45 μs	0.71	0.14	False
[ScalarValueTypeObj - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.CastingPerf2.CastingPerf.ScalarValueTypeObj.html>)	4.62 ms	3.40 ms	0.74	0.21	False
[IFooObjIsIFoo - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.CastingPerf2.CastingPerf.IFooObjIsIFoo.html>)	1.23 ms	875.07 μs	0.71	0.16	False
[FooObjIsFoo - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.CastingPerf2.CastingPerf.FooObjIsFoo.html>)	2.51 ms	1.82 ms	0.72	0.12	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'PerfLabTests.CastingPerf2.CastingPerf*'

### Payloads [Baseline]() [Compare]() ### Histogram #### PerfLabTests.CastingPerf2.CastingPerf.FooObjCastIfIsa ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.3398828530505953 < 1.7454507759701234. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.73008071546399 (T) = (0 -1337177.990148253) / Math.Sqrt((35100502148.73726 / (299)) + (273878810.34937245 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1279152377751306 = (1533311.9532289892 - 1337177.990148253) / 1533311.9532289892 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf2.CastingPerf.IFooObjIsDescendantOfIFoo ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 875.0150282407407 < 1.168065862494849. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.570961477420957 (T) = (0 -877982.6421311824) / Math.Sqrt((18341881287.616608 / (299)) + (116288799.5110562 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12375692576154344 = (1001985.2572235594 - 877982.6421311824) / 1001985.2572235594 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf2.CastingPerf.FooObjIsDescendant ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 898.0149289215685 < 1.1935388764835164. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.591042749672425 (T) = (0 -909165.9796906449) / Math.Sqrt((17648657720.202938 / (299)) + (113478665.78976947 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11142604986943387 = (1023174.2440311839 - 909165.9796906449) / 1023174.2440311839 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf2.CastingPerf.ObjInt ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.9098899691666666 < 4.078419677092633. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.719995320238898 (T) = (0 -3859419.276446988) / Math.Sqrt((18951229481.65471 / (299)) + (6298121014.94993 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.057390843898105136 = (4094400.368873342 - 3859419.276446988) / 4094400.368873342 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf2.CastingPerf.ObjFooIsObj ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.2398740257554945 < 1.8597736126277045. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.186039931846281 (T) = (0 -1252740.147168847) / Math.Sqrt((72442400185.68457 / (299)) + (823182158.8829619 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.16270890725714204 = (1496182.3409168625 - 1252740.147168847) / 1496182.3409168625 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf2.CastingPerf.ObjrefValueTypeObj ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.2371898934523813 < 2.873539900192308. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.877106082029677 (T) = (0 -2302182.6604770925) / Math.Sqrt((84502687665.57222 / (299)) + (26591661322.854485 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10614519523108867 = (2575566.689572449 - 2302182.6604770925) / 2575566.689572449 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf2.CastingPerf.IntObj ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.0357822848557694 < 2.6616251484598212. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.697952243454637 (T) = (0 -2042578.6524943227) / Math.Sqrt((74639559158.5949 / (299)) + (1459833195.4620001 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1195153955101376 = (2319834.602534314 - 2042578.6524943227) / 2319834.602534314 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf2.CastingPerf.FooObjIsNull ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.2398796644230772 < 1.860333997988281. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.53818218922992 (T) = (0 -1251284.3852837172) / Math.Sqrt((69647761832.1864 / (299)) + (359745237.5227985 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.161157371348425 = (1491679.538622322 - 1251284.3852837172) / 1491679.538622322 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf2.CastingPerf.IFooFooIsIFoo ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.2453637150641026 < 1.8598761224627975. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.722985330895396 (T) = (0 -1259878.6793809512) / Math.Sqrt((69824022207.6949 / (299)) + (2439359170.093313 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1534835676368652 = (1488309.7731060868 - 1259878.6793809512) / 1488309.7731060868 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf2.CastingPerf.IFooObjIsIFooInterAlia ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 875.4455547542735 < 1.168155679220467. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.644577635757102 (T) = (0 -878078.4601688376) / Math.Sqrt((18242817055.7601 / (299)) + (58215087.01802399 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12307553229605887 = (1001315.954232544 - 878078.4601688376) / 1001315.954232544 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf2.CastingPerf.ScalarValueTypeObj ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.3996776071428574 < 4.355898133407022. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.38597142603735 (T) = (0 -3441666.3903906303) / Math.Sqrt((196762521707.52954 / (299)) + (34110308963.910313 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1057693427363864 = (3848745.692663105 - 3441666.3903906303) / 3848745.692663105 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf2.CastingPerf.IFooObjIsIFoo ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 875.0709823495372 < 1.1681415002349913. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.031009377988532 (T) = (0 -889005.2111664913) / Math.Sqrt((19195167192.434628 / (299)) + (1147679326.955474 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11096624768256012 = (999967.896437144 - 889005.2111664913) / 999967.896437144 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf2.CastingPerf.FooObjIsFoo ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.8184164069444442 < 2.3862683485092475. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.938013596352842 (T) = (0 -1839870.9269814412) / Math.Sqrt((72927097420.21082 / (299)) + (6095400551.82619 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.100441644796287 = (2045304.6946184898 - 1839870.9269814412) / 2045304.6946184898 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)