[Perf] Changes at 6/5/2022 9:07:46 PM

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Buffers.Tests.RentReturnArrayPoolTests<Byte>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[SingleSerial - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Byte).SingleSerial(RentalSize%3a%204096%2c%20ManipulateArray%3a%20False%2c%20Async%3a%20False%2c%20UseSharedPool%3a%20False).html>)	590.91 ns	454.48 ns	0.77	0.10	False
[SingleSerial - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Byte).SingleSerial(RentalSize%3a%204096%2c%20ManipulateArray%3a%20True%2c%20Async%3a%20False%2c%20UseSharedPool%3a%20True).html>)	36.20 μs	21.89 μs	0.60	0.06	False
[SingleParallel - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Byte).SingleParallel(RentalSize%3a%204096%2c%20ManipulateArray%3a%20False%2c%20Async%3a%20False%2c%20UseSharedPool%3a%20True).html>)	565.20 ns	532.85 ns	0.94	0.25	False
[ProducerConsumer - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Byte).ProducerConsumer(RentalSize%3a%204096%2c%20ManipulateArray%3a%20True%2c%20Async%3a%20False%2c%20UseSharedPool%3a%20False).html>)	37.66 μs	24.99 μs	0.66	0.19	False
[SingleSerial - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Byte).SingleSerial(RentalSize%3a%204096%2c%20ManipulateArray%3a%20True%2c%20Async%3a%20True%2c%20UseSharedPool%3a%20True).html>)	41.08 μs	26.30 μs	0.64	0.06	False
[SingleParallel - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Byte).SingleParallel(RentalSize%3a%204096%2c%20ManipulateArray%3a%20True%2c%20Async%3a%20False%2c%20UseSharedPool%3a%20False).html>)	63.54 μs	47.08 μs	0.74	0.27	False
[SingleSerial - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Byte).SingleSerial(RentalSize%3a%204096%2c%20ManipulateArray%3a%20False%2c%20Async%3a%20False%2c%20UseSharedPool%3a%20True).html>)	313.73 ns	231.08 ns	0.74	0.15	False
[ProducerConsumer - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Byte).ProducerConsumer(RentalSize%3a%204096%2c%20ManipulateArray%3a%20True%2c%20Async%3a%20False%2c%20UseSharedPool%3a%20True).html>)	40.54 μs	26.96 μs	0.67	0.33	False
[ProducerConsumer - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Byte).ProducerConsumer(RentalSize%3a%204096%2c%20ManipulateArray%3a%20True%2c%20Async%3a%20True%2c%20UseSharedPool%3a%20False).html>)	37.71 μs	27.11 μs	0.72	0.18	False
[ProducerConsumer - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Byte).ProducerConsumer(RentalSize%3a%204096%2c%20ManipulateArray%3a%20True%2c%20Async%3a%20True%2c%20UseSharedPool%3a%20True).html>)	40.28 μs	25.50 μs	0.63	0.20	False
[SingleSerial - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Byte).SingleSerial(RentalSize%3a%204096%2c%20ManipulateArray%3a%20False%2c%20Async%3a%20True%2c%20UseSharedPool%3a%20True).html>)	2.36 μs	2.05 μs	0.87	0.01	False
[SingleParallel - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Byte).SingleParallel(RentalSize%3a%204096%2c%20ManipulateArray%3a%20False%2c%20Async%3a%20True%2c%20UseSharedPool%3a%20True).html>)	3.38 μs	2.94 μs	0.87	0.23	False
[SingleSerial - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Byte).SingleSerial(RentalSize%3a%204096%2c%20ManipulateArray%3a%20False%2c%20Async%3a%20True%2c%20UseSharedPool%3a%20False).html>)	2.75 μs	2.33 μs	0.85	0.02	False
[SingleSerial - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Byte).SingleSerial(RentalSize%3a%204096%2c%20ManipulateArray%3a%20True%2c%20Async%3a%20False%2c%20UseSharedPool%3a%20False).html>)	36.37 μs	22.33 μs	0.61	0.10	False
[SingleParallel - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Byte).SingleParallel(RentalSize%3a%204096%2c%20ManipulateArray%3a%20True%2c%20Async%3a%20False%2c%20UseSharedPool%3a%20True).html>)	65.00 μs	45.55 μs	0.70	0.31	False
[SingleSerial - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Byte).SingleSerial(RentalSize%3a%204096%2c%20ManipulateArray%3a%20True%2c%20Async%3a%20True%2c%20UseSharedPool%3a%20False).html>)	41.74 μs	26.78 μs	0.64	0.05	False
[SingleParallel - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Byte).SingleParallel(RentalSize%3a%204096%2c%20ManipulateArray%3a%20True%2c%20Async%3a%20True%2c%20UseSharedPool%3a%20False).html>)	67.85 μs	48.51 μs	0.71	0.21	False
[SingleParallel - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Byte).SingleParallel(RentalSize%3a%204096%2c%20ManipulateArray%3a%20True%2c%20Async%3a%20True%2c%20UseSharedPool%3a%20True).html>)	75.36 μs	48.87 μs	0.65	0.27	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Buffers.Tests.RentReturnArrayPoolTests<Byte>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleSerial(RentalSize: 4096, ManipulateArray: False, Async: False, UseSharedPool: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 454.4781565384616 < 566.2081199118588. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.300233057016746 (T) = (0 -455.8096259330993) / Math.Sqrt((3063.5339462991433 / (299)) + (61.98559238286159 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.08148382357494334 = (496.24561617101756 - 455.8096259330993) / 496.24561617101756 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleSerial(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 21.887001814999998 < 34.39310008605237. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.46305870824496 (T) = (0 -22037.967829485846) / Math.Sqrt((38371753.38194196 / (299)) + (8960.73264932718 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.12127052095828605 = (25079.35417566626 - 22037.967829485846) / 25079.35417566626 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleParallel(RentalSize: 4096, ManipulateArray: False, Async: False, UseSharedPool: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 532.8492897368421 < 534.5091169822917. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 4.3112817672895405 (T) = (0 -483.8544524628855) / Math.Sqrt((1880.8200933433798 / (299)) + (333.4574255140383 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.05115132926441095 = (509.93848374976415 - 483.8544524628855) / 509.93848374976415 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.ProducerConsumer(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 24.991238384615382 < 35.73106830037499. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 4.3404126354148005 (T) = (0 -24367.198749934876) / Math.Sqrt((47453434.16750538 / (299)) + (2432623.527341214 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.09672826309562167 = (26976.598242123924 - 24367.198749934876) / 26976.598242123924 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleSerial(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 26.299894868571428 < 39.00178331284103. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.129621832918627 (T) = (0 -26099.741201126988) / Math.Sqrt((42062278.01984471 / (299)) + (11553.11317307891 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11633161372551291 = (29535.673796323666 - 26099.741201126988) / 29535.673796323666 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 47.08152637 < 60.34121467156666. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 3.6976845949007284 (T) = (0 -47239.75249428438) / Math.Sqrt((64853947.12740948 / (299)) + (6634332.022366091 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.06619023508616195 = (50588.19715666944 - 47239.75249428438) / 50588.19715666944 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleSerial(RentalSize: 4096, ManipulateArray: False, Async: False, UseSharedPool: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 231.07628099999997 < 291.18709322922393. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 6.458507840163735 (T) = (0 -232.2271190713537) / Math.Sqrt((1042.7644115828346 / (299)) + (60.39072947159591 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.07691980184924233 = (251.57848639433854 - 232.2271190713537) / 251.57848639433854 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.ProducerConsumer(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 26.961747236999997 < 39.12881197445. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.597243376394536 (T) = (0 -27049.792061874996) / Math.Sqrt((38955718.701644786 / (299)) + (449733.38194357755 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10316974331369905 = (30161.55159820466 - 27049.792061874996) / 30161.55159820466 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.ProducerConsumer(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 27.112490117499995 < 35.81194756517856. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 6.6719358826768165 (T) = (0 -23753.830199700093) / Math.Sqrt((41097055.7360488 / (299)) + (1172691.8618312485 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11988165105811954 = (26989.359133641585 - 23753.830199700093) / 26989.359133641585 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.ProducerConsumer(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 25.503084375999997 < 37.98966435276667. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 6.4216040913823464 (T) = (0 -25840.36386812907) / Math.Sqrt((39998059.44208915 / (299)) + (1198961.8454464625 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.10908791470386606 = (29004.392570945856 - 25840.36386812907) / 29004.392570945856 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleSerial(RentalSize: 4096, ManipulateArray: False, Async: True, UseSharedPool: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.0485680753333337 < 2.2394970690416676. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 16.304679107022697 (T) = (0 -2035.3750163809525) / Math.Sqrt((11364.23287110273 / (299)) + (487.11157098431886 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.0663104336333001 = (2179.9269154321614 - 2035.3750163809525) / 2179.9269154321614 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleParallel(RentalSize: 4096, ManipulateArray: False, Async: True, UseSharedPool: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.94397603 < 3.2343834503714284. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.105576739272074 (T) = (0 -2996.250382006609) / Math.Sqrt((23977.87976669036 / (299)) + (4732.041722340799 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.06844232654882279 = (3216.387420122134 - 2996.250382006609) / 3216.387420122134 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleSerial(RentalSize: 4096, ManipulateArray: False, Async: True, UseSharedPool: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.3257078749999995 < 2.6044548448833336. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 14.552248830850223 (T) = (0 -2355.2515223202076) / Math.Sqrt((14766.894861343348 / (299)) + (969.3196013184137 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.06584992976376912 = (2521.2774663974537 - 2355.2515223202076) / 2521.2774663974537 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleSerial(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 22.33179883 < 34.65455940192738. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.477042960088461 (T) = (0 -22349.274779129868) / Math.Sqrt((41002776.55426191 / (299)) + (2187.3829854417395 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.12323892465643567 = (25490.72422081713 - 22349.274779129868) / 25490.72422081713 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 45.54873674 < 60.04051357401922. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.255775639904689 (T) = (0 -44990.21568587241) / Math.Sqrt((63151596.40510759 / (299)) + (2167625.4413793865 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10303235608567121 = (50158.12553676632 - 44990.21568587241) / 50158.12553676632 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleSerial(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 26.77699311142857 < 39.723373887516665. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.318491926220126 (T) = (0 -26798.458526687118) / Math.Sqrt((41032580.65285776 / (299)) + (24368.465325134704 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11485941423231143 = (30275.934645392663 - 26798.458526687118) / 30275.934645392663 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 48.506624736666666 < 63.560215095028575. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.600980788541012 (T) = (0 -48437.046062225774) / Math.Sqrt((60959350.15748733 / (299)) + (3350437.9193339045 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.10063676354851044 = (53857.04473905122 - 48437.046062225774) / 53857.04473905122 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 48.87276919400001 < 62.15956679327143. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 6.332958572045752 (T) = (0 -48082.32927237087) / Math.Sqrt((64326285.39767003 / (299)) + (4478351.164542222 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.09175622842131274 = (52939.894307004535 - 48082.32927237087) / 52939.894307004535 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Text.Encodings.Web.Tests.Perf_Encoders

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[EncodeUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments%3a%20UnsafeRelaxed%2cno%20(escaping%20%2f)%20required%2c16).html>)	5.28 μs	3.82 μs	0.72	0.14	False
[EncodeUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments%3a%20UnsafeRelaxed%2chello%20%22there%22%2c512).html>)	66.24 μs	44.57 μs	0.67	0.18	False
[EncodeUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments%3a%20JavaScript%2cno%20escaping%20required%2c512).html>)	65.85 μs	43.23 μs	0.66	0.16	False
[EncodeUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments%3a%20Url%2c%ef%bf%bd2020%2c512).html>)	23.60 μs	13.23 μs	0.56	0.07	False
[EncodeUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments%3a%20JavaScript%2c%26Hello%2b(World)!%2c512).html>)	65.23 μs	43.13 μs	0.66	0.15	False
[EncodeUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments%3a%20JavaScript%2cno%20escaping%20required%2c512).html>)	23.48 μs	12.83 μs	0.55	0.05	False
[EncodeUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments%3a%20Url%2c%26lorem%20ipsum%3ddolor%20sit%20amet%2c512).html>)	25.01 μs	13.69 μs	0.55	0.05	False
[EncodeUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments%3a%20JavaScript%2c%26Hello%2b(World)!%2c16).html>)	2.96 μs	2.00 μs	0.67	0.07	False
[EncodeUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments%3a%20JavaScript%2cno%20escaping%20required%2c16).html>)	4.77 μs	3.25 μs	0.68	0.16	False
[EncodeUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments%3a%20UnsafeRelaxed%2chello%20%22there%22%2c16).html>)	3.93 μs	2.54 μs	0.65	0.13	False
[EncodeUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments%3a%20Url%2c%26lorem%20ipsum%3ddolor%20sit%20amet%2c16).html>)	4.60 μs	2.95 μs	0.64	0.11	False
[EncodeUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments%3a%20UnsafeRelaxed%2chello%20%22there%22%2c16).html>)	2.03 μs	1.31 μs	0.64	0.05	False
[EncodeUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments%3a%20Url%2c%26lorem%20ipsum%3ddolor%20sit%20amet%2c16).html>)	3.45 μs	2.14 μs	0.62	0.08	False
[EncodeUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments%3a%20JavaScript%2c%26Hello%2b(World)!%2c512).html>)	24.64 μs	13.52 μs	0.55	0.04	False
[EncodeUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments%3a%20UnsafeRelaxed%2chello%20%22there%22%2c512).html>)	23.52 μs	13.02 μs	0.55	0.06	False
[EncodeUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments%3a%20UnsafeRelaxed%2cno%20(escaping%20%2f)%20required%2c512).html>)	23.88 μs	13.31 μs	0.56	0.07	False
[EncodeUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments%3a%20Url%2c%ef%bf%bd2020%2c512).html>)	64.92 μs	43.00 μs	0.66	0.15	False
[EncodeUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments%3a%20JavaScript%2c%26Hello%2b(World)!%2c16).html>)	3.63 μs	2.44 μs	0.67	0.14	False
[EncodeUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments%3a%20JavaScript%2cno%20escaping%20required%2c16).html>)	1.96 μs	1.13 μs	0.58	0.05	False
[EncodeUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments%3a%20UnsafeRelaxed%2cno%20(escaping%20%2f)%20required%2c16).html>)	2.08 μs	1.20 μs	0.58	0.06	False
[EncodeUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments%3a%20Url%2c%ef%bf%bd2020%2c16).html>)	2.02 μs	1.32 μs	0.66	0.04	False
[EncodeUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments%3a%20Url%2c%ef%bf%bd2020%2c16).html>)	3.82 μs	2.93 μs	0.77	0.05	False
[EncodeUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments%3a%20Url%2c%26lorem%20ipsum%3ddolor%20sit%20amet%2c512).html>)	66.18 μs	43.10 μs	0.65	0.13	False
[EncodeUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments%3a%20UnsafeRelaxed%2cno%20(escaping%20%2f)%20required%2c512).html>)	73.66 μs	44.31 μs	0.60	0.12	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Encodings.Web.Tests.Perf_Encoders*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: UnsafeRelaxed,no <escaping /> required,16) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.8180982951604543 < 4.993377992418498. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 6.548299142279786 (T) = (0 -3661.8082244558195) / Math.Sqrt((487138.33860062825 / (299)) + (21083.09783147832 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.09425255482949464 = (4042.8579114197673 - 3661.8082244558195) / 4042.8579114197673 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: UnsafeRelaxed,hello "there",512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 44.56556486779794 < 61.86022410915198. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.601391326445047 (T) = (0 -43416.39116483198) / Math.Sqrt((83307653.62759842 / (299)) + (615683.3471707854 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.12376244164480792 = (49548.65350251591 - 43416.39116483198) / 49548.65350251591 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: JavaScript,no escaping required,512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 43.230348743946735 < 62.450828613007694. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.209761143847748 (T) = (0 -44167.9040810456) / Math.Sqrt((81646303.35028125 / (299)) + (738949.5807790338 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11794889114202828 = (50074.087133376685 - 44167.9040810456) / 50074.087133376685 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: Url,�2020,512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 13.234060880120056 < 22.260943996929296. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.541464610042944 (T) = (0 -13327.526688951866) / Math.Sqrt((19651233.720308505 / (299)) + (256012.62200718702 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.17439733747688788 = (16142.785499530499 - 13327.526688951866) / 16142.785499530499 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: JavaScript,&Hello+<World>!,512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 43.13395450528006 < 61.63483906737341. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 5.4040978944683316 (T) = (0 -44560.02479048699) / Math.Sqrt((80312085.69732063 / (299)) + (5559792.078546905 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.09400184936918285 = (49183.35071596039 - 44560.02479048699) / 49183.35071596039 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: JavaScript,no escaping required,512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 12.831908128436888 < 22.151561674717538. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.6665401169662 (T) = (0 -12987.380512516334) / Math.Sqrt((17278465.284853406 / (299)) + (50195.4521554797 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.18321087182121648 = (15900.530583058375 - 12987.380512516334) / 15900.530583058375 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: Url,&lorem ipsum=dolor sit amet,512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 13.694163925438597 < 23.63486146657156. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.95309260986147 (T) = (0 -13880.104017187003) / Math.Sqrt((19255226.66962729 / (299)) + (16593.733965188516 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.18091297068572154 = (16945.82324030588 - 13880.104017187003) / 16945.82324030588 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: JavaScript,&Hello+<World>!,16) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.995591048271652 < 2.7923910721514065. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.45630800301658 (T) = (0 -1910.5681577962546) / Math.Sqrt((204140.87822069955 / (299)) + (1784.215838672469 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.11399112173184366 = (2156.3758610757495 - 1910.5681577962546) / 2156.3758610757495 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: JavaScript,no escaping required,16) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.2461838902769107 < 4.520816087501416. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.348193464878747 (T) = (0 -3300.934061148055) / Math.Sqrt((403972.84263543837 / (299)) + (9137.286525954365 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10413541852171589 = (3684.6350769902274 - 3300.934061148055) / 3684.6350769902274 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: UnsafeRelaxed,hello "there",16) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.5421984739149655 < 3.619929792919836. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.658894429969859 (T) = (0 -2604.2114931915407) / Math.Sqrt((260129.03150059868 / (299)) + (1829.5656136367609 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1060231544369954 = (2913.0636952363934 - 2604.2114931915407) / 2913.0636952363934 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: Url,&lorem ipsum=dolor sit amet,16) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.948569206703628 < 4.368263360252492. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.795481309595852 (T) = (0 -2933.1645056726416) / Math.Sqrt((451731.8968168638 / (299)) + (960.3163838930789 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12800635468861896 = (3363.745276635858 - 2933.1645056726416) / 3363.745276635858 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: UnsafeRelaxed,hello "there",16) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.30552679998798 < 1.924416693895451. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.665476554664862 (T) = (0 -1296.8226981907176) / Math.Sqrt((90758.43633474607 / (299)) + (258.64161339540084 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12913774499061714 = (1489.1249342029932 - 1296.8226981907176) / 1489.1249342029932 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: Url,&lorem ipsum=dolor sit amet,16) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.1412511516814896 < 3.263654192278743. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.728373500658165 (T) = (0 -2143.7909151272925) / Math.Sqrt((307386.52730763226 / (299)) + (3042.313401126241 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.128205706254243 = (2459.0559154915622 - 2143.7909151272925) / 2459.0559154915622 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: JavaScript,&Hello+<World>!,512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 13.517120952792883 < 23.038291100674865. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.25888486028783 (T) = (0 -13600.505223391216) / Math.Sqrt((18492302.544479508 / (299)) + (5154.057495155753 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.18363069725307007 = (16659.745996852234 - 13600.505223391216) / 16659.745996852234 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: UnsafeRelaxed,hello "there",512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 13.020033718575002 < 22.139456652766953. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.310487878746635 (T) = (0 -12969.5480358886) / Math.Sqrt((17572476.845071718 / (299)) + (8759.5628499624 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1880035029903762 = (15972.4187033468 - 12969.5480358886) / 15972.4187033468 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: UnsafeRelaxed,no <escaping /> required,512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 13.305360497675402 < 22.308284489254106. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.310857436659623 (T) = (0 -13068.11241477169) / Math.Sqrt((19954821.75535303 / (299)) + (47663.33318640229 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.18748340933946497 = (16083.50225088693 - 13068.11241477169) / 16083.50225088693 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: Url,�2020,512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 42.99988295118344 < 61.65593714268553. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.214395935567035 (T) = (0 -43327.06455213987) / Math.Sqrt((78719608.65756245 / (299)) + (150146.7779323913 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11966149022736369 = (49216.36855728359 - 43327.06455213987) / 49216.36855728359 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: JavaScript,&Hello+<World>!,16) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.4382254611355703 < 3.4503843969827757. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.071372825691808 (T) = (0 -2416.9873110039525) / Math.Sqrt((271053.1982924901 / (299)) + (5891.696128250973 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11098383083648172 = (2718.7214303178685 - 2416.9873110039525) / 2718.7214303178685 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: JavaScript,no escaping required,16) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.1321988062245159 < 1.8127303512755546. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.578826580211421 (T) = (0 -1105.7570999684247) / Math.Sqrt((105376.23337142714 / (299)) + (153.61641611857553 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.16697037980354396 = (1327.3922957357152 - 1105.7570999684247) / 1327.3922957357152 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: UnsafeRelaxed,no <escaping /> required,16) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.1967798118781092 < 1.956616890048814. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.72282116747397 (T) = (0 -1196.2296631980355) / Math.Sqrt((126547.84452709915 / (299)) + (181.97163740682515 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.17047630188780766 = (1442.068099947455 - 1196.2296631980355) / 1442.068099947455 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: Url,�2020,16) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.3246464586344697 < 1.905653647005742. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.4666950198246 (T) = (0 -1335.8370820794692) / Math.Sqrt((79658.29040057721 / (299)) + (480.42358533145455 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12061849698435435 = (1519.0643395369466 - 1335.8370820794692) / 1519.0643395369466 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: Url,�2020,16) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.9322643980377774 < 3.296972265121293. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 3.9535739468293802 (T) = (0 -2418.454493258889) / Math.Sqrt((217980.79435966862 / (299)) + (29642.30066723103 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.08730351261353277 = (2649.7905127083413 - 2418.454493258889) / 2649.7905127083413 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: Url,&lorem ipsum=dolor sit amet,512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 43.10348299144037 < 62.9859973053653. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.605395674448191 (T) = (0 -44320.22734846858) / Math.Sqrt((83264825.03988364 / (299)) + (2798231.5484975143 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10932766532528802 = (49760.41763400572 - 44320.22734846858) / 49760.41763400572 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: UnsafeRelaxed,no <escaping /> required,512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 44.30855308685445 < 62.883378144178124. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.250185242778583 (T) = (0 -44245.96954619254) / Math.Sqrt((83564486.97486696 / (299)) + (172546.839586063 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.12137338196586682 = (50358.1027913653 - 44245.96954619254) / 50358.1027913653 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in GuardedDevirtualization.TwoClassInterface

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.TwoClassInterface.Call(testInput%3a%20pB%20%3d%200.00).html>)	23.89 ns	17.90 ns	0.75	0.07	False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.TwoClassInterface.Call(testInput%3a%20pB%20%3d%200.10).html>)	23.89 ns	17.62 ns	0.74	0.06	False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.TwoClassInterface.Call(testInput%3a%20pB%20%3d%200.90).html>)	23.84 ns	19.11 ns	0.80	0.08	False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.TwoClassInterface.Call(testInput%3a%20pB%20%3d%200.50).html>)	23.91 ns	17.74 ns	0.74	0.05	False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.TwoClassInterface.Call(testInput%3a%20pB%20%3d%200.20).html>)	23.87 ns	17.61 ns	0.74	0.06	False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.TwoClassInterface.Call(testInput%3a%20pB%20%3d%200.60).html>)	23.94 ns	17.88 ns	0.75	0.06	False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.TwoClassInterface.Call(testInput%3a%20pB%20%3d%200.70).html>)	23.91 ns	17.81 ns	0.75	0.05	False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.TwoClassInterface.Call(testInput%3a%20pB%20%3d%200.40).html>)	23.84 ns	17.89 ns	0.75	0.06	False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.TwoClassInterface.Call(testInput%3a%20pB%20%3d%200.80).html>)	23.87 ns	17.68 ns	0.74	0.06	False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.TwoClassInterface.Call(testInput%3a%20pB%20%3d%200.30).html>)	23.93 ns	17.69 ns	0.74	0.06	False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.TwoClassInterface.Call(testInput%3a%20pB%20%3d%201.00).html>)	23.91 ns	17.71 ns	0.74	0.07	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'GuardedDevirtualization.TwoClassInterface*'

### Payloads [Baseline]() [Compare]() ### Histogram #### GuardedDevirtualization.TwoClassInterface.Call(testInput: pB = 0.00) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.904429041335604 < 22.60759250324328. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.228875997525591 (T) = (0 -17.824191378363547) / Math.Sqrt((5.187073537040574 / (299)) + (0.1046196974317457 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10700465395608962 = (19.960004783145976 - 17.824191378363547) / 19.960004783145976 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.TwoClassInterface.Call(testInput: pB = 0.10) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.623300796332046 < 22.640506475311756. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 17.053393519497686 (T) = (0 -17.718627878125325) / Math.Sqrt((4.863701197074367 / (299)) + (0.006801874514467275 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11101027039473974 = (19.93119525238268 - 17.718627878125325) / 19.93119525238268 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.TwoClassInterface.Call(testInput: pB = 0.90) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 19.113563173194613 < 22.675237660473528. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.174620540637058 (T) = (0 -17.829100979370928) / Math.Sqrt((4.801131834256931 / (299)) + (0.1688625649612215 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10596755355008396 = (19.94234219369545 - 17.829100979370928) / 19.94234219369545 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.TwoClassInterface.Call(testInput: pB = 0.50) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.74040714769056 < 22.626422533291354. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 16.936733181108423 (T) = (0 -17.746441052009132) / Math.Sqrt((4.990282985174518 / (299)) + (0.0038080140004088897 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11068549779328302 = (19.955191338917416 - 17.746441052009132) / 19.955191338917416 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.TwoClassInterface.Call(testInput: pB = 0.20) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.607517729381666 < 22.609139060385328. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 16.1359159466301 (T) = (0 -17.69440052613003) / Math.Sqrt((4.906176377854759 / (299)) + (0.036286113206124175 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11278481241431584 = (19.943752962886656 - 17.69440052613003) / 19.943752962886656 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.TwoClassInterface.Call(testInput: pB = 0.60) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.879339640672782 < 22.642648186157512. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 16.525119225477134 (T) = (0 -17.749558817796043) / Math.Sqrt((4.941140013452891 / (299)) + (0.01369746347441316 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.11040812640935088 = (19.952474100458797 - 17.749558817796043) / 19.952474100458797 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.TwoClassInterface.Call(testInput: pB = 0.70) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.81462301004298 < 22.658306129807688. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 16.49789545083487 (T) = (0 -17.7508837825486) / Math.Sqrt((5.011970773680935 / (299)) + (0.010563123367055071 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1098847414012509 = (19.942230639313685 - 17.7508837825486) / 19.942230639313685 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.TwoClassInterface.Call(testInput: pB = 0.40) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.89478945924017 < 22.640526079982816. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.709068301168578 (T) = (0 -17.849748891516874) / Math.Sqrt((5.061786425923496 / (299)) + (0.0733517350740636 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10441004137268617 = (19.93071574727735 - 17.849748891516874) / 19.93071574727735 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.TwoClassInterface.Call(testInput: pB = 0.80) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.684696397818602 < 22.63619553846105. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 15.91308928957596 (T) = (0 -17.762352097245458) / Math.Sqrt((4.948815786203735 / (299)) + (0.02378431382136037 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1087053929107315 = (19.92871039044271 - 17.762352097245458) / 19.92871039044271 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.TwoClassInterface.Call(testInput: pB = 0.30) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.686720695709948 < 22.64276807330703. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 16.337602846070794 (T) = (0 -17.756542431966537) / Math.Sqrt((4.782625386145567 / (299)) + (0.02030386179793345 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10902527814590987 = (19.929344791079746 - 17.756542431966537) / 19.929344791079746 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.TwoClassInterface.Call(testInput: pB = 1.00) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.707529864317447 < 22.592444372475416. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 17.25173903964569 (T) = (0 -17.686814693891346) / Math.Sqrt((4.882452841746937 / (299)) + (0.004282622496863222 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11189844988484068 = (19.915306635370598 - 17.686814693891346) / 19.915306635370598 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in MicroBenchmarks.Serializers.Xml_ToStream<XmlElement>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[DataContractSerializer_ - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/MicroBenchmarks.Serializers.XmlToStream(XmlElement).DataContractSerializer.html>)	6.75 μs	5.78 μs	0.86	0.01	False
[XmlSerializer_ - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/MicroBenchmarks.Serializers.XmlToStream(XmlElement).XmlSerializer.html>)	18.55 μs	16.72 μs	0.90	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'MicroBenchmarks.Serializers.Xml_ToStream<XmlElement>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### MicroBenchmarks.Serializers.Xml_ToStream<XmlElement>.DataContractSerializer_ ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.777681988219659 < 6.32451761464848. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.567939482622334 (T) = (0 -5744.605799354384) / Math.Sqrt((103994.04268666005 / (299)) + (3972.943133242642 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.053929380669632924 = (6072.068703941404 - 5744.605799354384) / 6072.068703941404 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### MicroBenchmarks.Serializers.Xml_ToStream<XmlElement>.XmlSerializer_ ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 16.7171229631104 < 17.885277454370282. IsChangePoint: Marked as a change because one of 4/8/2022 7:02:49 PM, 5/9/2022 11:56:12 AM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 20.74374963428587 (T) = (0 -16698.098538357055) / Math.Sqrt((277726.6065986965 / (299)) + (35807.672661393 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.07210482537544838 = (17995.67342842741 - 16698.098538357055) / 17995.67342842741 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in System.IO.Tests.Perf_FileStream

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Read - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_FileStream.Read(fileSize%3a%20104857600%2c%20userBufferSize%3a%204096%2c%20options%3a%20Asynchronous).html>)	44.51 ms	40.36 ms	0.91	0.02	False
[WriteByte - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_FileStream.WriteByte(fileSize%3a%201024%2c%20options%3a%20None).html>)	107.22 μs	91.48 μs	0.85	0.04	False
[SeekBackward - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_FileStream.SeekBackward(fileSize%3a%201024%2c%20options%3a%20None).html>)	1.36 ms	1.17 ms	0.86	0.02	False
[ReadByte - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_FileStream.ReadByte(fileSize%3a%201024%2c%20options%3a%20Asynchronous).html>)	71.61 μs	60.16 μs	0.84	0.06	False
[SeekForward - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_FileStream.SeekForward(fileSize%3a%201024%2c%20options%3a%20Asynchronous).html>)	356.77 μs	275.79 μs	0.77	0.03	False
[WriteByte - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_FileStream.WriteByte(fileSize%3a%201024%2c%20options%3a%20Asynchronous).html>)	117.73 μs	92.10 μs	0.78	0.05	False
[SeekForward - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_FileStream.SeekForward(fileSize%3a%201024%2c%20options%3a%20None).html>)	358.94 μs	275.74 μs	0.77	0.05	False
[SeekBackward - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_FileStream.SeekBackward(fileSize%3a%201024%2c%20options%3a%20Asynchronous).html>)	1.32 ms	1.16 ms	0.88	0.03	False
[ReadByte - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_FileStream.ReadByte(fileSize%3a%201024%2c%20options%3a%20None).html>)	73.95 μs	60.17 μs	0.81	0.06	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Tests.Perf_FileStream*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.IO.Tests.Perf_FileStream.Read(fileSize: 104857600, userBufferSize: 4096, options: Asynchronous) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 40.361315711111104 < 42.55094601456044. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.515435239499439 (T) = (0 -40580903.67910145) / Math.Sqrt((2090814375350.0017 / (299)) + (304627679860.19543 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.05019614940051731 = (42725562.39215941 - 40580903.67910145) / 42725562.39215941 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_FileStream.WriteByte(fileSize: 1024, options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 91.47593706131296 < 102.2787598994007. IsChangePoint: Marked as a change because one of 4/27/2022 1:24:17 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 14.431659298823309 (T) = (0 -91157.7348111169) / Math.Sqrt((36787631.85121926 / (299)) + (857111.8998417876 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.06525766448731886 = (97521.77829959881 - 91157.7348111169) / 97521.77829959881 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_FileStream.SeekBackward(fileSize: 1024, options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.1709281734203294 < 1.2390304016970008. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.498056129118138 (T) = (0 -1180853.5734484151) / Math.Sqrt((1776749941.315152 / (299)) + (304174484.1568157 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.053421877277453664 = (1247497.2166608353 - 1180853.5734484151) / 1247497.2166608353 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_FileStream.ReadByte(fileSize: 1024, options: Asynchronous) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 60.15812681089742 < 68.10754965592535. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.52504770116711 (T) = (0 -59239.2901459134) / Math.Sqrt((25098512.45292949 / (299)) + (474253.4757985399 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.06398572992351999 = (63288.875009430216 - 59239.2901459134) / 63288.875009430216 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_FileStream.SeekForward(fileSize: 1024, options: Asynchronous) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 275.79346644736836 < 339.5553910685018. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 14.451896203089781 (T) = (0 -278382.5701755111) / Math.Sqrt((858572476.6387403 / (299)) + (13393763.701316357 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.0939295055891413 = (307241.6240157118 - 278382.5701755111) / 307241.6240157118 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_FileStream.WriteByte(fileSize: 1024, options: Asynchronous) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 92.10169358291562 < 101.71572678370003. IsChangePoint: Marked as a change because one of 4/27/2022 1:24:17 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.387498093131278 (T) = (0 -91347.45098363403) / Math.Sqrt((37422320.43327384 / (299)) + (1413181.513597448 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.0626503436141137 = (97452.909233295 - 91347.45098363403) / 97452.909233295 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_FileStream.SeekForward(fileSize: 1024, options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 275.7403743734336 < 340.4380939410849. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 14.398374688734384 (T) = (0 -278605.97616033524) / Math.Sqrt((866943375.1565053 / (299)) + (13719793.611067541 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.09413030960258845 = (307556.3506690557 - 278605.97616033524) / 307556.3506690557 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_FileStream.SeekBackward(fileSize: 1024, options: Asynchronous) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.1622457171474359 < 1.2394366482200092. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.571454155172846 (T) = (0 -1175471.2670840062) / Math.Sqrt((2007160076.6655512 / (299)) + (478374176.34342504 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.05782830987725853 = (1247618.9630903383 - 1175471.2670840062) / 1247618.9630903383 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_FileStream.ReadByte(fileSize: 1024, options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 60.16615532147317 < 68.04533996750659. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.296211369480659 (T) = (0 -59316.169525187266) / Math.Sqrt((25815524.677958976 / (299)) + (1211319.8911748172 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.0635158827296992 = (63339.21572325676 - 59316.169525187266) / 63339.21572325676 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Count(Pattern%3a%20%22(%3f%3a(%3f%3a25%5b0-5%5d%7c2%5b0-4%5d%5b0-9%5d%7c%5b01%5d%3f%5b0-9%5d%5b0-9%5d)%5c.)%7b3%7d(%3f%3a25%5b0-5%5d%7c2%5b0-4%5d%5b0-9%5d%7c%5b01%5d%3f%5b0-9%5d%5b0-9%5d)%22%2c%20Options%3a%20NonBacktracking).html>)	397.38 ms	244.71 ms	0.62	0.07	False
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Count(Pattern%3a%20%22%5b%5cw%5d%2b%3a%2f%2f%5b%5e%2f%5cs%3f%23%5d%2b%5b%5e%5cs%3f%23%5d%2b(%3f%3a%5c%3f%5b%5e%5cs%23%5d)%3f(%3f%3a%23%5b%5e%5cs%5d)%3f%22%2c%20Options%3a%20None).html>)	89.42 ms	61.49 ms	0.69	0.01	False
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Count(Pattern%3a%20%22%5b%5cw%5d%2b%3a%2f%2f%5b%5e%2f%5cs%3f%23%5d%2b%5b%5e%5cs%3f%23%5d%2b(%3f%3a%5c%3f%5b%5e%5cs%23%5d)%3f(%3f%3a%23%5b%5e%5cs%5d)%3f%22%2c%20Options%3a%20Compiled).html>)	90.54 ms	61.18 ms	0.68	0.02	False
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Count(Pattern%3a%20%22%5b%5cw%5c.%2b-%5d%2b%40%5b%5cw%5c.-%5d%2b%5c.%5b%5cw%5c.-%5d%2b%22%2c%20Options%3a%20Compiled).html>)	41.80 ms	24.52 ms	0.59	0.07	False
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Count(Pattern%3a%20%22%5b%5cw%5c.%2b-%5d%2b%40%5b%5cw%5c.-%5d%2b%5c.%5b%5cw%5c.-%5d%2b%22%2c%20Options%3a%20None).html>)	41.77 ms	24.51 ms	0.59	0.09	False
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Count(Pattern%3a%20%22(%3f%3a(%3f%3a25%5b0-5%5d%7c2%5b0-4%5d%5b0-9%5d%7c%5b01%5d%3f%5b0-9%5d%5b0-9%5d)%5c.)%7b3%7d(%3f%3a25%5b0-5%5d%7c2%5b0-4%5d%5b0-9%5d%7c%5b01%5d%3f%5b0-9%5d%5b0-9%5d)%22%2c%20Options%3a%20Compiled).html>)	576.72 ms	378.25 ms	0.66	0.03	False
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Count(Pattern%3a%20%22%5b%5cw%5c.%2b-%5d%2b%40%5b%5cw%5c.-%5d%2b%5c.%5b%5cw%5c.-%5d%2b%22%2c%20Options%3a%20NonBacktracking).html>)	41.81 ms	24.32 ms	0.58	0.09	False
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Count(Pattern%3a%20%22(%3f%3a(%3f%3a25%5b0-5%5d%7c2%5b0-4%5d%5b0-9%5d%7c%5b01%5d%3f%5b0-9%5d%5b0-9%5d)%5c.)%7b3%7d(%3f%3a25%5b0-5%5d%7c2%5b0-4%5d%5b0-9%5d%7c%5b01%5d%3f%5b0-9%5d%5b0-9%5d)%22%2c%20Options%3a%20None).html>)	576.51 ms	378.56 ms	0.66	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Count(Pattern: "(?:(?:25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9])\.){3}(?:25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9])", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 244.70642493333332 < 377.41264610869047. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.834751582946659 (T) = (0 -248496852.7392857) / Math.Sqrt((3979405241640048.5 / (299)) + (18997066391972.09 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.13249328052135975 = (286449484.66638845 - 248496852.7392857) / 286449484.66638845 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Count(Pattern: "[\w]+://[^/\s?#]+[^\s?#]+(?:\?[^\s#]*)?(?:#[^\s]*)?", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 61.49237064285714 < 85.24168661624999. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.691666406972521 (T) = (0 -61802941.55147666) / Math.Sqrt((128931003509874.92 / (299)) + (677163450170.1942 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10778412887789496 = (69269045.25218713 - 61802941.55147666) / 69269045.25218713 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Count(Pattern: "[\w]+://[^/\s?#]+[^\s?#]+(?:\?[^\s#]*)?(?:#[^\s]*)?", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 61.179101375 < 85.37451392999999. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.860099488254875 (T) = (0 -61695276.62277168) / Math.Sqrt((127245702791469.8 / (299)) + (733598560391.5768 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10937303010256239 = (69271736.32511528 - 61695276.62277168) / 69271736.32511528 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Count(Pattern: "[\w\.+-]+@[\w\.-]+\.[\w\.-]+", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 24.5165568 < 39.70000262749999. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.500535277329705 (T) = (0 -24690165.19724359) / Math.Sqrt((50237445066782.266 / (299)) + (501184743890.0721 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.149834941972126 = (29041613.70089393 - 24690165.19724359) / 29041613.70089393 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Count(Pattern: "[\w\.+-]+@[\w\.-]+\.[\w\.-]+", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 24.506557771428575 < 39.68162254999999. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.510711621293629 (T) = (0 -24695565.83119658) / Math.Sqrt((52044962061226.21 / (299)) + (519128190041.06213 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.15220794429661128 = (29129272.52037928 - 24695565.83119658) / 29129272.52037928 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Count(Pattern: "(?:(?:25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9])\.){3}(?:25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9])", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 378.24795973333335 < 551.1506938182052. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.922030882223744 (T) = (0 -376663204.2718615) / Math.Sqrt((6385763039120617 / (299)) + (4320431438353.444 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.13792708203178844 = (436927313.71216875 - 376663204.2718615) / 436927313.71216875 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Count(Pattern: "[\w\.+-]+@[\w\.-]+\.[\w\.-]+", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 24.319982607407404 < 39.754014189503955. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.788020992663377 (T) = (0 -24558689.998614836) / Math.Sqrt((50949425883189.2 / (299)) + (6536436408.500136 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.15370423619082751 = (29019039.263621397 - 24558689.998614836) / 29019039.263621397 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Count(Pattern: "(?:(?:25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9])\.){3}(?:25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9])", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 378.5632351333333 < 552.749695060119. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.930975114345026 (T) = (0 -377715877.12777776) / Math.Sqrt((6275000377863252 / (299)) + (1802621908427.7986 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1359894262542938 = (437165803.99043393 - 377715877.12777776) / 437165803.99043393 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in System.Text.Json.Tests.Perf_Guids

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[WriteGuids - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Guids.WriteGuids(Formatted%3a%20False%2c%20SkipValidation%3a%20True).html>)	148.57 ms	95.95 ms	0.65	0.03	False
[WriteGuids - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Guids.WriteGuids(Formatted%3a%20True%2c%20SkipValidation%3a%20False).html>)	159.12 ms	105.45 ms	0.66	0.02	False
[WriteGuids - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Guids.WriteGuids(Formatted%3a%20False%2c%20SkipValidation%3a%20False).html>)	148.87 ms	96.69 ms	0.65	0.03	False
[WriteGuids - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Guids.WriteGuids(Formatted%3a%20True%2c%20SkipValidation%3a%20True).html>)	156.91 ms	100.91 ms	0.64	0.03	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Tests.Perf_Guids*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Tests.Perf_Guids.WriteGuids(Formatted: False, SkipValidation: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 95.95269795 < 140.11382910833333. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.975691708634296 (T) = (0 -94507324.05400433) / Math.Sqrt((461735217972379.8 / (299)) + (735812979860.0515 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.118151794898546 = (107169605.27592336 - 94507324.05400433) / 107169605.27592336 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Guids.WriteGuids(Formatted: True, SkipValidation: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 105.44923163333334 < 150.20822871833334. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.152651013527052 (T) = (0 -104689722.25376986) / Math.Sqrt((665742025380968.2 / (299)) + (2830636173170.2915 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10889484511311295 = (117483017.21704069 - 104689722.25376986) / 117483017.21704069 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Guids.WriteGuids(Formatted: False, SkipValidation: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 96.69151545 < 139.79601756386901. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.33110411176312 (T) = (0 -96529024.68005954) / Math.Sqrt((526304225763330.9 / (299)) + (756208642615.9227 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11545577437629446 = (109128545.39522369 - 96529024.68005954) / 109128545.39522369 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Guids.WriteGuids(Formatted: True, SkipValidation: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 100.91228757692308 < 148.00147220625. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.138453318407441 (T) = (0 -101564237.65720946) / Math.Sqrt((526278841709514.5 / (299)) + (947780327335.0605 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.11943763072160289 = (115340197.58355024 - 101564237.65720946) / 115340197.58355024 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in BenchmarksGame.RegexRedux_5

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[RunBench - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/BenchmarksGame.RegexRedux_5.RunBench(options%3a%20None).html>)	464.52 ms	361.05 ms	0.78	0.35	False
[RunBench - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/BenchmarksGame.RegexRedux_5.RunBench(options%3a%20Compiled).html>)	176.53 ms	137.30 ms	0.78	0.43	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'BenchmarksGame.RegexRedux_5*'

### Payloads [Baseline]() [Compare]() ### Histogram #### BenchmarksGame.RegexRedux_5.RunBench(options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 361.05192025 < 447.32156750499996. IsChangePoint: Marked as a change because one of 4/13/2022 5:30:39 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.981520848174329 (T) = (0 -350453314.7583333) / Math.Sqrt((2169225904215328.8 / (299)) + (101991687327206.95 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10156666221527269 = (390071583.52165365 - 350453314.7583333) / 390071583.52165365 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### BenchmarksGame.RegexRedux_5.RunBench(options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 137.30298094999998 < 165.272059371875. IsChangePoint: Marked as a change because one of 4/19/2022 9:35:37 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 5.171539731585549 (T) = (0 -130073884.71666668) / Math.Sqrt((312948077286965.4 / (299)) + (50064336292034.31 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.08598047282019483 = (142309743.77320787 - 130073884.71666668) / 142309743.77320787 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in System.Net.Primitives.Tests.IPAddressPerformanceTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[GetAddressBytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Net.Primitives.Tests.IPAddressPerformanceTests.GetAddressBytes(address%3a%201020%3a3040%3a5060%3a7080%3a9010%3a1112%3a1314%3a1516).html>)	401.43 ns	254.15 ns	0.63	0.08	False
[TryFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Net.Primitives.Tests.IPAddressPerformanceTests.TryFormat(address%3a%201020%3a3040%3a5060%3a7080%3a9010%3a1112%3a1314%3a1516).html>)	2.46 μs	1.76 μs	0.72	0.07	False
[TryWriteBytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Net.Primitives.Tests.IPAddressPerformanceTests.TryWriteBytes(address%3a%20143.24.20.36).html>)	72.74 ns	49.54 ns	0.68	0.21	False
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Net.Primitives.Tests.IPAddressPerformanceTests.ToString(address%3a%20143.24.20.36).html>)	19.00 ns	16.56 ns	0.87	0.58	False
[Ctor_Bytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Net.Primitives.Tests.IPAddressPerformanceTests.Ctor_Bytes(address%3a%20%5b143%2c%2024%2c%2020%2c%2036%5d).html>)	111.15 ns	90.05 ns	0.81	0.19	False
[Ctor_Span - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Net.Primitives.Tests.IPAddressPerformanceTests.Ctor_Span(address%3a%20%5b143%2c%2024%2c%2020%2c%2036%5d).html>)	99.15 ns	83.79 ns	0.85	0.17	False
[GetAddressBytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Net.Primitives.Tests.IPAddressPerformanceTests.GetAddressBytes(address%3a%20143.24.20.36).html>)	101.09 ns	81.01 ns	0.80	0.11	False
[Ctor_Bytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Net.Primitives.Tests.IPAddressPerformanceTests.Ctor_Bytes(address%3a%20%5b16%2c%2032%2c%2048%2c%2064%2c%2080%2c%20...%5d).html>)	351.15 ns	257.93 ns	0.73	0.09	False
[Ctor_Span - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Net.Primitives.Tests.IPAddressPerformanceTests.Ctor_Span(address%3a%20%5b16%2c%2032%2c%2048%2c%2064%2c%2080%2c%20...%5d).html>)	336.43 ns	249.54 ns	0.74	0.06	False
[TryWriteBytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Net.Primitives.Tests.IPAddressPerformanceTests.TryWriteBytes(address%3a%201020%3a3040%3a5060%3a7080%3a9010%3a1112%3a1314%3a1516).html>)	371.15 ns	224.71 ns	0.61	0.10	False
[TryFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Net.Primitives.Tests.IPAddressPerformanceTests.TryFormat(address%3a%20143.24.20.36).html>)	508.89 ns	312.57 ns	0.61	0.08	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Net.Primitives.Tests.IPAddressPerformanceTests*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Net.Primitives.Tests.IPAddressPerformanceTests.GetAddressBytes(address: 1020:3040:5060:7080:9010:1112:1314:1516) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 254.15025509064213 < 379.87479011911665. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.397757031690402 (T) = (0 -255.69643283880725) / Math.Sqrt((3547.3977173877875 / (299)) + (7.302373618559757 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.12582204339273745 = (292.49929136989516 - 255.69643283880725) / 292.49929136989516 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Net.Primitives.Tests.IPAddressPerformanceTests.TryFormat(address: 1020:3040:5060:7080:9010:1112:1314:1516) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.7590119848330315 < 2.3368104991381795. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 14.974889430616688 (T) = (0 -1744.4920870308422) / Math.Sqrt((69242.91468494035 / (299)) + (420.6639901985849 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12293774390499808 = (1989.017398602867 - 1744.4920870308422) / 1989.017398602867 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Net.Primitives.Tests.IPAddressPerformanceTests.TryWriteBytes(address: 143.24.20.36) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 49.544099250532874 < 68.3609975424333. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 5.222440191229448 (T) = (0 -50.01355949532246) / Math.Sqrt((112.86546366241544 / (299)) + (3.6201446974538936 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.07923532980294888 = (54.31741802671377 - 50.01355949532246) / 54.31741802671377 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Net.Primitives.Tests.IPAddressPerformanceTests.ToString(address: 143.24.20.36) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 16.558196253360432 < 18.15804909747446. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 6.420905666551693 (T) = (0 -16.689164051763004) / Math.Sqrt((3.129587853038403 / (299)) + (0.3773675298578136 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.07301540818058042 = (18.003712466252214 - 16.689164051763004) / 18.003712466252214 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Net.Primitives.Tests.IPAddressPerformanceTests.Ctor_Bytes(address: [143, 24, 20, 36]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 90.05090423152431 < 106.53946172750466. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.137447064915422 (T) = (0 -90.5373998538786) / Math.Sqrt((77.3276463275943 / (299)) + (8.88515024395944 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.08243133990007154 = (98.67098102938537 - 90.5373998538786) / 98.67098102938537 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Net.Primitives.Tests.IPAddressPerformanceTests.Ctor_Span(address: [143, 24, 20, 36]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 83.79292064701897 < 95.57820419082437. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.25863973833915 (T) = (0 -82.89909493506873) / Math.Sqrt((54.88448705889446 / (299)) + (0.9636528717248815 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.06521372322961672 = (88.68240473263997 - 82.89909493506873) / 88.68240473263997 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Net.Primitives.Tests.IPAddressPerformanceTests.GetAddressBytes(address: 143.24.20.36) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 81.00678043767134 < 95.64930100886113. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.643924080277152 (T) = (0 -79.62617348914092) / Math.Sqrt((74.17756250943204 / (299)) + (1.9834734317012301 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.08045350777914595 = (86.59287394684176 - 79.62617348914092) / 86.59287394684176 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Net.Primitives.Tests.IPAddressPerformanceTests.Ctor_Bytes(address: [16, 32, 48, 64, 80, ...]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 257.93014616190123 < 332.11571715785186. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.71800631637415 (T) = (0 -250.40763295178678) / Math.Sqrt((1486.0274694765242 / (299)) + (13.248021835831944 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.11206008012727264 = (282.0096578017113 - 250.40763295178678) / 282.0096578017113 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Net.Primitives.Tests.IPAddressPerformanceTests.Ctor_Span(address: [16, 32, 48, 64, 80, ...]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 249.5390635668442 < 319.78613075262484. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.206930131804178 (T) = (0 -244.5198175118803) / Math.Sqrt((1391.786946239129 / (299)) + (7.132615743851585 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.09546974140142787 = (270.32795772993313 - 244.5198175118803) / 270.32795772993313 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Net.Primitives.Tests.IPAddressPerformanceTests.TryWriteBytes(address: 1020:3040:5060:7080:9010:1112:1314:1516) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 224.71232338119574 < 352.330483688556. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.343890094426751 (T) = (0 -226.60370015015778) / Math.Sqrt((3966.402641151245 / (299)) + (28.662384981751856 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12715991072138147 = (259.6165127308031 - 226.60370015015778) / 259.6165127308031 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Net.Primitives.Tests.IPAddressPerformanceTests.TryFormat(address: 143.24.20.36) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 312.5713799777813 < 475.29021649811415. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.339792384634482 (T) = (0 -318.3807000374207) / Math.Sqrt((5212.2174943904865 / (299)) + (27.752589287667355 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1261098967046385 = (364.3257874609582 - 318.3807000374207) / 364.3257874609582 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in System.Text.Json.Serialization.Tests.WriteJson<LoginViewModel>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[SerializeToUtf8Bytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.WriteJson(LoginViewModel).SerializeToUtf8Bytes.html>)	11.75 μs	9.55 μs	0.81	0.01	False
[SerializeToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.WriteJson(LoginViewModel).SerializeToString.html>)	13.51 μs	11.17 μs	0.83	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson<LoginViewModel>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Serialization.Tests.WriteJson<LoginViewModel>.SerializeToUtf8Bytes ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 9.547221327967808 < 11.080104684382231. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.586177311571067 (T) = (0 -9618.58278382503) / Math.Sqrt((689928.8810672329 / (299)) + (12055.292642692179 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.0603333915917255 = (10236.165356687725 - 9618.58278382503) / 10236.165356687725 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Serialization.Tests.WriteJson<LoginViewModel>.SerializeToString ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 11.170627852449222 < 12.722155629797179. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.323671838143655 (T) = (0 -11141.587615232682) / Math.Sqrt((806207.9913236428 / (299)) + (5828.389256725579 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.05457728922809443 = (11784.768324568757 - 11141.587615232682) / 11784.768324568757 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Collections.Tests.Perf_PriorityQueue<Guid, Guid>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Dequeue_And_Enqueue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_PriorityQueue(Guid%2c%20Guid).Dequeue_And_Enqueue(Size%3a%20100).html>)	535.90 μs	448.23 μs	0.84	0.02	False
[Enumerate - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_PriorityQueue(Guid%2c%20Guid).Enumerate(Size%3a%2010).html>)	515.70 ns	378.59 ns	0.73	0.13	False
[K_Max_Elements - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_PriorityQueue(Guid%2c%20Guid).K_Max_Elements(Size%3a%2010).html>)	7.15 μs	6.15 μs	0.86	0.02	False
[Enumerate - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_PriorityQueue(Guid%2c%20Guid).Enumerate(Size%3a%20100).html>)	4.03 μs	2.91 μs	0.72	0.21	False
[Dequeue_And_Enqueue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_PriorityQueue(Guid%2c%20Guid).Dequeue_And_Enqueue(Size%3a%2010).html>)	24.48 μs	20.76 μs	0.85	0.01	False
[Enumerate - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_PriorityQueue(Guid%2c%20Guid).Enumerate(Size%3a%201000).html>)	40.57 μs	31.89 μs	0.79	0.18	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.Tests.Perf_PriorityQueue<Guid, Guid>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.Tests.Perf_PriorityQueue<Guid, Guid>.Dequeue_And_Enqueue(Size: 100) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 448.2286360969388 < 497.2900006805554. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.566341944349658 (T) = (0 -454113.0188856698) / Math.Sqrt((708116547.2617146 / (299)) + (15120277.358228803 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.0538412064675447 = (479954.3395778763 - 454113.0188856698) / 479954.3395778763 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_PriorityQueue<Guid, Guid>.Enumerate(Size: 10) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 378.59373838137066 < 491.21619246306. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.003476800943595 (T) = (0 -388.7767116440267) / Math.Sqrt((1967.515599147941 / (299)) + (383.3739595567521 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.11700567326230195 = (440.2935555434396 - 388.7767116440267) / 440.2935555434396 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_PriorityQueue<Guid, Guid>.K_Max_Elements(Size: 10) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.151990822908522 < 6.724501766262679. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.748462807318482 (T) = (0 -6206.043977171015) / Math.Sqrt((114595.94163098304 / (299)) + (9457.919570611788 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.05101943715934713 = (6539.695564041913 - 6206.043977171015) / 6539.695564041913 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_PriorityQueue<Guid, Guid>.Enumerate(Size: 100) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.9144080937092873 < 3.824820811834226. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.602293680125829 (T) = (0 -3050.67378878894) / Math.Sqrt((136820.8886424469 / (299)) + (19928.67058813327 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1148733854868888 = (3446.595931890545 - 3050.67378878894) / 3446.595931890545 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_PriorityQueue<Guid, Guid>.Dequeue_And_Enqueue(Size: 10) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 20.759285568835764 < 23.114401842830613. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.595076433750384 (T) = (0 -20709.34122340249) / Math.Sqrt((1661438.703941424 / (299)) + (121976.96482917044 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.05490396159478705 = (21912.41988311382 - 20709.34122340249) / 21912.41988311382 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_PriorityQueue<Guid, Guid>.Enumerate(Size: 1000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 31.887360183691754 < 38.00845620029138. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.70315891683921 (T) = (0 -30382.91154529603) / Math.Sqrt((13036886.973393513 / (299)) + (1271347.3023818694 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.11301646755018767 = (34254.2002571115 - 30382.91154529603) / 34254.2002571115 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in System.Text.Json.Serialization.Tests.WriteJson<ImmutableSortedDictionary<String, String>>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[SerializeObjectProperty - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.WriteJson(ImmutableSortedDictionary(String%2c%20String)).SerializeObjectProperty.html>)	508.77 μs	343.56 μs	0.68	0.02	False
[SerializeToStream - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.WriteJson(ImmutableSortedDictionary(String%2c%20String)).SerializeToStream.html>)	488.50 μs	318.14 μs	0.65	0.02	False
[SerializeToUtf8Bytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.WriteJson(ImmutableSortedDictionary(String%2c%20String)).SerializeToUtf8Bytes.html>)	475.81 μs	307.94 μs	0.65	0.01	False
[SerializeToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.WriteJson(ImmutableSortedDictionary(String%2c%20String)).SerializeToString.html>)	501.07 μs	330.98 μs	0.66	0.02	False

Test Report.html>)

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson<ImmutableSortedDictionary<String, String>>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Serialization.Tests.WriteJson<ImmutableSortedDictionary<String, String>>.SerializeObjectProperty ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 343.55740589198035 < 478.014368031394. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.63667257239181 (T) = (0 -342185.9290512277) / Math.Sqrt((4729170046.580918 / (299)) + (19947537.19931138 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.09582191946854157 = (378449.7063345059 - 342185.9290512277) / 378449.7063345059 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Serialization.Tests.WriteJson<ImmutableSortedDictionary<String, String>>.SerializeToStream ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 318.1373550833333 < 452.7651508377845. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.735314087918864 (T) = (0 -319183.576339047) / Math.Sqrt((4501960143.141335 / (299)) + (3490571.54147456 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.10681779381283164 = (357355.5027496387 - 319183.576339047) / 357355.5027496387 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Serialization.Tests.WriteJson<ImmutableSortedDictionary<String, String>>.SerializeToUtf8Bytes ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 307.94451625817 < 445.1392676060268. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.580780685255284 (T) = (0 -313038.79485874675) / Math.Sqrt((4381141567.343252 / (299)) + (13258835.402986087 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10833055590696843 = (351070.45209691644 - 313038.79485874675) / 351070.45209691644 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Serialization.Tests.WriteJson<ImmutableSortedDictionary<String, String>>.SerializeToString ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 330.9839996864549 < 471.88859588160415. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.801186916391043 (T) = (0 -334289.16769367683) / Math.Sqrt((4871499410.602376 / (299)) + (69139650.93511371 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.09876905427642074 = (370925.0878256107 - 334289.16769367683) / 370925.0878256107 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in System.Tests.Perf_Array

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[IndexOfShort - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Array.IndexOfShort.html>)	543.15 ns	334.83 ns	0.62	0.04	False
[ArrayAssign3D - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Array.ArrayAssign3D.html>)	75.76 ms	71.33 ms	0.94	0.01	False
[ArrayResize - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Array.ArrayResize.html>)	200.54 ns	179.87 ns	0.90	0.02	False
[IndexOfChar - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Array.IndexOfChar.html>)	534.49 ns	329.21 ns	0.62	0.08	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Array*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Tests.Perf_Array.IndexOfShort ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 334.8344537551045 < 514.3077210994561. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.185655239604174 (T) = (0 -332.92351441797837) / Math.Sqrt((7648.643745122636 / (299)) + (27.05940780579826 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.1274783069346239 = (381.5647416723118 - 332.92351441797837) / 381.5647416723118 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Array.ArrayAssign3D ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 71.32831766666668 < 71.99360173757441. IsChangePoint: Marked as a change because one of 5/2/2022 5:38:23 AM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 15.516338512712727 (T) = (0 -70643952.36418651) / Math.Sqrt((1450347588075.6033 / (299)) + (727508310260.8627 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.053211960691146865 = (74614326.99947917 - 70643952.36418651) / 74614326.99947917 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Array.ArrayResize ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 179.86645868333332 < 191.48044715714283. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.323809831954746 (T) = (0 -177.52710050129872) / Math.Sqrt((59.08767555599447 / (299)) + (5.63601991826303 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.05526069170416521 = (187.91120359068202 - 177.52710050129872) / 187.91120359068202 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Array.IndexOfChar ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 329.2067543744388 < 511.45548996088104. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.063947849223505 (T) = (0 -331.0173191091262) / Math.Sqrt((7424.312503780004 / (299)) + (9.683113370359024 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.13356991206096572 = (382.04735005972924 - 331.0173191091262) / 382.04735005972924 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in BilinearTest

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Interpol_Scalar - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/BilinearTest.Interpol_Scalar.html>)	198.82 μs	109.99 μs	0.55	0.08	False
[Interpol_Vector - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/BilinearTest.Interpol_Vector.html>)	2.76 ms	1.77 ms	0.64	0.05	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'BilinearTest*'

### Payloads [Baseline]() [Compare]() ### Histogram #### BilinearTest.Interpol_Scalar ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 109.98511413190683 < 187.32040670061386. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.331546485599924 (T) = (0 -110921.61066614576) / Math.Sqrt((1326639012.9294703 / (299)) + (235993.73326852144 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.177432375215295 = (134848.01410118453 - 110921.61066614576) / 134848.01410118453 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### BilinearTest.Interpol_Vector ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.7709194503968253 < 2.594890418656994. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.479976111573245 (T) = (0 -1749675.7953975035) / Math.Sqrt((145396760420.23376 / (299)) + (744097535.1664559 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.143114069791842 = (2041900.4837347085 - 1749675.7953975035) / 2041900.4837347085 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Text.Tests.Perf_Encoding

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[GetByteCount - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_Encoding.GetByteCount(size%3a%20512%2c%20encName%3a%20%22ascii%22).html>)	132.13 ns	103.68 ns	0.78	0.17	False
[GetString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_Encoding.GetString(size%3a%2016%2c%20encName%3a%20%22ascii%22).html>)	376.21 ns	323.30 ns	0.86	0.08	False
[GetEncoder - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_Encoding.GetEncoder(size%3a%2016%2c%20encName%3a%20%22utf-8%22).html>)	87.19 ns	80.09 ns	0.92	0.27	False
[GetEncoder - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_Encoding.GetEncoder(size%3a%2016%2c%20encName%3a%20%22ascii%22).html>)	85.72 ns	76.79 ns	0.90	0.25	False
[GetString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_Encoding.GetString(size%3a%20512%2c%20encName%3a%20%22ascii%22).html>)	705.31 ns	576.11 ns	0.82	0.13	False
[GetString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_Encoding.GetString(size%3a%20512%2c%20encName%3a%20%22utf-8%22).html>)	1.92 μs	1.28 μs	0.67	0.18	False
[GetString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_Encoding.GetString(size%3a%2016%2c%20encName%3a%20%22utf-8%22).html>)	366.93 ns	321.29 ns	0.88	0.09	False
[GetChars - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_Encoding.GetChars(size%3a%2016%2c%20encName%3a%20%22ascii%22).html>)	327.70 ns	231.42 ns	0.71	0.17	False
[GetBytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_Encoding.GetBytes(size%3a%2016%2c%20encName%3a%20%22utf-8%22).html>)	410.67 ns	303.60 ns	0.74	0.13	False
[GetByteCount - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_Encoding.GetByteCount(size%3a%2016%2c%20encName%3a%20%22ascii%22).html>)	137.60 ns	103.37 ns	0.75	0.20	False
[GetChars - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_Encoding.GetChars(size%3a%20512%2c%20encName%3a%20%22ascii%22).html>)	616.86 ns	472.54 ns	0.77	0.13	False
[GetBytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_Encoding.GetBytes(size%3a%20512%2c%20encName%3a%20%22utf-8%22).html>)	7.12 μs	4.31 μs	0.61	0.10	False
[GetBytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_Encoding.GetBytes(size%3a%20512%2c%20encName%3a%20%22ascii%22).html>)	5.29 μs	2.82 μs	0.53	0.13	False
[GetBytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_Encoding.GetBytes(size%3a%2016%2c%20encName%3a%20%22ascii%22).html>)	454.75 ns	324.97 ns	0.71	0.14	False
[GetEncoder - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_Encoding.GetEncoder(size%3a%20512%2c%20encName%3a%20%22ascii%22).html>)	85.22 ns	79.10 ns	0.93	0.24	False
[GetChars - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_Encoding.GetChars(size%3a%2016%2c%20encName%3a%20%22utf-8%22).html>)	419.15 ns	305.92 ns	0.73	0.16	False
[GetByteCount - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_Encoding.GetByteCount(size%3a%2016%2c%20encName%3a%20%22utf-8%22).html>)	244.51 ns	182.28 ns	0.75	0.22	False
[GetChars - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_Encoding.GetChars(size%3a%20512%2c%20encName%3a%20%22utf-8%22).html>)	1.81 μs	1.18 μs	0.65	0.13	False
[GetByteCount - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Tests.Perf_Encoding.GetByteCount(size%3a%20512%2c%20encName%3a%20%22utf-8%22).html>)	2.32 μs	1.42 μs	0.61	0.08	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Tests.Perf_Encoding*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Tests.Perf_Encoding.GetByteCount(size: 512, encName: "ascii") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 103.67837721735673 < 127.52030170893009. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.580798684194368 (T) = (0 -102.70512032931715) / Math.Sqrt((165.80518730382042 / (299)) + (7.424639505948292 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.09177008601210522 = (113.08273240897243 - 102.70512032931715) / 113.08273240897243 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_Encoding.GetString(size: 16, encName: "ascii") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 323.2955559735945 < 351.2750328036648. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.949819337673787 (T) = (0 -313.93553884123725) / Math.Sqrt((346.4964526854136 / (299)) + (54.70828413893891 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.07950605677188138 = (341.05117274349857 - 313.93553884123725) / 341.05117274349857 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_Encoding.GetEncoder(size: 16, encName: "utf-8") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 80.08646551096462 < 81.46556451558028. IsChangePoint: Marked as a change because one of 4/21/2022 3:06:05 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.707903198096773 (T) = (0 -77.99358579739356) / Math.Sqrt((10.836269549927914 / (299)) + (5.0633233337433 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.08063665889727693 = (84.83434384477934 - 77.99358579739356) / 84.83434384477934 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_Encoding.GetEncoder(size: 16, encName: "ascii") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 76.79023046370571 < 82.59876105294347. IsChangePoint: Marked as a change because one of 4/22/2022 12:44:39 AM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 17.19284941783066 (T) = (0 -76.73081257814063) / Math.Sqrt((11.227427641108514 / (299)) + (1.9777940797205247 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.09156716433207004 = (84.46503645118013 - 76.73081257814063) / 84.46503645118013 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_Encoding.GetString(size: 512, encName: "ascii") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 576.1071601928546 < 598.227028938848. IsChangePoint: Marked as a change because one of 4/26/2022 11:56:10 PM, 5/25/2022 8:13:38 AM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 5.2704708001053655 (T) = (0 -574.884268092459) / Math.Sqrt((1042.8523602629048 / (299)) + (419.3179891317661 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.05377776965574443 = (607.5573471607236 - 574.884268092459) / 607.5573471607236 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_Encoding.GetString(size: 512, encName: "utf-8") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.2815847764559147 < 1.7363742122867423. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.563751903290227 (T) = (0 -1292.976418044892) / Math.Sqrt((47086.26464376756 / (299)) + (590.2842908121983 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.09611458080860796 = (1430.4649578279261 - 1292.976418044892) / 1430.4649578279261 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_Encoding.GetString(size: 16, encName: "utf-8") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 321.28588246016994 < 358.71313958126456. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.731869515092473 (T) = (0 -315.5140148513704) / Math.Sqrt((481.5802115873578 / (299)) + (25.296410144651723 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.07389882654611261 = (340.69065442889274 - 315.5140148513704) / 340.69065442889274 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_Encoding.GetChars(size: 16, encName: "ascii") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 231.42439248385926 < 291.22321225342404. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.12556199090792 (T) = (0 -236.79114284779916) / Math.Sqrt((672.9245104237908 / (299)) + (24.94382354525117 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.09816291148189363 = (262.5653190166453 - 236.79114284779916) / 262.5653190166453 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_Encoding.GetBytes(size: 16, encName: "utf-8") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 303.60015417762355 < 392.6510967217046. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.688735522473511 (T) = (0 -300.22750015025014) / Math.Sqrt((2488.2789195057303 / (299)) + (20.761947341121292 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.0840446766727724 = (327.7752664394888 - 300.22750015025014) / 327.7752664394888 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_Encoding.GetByteCount(size: 16, encName: "ascii") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 103.37040296178705 < 129.67026379256566. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 6.775136467070498 (T) = (0 -104.41337452933539) / Math.Sqrt((169.38744746523238 / (299)) + (12.822655507242247 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.07661480639467644 = (113.07672599953352 - 104.41337452933539) / 113.07672599953352 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_Encoding.GetChars(size: 512, encName: "ascii") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 472.54323077413363 < 524.7069186276445. IsChangePoint: Marked as a change because one of 4/26/2022 11:56:10 PM, 5/25/2022 8:13:38 AM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 4.465206555451273 (T) = (0 -483.90001077322) / Math.Sqrt((1297.7327819984587 / (299)) + (675.1007637194903 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.06701787962343861 = (518.6594686058002 - 483.90001077322) / 518.6594686058002 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_Encoding.GetBytes(size: 512, encName: "utf-8") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 4.312280695384471 < 6.760495744418552. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 2.396320746393553 (T) = (0 -4579.353629010608) / Math.Sqrt((1550643.0212141806 / (299)) + (218669.99261479796 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.07412754494875783 = (4945.987542913958 - 4579.353629010608) / 4945.987542913958 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_Encoding.GetBytes(size: 512, encName: "ascii") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.822376160741417 < 4.715846085600335. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.549941132185783 (T) = (0 -2894.5165334687968) / Math.Sqrt((906634.0454686614 / (299)) + (15059.840696972415 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.14587366683959482 = (3388.8623041964047 - 2894.5165334687968) / 3388.8623041964047 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_Encoding.GetBytes(size: 16, encName: "ascii") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 324.97438244448296 < 433.17038014416346. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 6.305640559339438 (T) = (0 -331.837795904535) / Math.Sqrt((2972.49577900341 / (299)) + (136.55958840776069 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.08243940185103191 = (361.65218577820883 - 331.837795904535) / 361.65218577820883 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_Encoding.GetEncoder(size: 512, encName: "ascii") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 79.10378417583932 < 81.11325813040573. IsChangePoint: Marked as a change because one of 4/21/2022 3:06:05 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.436125898737277 (T) = (0 -77.18733981322761) / Math.Sqrt((13.429723218673487 / (299)) + (4.2652277876251965 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.08571105520010784 = (84.42335462135702 - 77.18733981322761) / 84.42335462135702 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_Encoding.GetChars(size: 16, encName: "utf-8") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 305.9183677263291 < 396.09428929775584. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 15.49872328007843 (T) = (0 -308.58761483646987) / Math.Sqrt((1497.8234719755014 / (299)) + (23.08054563574994 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.1180881635261781 = (349.90755546530164 - 308.58761483646987) / 349.90755546530164 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_Encoding.GetByteCount(size: 16, encName: "utf-8") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 182.2849696131439 < 232.11062333443158. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.256577889181726 (T) = (0 -179.11640486051286) / Math.Sqrt((728.5164107654075 / (299)) + (35.832394657205555 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.09909514619690174 = (198.81833703568938 - 179.11640486051286) / 198.81833703568938 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_Encoding.GetChars(size: 512, encName: "utf-8") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.1766206019950511 < 1.627722209168169. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.133135230269392 (T) = (0 -1185.8170691106866) / Math.Sqrt((49409.08750389849 / (299)) + (688.1413000994569 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.10414159455559296 = (1323.6657287626165 - 1185.8170691106866) / 1323.6657287626165 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_Encoding.GetByteCount(size: 512, encName: "utf-8") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.4245169289768367 < 2.2007122272339394. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.389464470376279 (T) = (0 -1423.552315579441) / Math.Sqrt((139338.30998056088 / (299)) + (519.0574643540848 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1295623367705503 = (1635.4443008564863 - 1423.552315579441) / 1635.4443008564863 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Threading.Tests.Perf_CancellationToken

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[CreateManyRegisterMultipleDispose - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Threading.Tests.Perf_CancellationToken.CreateManyRegisterMultipleDispose.html>)	1.97 μs	1.60 μs	0.81	0.06	False
[CreateManyRegisterDispose - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Threading.Tests.Perf_CancellationToken.CreateManyRegisterDispose.html>)	404.50 ns	310.41 ns	0.77	0.14	False
[CreateRegisterDispose - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Threading.Tests.Perf_CancellationToken.CreateRegisterDispose.html>)	859.51 ns	722.27 ns	0.84	0.09	False
[CreateLinkedTokenSource3 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Threading.Tests.Perf_CancellationToken.CreateLinkedTokenSource3.html>)	1.64 μs	1.36 μs	0.83	0.04	False
[RegisterAndUnregister_Serial - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Threading.Tests.Perf_CancellationToken.RegisterAndUnregister_Serial.html>)	440.54 ns	370.34 ns	0.84	0.10	False
[Cancel - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Threading.Tests.Perf_CancellationToken.Cancel.html>)	1.02 μs	866.15 ns	0.85	0.06	False
[CreateLinkedTokenSource2 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Threading.Tests.Perf_CancellationToken.CreateLinkedTokenSource2.html>)	1.12 μs	963.12 ns	0.86	0.03	False
[CreateLinkedTokenSource1 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Threading.Tests.Perf_CancellationToken.CreateLinkedTokenSource1.html>)	694.57 ns	606.32 ns	0.87	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Threading.Tests.Perf_CancellationToken*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Threading.Tests.Perf_CancellationToken.CreateManyRegisterMultipleDispose ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.6023430430833332 < 1.9022576018353847. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 15.451166908624263 (T) = (0 -1607.312095628495) / Math.Sqrt((16286.421533917803 / (299)) + (749.433957185642 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.09415903777004982 = (1774.3866336886567 - 1607.312095628495) / 1774.3866336886567 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Threading.Tests.Perf_CancellationToken.CreateManyRegisterDispose ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 310.4145152142857 < 376.85951313371794. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.960887023548489 (T) = (0 -315.6633795795177) / Math.Sqrt((761.0277615343759 / (299)) + (48.42771582855187 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10189610546422576 = (351.47757570150907 - 315.6633795795177) / 351.47757570150907 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Threading.Tests.Perf_CancellationToken.CreateRegisterDispose ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 722.2719876771267 < 820.7880354246727. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 15.616769058055535 (T) = (0 -734.9626104516122) / Math.Sqrt((1500.8423589258157 / (299)) + (122.41286016186837 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.07655165715488516 = (795.8892515711447 - 734.9626104516122) / 795.8892515711447 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Threading.Tests.Perf_CancellationToken.CreateLinkedTokenSource3 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.35916522146615 < 1.5477607073835284. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 15.03962399667705 (T) = (0 -1377.626720625082) / Math.Sqrt((7923.124395799176 / (299)) + (174.55293583202558 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.06536941477723983 = (1473.9799257657912 - 1377.626720625082) / 1473.9799257657912 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Threading.Tests.Perf_CancellationToken.RegisterAndUnregister_Serial ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 370.34305058327857 < 419.3434535178071. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.673705056886224 (T) = (0 -372.1815329293231) / Math.Sqrt((636.3315128859722 / (299)) + (64.75303679390835 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.07922127093007612 = (404.2030090174462 - 372.1815329293231) / 404.2030090174462 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Threading.Tests.Perf_CancellationToken.Cancel ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 866.1538721751125 < 0.976351220342322. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 17.888060949843638 (T) = (0 -874.5611476500145) / Math.Sqrt((2011.6797976457653 / (299)) + (188.3908682739488 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.09082500729428349 = (961.928291766263 - 874.5611476500145) / 961.928291766263 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Threading.Tests.Perf_CancellationToken.CreateLinkedTokenSource2 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 963.1188921422818 < 1.0582253155328678. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 14.311466719452062 (T) = (0 -957.9663356258066) / Math.Sqrt((3011.603429301172 / (299)) + (143.6347272013255 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.06703284378792898 = (1026.7953477754077 - 957.9663356258066) / 1026.7953477754077 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Threading.Tests.Perf_CancellationToken.CreateLinkedTokenSource1 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 606.3170747361712 < 655.9148909477216. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.566099623711555 (T) = (0 -606.70339365702) / Math.Sqrt((920.394089237728 / (299)) + (120.09833145589913 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.05926730734135965 = (644.9264476419891 - 606.70339365702) / 644.9264476419891 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Tests.Perf_Decimal

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Round - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Decimal.Round.html>)	96.25 ns	69.46 ns	0.72	0.13	False
[Add - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Decimal.Add.html>)	77.16 ns	53.54 ns	0.69	0.20	False
[Divide - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Decimal.Divide.html>)	721.23 ns	529.78 ns	0.73	0.09	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Decimal.Parse(value%3a%20%22123456.789%22).html>)	1.54 μs	1.01 μs	0.65	0.03	False
[Mod - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Decimal.Mod.html>)	138.56 ns	105.20 ns	0.76	0.16	False
[Multiply - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Decimal.Multiply.html>)	75.59 ns	50.50 ns	0.67	0.18	False
[Floor - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Decimal.Floor.html>)	87.86 ns	59.84 ns	0.68	0.14	False
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Decimal.ToString(value%3a%20123456.789).html>)	1.34 μs	953.52 ns	0.71	0.05	False
[Subtract - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Decimal.Subtract.html>)	76.90 ns	53.62 ns	0.70	0.19	False
[TryParse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Decimal.TryParse(value%3a%20%22123456.789%22).html>)	1.51 μs	990.26 ns	0.66	0.04	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Decimal*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Tests.Perf_Decimal.Round ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 69.46308798696772 < 91.52152703939217. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 16.596997663617785 (T) = (0 -70.51748128386456) / Math.Sqrt((84.7345858674327 / (299)) + (1.527618414795272 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.13106313836741773 = (81.1537459135689 - 70.51748128386456) / 81.1537459135689 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Decimal.Add ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 53.54349598935607 < 72.9893762052098. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.047349056335845 (T) = (0 -53.149309178228485) / Math.Sqrt((98.27033214342293 / (299)) + (1.4445878793933298 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.11364156417508303 = (59.96367499877567 - 53.149309178228485) / 59.96367499877567 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Decimal.Divide ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 529.7780099829275 < 686.9400205824292. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.016391330975514 (T) = (0 -516.1936118380784) / Math.Sqrt((7804.742176095563 / (299)) + (99.48719049369907 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.10317003085521166 = (575.5757831446216 - 516.1936118380784) / 575.5757831446216 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Decimal.Parse(value: "123456.789") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.0087466784984402 < 1.4635543536627225. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.53759814451457 (T) = (0 -1006.6595791300609) / Math.Sqrt((50043.303181996904 / (299)) + (85.08602844375054 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11122340756545436 = (1132.6351162923959 - 1006.6595791300609) / 1132.6351162923959 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Decimal.Mod ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 105.19843205203514 < 131.889678924775. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.160260526351875 (T) = (0 -99.16548170860875) / Math.Sqrt((240.1523306093612 / (299)) + (23.579476647865317 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.11027961526077526 = (111.45690647255874 - 99.16548170860875) / 111.45690647255874 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Decimal.Multiply ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 50.50495375070942 < 71.91769637353067. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 3.883838342649896 (T) = (0 -52.38031913924752) / Math.Sqrt((94.38613269638024 / (299)) + (31.565277425709997 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11289914749653018 = (59.046633752437565 - 52.38031913924752) / 59.046633752437565 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Decimal.Floor ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 59.83863710879953 < 81.97885831856391. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 15.363791682856421 (T) = (0 -60.23651109394235) / Math.Sqrt((98.71922169386123 / (299)) + (0.33802881413117153 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.13286629040371528 = (69.46623159418739 - 60.23651109394235) / 69.46623159418739 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Decimal.ToString(value: 123456.789) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 953.5185648698226 < 1.2765943348056386. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 6.4832483183509995 (T) = (0 -979.1128462358935) / Math.Sqrt((22356.57239157333 / (299)) + (1512.4521066868992 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.08578288491682663 = (1070.985031982054 - 979.1128462358935) / 1070.985031982054 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Decimal.Subtract ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 53.620125650212195 < 73.41174154885738. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.506826014591942 (T) = (0 -53.239843197363165) / Math.Sqrt((100.1334284741947 / (299)) + (2.881398612884412 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10806877142101375 = (59.69052488742234 - 53.239843197363165) / 59.69052488742234 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Decimal.TryParse(value: "123456.789") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 990.2581757966257 < 1.4366077233325363. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.014340983584304 (T) = (0 -990.9465759581875) / Math.Sqrt((47643.834123262284 / (299)) + (105.81049129378582 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.11610920010836906 = (1121.1187808264121 - 990.9465759581875) / 1121.1187808264121 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Buffers.Binary.Tests.BinaryReadAndWriteTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[MeasureReverseUsingNtoH - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Binary.Tests.BinaryReadAndWriteTests.MeasureReverseUsingNtoH.html>)	26.29 μs	15.24 μs	0.58	0.15	True
[ReadStructAndReverseBE - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Binary.Tests.BinaryReadAndWriteTests.ReadStructAndReverseBE.html>)	457.19 ns	305.49 ns	0.67	0.08	False
[ReadStructFieldByFieldBE - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Binary.Tests.BinaryReadAndWriteTests.ReadStructFieldByFieldBE.html>)	1.19 μs	822.58 ns	0.69	0.08	False
[ReadStructFieldByFieldUsingBitConverterBE - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Binary.Tests.BinaryReadAndWriteTests.ReadStructFieldByFieldUsingBitConverterBE.html>)	817.97 ns	554.22 ns	0.68	0.05	False
[ReadStructFieldByFieldUsingBitConverterLE - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Binary.Tests.BinaryReadAndWriteTests.ReadStructFieldByFieldUsingBitConverterLE.html>)	413.44 ns	313.37 ns	0.76	0.09	False
[ReadStructAndReverseLE - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Binary.Tests.BinaryReadAndWriteTests.ReadStructAndReverseLE.html>)	58.46 ns	44.06 ns	0.75	0.28	False
[MeasureReverseEndianness - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Binary.Tests.BinaryReadAndWriteTests.MeasureReverseEndianness.html>)	26.29 μs	15.27 μs	0.58	0.08	False
[ReadStructFieldByFieldLE - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Binary.Tests.BinaryReadAndWriteTests.ReadStructFieldByFieldLE.html>)	888.51 ns	665.90 ns	0.75	0.06	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Buffers.Binary.Tests.BinaryReadAndWriteTests*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Buffers.Binary.Tests.BinaryReadAndWriteTests.MeasureReverseUsingNtoH ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 15.239537506103515 < 24.974731692453954. IsChangePoint: Marked as a change because one of 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 232.50010608609077 (T) = (0 -15276.823485531035) / Math.Sqrt((565078.2133185562 / (299)) + (965.8086756930702 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.4031851137185282 = (25597.256095127173 - 15276.823485531035) / 25597.256095127173 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ```#### System.Buffers.Binary.Tests.BinaryReadAndWriteTests.ReadStructAndReverseBE ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 305.4864840072581 < 433.97179673785604. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.6428055470119585 (T) = (0 -293.43587440520827) / Math.Sqrt((5098.146395591664 / (299)) + (49.88397505604041 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10709984073784837 = (328.63234636186996 - 293.43587440520827) / 328.63234636186996 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Binary.Tests.BinaryReadAndWriteTests.ReadStructFieldByFieldBE ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 822.575209395973 < 1.135860246992451. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.714494388497931 (T) = (0 -831.8009729770102) / Math.Sqrt((26840.604534570386 / (299)) + (222.5251632742428 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.08802547549045495 = (912.0879483167014 - 831.8009729770102) / 912.0879483167014 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Binary.Tests.BinaryReadAndWriteTests.ReadStructFieldByFieldUsingBitConverterBE ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 554.2225888811752 < 777.2775379717706. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.22289697130869 (T) = (0 -571.3378980775972) / Math.Sqrt((9123.990898035685 / (299)) + (96.69080829752515 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.12671142500162746 = (654.2372297480955 - 571.3378980775972) / 654.2372297480955 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Binary.Tests.BinaryReadAndWriteTests.ReadStructFieldByFieldUsingBitConverterLE ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 313.3701448183493 < 393.4554051260804. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 23.421552778083317 (T) = (0 -318.84571032945644) / Math.Sqrt((733.7774953589924 / (299)) + (30.484876977687378 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.14377551176724584 = (372.3856473523123 - 318.84571032945644) / 372.3856473523123 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Binary.Tests.BinaryReadAndWriteTests.ReadStructAndReverseLE ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 44.05841660020226 < 55.59824857214274. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.875422506439083 (T) = (0 -43.94126129606308) / Math.Sqrt((43.00638035882305 / (299)) + (0.18766660111016784 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.0903103777385061 = (48.303575440186776 - 43.94126129606308) / 48.303575440186776 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Binary.Tests.BinaryReadAndWriteTests.MeasureReverseEndianness ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 15.266819368767807 < 24.967276417607334. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.814913846665519 (T) = (0 -15341.489189397871) / Math.Sqrt((18722779.70583175 / (299)) + (53223.704637247814 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1778349998084206 = (18659.866554551732 - 15341.489189397871) / 18659.866554551732 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Binary.Tests.BinaryReadAndWriteTests.ReadStructFieldByFieldLE ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 665.8969000269572 < 850.2755638380174. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.205350094724142 (T) = (0 -668.5894900040021) / Math.Sqrt((10982.59709869692 / (299)) + (12.691791625762313 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.06213242276575666 = (712.8826139567186 - 668.5894900040021) / 712.8826139567186 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Collections.Tests.Add_Remove_SteadyState<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ImmutableStack - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Add_Remove_SteadyState(String).ImmutableStack(Count%3a%20512).html>)	107.52 ns	94.26 ns	0.88	0.06	False
[ImmutableQueue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Add_Remove_SteadyState(String).ImmutableQueue(Count%3a%20512).html>)	385.07 ns	328.03 ns	0.85	0.03	False
[ConcurrentQueue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Add_Remove_SteadyState(String).ConcurrentQueue(Count%3a%20512).html>)	243.40 ns	188.95 ns	0.78	0.11	False
[ConcurrentStack - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Add_Remove_SteadyState(String).ConcurrentStack(Count%3a%20512).html>)	231.71 ns	205.51 ns	0.89	0.12	False
[Stack - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Add_Remove_SteadyState(String).Stack(Count%3a%20512).html>)	76.27 ns	58.04 ns	0.76	0.19	False
[ConcurrentBag - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Add_Remove_SteadyState(String).ConcurrentBag(Count%3a%20512).html>)	367.85 ns	304.09 ns	0.83	0.13	False
[Queue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Add_Remove_SteadyState(String).Queue(Count%3a%20512).html>)	123.08 ns	93.90 ns	0.76	0.14	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.Tests.Add_Remove_SteadyState<String>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.Tests.Add_Remove_SteadyState<String>.ImmutableStack(Count: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 94.2598653785845 < 103.78950205976506. IsChangePoint: Marked as a change because one of 3/31/2022 5:34:47 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.386700935108836 (T) = (0 -93.80886493314743) / Math.Sqrt((29.109794684311847 / (299)) + (1.6738754115352312 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.05577787416076929 = (99.35042016704439 - 93.80886493314743) / 99.35042016704439 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Add_Remove_SteadyState<String>.ImmutableQueue(Count: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 328.03143624599556 < 365.1141578749263. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.819285936802107 (T) = (0 -333.9610383857294) / Math.Sqrt((228.16954453316802 / (299)) + (42.76363491968413 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.06856884758223945 = (358.54613356966934 - 333.9610383857294) / 358.54613356966934 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Add_Remove_SteadyState<String>.ConcurrentQueue(Count: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 188.95035081605843 < 221.8379136518713. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.039369230540302 (T) = (0 -188.3261652692166) / Math.Sqrt((249.89391186473924 / (299)) + (16.976967422452006 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.09409554586372042 = (207.88744818433776 - 188.3261652692166) / 207.88744818433776 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Add_Remove_SteadyState<String>.ConcurrentStack(Count: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 205.50749020264945 < 217.74995467236232. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.2086008212347075 (T) = (0 -198.67104939040837) / Math.Sqrt((119.98736835424171 / (299)) + (23.54165918536829 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.05283055405203053 = (209.75238405369961 - 198.67104939040837) / 209.75238405369961 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Add_Remove_SteadyState<String>.Stack(Count: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 58.036666969586825 < 73.00474039747506. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.54349043079798 (T) = (0 -58.93061990712781) / Math.Sqrt((54.68295227442894 / (299)) + (0.6622227546144619 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.08723828652302454 = (64.56298400449325 - 58.93061990712781) / 64.56298400449325 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Add_Remove_SteadyState<String>.ConcurrentBag(Count: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 304.08891375799 < 357.85291474336117. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.806748855858881 (T) = (0 -297.1462289293473) / Math.Sqrt((688.1032515570014 / (299)) + (63.24673546353377 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.09354047394239813 = (327.8097040048811 - 297.1462289293473) / 327.8097040048811 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Add_Remove_SteadyState<String>.Queue(Count: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 93.89540664613482 < 116.6337748642242. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 20.44429376357305 (T) = (0 -94.74482071212843) / Math.Sqrt((88.0885825779211 / (299)) + (1.9162784336784784 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12697415950990876 = (108.52464648576891 - 94.74482071212843) / 108.52464648576891 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Collections.Concurrent.IsEmpty<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Bag - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Concurrent.IsEmpty(Int32).Bag(Size%3a%20512).html>)	76.71 ns	59.28 ns	0.77	0.17	False
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Concurrent.IsEmpty(Int32).Dictionary(Size%3a%200).html>)	2.79 μs	2.41 μs	0.86	0.09	False
[Queue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Concurrent.IsEmpty(Int32).Queue(Size%3a%20512).html>)	78.62 ns	54.62 ns	0.69	0.17	False
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Concurrent.IsEmpty(Int32).Dictionary(Size%3a%20512).html>)	35.91 ns	29.26 ns	0.81	0.24	False
[Queue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Concurrent.IsEmpty(Int32).Queue(Size%3a%200).html>)	93.11 ns	66.63 ns	0.72	0.17	False
[Bag - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Concurrent.IsEmpty(Int32).Bag(Size%3a%200).html>)	85.79 ns	63.33 ns	0.74	0.19	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.Concurrent.IsEmpty<Int32>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.Concurrent.IsEmpty<Int32>.Bag(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 59.284863364913534 < 73.23258758114852. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 15.39934259931923 (T) = (0 -58.997420687448916) / Math.Sqrt((36.34687428615906 / (299)) + (2.312406533674973 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12764616299387002 = (67.63014981389294 - 58.997420687448916) / 67.63014981389294 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Concurrent.IsEmpty<Int32>.Dictionary(Size: 0) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.4063799420548246 < 2.6761320033939104. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 19.107112817531597 (T) = (0 -2435.415342676264) / Math.Sqrt((17641.384137653265 / (299)) + (364.0735158919998 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.07002010497747098 = (2618.782788435728 - 2435.415342676264) / 2618.782788435728 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Concurrent.IsEmpty<Int32>.Queue(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 54.623712537755495 < 73.31453764387885. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.90735277665223 (T) = (0 -55.436077995680044) / Math.Sqrt((72.46220793117823 / (299)) + (3.0595210585231047 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12184581742545222 = (63.127955313216304 - 55.436077995680044) / 63.127955313216304 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Concurrent.IsEmpty<Int32>.Dictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 29.25672457917326 < 34.00700115981652. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 6.559454689145883 (T) = (0 -29.58374839878736) / Math.Sqrt((8.194265003104157 / (299)) + (0.8683902382063398 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.06545147991096241 = (31.655658066815853 - 29.58374839878736) / 31.655658066815853 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Concurrent.IsEmpty<Int32>.Queue(Size: 0) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 66.62812786864541 < 87.61471602952582. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.52400677810362 (T) = (0 -67.52940352209822) / Math.Sqrt((106.28320489694393 / (299)) + (3.5614909566554376 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1022557001321926 = (75.22119999207113 - 67.52940352209822) / 75.22119999207113 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Concurrent.IsEmpty<Int32>.Bag(Size: 0) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 63.33137034057964 < 79.71021656566069. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 14.294904526047429 (T) = (0 -64.9442316200349) / Math.Sqrt((54.00306571242344 / (299)) + (1.8171004782041271 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1125574765113092 = (73.1813383978129 - 64.9442316200349) / 73.1813383978129 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in System.Collections.AddGivenSize<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ICollection - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.AddGivenSize(String).ICollection(Size%3a%20512).html>)	23.08 μs	17.76 μs	0.77	0.11	False
[Queue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.AddGivenSize(String).Queue(Size%3a%20512).html>)	32.35 μs	24.70 μs	0.76	0.05	False
[ObservableCollection - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.AddGivenSize(String).ObservableCollection(Size%3a%20512).html>)	167.80 μs	139.30 μs	0.83	0.04	False
[Stack - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.AddGivenSize(String).Stack(Size%3a%20512).html>)	19.68 μs	14.90 μs	0.76	0.10	False
[IDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.AddGivenSize(String).IDictionary(Size%3a%20512).html>)	189.26 μs	127.34 μs	0.67	0.03	False
[ConcurrentDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.AddGivenSize(String).ConcurrentDictionary(Size%3a%20512).html>)	390.13 μs	310.37 μs	0.80	0.02	False
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.AddGivenSize(String).Dictionary(Size%3a%20512).html>)	186.85 μs	121.39 μs	0.65	0.04	False
[SortedList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.AddGivenSize(String).SortedList(Size%3a%20512).html>)	1.89 ms	1.57 ms	0.83	0.04	False
[List - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.AddGivenSize(String).List(Size%3a%20512).html>)	18.21 μs	13.90 μs	0.76	0.11	False
[HashSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.AddGivenSize(String).HashSet(Size%3a%20512).html>)	184.83 μs	118.86 μs	0.64	0.05	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.AddGivenSize<String>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.AddGivenSize<String>.ICollection(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.764031841801387 < 21.478297602789464. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.745379643864693 (T) = (0 -17713.308220370804) / Math.Sqrt((4703944.067977863 / (299)) + (8952.33719723987 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.06609230543515465 = (18966.87255438486 - 17713.308220370804) / 18966.87255438486 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.AddGivenSize<String>.Queue(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 24.69533629763807 < 30.73175629889956. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 27.55918444034612 (T) = (0 -24539.635078802206) / Math.Sqrt((5525566.090595427 / (299)) + (13839.907904965366 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.13596530005927385 = (28401.214766589415 - 24539.635078802206) / 28401.214766589415 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.AddGivenSize<String>.ObservableCollection(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 139.29621819690266 < 162.1746065250052. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 23.448858156589413 (T) = (0 -139996.070346501) / Math.Sqrt((60386407.337984495 / (299)) + (1832009.102258955 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.09229414730915055 = (154230.65735611322 - 139996.070346501) / 154230.65735611322 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.AddGivenSize<String>.Stack(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 14.897045379477388 < 18.733230603974434. IsChangePoint: Marked as a change because one of 5/25/2022 12:28:02 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 5.187411780785866 (T) = (0 -15355.166393951951) / Math.Sqrt((2514316.5887594917 / (299)) + (1191725.9706600723 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.09981075670108772 = (17057.70926308791 - 15355.166393951951) / 17057.70926308791 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.AddGivenSize<String>.IDictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 127.34376104336043 < 180.60322040984622. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.232490461949716 (T) = (0 -124735.29104383134) / Math.Sqrt((655464254.9023305 / (299)) + (1913790.9024033824 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.13991987617184143 = (145027.52428302026 - 124735.29104383134) / 145027.52428302026 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.AddGivenSize<String>.ConcurrentDictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 310.37178639423075 < 370.3131342602261. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.287874394138187 (T) = (0 -313729.9768839465) / Math.Sqrt((908305790.9279863 / (299)) + (4545673.353594646 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.05188247780713581 = (330897.77326162334 - 313729.9768839465) / 330897.77326162334 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.AddGivenSize<String>.Dictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 121.38693833056479 < 177.59232696380934. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.920422678561726 (T) = (0 -123269.01573866606) / Math.Sqrt((615676231.7552258 / (299)) + (2923733.276155563 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.13722817834627432 = (142875.56993040067 - 123269.01573866606) / 142875.56993040067 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.AddGivenSize<String>.SortedList(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.5709136491071432 < 1.796877627938988. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.182969386644054 (T) = (0 -1575369.251799069) / Math.Sqrt((10107122498.759699 / (299)) + (741965768.7798016 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.07564413405817653 = (1704288.6942616305 - 1575369.251799069) / 1704288.6942616305 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.AddGivenSize<String>.List(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 13.902873477777778 < 17.303918086615486. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.800627593048667 (T) = (0 -12289.420021964208) / Math.Sqrt((6005420.3093019435 / (299)) + (269248.9763755476 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11574087409153565 = (13897.98494795107 - 12289.420021964208) / 13897.98494795107 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.AddGivenSize<String>.HashSet(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 118.85734643308079 < 169.88490276130787. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.826774034131557 (T) = (0 -119827.95221271389) / Math.Sqrt((525570622.2750649 / (299)) + (1798809.9077601833 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12880310992361763 = (137544.05413707107 - 119827.95221271389) / 137544.05413707107 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in System.Tests.Perf_UInt64

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt64.Parse(value%3a%20%220%22).html>)	163.17 ns	115.11 ns	0.71	0.29	False
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt64.ToString(value%3a%2012345).html>)	322.35 ns	265.53 ns	0.82	0.07	False
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt64.ToString(value%3a%2018446744073709551615).html>)	720.13 ns	552.37 ns	0.77	0.06	False
[TryParseHex - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt64.TryParseHex(value%3a%20%22FFFFFFFFFFFFFFFF%22).html>)	947.00 ns	600.95 ns	0.63	0.10	False
[TryFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt64.TryFormat(value%3a%200).html>)	141.42 ns	100.68 ns	0.71	0.23	False
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt64.ToString(value%3a%200).html>)	48.49 ns	37.76 ns	0.78	0.22	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt64.Parse(value%3a%20%2212345%22).html>)	298.86 ns	188.66 ns	0.63	0.21	False
[TryParseHex - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt64.TryParseHex(value%3a%20%223039%22).html>)	349.16 ns	240.90 ns	0.69	0.19	False
[ParseSpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt64.ParseSpan(value%3a%20%2212345%22).html>)	317.66 ns	217.57 ns	0.68	0.21	False
[TryParse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt64.TryParse(value%3a%20%2218446744073709551615%22).html>)	728.62 ns	470.91 ns	0.65	0.07	False
[TryParse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt64.TryParse(value%3a%20%2212345%22).html>)	275.56 ns	175.55 ns	0.64	0.20	False
[TryParse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt64.TryParse(value%3a%20%220%22).html>)	139.03 ns	100.39 ns	0.72	0.22	False
[TryFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt64.TryFormat(value%3a%2018446744073709551615).html>)	644.48 ns	467.02 ns	0.72	0.09	False
[ParseSpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt64.ParseSpan(value%3a%20%2218446744073709551615%22).html>)	778.68 ns	462.98 ns	0.59	0.09	False
[ParseSpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt64.ParseSpan(value%3a%20%220%22).html>)	188.09 ns	141.11 ns	0.75	0.32	False
[TryFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt64.TryFormat(value%3a%2012345).html>)	248.94 ns	180.72 ns	0.73	0.19	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt64.Parse(value%3a%20%2218446744073709551615%22).html>)	770.03 ns	477.70 ns	0.62	0.09	False
[TryParseHex - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_UInt64.TryParseHex(value%3a%20%220%22).html>)	167.29 ns	121.00 ns	0.72	0.21	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_UInt64*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Tests.Perf_UInt64.Parse(value: "0") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 115.1081971801783 < 156.70135607975175. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.92078359742846 (T) = (0 -117.42840392091888) / Math.Sqrt((362.86747096771 / (299)) + (10.283713547304506 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.1199631422428201 = (133.43577929246206 - 117.42840392091888) / 133.43577929246206 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt64.ToString(value: 12345) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 265.5255189073679 < 309.6105783178958. IsChangePoint: Marked as a change because one of 5/5/2022 12:13:02 AM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 14.280758806924933 (T) = (0 -268.95224217844924) / Math.Sqrt((469.531496272115 / (299)) + (11.29421615336739 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.0776168730925328 = (291.5840872763822 - 268.95224217844924) / 291.5840872763822 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt64.ToString(value: 18446744073709551615) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 552.3746370182564 < 680.8002300327845. IsChangePoint: Marked as a change because one of 5/5/2022 12:13:02 AM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 22.341028031571614 (T) = (0 -555.4324250950322) / Math.Sqrt((4066.145233946807 / (299)) + (16.062591646479994 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.13501555845769764 = (642.1299602853823 - 555.4324250950322) / 642.1299602853823 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt64.TryParseHex(value: "FFFFFFFFFFFFFFFF") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 600.9529125821584 < 899.6259815404123. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.997001762025414 (T) = (0 -605.6329998448457) / Math.Sqrt((17465.07489883075 / (299)) + (71.30347480101052 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.14739506528690274 = (710.3325059321197 - 605.6329998448457) / 710.3325059321197 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt64.TryFormat(value: 0) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 100.67745274355406 < 135.5785526846286. IsChangePoint: Marked as a change because one of 5/5/2022 12:13:02 AM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 17.587272485848484 (T) = (0 -98.29891522541526) / Math.Sqrt((307.2912405541746 / (299)) + (2.3013722630975555 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.16498259884548983 = (117.72079850013353 - 98.29891522541526) / 117.72079850013353 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt64.ToString(value: 0) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 37.764508867740155 < 46.01330546254377. IsChangePoint: Marked as a change because one of 5/5/2022 12:13:02 AM, 5/25/2022 12:28:02 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 6.473047577942135 (T) = (0 -38.5595271416995) / Math.Sqrt((21.900340771243588 / (299)) + (2.333998596256255 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.07992136086094419 = (41.90894723714134 - 38.5595271416995) / 41.90894723714134 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt64.Parse(value: "12345") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 188.6572010898994 < 283.2509619461734. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.599676745143874 (T) = (0 -189.39196282970016) / Math.Sqrt((1907.9953510712792 / (299)) + (13.156948564370765 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.14427099504885532 = (221.32235992224307 - 189.39196282970016) / 221.32235992224307 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt64.TryParseHex(value: "3039") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 240.90289877579767 < 332.5015654562849. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.250511787646577 (T) = (0 -237.39688193782095) / Math.Sqrt((2114.887077759121 / (299)) + (17.379531213957115 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12152965762291265 = (270.2389261035716 - 237.39688193782095) / 270.2389261035716 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt64.ParseSpan(value: "12345") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 217.56832249141885 < 302.274087020302. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.160778012961403 (T) = (0 -208.8917807462578) / Math.Sqrt((2012.9716021601528 / (299)) + (22.464398763257563 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.13548883502438583 = (241.62993979626643 - 208.8917807462578) / 241.62993979626643 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt64.TryParse(value: "18446744073709551615") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 470.90952614471985 < 691.3748180937458. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.575977581984481 (T) = (0 -432.80097562343957) / Math.Sqrt((17158.42589941018 / (299)) + (177.57468073064464 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12946618648085448 = (497.1673344586529 - 432.80097562343957) / 497.1673344586529 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt64.TryParse(value: "12345") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 175.54889744914925 < 264.3808855029966. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.551087633653363 (T) = (0 -175.0294287118631) / Math.Sqrt((1703.3908648770002 / (299)) + (3.3493214633313926 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.12867500061640394 = (200.8773176893635 - 175.0294287118631) / 200.8773176893635 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt64.TryParse(value: "0") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 100.38907340884013 < 132.31364109686135. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.965854884300745 (T) = (0 -102.30535730031845) / Math.Sqrt((253.97563517443018 / (299)) + (4.362388121899315 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.09688983499438099 = (113.28114914937528 - 102.30535730031845) / 113.28114914937528 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt64.TryFormat(value: 18446744073709551615) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 467.01822434846275 < 611.576796677322. IsChangePoint: Marked as a change because one of 5/5/2022 12:13:02 AM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.950081115427132 (T) = (0 -475.63041108172325) / Math.Sqrt((5217.235955951374 / (299)) + (158.4176286069786 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.14201810829988568 = (554.3594983563682 - 475.63041108172325) / 554.3594983563682 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt64.ParseSpan(value: "18446744073709551615") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 462.9782339997383 < 742.0485155276465. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.043106118080713 (T) = (0 -466.61474954667375) / Math.Sqrt((18773.337741123672 / (299)) + (68.24130786298879 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.13820548804263305 = (541.4454873782687 - 466.61474954667375) / 541.4454873782687 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt64.ParseSpan(value: "0") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 141.10825496131852 < 178.41739064238783. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.079410059232478 (T) = (0 -137.47745772575666) / Math.Sqrt((383.60726028893373 / (299)) + (18.325692614064657 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.11182412851844668 = (154.78630093433242 - 137.47745772575666) / 154.78630093433242 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt64.TryFormat(value: 12345) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 180.71710163717742 < 236.58201622935132. IsChangePoint: Marked as a change because one of 5/5/2022 12:13:02 AM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.024738842428611 (T) = (0 -181.47299556429132) / Math.Sqrt((760.145149729664 / (299)) + (15.67984106748006 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11504217059482015 = (205.06400365570812 - 181.47299556429132) / 205.06400365570812 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt64.Parse(value: "18446744073709551615") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 477.7038086348338 < 719.0699743715653. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.835160616509802 (T) = (0 -453.38722547212694) / Math.Sqrt((17521.411782470364 / (299)) + (99.12361360235684 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.12441845218886086 = (517.8126773063535 - 453.38722547212694) / 517.8126773063535 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt64.TryParseHex(value: "0") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 121.00227079459272 < 159.64483179982562. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 6.810635792511553 (T) = (0 -123.72141300789517) / Math.Sqrt((396.9877449944891 / (299)) + (17.1714782249961 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.08555695218306086 = (135.29701308709906 - 123.72141300789517) / 135.29701308709906 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Security.Cryptography.Primitives.Tests.Performance.Perf_FixedTimeEquals

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[FixedTimeEquals_256Bit_VersusZero - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Security.Cryptography.Primitives.Tests.Performance.Perf_FixedTimeEquals.FixedTimeEquals_256Bit_VersusZero.html>)	651.48 ns	399.92 ns	0.61	0.13	False
[FixedTimeEquals_256Bit_SameReference - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Security.Cryptography.Primitives.Tests.Performance.Perf_FixedTimeEquals.FixedTimeEquals_256Bit_SameReference.html>)	626.27 ns	400.93 ns	0.64	0.10	False
[FixedTimeEquals_256Bit_Equal - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Security.Cryptography.Primitives.Tests.Performance.Perf_FixedTimeEquals.FixedTimeEquals_256Bit_Equal.html>)	626.58 ns	401.10 ns	0.64	0.13	False
[FixedTimeEquals_256Bit_FirstBitDifferent - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Security.Cryptography.Primitives.Tests.Performance.Perf_FixedTimeEquals.FixedTimeEquals_256Bit_FirstBitDifferent.html>)	684.00 ns	400.86 ns	0.59	0.11	False
[FixedTimeEquals_256Bit_AllBitsDifferent - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Security.Cryptography.Primitives.Tests.Performance.Perf_FixedTimeEquals.FixedTimeEquals_256Bit_AllBitsDifferent.html>)	627.05 ns	401.60 ns	0.64	0.12	False
[FixedTimeEquals_256Bit_LastBitDifferent - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Security.Cryptography.Primitives.Tests.Performance.Perf_FixedTimeEquals.FixedTimeEquals_256Bit_LastBitDifferent.html>)	627.02 ns	408.14 ns	0.65	0.12	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Security.Cryptography.Primitives.Tests.Performance.Perf_FixedTimeEquals*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Security.Cryptography.Primitives.Tests.Performance.Perf_FixedTimeEquals.FixedTimeEquals_256Bit_VersusZero ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 399.917045721224 < 596.8829810906766. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.543839777888905 (T) = (0 -402.1773789657637) / Math.Sqrt((10061.12041298408 / (299)) + (10.931070723840005 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11102319577120046 = (452.40480634886586 - 402.1773789657637) / 452.40480634886586 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Security.Cryptography.Primitives.Tests.Performance.Perf_FixedTimeEquals.FixedTimeEquals_256Bit_SameReference ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 400.92569811797233 < 596.4583491257465. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.792742572013749 (T) = (0 -402.18336062885027) / Math.Sqrt((9825.52985899365 / (299)) + (40.32375607605342 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10443525600837389 = (449.0835121939669 - 402.18336062885027) / 449.0835121939669 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Security.Cryptography.Primitives.Tests.Performance.Perf_FixedTimeEquals.FixedTimeEquals_256Bit_Equal ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 401.0999809318899 < 595.6604705762451. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 6.257687335743521 (T) = (0 -405.8628092122302) / Math.Sqrt((9792.647177211806 / (299)) + (183.73830195471734 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.09782089613059507 = (449.8694410804941 - 405.8628092122302) / 449.8694410804941 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Security.Cryptography.Primitives.Tests.Performance.Perf_FixedTimeEquals.FixedTimeEquals_256Bit_FirstBitDifferent ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 400.8624847354589 < 596.46818268328. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.678187670371338 (T) = (0 -400.93798586060984) / Math.Sqrt((9847.656553474193 / (299)) + (5.5080670155341735 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1111743641914686 = (451.08733333944804 - 400.93798586060984) / 451.08733333944804 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Security.Cryptography.Primitives.Tests.Performance.Perf_FixedTimeEquals.FixedTimeEquals_256Bit_AllBitsDifferent ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 401.60131918402084 < 595.581890850758. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.608321339092189 (T) = (0 -400.4765285167407) / Math.Sqrt((10001.68992510777 / (299)) + (2.317591610628601 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.11088297190858479 = (450.42049118821444 - 400.4765285167407) / 450.42049118821444 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Security.Cryptography.Primitives.Tests.Performance.Perf_FixedTimeEquals.FixedTimeEquals_256Bit_LastBitDifferent ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 408.14264429829296 < 595.6880759489659. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.568210211604207 (T) = (0 -401.0808799015738) / Math.Sqrt((9685.2930232001 / (299)) + (6.866032060882898 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10925346886798529 = (450.27498382941315 - 401.0808799015738) / 450.27498382941315 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in System.Text.Json.Serialization.Tests.ReadJson<ArrayList>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[DeserializeFromString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.ReadJson(ArrayList).DeserializeFromString.html>)	448.12 μs	365.79 μs	0.82	0.02	False
[DeserializeFromUtf8Bytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.ReadJson(ArrayList).DeserializeFromUtf8Bytes.html>)	402.43 μs	335.91 μs	0.83	0.10	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Serialization.Tests.ReadJson<ArrayList>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Serialization.Tests.ReadJson<ArrayList>.DeserializeFromString ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 365.7946992732558 < 414.6305016859851. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.011987299360793 (T) = (0 -364356.14184327656) / Math.Sqrt((833532898.5535885 / (299)) + (22386661.302730635 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.06751266202677292 = (390735.75265398156 - 364356.14184327656) / 390735.75265398156 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Serialization.Tests.ReadJson<ArrayList>.DeserializeFromUtf8Bytes ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 335.9142075181159 < 372.0143308997395. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.680435557762972 (T) = (0 -333936.5766322894) / Math.Sqrt((579037570.8333474 / (299)) + (46094090.4434593 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.052388016218038305 = (352398.0092564191 - 333936.5766322894) / 352398.0092564191 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in BenchmarksGame.FannkuchRedux_5

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[RunBench - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/BenchmarksGame.FannkuchRedux_5.RunBench(n%3a%2010%2c%20expectedSum%3a%2038).html>)	210.32 ms	149.86 ms	0.71	0.28	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'BenchmarksGame.FannkuchRedux_5*'

### Payloads [Baseline]() [Compare]() ### Histogram #### BenchmarksGame.FannkuchRedux_5.RunBench(n: 10, expectedSum: 38) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 149.86170756666667 < 199.50713399107144. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.134708584944597 (T) = (0 -150830705.55131257) / Math.Sqrt((581177051231849.9 / (299)) + (26940039701426.137 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11028072164933399 = (169526174.40291712 - 150830705.55131257) / 169526174.40291712 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Text.Json.Document.Tests.Perf_EnumerateObject

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[PropertyIndexer - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_EnumerateObject.PropertyIndexer(TestCase%3a%20StringProperties).html>)	118.50 μs	85.74 μs	0.72	0.09	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_EnumerateObject.Parse(TestCase%3a%20ObjectProperties).html>)	19.81 ms	14.97 ms	0.76	0.02	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_EnumerateObject.Parse(TestCase%3a%20StringProperties).html>)	410.72 μs	284.26 μs	0.69	0.04	False
[EnumerateProperties - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_EnumerateObject.EnumerateProperties(TestCase%3a%20ObjectProperties).html>)	70.59 μs	56.22 μs	0.80	0.18	False
[EnumerateProperties - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_EnumerateObject.EnumerateProperties(TestCase%3a%20StringProperties).html>)	66.50 μs	54.97 μs	0.83	0.20	False
[PropertyIndexer - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_EnumerateObject.PropertyIndexer(TestCase%3a%20NumericProperties).html>)	115.30 μs	85.84 μs	0.74	0.17	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_EnumerateObject.Parse(TestCase%3a%20NumericProperties).html>)	480.83 μs	348.57 μs	0.72	0.04	False
[PropertyIndexer - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_EnumerateObject.PropertyIndexer(TestCase%3a%20ObjectProperties).html>)	121.08 μs	91.39 μs	0.75	0.09	False
[EnumerateProperties - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_EnumerateObject.EnumerateProperties(TestCase%3a%20NumericProperties).html>)	66.69 μs	58.56 μs	0.88	0.20	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Document.Tests.Perf_EnumerateObject*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Document.Tests.Perf_EnumerateObject.PropertyIndexer(TestCase: StringProperties) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 85.73530288836848 < 111.14844895366915. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 16.204477886528206 (T) = (0 -87075.25677618313) / Math.Sqrt((118203560.63609236 / (299)) + (1355835.376587249 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11713851252669867 = (98628.44626441628 - 87075.25677618313) / 98628.44626441628 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_EnumerateObject.Parse(TestCase: ObjectProperties) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 14.9720088875 < 18.81444003083333. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.230631556710044 (T) = (0 -14902991.966864964) / Math.Sqrt((4171210073724.2383 / (299)) + (27286346533.690304 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.0731246142547035 = (16078743.913219286 - 14902991.966864964) / 16078743.913219286 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_EnumerateObject.Parse(TestCase: StringProperties) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 284.26087410714285 < 370.610955404224. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.655476772673378 (T) = (0 -282045.29065190884) / Math.Sqrt((2324264345.6039534 / (299)) + (10497712.887218114 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.08312551434246307 = (307616.0314894573 - 282045.29065190884) / 307616.0314894573 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_EnumerateObject.EnumerateProperties(TestCase: ObjectProperties) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 56.22209677991233 < 67.11351698241556. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.994519221480065 (T) = (0 -57823.12141870906) / Math.Sqrt((26210289.35659627 / (299)) + (3259408.8110001385 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.08528579342363675 = (63214.41276738474 - 57823.12141870906) / 63214.41276738474 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_EnumerateObject.EnumerateProperties(TestCase: StringProperties) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 54.96692793367347 < 63.246531814599834. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.242788810067237 (T) = (0 -54862.75742130465) / Math.Sqrt((19673532.64002297 / (299)) + (1237804.243967101 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.09026008824675139 = (60305.98054731189 - 54862.75742130465) / 60305.98054731189 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_EnumerateObject.PropertyIndexer(TestCase: NumericProperties) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 85.8428369681889 < 111.54096205897265. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.5630454150233 (T) = (0 -88189.39312956108) / Math.Sqrt((169716251.7320115 / (299)) + (12237145.46668998 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.11178763615853596 = (99288.63492526422 - 88189.39312956108) / 99288.63492526422 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_EnumerateObject.Parse(TestCase: NumericProperties) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 348.567850872093 < 447.1170084522616. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 5.3865623332937576 (T) = (0 -350599.5056859599) / Math.Sqrt((3269888512.8604813 / (299)) + (19916515.985350486 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.05170771448016444 = (369716.71186143626 - 350599.5056859599) / 369716.71186143626 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_EnumerateObject.PropertyIndexer(TestCase: ObjectProperties) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 91.38505634469698 < 115.95958189195737. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 16.533029014364164 (T) = (0 -90272.01947529153) / Math.Sqrt((139495051.74970475 / (299)) + (1069945.5402830774 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12012678728506213 = (102596.62207097778 - 90272.01947529153) / 102596.62207097778 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_EnumerateObject.EnumerateProperties(TestCase: NumericProperties) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 58.55844612983769 < 63.40153555589324. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.146406354070987 (T) = (0 -56168.06910307964) / Math.Sqrt((19109285.360739186 / (299)) + (3184170.2149239345 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.06803992136596831 = (60268.75012222073 - 56168.06910307964) / 60268.75012222073 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Threading.Tests.Perf_SemaphoreSlim

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ReleaseWait - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Threading.Tests.Perf_SemaphoreSlim.ReleaseWait.html>)	646.02 ns	563.70 ns	0.87	0.06	False
[ReleaseWaitAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Threading.Tests.Perf_SemaphoreSlim.ReleaseWaitAsync.html>)	641.70 ns	560.47 ns	0.87	0.06	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Threading.Tests.Perf_SemaphoreSlim*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Threading.Tests.Perf_SemaphoreSlim.ReleaseWait ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 563.695493070792 < 613.8621083733113. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.480013356251922 (T) = (0 -541.0508750684124) / Math.Sqrt((946.8215302973138 / (299)) + (171.74841104710788 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.08148001941925709 = (589.0463860419541 - 541.0508750684124) / 589.0463860419541 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Threading.Tests.Perf_SemaphoreSlim.ReleaseWaitAsync ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 560.4691532475954 < 613.848846878432. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.746652495252796 (T) = (0 -556.9817036910364) / Math.Sqrt((715.2214454098662 / (299)) + (176.6457014779454 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.06319150759628085 = (594.5523639115391 - 556.9817036910364) / 594.5523639115391 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Collections.AddGivenSize<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Queue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.AddGivenSize(Int32).Queue(Size%3a%20512).html>)	29.72 μs	22.28 μs	0.75	0.06	False
[List - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.AddGivenSize(Int32).List(Size%3a%20512).html>)	15.49 μs	9.10 μs	0.59	0.10	False
[Stack - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.AddGivenSize(Int32).Stack(Size%3a%20512).html>)	17.06 μs	12.49 μs	0.73	0.07	False
[HashSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.AddGivenSize(Int32).HashSet(Size%3a%20512).html>)	82.95 μs	62.77 μs	0.76	0.07	False
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.AddGivenSize(Int32).Dictionary(Size%3a%20512).html>)	89.02 μs	65.92 μs	0.74	0.05	False
[ICollection - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.AddGivenSize(Int32).ICollection(Size%3a%20512).html>)	19.90 μs	14.51 μs	0.73	0.05	False
[IDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.AddGivenSize(Int32).IDictionary(Size%3a%20512).html>)	100.07 μs	67.55 μs	0.67	0.02	False
[ObservableCollection - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.AddGivenSize(Int32).ObservableCollection(Size%3a%20512).html>)	181.95 μs	150.82 μs	0.83	0.02	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.AddGivenSize<Int32>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.AddGivenSize<Int32>.Queue(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 22.279764938895358 < 28.239797787165816. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 18.059286463168327 (T) = (0 -21911.75005778047) / Math.Sqrt((6420080.465232 / (299)) + (224475.67013967884 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1417805972506956 = (25531.641428271392 - 21911.75005778047) / 25531.641428271392 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.AddGivenSize<Int32>.List(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 9.103493231282648 < 14.714509542985047. IsChangePoint: Marked as a change because one of 5/27/2022 6:33:44 PM, 5/28/2022 1:41:21 AM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 63.54592223654673 (T) = (0 -9091.414714815946) / Math.Sqrt((1863694.3577036597 / (299)) + (645.2891612810106 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.3566749200892513 = (14131.914017835645 - 9091.414714815946) / 14131.914017835645 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.AddGivenSize<Int32>.Stack(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 12.488909034920244 < 16.122791322332525. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 22.22648012680352 (T) = (0 -12296.104563653289) / Math.Sqrt((2264459.581104508 / (299)) + (7224.516973164422 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.14048039889832128 = (14305.787265226887 - 12296.104563653289) / 14305.787265226887 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.AddGivenSize<Int32>.HashSet(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 62.774895915354335 < 79.45662795756633. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.15823634958979 (T) = (0 -61666.34137988095) / Math.Sqrt((77266560.04039605 / (299)) + (1963295.6731426832 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.08938947099604419 = (67719.77636513037 - 61666.34137988095) / 67719.77636513037 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.AddGivenSize<Int32>.Dictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 65.92365205087636 < 84.43571843494955. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.262444107639617 (T) = (0 -65830.71304856974) / Math.Sqrt((80837124.44818863 / (299)) + (65133.79492475632 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.09567644516505296 = (72795.53064454332 - 65830.71304856974) / 72795.53064454332 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.AddGivenSize<Int32>.ICollection(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 14.508601839929518 < 18.983172823178947. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 15.299561377325043 (T) = (0 -14596.972314116638) / Math.Sqrt((3745856.6513047786 / (299)) + (39874.29933174978 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11657645723607374 = (16523.18690585013 - 14596.972314116638) / 16523.18690585013 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.AddGivenSize<Int32>.IDictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 67.54728755506608 < 86.70317141943167. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.244319148353744 (T) = (0 -68202.53184081685) / Math.Sqrt((84329479.66705535 / (299)) + (837980.0927878282 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.08981263066226983 = (74932.40857697501 - 68202.53184081685) / 74932.40857697501 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.AddGivenSize<Int32>.ObservableCollection(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 150.8220933108358 < 176.29152464644608. IsChangePoint: Marked as a change because one of 5/25/2022 12:28:02 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 20.739614013321024 (T) = (0 -153318.81189592887) / Math.Sqrt((83725703.21583295 / (299)) + (2628292.4083629088 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.08722447919952965 = (167969.8988437748 - 153318.81189592887) / 167969.8988437748 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in Benchstone.BenchI.Midpoint

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Test - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Benchstone.BenchI.Midpoint.Test.html>)	6.13 secs	4.88 secs	0.80	0.10	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Benchstone.BenchI.Midpoint*'

### Payloads [Baseline]() [Compare]() ### Histogram #### Benchstone.BenchI.Midpoint.Test ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 4.875545306666667 < 5.8249832379563085. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.760050018599356 (T) = (0 -4487061194.821505) / Math.Sqrt((3.315254905431226E+17 / (299)) + (23100572306162876 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12614805377783253 = (5134807119.4668 - 4487061194.821505) / 5134807119.4668 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in System.Text.Json.Serialization.Tests.WriteJson<Location>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[SerializeToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.WriteJson(Location).SerializeToString.html>)	28.29 μs	22.44 μs	0.79	0.01	False
[SerializeToStream - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.WriteJson(Location).SerializeToStream.html>)	31.53 μs	25.58 μs	0.81	0.01	False
[SerializeToUtf8Bytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.WriteJson(Location).SerializeToUtf8Bytes.html>)	25.52 μs	20.77 μs	0.81	0.01	False
[SerializeObjectProperty - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.WriteJson(Location).SerializeObjectProperty.html>)	34.15 μs	28.59 μs	0.84	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson<Location>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Serialization.Tests.WriteJson<Location>.SerializeToString ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 22.44253878297362 < 26.60225917210859. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.606350705045013 (T) = (0 -22463.535818650696) / Math.Sqrt((4946876.547285089 / (299)) + (43548.90498213654 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.057701267663319934 = (23839.081013031177 - 22463.535818650696) / 23839.081013031177 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Serialization.Tests.WriteJson<Location>.SerializeToStream ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 25.57718702682462 < 29.85743596670335. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.572235432772128 (T) = (0 -25801.181334333065) / Math.Sqrt((4998530.450267015 / (299)) + (25992.636666965485 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.05356865844374396 = (27261.54576824043 - 25801.181334333065) / 27261.54576824043 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Serialization.Tests.WriteJson<Location>.SerializeToUtf8Bytes ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 20.7716167268991 < 24.47155700701952. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.385238170376807 (T) = (0 -20875.647254569358) / Math.Sqrt((4733228.936172375 / (299)) + (35194.253607583814 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.05215142168116052 = (22024.24282958323 - 20875.647254569358) / 22024.24282958323 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Serialization.Tests.WriteJson<Location>.SerializeObjectProperty ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 28.589499291590492 < 32.50025024880107. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.355565382608164 (T) = (0 -28140.127371279115) / Math.Sqrt((5667244.267972627 / (299)) + (74171.8769091863 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.050069704036148625 = (29623.360251634673 - 28140.127371279115) / 29623.360251634673 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Numerics.Tests.Perf_Quaternion

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[MultiplyByScalarBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.MultiplyByScalarBenchmark.html>)	76.51 ns	51.21 ns	0.67	0.18	False
[NormalizeBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.NormalizeBenchmark.html>)	95.50 ns	69.75 ns	0.73	0.12	False
[MultiplyByScalarOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.MultiplyByScalarOperatorBenchmark.html>)	68.46 ns	48.88 ns	0.71	0.24	False
[AddBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.AddBenchmark.html>)	111.68 ns	93.25 ns	0.84	0.24	False
[ConcatenateBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.ConcatenateBenchmark.html>)	145.71 ns	115.56 ns	0.79	0.25	False
[LengthSquaredBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.LengthSquaredBenchmark.html>)	67.26 ns	49.42 ns	0.73	0.18	False
[CreateFromYawPitchRollBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.CreateFromYawPitchRollBenchmark.html>)	101.96 ns	73.97 ns	0.73	0.11	False
[IsIdentityBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.IsIdentityBenchmark.html>)	96.10 ns	81.02 ns	0.84	0.19	False
[NegationOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.NegationOperatorBenchmark.html>)	66.22 ns	49.18 ns	0.74	0.17	False
[SlerpBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.SlerpBenchmark.html>)	217.80 ns	163.65 ns	0.75	0.22	False
[MultiplyByQuaternionBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.MultiplyByQuaternionBenchmark.html>)	151.79 ns	102.50 ns	0.68	0.26	False
[LengthBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.LengthBenchmark.html>)	79.99 ns	64.56 ns	0.81	0.14	False
[CreateFromRotationMatrixBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.CreateFromRotationMatrixBenchmark.html>)	84.44 ns	44.36 ns	0.53	0.20	False
[DivisionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.DivisionOperatorBenchmark.html>)	184.85 ns	140.76 ns	0.76	0.20	False
[ConjugateBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.ConjugateBenchmark.html>)	63.91 ns	49.18 ns	0.77	0.23	False
[CreateFromVector3WithScalarBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.CreateFromVector3WithScalarBenchmark.html>)	47.04 ns	37.71 ns	0.80	0.17	False
[CreateFromAxisAngleBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.CreateFromAxisAngleBenchmark.html>)	77.45 ns	63.93 ns	0.83	0.20	False
[InverseBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.InverseBenchmark.html>)	99.76 ns	66.99 ns	0.67	0.18	False
[DivideBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.DivideBenchmark.html>)	109.99 ns	77.93 ns	0.71	0.29	False
[LerpBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.LerpBenchmark.html>)	216.49 ns	139.21 ns	0.64	0.22	False
[NegateBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.NegateBenchmark.html>)	68.06 ns	49.11 ns	0.72	0.20	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_Quaternion*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_Quaternion.MultiplyByScalarBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 51.20760590465647 < 69.94043273328035. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 5.184988088415012 (T) = (0 -53.070105498383235) / Math.Sqrt((64.98406614609496 / (299)) + (10.928710996643217 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.0940127495702459 = (58.57709970334515 - 53.070105498383235) / 58.57709970334515 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Quaternion.NormalizeBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 69.75353222695155 < 92.05648585575257. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.586702731754122 (T) = (0 -69.47367101039988) / Math.Sqrt((121.94351712925402 / (299)) + (6.4298595712940525 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.09811204698630736 = (77.03137709983928 - 69.47367101039988) / 77.03137709983928 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Quaternion.MultiplyByScalarOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 48.88120064207894 < 65.05431355521964. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 5.8597861917361005 (T) = (0 -51.369240663022225) / Math.Sqrt((59.25909757722378 / (299)) + (6.855894128662323 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.09370051904584045 = (56.68020532124797 - 51.369240663022225) / 56.68020532124797 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Quaternion.AddBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 93.2534199284365 < 105.30728714337496. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 6.09253408745884 (T) = (0 -80.23450863408434) / Math.Sqrt((159.16556406149593 / (299)) + (19.6893307616505 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10066917131507169 = (89.2157880892502 - 80.23450863408434) / 89.2157880892502 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Quaternion.ConcatenateBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 115.56011278511775 < 139.36683403126497. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 6.7688278970804125 (T) = (0 -116.35369405725915) / Math.Sqrt((195.2765192395101 / (299)) + (5.307641309659036 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.058374909837396655 = (123.56690074726743 - 116.35369405725915) / 123.56690074726743 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Quaternion.LengthSquaredBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 49.42048671950926 < 63.690964701841985. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 5.384445968190458 (T) = (0 -51.37533587454394) / Math.Sqrt((39.9768818710797 / (299)) + (9.324433555930993 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.09092490500141732 = (56.51385254880846 - 51.37533587454394) / 56.51385254880846 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Quaternion.CreateFromYawPitchRollBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 73.96800251559613 < 98.13014724233528. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.350054296552072 (T) = (0 -74.5234478289505) / Math.Sqrt((141.10012992335473 / (299)) + (0.7043064070150278 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.08373826401059431 = (81.33423551566075 - 74.5234478289505) / 81.33423551566075 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Quaternion.IsIdentityBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 81.02182685814975 < 91.69719903703034. IsChangePoint: Marked as a change because one of 5/9/2022 10:19:44 PM, 5/17/2022 4:22:41 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.732654380402835 (T) = (0 -78.54740087525272) / Math.Sqrt((66.60958231291815 / (299)) + (5.296985423862818 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1166930372358968 = (88.92424059407043 - 78.54740087525272) / 88.92424059407043 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Quaternion.NegationOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 49.18263456520764 < 63.19269340714684. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.263184860875604 (T) = (0 -49.988739730190375) / Math.Sqrt((57.44401950339021 / (299)) + (1.3162025521592908 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.08449959645015431 = (54.60264084686301 - 49.988739730190375) / 54.60264084686301 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Quaternion.SlerpBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 163.64504267261842 < 207.0480990544679. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 4.785732285013545 (T) = (0 -144.62708257823036) / Math.Sqrt((1029.6220918492008 / (299)) + (81.25254812200069 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.09564222828471496 = (159.92241909296342 - 144.62708257823036) / 159.92241909296342 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Quaternion.MultiplyByQuaternionBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 102.49746795874158 < 143.7249910528793. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 5.395779693266376 (T) = (0 -104.40271284421766) / Math.Sqrt((403.4210413647186 / (299)) + (46.37095387269313 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10555089765764022 = (116.7229220430884 - 104.40271284421766) / 116.7229220430884 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Quaternion.LengthBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 64.55711827505219 < 75.48439107506631. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 4.322533809346552 (T) = (0 -63.42380392746071) / Math.Sqrt((48.658539919648184 / (299)) + (11.939484467571843 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.06832029864245863 = (68.07468686400112 - 63.42380392746071) / 68.07468686400112 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Quaternion.CreateFromRotationMatrixBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 44.356983098462074 < 70.72581161466996. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 5.9731808451072474 (T) = (0 -46.826392169409836) / Math.Sqrt((83.99379752107092 / (299)) + (40.08912954329582 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1953367510672384 = (58.193775137011 - 46.826392169409836) / 58.193775137011 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Quaternion.DivisionOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 140.7636811378554 < 175.92725737267628. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 6.943354519739027 (T) = (0 -139.75874153061025) / Math.Sqrt((428.3610342368513 / (299)) + (12.602463356574598 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.0738799193772848 = (150.90779743879182 - 139.75874153061025) / 150.90779743879182 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Quaternion.ConjugateBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 49.178551062495224 < 61.49508335693613. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.614042689240684 (T) = (0 -49.06729750222906) / Math.Sqrt((52.836277845414465 / (299)) + (1.0121258416920211 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.08231404752706407 = (53.468506704286874 - 49.06729750222906) / 53.468506704286874 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Quaternion.CreateFromVector3WithScalarBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 37.705185233787695 < 44.120584448379766. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.505959157211139 (T) = (0 -38.44447566051178) / Math.Sqrt((11.343346016051756 / (299)) + (0.8355198590878993 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.08225421739110403 = (41.890114222290215 - 38.44447566051178) / 41.890114222290215 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Quaternion.CreateFromAxisAngleBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 63.933774126235235 < 72.34532999748788. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 5.809490795359119 (T) = (0 -63.095540523087315) / Math.Sqrt((31.88730006691449 / (299)) + (6.488170976414142 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.0689707168300288 = (67.76966274171252 - 63.095540523087315) / 67.76966274171252 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Quaternion.InverseBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 66.9909525158844 < 94.92972125008079. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.473107074939687 (T) = (0 -67.49502824138834) / Math.Sqrt((179.1773405150241 / (299)) + (4.50103940288016 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12168244401836764 = (76.84581479867381 - 67.49502824138834) / 76.84581479867381 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Quaternion.DivideBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 77.93078436704015 < 104.69950474135644. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 5.047975677551593 (T) = (0 -80.87644613245718) / Math.Sqrt((162.31300417274952 / (299)) + (26.54871485318473 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.09387764980290139 = (89.25554712877906 - 80.87644613245718) / 89.25554712877906 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Quaternion.LerpBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 139.21494105735516 < 204.9667588865604. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.8980046711427 (T) = (0 -140.63165229271456) / Math.Sqrt((1073.5747681070682 / (299)) + (13.30229554028834 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12061341316602621 = (159.9201698072585 - 140.63165229271456) / 159.9201698072585 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Quaternion.NegateBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 49.10507931897772 < 64.98606945268229. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.376114751513263 (T) = (0 -49.9322568868755) / Math.Sqrt((54.46798337219335 / (299)) + (1.2566680976228015 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11719885134432154 = (56.561159852263316 - 49.9322568868755) / 56.561159852263316 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Linq.Tests.Perf_OrderBy

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[OrderByValueType - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Linq.Tests.Perf_OrderBy.OrderByValueType(NumberOfPeople%3a%20512).html>)	1.12 ms	920.11 μs	0.82	0.01	False
[OrderByCustomComparer - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Linq.Tests.Perf_OrderBy.OrderByCustomComparer(NumberOfPeople%3a%20512).html>)	1.78 ms	1.38 ms	0.78	0.02	False
[OrderByString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Linq.Tests.Perf_OrderBy.OrderByString(NumberOfPeople%3a%20512).html>)	2.00 ms	1.51 ms	0.75	0.03	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Linq.Tests.Perf_OrderBy*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Linq.Tests.Perf_OrderBy.OrderByValueType(NumberOfPeople: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 920.1102347689075 < 1.0418605615789347. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 14.999826349190469 (T) = (0 -914490.4306862034) / Math.Sqrt((4280611987.2911425 / (299)) + (76629624.05787335 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.06944748437253376 = (982739.1956160236 - 914490.4306862034) / 982739.1956160236 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Linq.Tests.Perf_OrderBy.OrderByCustomComparer(NumberOfPeople: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.384993971875 < 1.6971863879836306. IsChangePoint: Marked as a change because one of 4/1/2022 6:56:03 AM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 23.7973070887667 (T) = (0 -1389017.8804714095) / Math.Sqrt((15186277983.516945 / (299)) + (100417650.74038224 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11643097687105056 = (1572053.619028577 - 1389017.8804714095) / 1572053.619028577 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Linq.Tests.Perf_OrderBy.OrderByString(NumberOfPeople: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.5101688139204543 < 1.7349112251959327. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.359682037096553 (T) = (0 -1529950.6801802928) / Math.Sqrt((11866837433.753105 / (299)) + (408599973.216909 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.06110571085170481 = (1629523.8962079172 - 1529950.6801802928) / 1629523.8962079172 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Collections.Tests.Perf_SortedSet

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Max - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_SortedSet.Max.html>)	170.59 ns	127.53 ns	0.75	0.10	False
[Min - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_SortedSet.Min.html>)	121.60 ns	103.96 ns	0.85	0.18	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.Tests.Perf_SortedSet*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.Tests.Perf_SortedSet.Max ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 127.53272690011872 < 161.53847192655104. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.222737156451338 (T) = (0 -129.07625240604293) / Math.Sqrt((290.7518210616103 / (299)) + (12.754113839689673 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.09250541351663955 = (142.23363348780663 - 129.07625240604293) / 142.23363348780663 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_SortedSet.Min ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 103.95892745098038 < 116.73454843689531. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 5.250139401731254 (T) = (0 -88.9444799291777) / Math.Sqrt((211.74552820781338 / (299)) + (27.18099085613314 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.09522477799747807 = (98.30560979810937 - 88.9444799291777) / 98.30560979810937 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in System.Globalization.Tests.StringSearch

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[IndexOf_Word_NotFound - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IndexOf_Word_NotFound(Options%3a%20(en-US%2c%20Ordinal%2c%20False)).html>)	1.92 μs	1.10 μs	0.57	0.06	False
[IsPrefix_DifferentFirstChar - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsPrefix_DifferentFirstChar(Options%3a%20(en-US%2c%20IgnoreCase%2c%20False)).html>)	284.76 ns	193.67 ns	0.68	0.29	False
[IsPrefix_FirstHalf - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsPrefix_FirstHalf(Options%3a%20(en-US%2c%20None%2c%20False)).html>)	4.87 μs	3.36 μs	0.69	0.15	False
[LastIndexOf_Word_NotFound - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options%3a%20(en-US%2c%20None%2c%20False)).html>)	13.58 μs	8.19 μs	0.60	0.14	False
[IsPrefix_DifferentFirstChar - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsPrefix_DifferentFirstChar(Options%3a%20(%2c%20None%2c%20False)).html>)	262.53 ns	204.67 ns	0.78	0.27	False
[IsSuffix_DifferentLastChar - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsSuffix_DifferentLastChar(Options%3a%20(en-US%2c%20IgnoreNonSpace%2c%20False)).html>)	256.23 ns	185.86 ns	0.73	0.21	False
[IsSuffix_SecondHalf - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsSuffix_SecondHalf(Options%3a%20(en-US%2c%20None%2c%20False)).html>)	5.05 μs	3.34 μs	0.66	0.14	False
[LastIndexOf_Word_NotFound - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options%3a%20(en-US%2c%20None%2c%20True)).html>)	26.07 μs	20.58 μs	0.79	0.03	False
[LastIndexOf_Word_NotFound - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options%3a%20(%2c%20None%2c%20True)).html>)	26.06 μs	20.78 μs	0.80	0.05	False
[IsSuffix_SecondHalf - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsSuffix_SecondHalf(Options%3a%20(en-US%2c%20Ordinal%2c%20False)).html>)	423.02 ns	296.73 ns	0.70	0.13	False
[IsSuffix_DifferentLastChar - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsSuffix_DifferentLastChar(Options%3a%20(%2c%20None%2c%20False)).html>)	262.90 ns	185.07 ns	0.70	0.24	False
[IsPrefix_FirstHalf - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsPrefix_FirstHalf(Options%3a%20(%2c%20IgnoreCase%2c%20False)).html>)	4.88 μs	3.37 μs	0.69	0.16	False
[LastIndexOf_Word_NotFound - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options%3a%20(en-US%2c%20OrdinalIgnoreCase%2c%20False)).html>)	13.32 μs	8.57 μs	0.64	0.10	False
[LastIndexOf_Word_NotFound - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options%3a%20(%2c%20None%2c%20False)).html>)	13.58 μs	8.19 μs	0.60	0.09	False
[IsPrefix_FirstHalf - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsPrefix_FirstHalf(Options%3a%20(en-US%2c%20OrdinalIgnoreCase%2c%20False)).html>)	799.81 ns	552.23 ns	0.69	0.07	False
[IsSuffix_SecondHalf - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsSuffix_SecondHalf(Options%3a%20(%2c%20None%2c%20False)).html>)	4.91 μs	3.37 μs	0.69	0.11	False
[IndexOf_Word_NotFound - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IndexOf_Word_NotFound(Options%3a%20(en-US%2c%20None%2c%20False)).html>)	13.53 μs	8.22 μs	0.61	0.12	False
[IsPrefix_DifferentFirstChar - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsPrefix_DifferentFirstChar(Options%3a%20(en-US%2c%20OrdinalIgnoreCase%2c%20False)).html>)	169.82 ns	128.69 ns	0.76	0.22	False
[IsSuffix_DifferentLastChar - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsSuffix_DifferentLastChar(Options%3a%20(%2c%20IgnoreCase%2c%20False)).html>)	270.73 ns	193.72 ns	0.72	0.22	False
[IsSuffix_SecondHalf - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsSuffix_SecondHalf(Options%3a%20(en-US%2c%20IgnoreNonSpace%2c%20False)).html>)	4.96 μs	3.37 μs	0.68	0.18	False
[IsPrefix_FirstHalf - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsPrefix_FirstHalf(Options%3a%20(en-US%2c%20IgnoreNonSpace%2c%20False)).html>)	4.99 μs	3.36 μs	0.67	0.11	False
[IsPrefix_FirstHalf - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsPrefix_FirstHalf(Options%3a%20(%2c%20None%2c%20False)).html>)	4.91 μs	3.33 μs	0.68	0.10	False
[IsPrefix_FirstHalf - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsPrefix_FirstHalf(Options%3a%20(en-US%2c%20Ordinal%2c%20False)).html>)	416.99 ns	294.34 ns	0.71	0.15	False
[LastIndexOf_Word_NotFound - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options%3a%20(en-US%2c%20IgnoreNonSpace%2c%20False)).html>)	13.88 μs	8.15 μs	0.59	0.09	False
[IsSuffix_SecondHalf - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsSuffix_SecondHalf(Options%3a%20(en-US%2c%20IgnoreCase%2c%20False)).html>)	4.91 μs	3.37 μs	0.69	0.14	False
[IsSuffix_SecondHalf - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsSuffix_SecondHalf(Options%3a%20(en-US%2c%20OrdinalIgnoreCase%2c%20False)).html>)	817.01 ns	553.66 ns	0.68	0.06	False
[IsPrefix_DifferentFirstChar - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsPrefix_DifferentFirstChar(Options%3a%20(%2c%20IgnoreCase%2c%20False)).html>)	268.67 ns	195.75 ns	0.73	0.25	False
[IsPrefix_FirstHalf - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsPrefix_FirstHalf(Options%3a%20(en-US%2c%20IgnoreCase%2c%20False)).html>)	4.88 μs	3.36 μs	0.69	0.11	False
[IsPrefix_DifferentFirstChar - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsPrefix_DifferentFirstChar(Options%3a%20(en-US%2c%20Ordinal%2c%20False)).html>)	166.65 ns	129.18 ns	0.78	0.26	False
[IsSuffix_DifferentLastChar - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsSuffix_DifferentLastChar(Options%3a%20(en-US%2c%20None%2c%20False)).html>)	282.45 ns	200.01 ns	0.71	0.19	False
[IsSuffix_SecondHalf - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsSuffix_SecondHalf(Options%3a%20(%2c%20IgnoreCase%2c%20False)).html>)	4.91 μs	3.37 μs	0.69	0.16	False
[IsSuffix_DifferentLastChar - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsSuffix_DifferentLastChar(Options%3a%20(en-US%2c%20OrdinalIgnoreCase%2c%20False)).html>)	1.55 μs	954.51 ns	0.62	0.07	False
[IsSuffix_DifferentLastChar - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsSuffix_DifferentLastChar(Options%3a%20(en-US%2c%20IgnoreCase%2c%20False)).html>)	266.83 ns	206.84 ns	0.78	0.26	False
[LastIndexOf_Word_NotFound - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options%3a%20(en-US%2c%20Ordinal%2c%20False)).html>)	1.74 μs	1.01 μs	0.58	0.04	False
[IndexOf_Word_NotFound - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IndexOf_Word_NotFound(Options%3a%20(%2c%20None%2c%20False)).html>)	13.54 μs	8.66 μs	0.64	0.11	False
[IsPrefix_DifferentFirstChar - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsPrefix_DifferentFirstChar(Options%3a%20(en-US%2c%20IgnoreNonSpace%2c%20False)).html>)	270.22 ns	188.17 ns	0.70	0.28	False
[IsSuffix_DifferentLastChar - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsSuffix_DifferentLastChar(Options%3a%20(en-US%2c%20Ordinal%2c%20False)).html>)	668.93 ns	438.28 ns	0.66	0.08	False
[IndexOf_Word_NotFound - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IndexOf_Word_NotFound(Options%3a%20(en-US%2c%20IgnoreNonSpace%2c%20False)).html>)	13.78 μs	10.84 μs	0.79	0.12	False
[IsPrefix_DifferentFirstChar - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsPrefix_DifferentFirstChar(Options%3a%20(en-US%2c%20None%2c%20False)).html>)	273.15 ns	185.79 ns	0.68	0.23	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Globalization.Tests.StringSearch*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Globalization.Tests.StringSearch.IndexOf_Word_NotFound(Options: (en-US, Ordinal, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.1028150554760203 < 1.7196767475346535. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.073085781915433 (T) = (0 -1119.0463364126967) / Math.Sqrt((93886.41423910126 / (299)) + (259.0773473647173 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.14191164032494707 = (1304.115507214741 - 1119.0463364126967) / 1304.115507214741 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsPrefix_DifferentFirstChar(Options: (en-US, IgnoreCase, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 193.67400940492638 < 255.90072052513432. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.018006486718692 (T) = (0 -197.52535276943718) / Math.Sqrt((941.6188554340608 / (299)) + (41.51150369282006 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.10724281767653619 = (221.25316567643114 - 197.52535276943718) / 221.25316567643114 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsPrefix_FirstHalf(Options: (en-US, None, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.3592625692944567 < 4.659489442723833. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.964439936524084 (T) = (0 -3344.9104975287555) / Math.Sqrt((371538.29362971993 / (299)) + (2383.7632788012265 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12826892002025014 = (3837.089871347087 - 3344.9104975287555) / 3837.089871347087 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options: (en-US, None, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 8.185302576235541 < 12.886513024071473. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 5.7309280037781 (T) = (0 -8434.796154853408) / Math.Sqrt((4513157.981299602 / (299)) + (542296.7783067357 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.14297230269086633 = (9841.917806550118 - 8434.796154853408) / 9841.917806550118 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsPrefix_DifferentFirstChar(Options: (, None, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 204.67455876061715 < 249.23157466639802. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.313013915604207 (T) = (0 -192.29322891180848) / Math.Sqrt((904.2160128537703 / (299)) + (29.596831674761745 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.10376415915394147 = (214.55650415663038 - 192.29322891180848) / 214.55650415663038 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsSuffix_DifferentLastChar(Options: (en-US, IgnoreNonSpace, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 185.86392412033553 < 244.42281398037613. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.310847255077974 (T) = (0 -190.0476263443837) / Math.Sqrt((758.3869675173289 / (299)) + (38.8212418121646 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10530449562123709 = (212.41598444863584 - 190.0476263443837) / 212.41598444863584 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsSuffix_SecondHalf(Options: (en-US, None, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.3372185965571544 < 4.705887526995856. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.512207486656521 (T) = (0 -3354.4997888703906) / Math.Sqrt((645882.618940354 / (299)) + (618.0655536818609 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1284454522874955 = (3848.8695832919034 - 3354.4997888703906) / 3848.8695832919034 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options: (en-US, None, True)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 20.581762156442394 < 24.88944964270733. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 14.034685901650668 (T) = (0 -20642.79806426534) / Math.Sqrt((4278622.0669928305 / (299)) + (14676.639005790015 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.0781152792691766 = (22391.951618311643 - 20642.79806426534) / 22391.951618311643 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options: (, None, True)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 20.78364399689303 < 24.86328796546474. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.56147409574995 (T) = (0 -20747.316184624287) / Math.Sqrt((4405105.070679049 / (299)) + (33656.11111252912 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.07472521220508221 = (22422.86989583771 - 20747.316184624287) / 22422.86989583771 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsSuffix_SecondHalf(Options: (en-US, Ordinal, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 296.72555460325685 < 405.93916682973463. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.78600376830532 (T) = (0 -290.03125923714987) / Math.Sqrt((3458.8216164990154 / (299)) + (36.106043155072435 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1036684041245025 = (323.5758513609687 - 290.03125923714987) / 323.5758513609687 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsSuffix_DifferentLastChar(Options: (, None, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 185.07206719057956 < 244.2984666130361. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 5.9231416057782855 (T) = (0 -193.5893053735432) / Math.Sqrt((794.9188695486896 / (299)) + (84.70339596883194 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.08964730947370415 = (212.65308202870776 - 193.5893053735432) / 212.65308202870776 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsPrefix_FirstHalf(Options: (, IgnoreCase, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.3673672401564314 < 4.667317954122311. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.720222413150726 (T) = (0 -3343.973531159239) / Math.Sqrt((366383.6924884238 / (299)) + (596.5375206844502 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1277875295220868 = (3833.897868173071 - 3343.973531159239) / 3833.897868173071 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options: (en-US, OrdinalIgnoreCase, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 8.566979974723264 < 12.71774995844228. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.382902802573961 (T) = (0 -8539.912234791485) / Math.Sqrt((4887248.436280747 / (299)) + (39162.50227137454 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.10871228975834267 = (9581.543800795856 - 8539.912234791485) / 9581.543800795856 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options: (, None, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 8.18533961511485 < 12.892878300114603. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.600573086977358 (T) = (0 -8113.855457044444) / Math.Sqrt((4626528.694869587 / (299)) + (5878.835642130499 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.17476954399419045 = (9832.229770476773 - 8113.855457044444) / 9832.229770476773 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsPrefix_FirstHalf(Options: (en-US, OrdinalIgnoreCase, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 552.2269559947216 < 763.2786095808885. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.17314844729853 (T) = (0 -543.7246294655549) / Math.Sqrt((12881.115295865053 / (299)) + (68.46155517562474 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.09501623310801639 = (600.8114723790978 - 543.7246294655549) / 600.8114723790978 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsSuffix_SecondHalf(Options: (, None, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.374571511585675 < 4.6863787088720965. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.024051780848739 (T) = (0 -3362.207074769274) / Math.Sqrt((390785.0384690912 / (299)) + (1217.221662860392 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11833045636407863 = (3813.4549378941365 - 3362.207074769274) / 3813.4549378941365 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IndexOf_Word_NotFound(Options: (en-US, None, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 8.221334190067848 < 12.869909655353352. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.482200179498635 (T) = (0 -8150.812888622273) / Math.Sqrt((4726815.1234106785 / (299)) + (22384.966418730623 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.16915331178814763 = (9810.248995713573 - 8150.812888622273) / 9810.248995713573 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsPrefix_DifferentFirstChar(Options: (en-US, OrdinalIgnoreCase, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 128.68960062756588 < 160.70367921161161. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.068806118006195 (T) = (0 -127.72039146110113) / Math.Sqrt((281.95135502757176 / (299)) + (4.896355620865044 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.10017787103958983 = (141.9395982277743 - 127.72039146110113) / 141.9395982277743 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsSuffix_DifferentLastChar(Options: (, IgnoreCase, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 193.71777557540236 < 264.48707523403726. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.709817929236946 (T) = (0 -195.5483915734562) / Math.Sqrt((926.3165469580506 / (299)) + (22.81043778694574 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10909330274828 = (219.49368230891776 - 195.5483915734562) / 219.49368230891776 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsSuffix_SecondHalf(Options: (en-US, IgnoreNonSpace, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.3703113634724926 < 4.706058251035686. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 3.609544407999968 (T) = (0 -3479.543985393013) / Math.Sqrt((396827.9812602277 / (299)) + (95025.70598440469 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.09070127917925465 = (3826.6236449253215 - 3479.543985393013) / 3826.6236449253215 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsPrefix_FirstHalf(Options: (en-US, IgnoreNonSpace, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.359408895967095 < 4.677287441815825. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 6.432763833133501 (T) = (0 -3393.841271059188) / Math.Sqrt((386995.362689282 / (299)) + (39325.66255236611 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11359626390924418 = (3828.7759097528265 - 3393.841271059188) / 3828.7759097528265 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsPrefix_FirstHalf(Options: (, None, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.3315210534759365 < 4.6733909179217505. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.638453127050353 (T) = (0 -3330.2940052125814) / Math.Sqrt((384992.52849927027 / (299)) + (510.0547348434686 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1299482893065896 = (3827.6966349027884 - 3330.2940052125814) / 3827.6966349027884 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsPrefix_FirstHalf(Options: (en-US, Ordinal, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 294.34496391365406 < 395.96524348473605. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.5026484249038266 (T) = (0 -290.3329734416124) / Math.Sqrt((3114.032621090831 / (299)) + (63.02417857017496 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.09279302145439465 = (320.02947542032973 - 290.3329734416124) / 320.02947542032973 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options: (en-US, IgnoreNonSpace, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 8.145089832647718 < 12.986143204262468. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.114469520673063 (T) = (0 -8220.867208499069) / Math.Sqrt((4447879.602678065 / (299)) + (180094.30384993102 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.16083432259460126 = (9796.476941141134 - 8220.867208499069) / 9796.476941141134 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsSuffix_SecondHalf(Options: (en-US, IgnoreCase, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.3668729198737686 < 4.694237564877962. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.870620179538975 (T) = (0 -3354.846927230244) / Math.Sqrt((391544.125743975 / (299)) + (1567.3883881043234 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11838103790333554 = (3805.32528389788 - 3354.846927230244) / 3805.32528389788 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsSuffix_SecondHalf(Options: (en-US, OrdinalIgnoreCase, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 553.6567235089504 < 778.7866566974218. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.524966159172273 (T) = (0 -551.4833183852871) / Math.Sqrt((13466.206075430664 / (299)) + (53.57620039925739 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.09845401547455679 = (611.7084739449841 - 551.4833183852871) / 611.7084739449841 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsPrefix_DifferentFirstChar(Options: (, IgnoreCase, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 195.75195896269219 < 255.84439623533908. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 4.50434624343744 (T) = (0 -202.94362437136152) / Math.Sqrt((919.9699022185085 / (299)) + (128.17309870951544 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.07849459067187169 = (220.23052964966118 - 202.94362437136152) / 220.23052964966118 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsPrefix_FirstHalf(Options: (en-US, IgnoreCase, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.3554458354281884 < 4.658988636623166. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.077234271974229 (T) = (0 -3344.368215380034) / Math.Sqrt((377117.5201992439 / (299)) + (579.1660489752128 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12396033068701841 = (3817.5990569043465 - 3344.368215380034) / 3817.5990569043465 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsPrefix_DifferentFirstChar(Options: (en-US, Ordinal, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 129.1777583038826 < 166.78198648682059. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.366265036093047 (T) = (0 -129.05806125284093) / Math.Sqrt((270.2593539701541 / (299)) + (14.376229057020474 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.08590952748774922 = (141.1874044569601 - 129.05806125284093) / 141.1874044569601 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsSuffix_DifferentLastChar(Options: (en-US, None, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 200.0132689858777 < 247.18562443855197. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.886150316661064 (T) = (0 -190.46957728007922) / Math.Sqrt((748.0425402290394 / (299)) + (29.636133678019576 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10372560308520962 = (212.5125719709556 - 190.46957728007922) / 212.5125719709556 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsSuffix_SecondHalf(Options: (, IgnoreCase, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.3655483799944377 < 4.703280662969236. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.986832532727664 (T) = (0 -3353.678368171722) / Math.Sqrt((405829.12649391947 / (299)) + (4594.035855638316 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.12128067439737657 = (3816.5524194790846 - 3353.678368171722) / 3816.5524194790846 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsSuffix_DifferentLastChar(Options: (en-US, OrdinalIgnoreCase, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 954.5122626418989 < 1.4139252617679583. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.204963382987074 (T) = (0 -948.7072696920253) / Math.Sqrt((49887.61285157698 / (299)) + (77.87406120972973 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11327297504292962 = (1069.8977734866664 - 948.7072696920253) / 1069.8977734866664 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsSuffix_DifferentLastChar(Options: (en-US, IgnoreCase, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 206.8370537648542 < 254.92891749763237. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 6.3743537905065235 (T) = (0 -197.51314579379212) / Math.Sqrt((873.3423968119436 / (299)) + (115.69022887322868 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10264317032954892 = (220.10546893182686 - 197.51314579379212) / 220.10546893182686 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options: (en-US, Ordinal, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.0060910507184162 < 1.639165954860226. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.048121423352926 (T) = (0 -1012.8490482824477) / Math.Sqrt((82410.89989832239 / (299)) + (232.64106456531866 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1455877622242113 = (1185.4336858740492 - 1012.8490482824477) / 1185.4336858740492 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IndexOf_Word_NotFound(Options: (, None, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 8.6636967219656 < 12.872883664182632. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 6.694352211393481 (T) = (0 -8401.096468225653) / Math.Sqrt((4389247.4192234175 / (299)) + (350616.2691576408 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.14306735597226242 = (9803.683552932454 - 8401.096468225653) / 9803.683552932454 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsPrefix_DifferentFirstChar(Options: (en-US, IgnoreNonSpace, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 188.17042916353319 < 255.25435031056256. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.281324465118889 (T) = (0 -191.03999680887355) / Math.Sqrt((889.645697129513 / (299)) + (46.41953283100698 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11276394381589742 = (215.32037103013374 - 191.03999680887355) / 215.32037103013374 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsSuffix_DifferentLastChar(Options: (en-US, Ordinal, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 438.28382931940297 < 638.8980869348685. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.240347833011445 (T) = (0 -442.22820275046064) / Math.Sqrt((9608.09584443992 / (299)) + (47.32127484340787 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11150978710444115 = (497.72996520609297 - 442.22820275046064) / 497.72996520609297 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IndexOf_Word_NotFound(Options: (en-US, IgnoreNonSpace, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 10.836050564887447 < 12.891428207300237. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 5.192047054827216 (T) = (0 -8364.470478191624) / Math.Sqrt((4564760.076413218 / (299)) + (675843.2750254937 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.14669695920223466 = (9802.461819861277 - 8364.470478191624) / 9802.461819861277 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsPrefix_DifferentFirstChar(Options: (en-US, None, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 185.79497323455914 < 248.26441745996001. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.879395049095584 (T) = (0 -191.78312372419313) / Math.Sqrt((878.8463796990419 / (299)) + (60.38156787283692 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10393904092424369 = (214.02910346859457 - 191.78312372419313) / 214.02910346859457 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Memory.Span<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[IndexOfAnyThreeValues - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Int32).IndexOfAnyThreeValues(Size%3a%20512).html>)	9.28 μs	5.04 μs	0.54	0.04	False
[LastIndexOfValue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Int32).LastIndexOfValue(Size%3a%20512).html>)	3.85 μs	2.34 μs	0.61	0.09	False
[Clear - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Int32).Clear(Size%3a%20512).html>)	103.33 ns	81.74 ns	0.79	0.20	False
[EndsWith - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Int32).EndsWith(Size%3a%20512).html>)	1.29 μs	789.51 ns	0.61	0.09	False
[IndexOfAnyFourValues - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Int32).IndexOfAnyFourValues(Size%3a%20512).html>)	18.98 μs	11.38 μs	0.60	0.10	False
[IndexOfAnyTwoValues - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Int32).IndexOfAnyTwoValues(Size%3a%20512).html>)	7.07 μs	3.85 μs	0.54	0.06	False
[IndexOfValue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Int32).IndexOfValue(Size%3a%20512).html>)	3.47 μs	2.11 μs	0.61	0.06	False
[SequenceEqual - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Int32).SequenceEqual(Size%3a%20512).html>)	2.33 μs	1.49 μs	0.64	0.09	False
[LastIndexOfAnyValues - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Int32).LastIndexOfAnyValues(Size%3a%20512).html>)	6.92 μs	4.02 μs	0.58	0.06	False
[GetPinnableReference - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Int32).GetPinnableReference(Size%3a%20512).html>)	22.55 ns	18.53 ns	0.82	0.09	False
[ToArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Int32).ToArray(Size%3a%20512).html>)	897.34 ns	739.56 ns	0.82	0.06	False
[BinarySearch - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Int32).BinarySearch(Size%3a%20512).html>)	503.28 ns	288.09 ns	0.57	0.07	False
[SequenceCompareTo - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Int32).SequenceCompareTo(Size%3a%20512).html>)	36.18 μs	27.29 μs	0.75	0.06	False
[StartsWith - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Int32).StartsWith(Size%3a%20512).html>)	1.27 μs	787.32 ns	0.62	0.13	False
[Fill - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Int32).Fill(Size%3a%20512).html>)	2.82 μs	1.71 μs	0.61	0.13	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Memory.Span<Int32>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Memory.Span<Int32>.IndexOfAnyThreeValues(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.039693341410878 < 8.792322476542385. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.940797302169546 (T) = (0 -5033.57056457175) / Math.Sqrt((2965087.4515975965 / (299)) + (851.5162742475237 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.17845732585591417 = (6126.97395155512 - 5033.57056457175) / 6126.97395155512 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Int32>.LastIndexOfValue(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.341818152050114 < 3.6934870621847598. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.146945015687427 (T) = (0 -2335.665841648029) / Math.Sqrt((417994.83913266583 / (299)) + (865.6142202422935 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1427869090316396 = (2724.7202198108266 - 2335.665841648029) / 2724.7202198108266 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Int32>.Clear(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 81.73746998092734 < 98.40246940689065. IsChangePoint: Marked as a change because one of 5/25/2022 12:28:02 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.21475250934596 (T) = (0 -83.31609644189186) / Math.Sqrt((52.39750618536519 / (299)) + (6.913423059985508 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.07873611213940004 = (90.43673320938717 - 83.31609644189186) / 90.43673320938717 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Int32>.EndsWith(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 789.5083422859519 < 1.2292336139475284. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.361057192329024 (T) = (0 -789.0965246526658) / Math.Sqrt((44073.64069063743 / (299)) + (2.4615286117496855 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12597248967063931 = (902.828017799245 - 789.0965246526658) / 902.828017799245 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Int32>.IndexOfAnyFourValues(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 11.381765458811262 < 18.04290734469419. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.060473865525193 (T) = (0 -11656.653414548091) / Math.Sqrt((8265649.642438913 / (299)) + (380376.0999120456 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1592027535578791 = (13863.810168115859 - 11656.653414548091) / 13863.810168115859 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Int32>.IndexOfAnyTwoValues(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.8508833549489467 < 6.618990338767117. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.24434717826768 (T) = (0 -3848.0794017792655) / Math.Sqrt((1628541.575039553 / (299)) + (671.6284770641612 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.17814352167973155 = (4682.17931389197 - 3848.0794017792655) / 4682.17931389197 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Int32>.IndexOfValue(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.106432512532177 < 3.302205709619043. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.639013084483995 (T) = (0 -2075.8830806200517) / Math.Sqrt((327784.2325342825 / (299)) + (806.7777714664556 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.14913511679744637 = (2439.732937157632 - 2075.8830806200517) / 2439.732937157632 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Int32>.SequenceEqual(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.4919755638871297 < 2.251849049036892. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 6.191015666106204 (T) = (0 -1498.0003273384582) / Math.Sqrt((141084.86277064472 / (299)) + (5878.541230875244 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11360670848357832 = (1689.9951090285363 - 1498.0003273384582) / 1689.9951090285363 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Int32>.LastIndexOfAnyValues(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 4.016304292526195 < 6.552697802201679. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.634713974967172 (T) = (0 -3812.352182835463) / Math.Sqrt((1565295.6091772795 / (299)) + (9448.114007968172 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.17795655825391718 = (4637.65293807069 - 3812.352182835463) / 4637.65293807069 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Int32>.GetPinnableReference(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 18.528550047606217 < 21.414757539720277. IsChangePoint: Marked as a change because one of 3/31/2022 5:34:47 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 48.587038085031615 (T) = (0 -18.429781745064236) / Math.Sqrt((0.39817680759281926 / (299)) + (0.043593676256418766 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.15665471507807696 = (21.85318644043936 - 18.429781745064236) / 21.85318644043936 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Int32>.ToArray(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 739.556746817453 < 842.4932906868254. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.327849580641008 (T) = (0 -739.5627966377614) / Math.Sqrt((3500.6790052629613 / (299)) + (125.76689579198548 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.05607974871039244 = (783.5013557844024 - 739.5627966377614) / 783.5013557844024 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Int32>.BinarySearch(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 288.0927468987403 < 430.15667345743805. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.0894126208672725 (T) = (0 -293.7879681169674) / Math.Sqrt((4850.168584261293 / (299)) + (72.72827670033251 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10225958089316521 = (327.2526911612804 - 293.7879681169674) / 327.2526911612804 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Int32>.SequenceCompareTo(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 27.289564425893378 < 33.90142039760423. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.230714842451041 (T) = (0 -27621.699375837237) / Math.Sqrt((9680516.50493515 / (299)) + (310776.4904310226 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.08937860570691891 = (30332.803016647846 - 27621.699375837237) / 30332.803016647846 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Int32>.StartsWith(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 787.3214368607357 < 1.2168447812943257. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 3.7938134117587894 (T) = (0 -810.6856689454639) / Math.Sqrt((49068.90882061284 / (299)) + (5244.693211513586 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10293121156540942 = (903.705133204035 - 810.6856689454639) / 903.705133204035 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Int32>.Fill(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.7120957278713176 < 2.6846996822736853. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.574025616562121 (T) = (0 -1700.9384004931608) / Math.Sqrt((193476.56968844833 / (299)) + (374.6554215605055 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.16172899435958893 = (2029.1032244324144 - 1700.9384004931608) / 2029.1032244324144 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in System.Collections.IterateForEachNonGeneric<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Queue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateForEachNonGeneric(Int32).Queue(Size%3a%20512).html>)	46.60 μs	36.97 μs	0.79	0.11	False
[ArrayList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateForEachNonGeneric(Int32).ArrayList(Size%3a%20512).html>)	36.67 μs	28.03 μs	0.76	0.08	False
[SortedList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateForEachNonGeneric(Int32).SortedList(Size%3a%20512).html>)	70.85 μs	57.81 μs	0.82	0.06	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.IterateForEachNonGeneric<Int32>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.IterateForEachNonGeneric<Int32>.Queue(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 36.96838866747183 < 44.24579286143543. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 16.845235006724767 (T) = (0 -36924.12185477892) / Math.Sqrt((12900615.191331739 / (299)) + (57506.001101321584 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.0911895003852872 = (40629.06609291241 - 36924.12185477892) / 40629.06609291241 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateForEachNonGeneric<Int32>.ArrayList(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 28.02543034920855 < 34.80254599917068. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.026253901405834 (T) = (0 -28303.701500195275) / Math.Sqrt((14548622.578393396 / (299)) + (153867.38184676546 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.0584987516072063 = (30062.30905005342 - 28303.701500195275) / 30062.30905005342 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateForEachNonGeneric<Int32>.SortedList(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 57.812982082032356 < 67.31603721883712. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 14.93241344202576 (T) = (0 -57921.81974538455) / Math.Sqrt((21874040.89922376 / (299)) + (354430.29223921726 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.07722520170029391 = (62769.18252656077 - 57921.81974538455) / 62769.18252656077 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Collections.IterateForEachNonGeneric<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Queue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateForEachNonGeneric(String).Queue(Size%3a%20512).html>)	46.50 μs	36.71 μs	0.79	0.12	False
[SortedList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateForEachNonGeneric(String).SortedList(Size%3a%20512).html>)	77.53 μs	57.92 μs	0.75	0.09	False
[Stack - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateForEachNonGeneric(String).Stack(Size%3a%20512).html>)	40.92 μs	31.93 μs	0.78	0.12	False
[ArrayList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateForEachNonGeneric(String).ArrayList(Size%3a%20512).html>)	36.75 μs	28.07 μs	0.76	0.11	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.IterateForEachNonGeneric<String>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.IterateForEachNonGeneric<String>.Queue(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 36.70999212636932 < 44.17481734409367. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 17.51818038538422 (T) = (0 -36812.38185831881) / Math.Sqrt((13534290.436713457 / (299)) + (41753.32195649274 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.09507593351405358 = (40680.07827581687 - 36812.38185831881) / 40680.07827581687 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateForEachNonGeneric<String>.SortedList(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 57.91595890432099 < 67.33208422216978. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 17.616227726443032 (T) = (0 -57633.19232218488) / Math.Sqrt((22835321.203754578 / (299)) + (192664.3318862389 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.08502568716746611 = (62988.86374609445 - 57633.19232218488) / 62988.86374609445 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateForEachNonGeneric<String>.Stack(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 31.92574601154107 < 38.87581252882698. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.243779288610227 (T) = (0 -31025.512101517957) / Math.Sqrt((19489772.98344223 / (299)) + (147706.51357345196 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.0770955241411237 = (33617.251744981404 - 31025.512101517957) / 33617.251744981404 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateForEachNonGeneric<String>.ArrayList(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 28.07118570466786 < 34.945951320941795. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.122973704403966 (T) = (0 -28182.925091569876) / Math.Sqrt((14178430.37183441 / (299)) + (102265.3373905235 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.06381986581392016 = (30104.169125605582 - 28182.925091569876) / 30104.169125605582 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in System.Hashing

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[GetStringHashCode - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Hashing.GetStringHashCode(BytesCount%3a%201000).html>)	2.00 μs	1.27 μs	0.64	0.05	False
[GetStringHashCode - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Hashing.GetStringHashCode(BytesCount%3a%2010000).html>)	19.28 μs	11.74 μs	0.61	0.08	False
[GetStringHashCode - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Hashing.GetStringHashCode(BytesCount%3a%20100).html>)	273.92 ns	184.33 ns	0.67	0.10	False
[GetStringHashCode - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Hashing.GetStringHashCode(BytesCount%3a%2010).html>)	91.19 ns	65.59 ns	0.72	0.20	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Hashing*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Hashing.GetStringHashCode(BytesCount: 1000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.273379757727286 < 1.936084921811741. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.153889311491298 (T) = (0 -1265.4439623502353) / Math.Sqrt((94532.75427136225 / (299)) + (190.22866629061355 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.13863978106963412 = (1469.1228298442425 - 1265.4439623502353) / 1469.1228298442425 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Hashing.GetStringHashCode(BytesCount: 10000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 11.741136932475422 < 18.3045368054206. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.70707999119403 (T) = (0 -11684.190870227792) / Math.Sqrt((8924068.24038982 / (299)) + (4150.5819781271775 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.15893653123859725 = (13892.163081859431 - 11684.190870227792) / 13892.163081859431 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Hashing.GetStringHashCode(BytesCount: 100) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 184.32868604907895 < 257.9070558125807. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.576450558605785 (T) = (0 -182.29852259014663) / Math.Sqrt((1515.5953296760363 / (299)) + (46.81677395284521 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11069689002030485 = (204.9903126891223 - 182.29852259014663) / 204.9903126891223 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Hashing.GetStringHashCode(BytesCount: 10) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 65.58780743028771 < 86.63942473681357. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 5.913081111725463 (T) = (0 -66.35944183910057) / Math.Sqrt((136.98532488931033 / (299)) + (8.514188099979059 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.0900082791200879 = (72.92312700925963 - 66.35944183910057) / 72.92312700925963 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.IO.Tests.StringReaderReadLineTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ReadLineAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadLineTests.ReadLineAsync(LineLengthRange%3a%20%5b%20%20%200%2c%201024%5d).html>)	187.44 μs	112.46 μs	0.60	0.02	False
[ReadLine - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadLineTests.ReadLine(LineLengthRange%3a%20%5b%20%2033%2c%20%20128%5d).html>)	245.82 μs	161.67 μs	0.66	0.06	False
[ReadLine - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadLineTests.ReadLine(LineLengthRange%3a%20%5b%20%20%209%2c%20%20%2032%5d).html>)	448.17 μs	336.28 μs	0.75	0.04	False
[ReadLineAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadLineTests.ReadLineAsync(LineLengthRange%3a%20%5b%20129%2c%201024%5d).html>)	187.25 μs	109.58 μs	0.59	0.04	False
[ReadLineAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadLineTests.ReadLineAsync(LineLengthRange%3a%20%5b%20%20%200%2c%20%20%20%200%5d).html>)	5.04 ms	3.78 ms	0.75	0.18	False
[ReadLine - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadLineTests.ReadLine(LineLengthRange%3a%20%5b%20%20%201%2c%20%20%20%201%5d).html>)	2.97 ms	2.41 ms	0.81	0.11	False
[ReadLineAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadLineTests.ReadLineAsync(LineLengthRange%3a%20%5b%20%20%201%2c%20%20%20%201%5d).html>)	4.14 ms	3.38 ms	0.82	0.07	False
[ReadLineAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadLineTests.ReadLineAsync(LineLengthRange%3a%20%5b%20%20%209%2c%20%20%2032%5d).html>)	562.97 μs	429.64 μs	0.76	0.02	False
[ReadLineAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadLineTests.ReadLineAsync(LineLengthRange%3a%20%5b%20%2033%2c%20%20128%5d).html>)	280.16 μs	189.90 μs	0.68	0.03	False
[ReadLineAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadLineTests.ReadLineAsync(LineLengthRange%3a%20%5b%20%20%201%2c%20%20%20%208%5d).html>)	1.82 ms	1.47 ms	0.81	0.04	False
[ReadLine - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadLineTests.ReadLine(LineLengthRange%3a%20%5b%20129%2c%201024%5d).html>)	182.57 μs	105.19 μs	0.58	0.06	False
[ReadLine - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadLineTests.ReadLine(LineLengthRange%3a%20%5b%20%20%201%2c%20%20%20%208%5d).html>)	1.31 ms	1.04 ms	0.80	0.06	False
[ReadLine - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadLineTests.ReadLine(LineLengthRange%3a%20%5b1025%2c%202048%5d).html>)	171.13 μs	95.58 μs	0.56	0.09	False
[ReadLine - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadLineTests.ReadLine(LineLengthRange%3a%20%5b%20%20%200%2c%20%20%20%200%5d).html>)	2.57 ms	2.12 ms	0.82	0.17	False
[ReadLineAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadLineTests.ReadLineAsync(LineLengthRange%3a%20%5b1025%2c%202048%5d).html>)	173.54 μs	98.14 μs	0.57	0.04	False
[ReadLine - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadLineTests.ReadLine(LineLengthRange%3a%20%5b%20%20%200%2c%201024%5d).html>)	181.51 μs	107.15 μs	0.59	0.04	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Tests.StringReaderReadLineTests*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.IO.Tests.StringReaderReadLineTests.ReadLineAsync(LineLengthRange: [ 0, 1024]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 112.46262598920862 < 178.07540924266584. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.819839606680837 (T) = (0 -111608.71914717801) / Math.Sqrt((982903875.1055061 / (299)) + (723562.5440871421 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.15065208771258484 = (131405.1845333908 - 111608.71914717801) / 131405.1845333908 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadLineTests.ReadLine(LineLengthRange: [ 33, 128]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 161.67223630798972 < 235.2995439453125. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.445719881983525 (T) = (0 -161710.066581597) / Math.Sqrt((1191806058.3394027 / (299)) + (2655928.743145431 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12677509734544976 = (185187.190711131 - 161710.066581597) / 185187.190711131 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadLineTests.ReadLine(LineLengthRange: [ 9, 32]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 336.2811910778985 < 426.7844471488499. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.086970090907261 (T) = (0 -335858.8053629621) / Math.Sqrt((1972452661.7656622 / (299)) + (7359592.436943133 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.09504982355042664 = (371135.13440115587 - 335858.8053629621) / 371135.13440115587 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadLineTests.ReadLineAsync(LineLengthRange: [ 129, 1024]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 109.58168842592595 < 177.68409636367167. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.229225221042373 (T) = (0 -110593.02131278919) / Math.Sqrt((1001369925.3650652 / (299)) + (3076790.6402944545 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.14939130707382306 = (130016.33093160429 - 110593.02131278919) / 130016.33093160429 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadLineTests.ReadLineAsync(LineLengthRange: [ 0, 0]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.7836815150000005 < 4.640833460259415. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 25.88499511481274 (T) = (0 -3813325.822763374) / Math.Sqrt((97539804868.42876 / (299)) + (2102244365.3047783 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.13194334486751697 = (4392945.783223542 - 3813325.822763374) / 4392945.783223542 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadLineTests.ReadLine(LineLengthRange: [ 1, 1]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.413249726403061 < 2.8119433991979164. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.64724978718166 (T) = (0 -2417494.613019867) / Math.Sqrt((40564958203.06645 / (299)) + (2307208748.093959 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.08218344844440896 = (2633962.7553267567 - 2417494.613019867) / 2633962.7553267567 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadLineTests.ReadLineAsync(LineLengthRange: [ 1, 1]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.382216611607143 < 3.9890238397460935. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.391028315837316 (T) = (0 -3482366.345607257) / Math.Sqrt((46669181676.58285 / (299)) + (7281612091.513566 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.08948487943816182 = (3824611.219480292 - 3482366.345607257) / 3824611.219480292 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadLineTests.ReadLineAsync(LineLengthRange: [ 9, 32]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 429.644321509009 < 537.3707040142747. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 17.546472824047243 (T) = (0 -431840.9951366685) / Math.Sqrt((1992215646.0817616 / (299)) + (28171959.094309364 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10870825022586456 = (484511.37940646533 - 431840.9951366685) / 484511.37940646533 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadLineTests.ReadLineAsync(LineLengthRange: [ 33, 128]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 189.90196792168678 < 264.7268553745039. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.017039629317205 (T) = (0 -188983.89916318536) / Math.Sqrt((1225652899.5822773 / (299)) + (1997868.4695327715 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12454203846598656 = (215868.616731796 - 188983.89916318536) / 215868.616731796 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadLineTests.ReadLineAsync(LineLengthRange: [ 1, 8]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.4742943527097905 < 1.719249425185185. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.160391284583524 (T) = (0 -1465898.7363342338) / Math.Sqrt((10091286774.543152 / (299)) + (1089606176.9955974 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.09375961833956208 = (1617560.600917358 - 1465898.7363342338) / 1617560.600917358 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadLineTests.ReadLine(LineLengthRange: [ 129, 1024]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 105.1935400447427 < 173.51842555959303. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.793471113618502 (T) = (0 -105524.93459289096) / Math.Sqrt((1049250698.4831623 / (299)) + (438451.08784324775 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1614968373972236 = (125849.17898858448 - 105524.93459289096) / 125849.17898858448 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadLineTests.ReadLine(LineLengthRange: [ 1, 8]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.042135421388889 < 1.2446847082919337. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.096980125177312 (T) = (0 -1058513.4162351193) / Math.Sqrt((8569356084.841122 / (299)) + (157183185.76824474 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.0687717360585769 = (1136685.2330651584 - 1058513.4162351193) / 1136685.2330651584 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadLineTests.ReadLine(LineLengthRange: [1025, 2048]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 95.57545851117885 < 163.03291867543348. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.843322251552726 (T) = (0 -95404.89454246477) / Math.Sqrt((1042740763.8779579 / (299)) + (83041.79288159571 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1752297159939824 = (115674.50524413981 - 95404.89454246477) / 115674.50524413981 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadLineTests.ReadLine(LineLengthRange: [ 0, 0]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.1157191484375 < 2.405986294802296. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 3.486037898441332 (T) = (0 -1940639.4169988914) / Math.Sqrt((69662358625.49506 / (299)) + (10047785871.997084 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.05550591355716066 = (2054686.6781429432 - 1940639.4169988914) / 2054686.6781429432 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadLineTests.ReadLineAsync(LineLengthRange: [1025, 2048]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 98.14232985677083 < 165.14540098346558. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.600540644128973 (T) = (0 -97834.01034538301) / Math.Sqrt((1029914888.660221 / (299)) + (61153.24003766966 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.16753008457438656 = (117522.57773227015 - 97834.01034538301) / 117522.57773227015 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadLineTests.ReadLine(LineLengthRange: [ 0, 1024]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 107.14850499429224 < 172.65789145441323. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.644861940903903 (T) = (0 -106529.05698978367) / Math.Sqrt((954937425.8286498 / (299)) + (542257.2756624711 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.15242398695452425 = (125686.72939080447 - 106529.05698978367) / 125686.72939080447 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in System.Memory.ReadOnlySequence

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Slice_Start_And_Length - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySequence.Slice_Start_And_Length(Segment%3a%20Multiple).html>)	181.43 ns	130.81 ns	0.72	0.21	False
[Slice_Repeat_StartPosition_And_EndPosition - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySequence.Slice_Repeat_StartPosition_And_EndPosition(Segment%3a%20Multiple).html>)	669.90 ns	466.38 ns	0.70	0.12	False
[Slice_Repeat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySequence.Slice_Repeat(Segment%3a%20Single).html>)	585.53 ns	396.33 ns	0.68	0.12	False
[Slice_Repeat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySequence.Slice_Repeat(Segment%3a%20Multiple).html>)	775.55 ns	571.39 ns	0.74	0.10	False
[Slice_Start_And_EndPosition - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySequence.Slice_Start_And_EndPosition(Segment%3a%20Single).html>)	125.23 ns	89.35 ns	0.71	0.21	False
[Slice_StartPosition_And_EndPosition - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySequence.Slice_StartPosition_And_EndPosition(Segment%3a%20Multiple).html>)	121.14 ns	82.35 ns	0.68	0.20	False
[Slice_Repeat_StartPosition_And_EndPosition - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySequence.Slice_Repeat_StartPosition_And_EndPosition(Segment%3a%20Single).html>)	510.46 ns	364.15 ns	0.71	0.13	False
[Slice_StartPosition_And_EndPosition - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySequence.Slice_StartPosition_And_EndPosition(Segment%3a%20Single).html>)	88.50 ns	62.90 ns	0.71	0.21	False
[Slice_StartPosition_And_Length - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySequence.Slice_StartPosition_And_Length(Segment%3a%20Multiple).html>)	161.16 ns	116.66 ns	0.72	0.13	False
[Slice_StartPosition_And_Length - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySequence.Slice_StartPosition_And_Length(Segment%3a%20Single).html>)	122.67 ns	92.26 ns	0.75	0.17	False
[Slice_StartPosition - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySequence.Slice_StartPosition(Segment%3a%20Single).html>)	88.59 ns	62.91 ns	0.71	0.19	False
[Slice_Start_And_EndPosition - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySequence.Slice_Start_And_EndPosition(Segment%3a%20Multiple).html>)	160.46 ns	118.64 ns	0.74	0.18	False
[Slice_Start_And_Length - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySequence.Slice_Start_And_Length(Segment%3a%20Single).html>)	111.95 ns	76.05 ns	0.68	0.11	False
[Slice_StartPosition - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySequence.Slice_StartPosition(Segment%3a%20Multiple).html>)	117.80 ns	79.50 ns	0.67	0.18	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Memory.ReadOnlySequence*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Memory.ReadOnlySequence.Slice_Start_And_Length(Segment: Multiple) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 130.81217730911533 < 172.9206128496517. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.7153132091018986 (T) = (0 -128.44159066075306) / Math.Sqrt((559.213982973136 / (299)) + (16.49575588308445 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.09931791593621658 = (142.60480244176506 - 128.44159066075306) / 142.60480244176506 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySequence.Slice_Repeat_StartPosition_And_EndPosition(Segment: Multiple) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 466.3813003460094 < 635.6433330857351. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.229070153371957 (T) = (0 -462.5890192507634) / Math.Sqrt((7819.6835726830595 / (299)) + (29.037059555795484 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10570512100864346 = (517.2667652670684 - 462.5890192507634) / 517.2667652670684 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySequence.Slice_Repeat(Segment: Single) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 396.3312160084871 < 533.3667102101283. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.534832414886928 (T) = (0 -398.6354952117122) / Math.Sqrt((5931.240599700658 / (299)) + (58.82447343801856 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.09702069795203258 = (441.4669243332625 - 398.6354952117122) / 441.4669243332625 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySequence.Slice_Repeat(Segment: Multiple) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 571.3872224080061 < 745.0621340287134. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.196257428053257 (T) = (0 -557.3784847578642) / Math.Sqrt((9046.727414272604 / (299)) + (264.8357155847447 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.08541612452983577 = (609.4339728779169 - 557.3784847578642) / 609.4339728779169 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySequence.Slice_Start_And_EndPosition(Segment: Single) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 89.34606979937551 < 117.9269484209806. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.083633249587804 (T) = (0 -90.70107401219929) / Math.Sqrt((189.2978189735926 / (299)) + (1.4495851868425913 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.10435616391523059 = (101.26913216830843 - 90.70107401219929) / 101.26913216830843 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySequence.Slice_StartPosition_And_EndPosition(Segment: Multiple) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 82.35446999048466 < 115.21437239960404. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.710983678616282 (T) = (0 -82.65602268333139) / Math.Sqrt((279.7967054260684 / (299)) + (1.4984475426025428 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10793678798872863 = (92.65713636702128 - 82.65602268333139) / 92.65713636702128 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySequence.Slice_Repeat_StartPosition_And_EndPosition(Segment: Single) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 364.15240668366573 < 485.14794098975955. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.449860609473687 (T) = (0 -359.7283530361164) / Math.Sqrt((3877.037503108922 / (299)) + (47.29834807928414 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10670385272901418 = (402.697754977545 - 359.7283530361164) / 402.697754977545 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySequence.Slice_StartPosition_And_EndPosition(Segment: Single) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 62.89668845758216 < 84.87729267583738. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 4.295265168062087 (T) = (0 -63.51964695263673) / Math.Sqrt((134.4332147971078 / (299)) + (13.934534151725265 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.08138129135824161 = (69.14691193972627 - 63.51964695263673) / 69.14691193972627 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySequence.Slice_StartPosition_And_Length(Segment: Multiple) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 116.66189988267301 < 154.97492655486317. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.461492245410476 (T) = (0 -116.82339176539837) / Math.Sqrt((346.97034248070895 / (299)) + (14.43679866294197 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1001944880093386 = (129.83182499843457 - 116.82339176539837) / 129.83182499843457 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySequence.Slice_StartPosition_And_Length(Segment: Single) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 92.2582695056501 < 116.96481634109385. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.811786622684908 (T) = (0 -90.99375892294542) / Math.Sqrt((180.7172916021627 / (299)) + (10.267132170819842 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.10721301423457001 = (101.92101853381298 - 90.99375892294542) / 101.92101853381298 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySequence.Slice_StartPosition(Segment: Single) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 62.91477541182964 < 84.18860177592605. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 4.210033362195131 (T) = (0 -62.761637378364185) / Math.Sqrt((141.50903137046407 / (299)) + (12.122023178635757 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.07765395067599466 = (68.04565100524113 - 62.761637378364185) / 68.04565100524113 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySequence.Slice_Start_And_EndPosition(Segment: Multiple) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 118.6408204403611 < 153.64547547996915. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.005947494690025 (T) = (0 -117.11735977930117) / Math.Sqrt((370.733149805078 / (299)) + (11.907935815094362 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.09266764543414313 = (129.07878705079335 - 117.11735977930117) / 129.07878705079335 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySequence.Slice_Start_And_Length(Segment: Single) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 76.04546889829099 < 105.58023914148869. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.24053610686621 (T) = (0 -76.49142565892484) / Math.Sqrt((221.82514227420367 / (299)) + (1.8304658591315188 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.10324562137179415 = (85.29807880719383 - 76.49142565892484) / 85.29807880719383 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySequence.Slice_StartPosition(Segment: Multiple) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 79.49641662910079 < 112.72172869314204. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.837959224088518 (T) = (0 -80.72050224604345) / Math.Sqrt((254.0483805190746 / (299)) + (1.8188886613295032 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.10936017911551728 = (90.63203817440026 - 80.72050224604345) / 90.63203817440026 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in System.IO.Tests.BinaryWriterExtendedTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[WriteAsciiCharArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.BinaryWriterExtendedTests.WriteAsciiCharArray(StringLengthInChars%3a%208000).html>)	71.08 μs	40.14 μs	0.56	0.14	False
[WriteAsciiString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.BinaryWriterExtendedTests.WriteAsciiString(StringLengthInChars%3a%202000000).html>)	25.81 ms	14.99 ms	0.58	0.15	False
[WriteAsciiString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.BinaryWriterExtendedTests.WriteAsciiString(StringLengthInChars%3a%2032).html>)	613.61 ns	415.40 ns	0.68	0.13	False
[WriteAsciiCharArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.BinaryWriterExtendedTests.WriteAsciiCharArray(StringLengthInChars%3a%2032).html>)	924.60 ns	659.68 ns	0.71	0.09	False
[WriteAsciiString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.BinaryWriterExtendedTests.WriteAsciiString(StringLengthInChars%3a%208000).html>)	71.14 μs	41.16 μs	0.58	0.08	False
[WriteAsciiCharArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.BinaryWriterExtendedTests.WriteAsciiCharArray(StringLengthInChars%3a%202000000).html>)	17.62 ms	9.98 ms	0.57	0.12	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Tests.BinaryWriterExtendedTests*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.IO.Tests.BinaryWriterExtendedTests.WriteAsciiCharArray(StringLengthInChars: 8000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 40.13720548076924 < 67.43721714658837. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.304385722464257 (T) = (0 -40089.73745826318) / Math.Sqrt((171119146.75561127 / (299)) + (2735.1107941198984 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.1628225173785877 = (47886.784212986924 - 40089.73745826318) / 47886.784212986924 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.BinaryWriterExtendedTests.WriteAsciiString(StringLengthInChars: 2000000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 14.98519560576923 < 24.518110141880342. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.123213195994415 (T) = (0 -15025162.140423466) / Math.Sqrt((20891759415474.99 / (299)) + (1039856215.3703396 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.1512586081515649 = (17702874.26150014 - 15025162.140423466) / 17702874.26150014 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.BinaryWriterExtendedTests.WriteAsciiString(StringLengthInChars: 32) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 415.40464498936814 < 581.2515374901756. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 4.5928225311055675 (T) = (0 -427.31168519012596) / Math.Sqrt((7607.124303363251 / (299)) + (281.2654744490981 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.07129310192831816 = (460.1146885819126 - 427.31168519012596) / 460.1146885819126 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.BinaryWriterExtendedTests.WriteAsciiCharArray(StringLengthInChars: 32) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 659.6752345573506 < 873.9313733675999. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.501051914523591 (T) = (0 -656.1938167298536) / Math.Sqrt((9737.755397415936 / (299)) + (244.71228306804784 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.10593004747572207 = (733.9401294911933 - 656.1938167298536) / 733.9401294911933 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.BinaryWriterExtendedTests.WriteAsciiString(StringLengthInChars: 8000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 41.16282679023279 < 67.5364577470238. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.505740540403753 (T) = (0 -40860.26388665734) / Math.Sqrt((167632388.78160948 / (299)) + (31581.19456166048 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.14864660046872746 = (47994.48021133606 - 40860.26388665734) / 47994.48021133606 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.BinaryWriterExtendedTests.WriteAsciiCharArray(StringLengthInChars: 2000000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 9.981298683333334 < 16.73530604896978. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.082383223451997 (T) = (0 -9948864.77209535) / Math.Sqrt((10684664155877.543 / (299)) + (1076037890.2655766 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.16094240896140735 = (11857189.397190914 - 9948864.77209535) / 11857189.397190914 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in System.Memory.ReadOnlySpan

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Trim - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySpan.Trim(input%3a%20%22abcdefg%22).html>)	213.68 ns	152.53 ns	0.71	0.19	False
[Trim - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySpan.Trim(input%3a%20%22%20abcdefg%20%22).html>)	356.28 ns	256.44 ns	0.72	0.11	False
[IndexOfString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySpan.IndexOfString(input%3a%20%22AAAAA5AAAA%22%2c%20value%3a%20%225%22%2c%20comparisonType%3a%20InvariantCulture).html>)	634.71 ns	378.65 ns	0.60	0.06	False
[IndexOfString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySpan.IndexOfString(input%3a%20%22string1%22%2c%20value%3a%20%22string2%22%2c%20comparisonType%3a%20InvariantCulture).html>)	719.26 ns	452.16 ns	0.63	0.11	False
[IndexOfString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySpan.IndexOfString(input%3a%20%22StrIng%22%2c%20value%3a%20%22string%22%2c%20comparisonType%3a%20OrdinalIgnoreCase).html>)	241.95 ns	164.39 ns	0.68	0.26	False
[IndexOfString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySpan.IndexOfString(input%3a%20%22foobardzsdzs%22%2c%20value%3a%20%22rddzs%22%2c%20comparisonType%3a%20InvariantCulture).html>)	943.83 ns	580.94 ns	0.62	0.12	False
[IndexOfString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySpan.IndexOfString(input%3a%20%22%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%99%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%22%2c%20value%3a%20%22%e3%81%99%22%2c%20comparisonType%3a%20Ordinal).html>)	428.30 ns	270.69 ns	0.63	0.07	False
[GetPinnableReference - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySpan.GetPinnableReference.html>)	17.38 ns	16.22 ns	0.93	0.13	False
[IndexOfString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySpan.IndexOfString(input%3a%20%22Hello%20Worldbbbbbbbbbbbbbbcbbbbbbbbbbbbbbbbbbba!%22%2c%20value%3a%20%22y%22%2c%20comparisonType%3a%20Ordinal).html>)	418.17 ns	263.76 ns	0.63	0.06	False
[IndexOfString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySpan.IndexOfString(input%3a%20%22Hello%20WorldbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbareallyreallylongHello%20WorldbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbareallyreallylongHello%20Worldbbbbbbbbbbbbbbbbbb.html>)	1.36 μs	806.27 ns	0.59	0.05	False
[IndexOfString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySpan.IndexOfString(input%3a%20%22%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0.html>)	3.37 μs	1.94 μs	0.58	0.07	False
[IndexOfString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySpan.IndexOfString(input%3a%20%22ABCDE%22%2c%20value%3a%20%22c%22%2c%20comparisonType%3a%20InvariantCultureIgnoreCase).html>)	518.61 ns	349.28 ns	0.67	0.10	False
[IndexOfString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySpan.IndexOfString(input%3a%20%22AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA.html>)	3.32 μs	1.94 μs	0.58	0.07	False
[Trim - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.ReadOnlySpan.Trim(input%3a%20%22%22).html>)	75.18 ns	50.78 ns	0.68	0.26	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Memory.ReadOnlySpan*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Memory.ReadOnlySpan.Trim(input: "abcdefg") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 152.527691912346 < 202.9753348188175. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 5.771169499721104 (T) = (0 -158.90772389761943) / Math.Sqrt((576.3360127046182 / (299)) + (57.0990539345471 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.08833713578336642 = (174.305360166408 - 158.90772389761943) / 174.305360166408 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySpan.Trim(input: " abcdefg ") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 256.44216474735197 < 340.61685576000053. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.093531068467655 (T) = (0 -260.4183063109488) / Math.Sqrt((1394.7828870150377 / (299)) + (30.557898669914913 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.11244624013346581 = (293.41130429114423 - 260.4183063109488) / 293.41130429114423 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySpan.IndexOfString(input: "AAAAA5AAAA", value: "5", comparisonType: InvariantCulture) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 378.65245247547125 < 571.8214827004971. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.13604722124814 (T) = (0 -372.9126693243342) / Math.Sqrt((8510.911759021034 / (299)) + (44.60643065474404 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.14551327928388447 = (436.4171616520958 - 372.9126693243342) / 436.4171616520958 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySpan.IndexOfString(input: "string1", value: "string2", comparisonType: InvariantCulture) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 452.16290965637535 < 682.0361582200543. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.074478660510833 (T) = (0 -453.042734080207) / Math.Sqrt((12331.280511252222 / (299)) + (112.7842696070263 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.13662537972109717 = (524.7348293998461 - 453.042734080207) / 524.7348293998461 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySpan.IndexOfString(input: "StrIng", value: "string", comparisonType: OrdinalIgnoreCase) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 164.39483123466087 < 217.34474356894037. IsChangePoint: Marked as a change because one of 4/9/2022 5:43:54 AM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 5.5225393327543335 (T) = (0 -162.23588869131947) / Math.Sqrt((1065.9696711531567 / (299)) + (13.659472201778039 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.06874877219669209 = (174.21280514605212 - 162.23588869131947) / 174.21280514605212 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySpan.IndexOfString(input: "foobardzsdzs", value: "rddzs", comparisonType: InvariantCulture) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 580.9432265795293 < 889.8489719068939. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.079720799070763 (T) = (0 -577.3156761242805) / Math.Sqrt((20126.829811751166 / (299)) + (213.23848880956507 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.15160719450393406 = (680.4815792688349 - 577.3156761242805) / 680.4815792688349 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySpan.IndexOfString(input: "だだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだすだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだ", value: "す", comparisonType: Ordinal) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 270.6907460930089 < 403.6718336946174. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.899327133176952 (T) = (0 -263.4463397336697) / Math.Sqrt((4059.99974232576 / (299)) + (6.792541533123299 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.14520688059976164 = (308.1989475050005 - 263.4463397336697) / 308.1989475050005 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySpan.GetPinnableReference ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 16.21807392832182 < 16.500947254994635. IsChangePoint: Marked as a change because one of 3/31/2022 5:34:47 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.829171949556478 (T) = (0 -14.13032589463491) / Math.Sqrt((0.8301736294236337 / (299)) + (0.47993852949829824 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11443639702600591 = (15.956308329724644 - 14.13032589463491) / 15.956308329724644 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySpan.IndexOfString(input: "Hello Worldbbbbbbbbbbbbbbcbbbbbbbbbbbbbbbbbbba!", value: "y", comparisonType: Ordinal) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 263.75777179712026 < 397.18467230900563. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.193582374745626 (T) = (0 -264.73360071942335) / Math.Sqrt((4049.17304129245 / (299)) + (5.439818797555775 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12591280195234025 = (302.8686397772739 - 264.73360071942335) / 302.8686397772739 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySpan.IndexOfString(input: "Hello WorldbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbareallyreallylongHello WorldbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbareallyreallylongHello Worldbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbareallyreallylong!xyz", value: "~", comparisonType: Ordinal) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 806.2736170296718 < 1.2938372827140152. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 6.9430904727399625 (T) = (0 -809.012607456469) / Math.Sqrt((54236.483314014375 / (299)) + (1458.0238765268257 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1299529809751408 = (929.849295229128 - 809.012607456469) / 929.849295229128 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySpan.IndexOfString(input: "だだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだxだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだ", value: "x", comparisonType: Ordinal) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.9413617801112444 < 3.1913082908352917. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.786013587764074 (T) = (0 -1994.3217397931191) / Math.Sqrt((321633.801903642 / (299)) + (4082.2315591740867 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.14352204992077014 = (2328.514983495642 - 1994.3217397931191) / 2328.514983495642 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySpan.IndexOfString(input: "ABCDE", value: "c", comparisonType: InvariantCultureIgnoreCase) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 349.27841302398315 < 489.17555180964666. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 3.376795601348325 (T) = (0 -340.22620146373225) / Math.Sqrt((7798.05877275837 / (299)) + (31.44069657913061 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.05048736052378792 = (358.3166640640131 - 340.22620146373225) / 358.3166640640131 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySpan.IndexOfString(input: "AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAXAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA", value: "X", comparisonType: Ordinal) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.9391763747300559 < 3.154129256568552. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.9968726025374 (T) = (0 -1990.5919916285632) / Math.Sqrt((320700.1687576001 / (299)) + (1134.076887266536 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.14690099709389193 = (2333.365746352475 - 1990.5919916285632) / 2333.365746352475 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.ReadOnlySpan.Trim(input: "") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 50.78082589809431 < 71.43235135313908. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 3.870177157355106 (T) = (0 -52.484569227976316) / Math.Sqrt((106.14176302207812 / (299)) + (13.755275297286152 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.08286318073080737 = (57.22654256733242 - 52.484569227976316) / 57.22654256733242 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in StoreBlock.AnyLocation

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[CopyBlock8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/StoreBlock.AnyLocation.CopyBlock8.html>)	14.41 ns	10.11 ns	0.70	0.09	False
[InitBlockAllZeros16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/StoreBlock.AnyLocation.InitBlockAllZeros16.html>)	11.91 ns	7.57 ns	0.64	0.05	False
[InitBlockAllOnes8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/StoreBlock.AnyLocation.InitBlockAllOnes8.html>)	11.72 ns	7.96 ns	0.68	0.06	False
[InitBlockAllZeros32 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/StoreBlock.AnyLocation.InitBlockAllZeros32.html>)	11.97 ns	7.58 ns	0.63	0.10	False
[CopyBlock64 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/StoreBlock.AnyLocation.CopyBlock64.html>)	14.99 ns	10.27 ns	0.69	0.07	False
[CopyBlock16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/StoreBlock.AnyLocation.CopyBlock16.html>)	14.70 ns	10.10 ns	0.69	0.08	False
[InitBlockAllOnes32 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/StoreBlock.AnyLocation.InitBlockAllOnes32.html>)	11.98 ns	8.22 ns	0.69	0.05	False
[CopyBlock128 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/StoreBlock.AnyLocation.CopyBlock128.html>)	17.84 ns	12.48 ns	0.70	0.08	False
[InitBlockAllOnes16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/StoreBlock.AnyLocation.InitBlockAllOnes16.html>)	11.91 ns	8.26 ns	0.69	0.10	False
[CopyBlock32 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/StoreBlock.AnyLocation.CopyBlock32.html>)	14.89 ns	10.18 ns	0.68	0.07	False
[InitBlockAllOnes64 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/StoreBlock.AnyLocation.InitBlockAllOnes64.html>)	12.24 ns	8.28 ns	0.68	0.07	False
[InitBlockAllZeros64 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/StoreBlock.AnyLocation.InitBlockAllZeros64.html>)	12.21 ns	7.98 ns	0.65	0.10	False
[InitBlockAllZeros8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/StoreBlock.AnyLocation.InitBlockAllZeros8.html>)	11.58 ns	7.99 ns	0.69	0.09	False
[InitBlockAllZeros128 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/StoreBlock.AnyLocation.InitBlockAllZeros128.html>)	12.56 ns	8.60 ns	0.68	0.14	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'StoreBlock.AnyLocation*'

### Payloads [Baseline]() [Compare]() ### Histogram #### StoreBlock.AnyLocation.CopyBlock8 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 10.11343286879399 < 13.783461684704921. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 6.582073231684671 (T) = (0 -9.753613701714714) / Math.Sqrt((4.412001918249003 / (299)) + (0.09041325279416018 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.09279657046931376 = (10.751297210990975 - 9.753613701714714) / 10.751297210990975 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.InitBlockAllZeros16 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 7.572735976122497 < 11.299847548688975. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.50582929827263 (T) = (0 -7.798079202572459) / Math.Sqrt((3.406103922869509 / (299)) + (0.012551216536071415 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.0969385267853301 = (8.635158772539896 - 7.798079202572459) / 8.635158772539896 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.InitBlockAllOnes8 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 7.963798599254554 < 11.14033469057004. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 4.544849800201153 (T) = (0 -8.024766837523428) / Math.Sqrt((3.3165220070051045 / (299)) + (0.008799671691125006 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.058014730290816 = (8.518993975352595 - 8.024766837523428) / 8.518993975352595 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.InitBlockAllZeros32 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 7.576439197024949 < 11.367380472848218. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 5.647493378156336 (T) = (0 -7.7565428118445725) / Math.Sqrt((3.2482425925860126 / (299)) + (0.21800541248292377 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11036445086466656 = (8.718786945264739 - 7.7565428118445725) / 8.718786945264739 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.CopyBlock64 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 10.273154981639738 < 14.21513448493031. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.37355485041219 (T) = (0 -10.310909827089368) / Math.Sqrt((4.355275962834452 / (299)) + (0.003811654567425869 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.09022452087691725 = (11.333466403192006 - 10.310909827089368) / 11.333466403192006 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.CopyBlock16 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 10.098559523021994 < 14.115345342128302. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.3221944963996135 (T) = (0 -10.077086537851365) / Math.Sqrt((4.552298560913211 / (299)) + (0.0099680420092894 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.08430838935100937 = (11.004891188977142 - 10.077086537851365) / 11.004891188977142 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.InitBlockAllOnes32 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 8.215369619389394 < 11.372543281825093. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 5.954543080903357 (T) = (0 -8.236857213339412) / Math.Sqrt((3.093321337027683 / (299)) + (0.014918238145666679 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.07220343004892903 = (8.877869869441097 - 8.236857213339412) / 8.877869869441097 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.CopyBlock128 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 12.477129997138652 < 16.861347062298957. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.06346900770292 (T) = (0 -12.550430388689792) / Math.Sqrt((4.231245318946648 / (299)) + (0.010396364569737861 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11312620780360601 = (14.151314988807966 - 12.550430388689792) / 14.151314988807966 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.InitBlockAllOnes16 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 8.262901190721808 < 11.31016342338446. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 4.515319789405354 (T) = (0 -8.253146914940093) / Math.Sqrt((3.0987349868805545 / (299)) + (0.051657178038523585 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.06291539122203088 = (8.80725906458205 - 8.253146914940093) / 8.80725906458205 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.CopyBlock32 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 10.176399319189867 < 14.11817745885776. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.275779028362598 (T) = (0 -10.218827123252652) / Math.Sqrt((4.53543184574553 / (299)) + (0.0207387228494122 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.08471106059797724 = (11.164591511319719 - 10.218827123252652) / 11.164591511319719 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.InitBlockAllOnes64 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 8.275070453570505 < 11.488786363421081. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 6.875750758528009 (T) = (0 -8.32718209381727) / Math.Sqrt((3.09844850793693 / (299)) + (0.00655104483351975 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.0793928517161474 = (9.045315484830162 - 8.32718209381727) / 9.045315484830162 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.InitBlockAllZeros64 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 7.981447193132786 < 11.544340205736818. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.39386008004621 (T) = (0 -7.7457387366569925) / Math.Sqrt((3.5162966494089667 / (299)) + (0.005964870957387205 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1293468697707983 = (8.896469176671893 - 7.7457387366569925) / 8.896469176671893 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.InitBlockAllZeros8 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 7.993492580324216 < 11.01296673885462. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 5.389408264898664 (T) = (0 -7.986504662792806) / Math.Sqrt((2.925335244468344 / (299)) + (0.0008427241854703071 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.0628003987548925 = (8.521668865610284 - 7.986504662792806) / 8.521668865610284 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.InitBlockAllZeros128 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 8.596528995476712 < 11.92591924536792. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 6.319750204606075 (T) = (0 -8.64114418415677) / Math.Sqrt((3.3084948036213775 / (299)) + (0.06264670912796642 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.08536511431578164 = (9.447643337693728 - 8.64114418415677) / 9.447643337693728 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Text.Json.Tests.Perf_Depth

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ReadSpanEmptyLoop - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Depth.ReadSpanEmptyLoop(Depth%3a%201).html>)	1.57 μs	1.15 μs	0.73	0.05	False
[ReadSpanEmptyLoop - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Depth.ReadSpanEmptyLoop(Depth%3a%20512).html>)	462.75 μs	311.31 μs	0.67	0.09	False
[ReadSpanEmptyLoop - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Depth.ReadSpanEmptyLoop(Depth%3a%2065).html>)	53.63 μs	36.30 μs	0.68	0.08	False
[ReadSpanEmptyLoop - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Depth.ReadSpanEmptyLoop(Depth%3a%2064).html>)	52.62 μs	35.81 μs	0.68	0.07	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Tests.Perf_Depth*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Tests.Perf_Depth.ReadSpanEmptyLoop(Depth: 1) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.1459609276997003 < 1.5320154687047087. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.141094332613281 (T) = (0 -1149.2495484670526) / Math.Sqrt((40152.76081638536 / (299)) + (306.89066822158685 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.07284171810379328 = (1239.539753791153 - 1149.2495484670526) / 1239.539753791153 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Depth.ReadSpanEmptyLoop(Depth: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 311.3108996040724 < 435.81663139399507. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.386353248742432 (T) = (0 -318582.32502206595) / Math.Sqrt((3881228282.69339 / (299)) + (25946479.039015844 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.08275571296918348 = (347325.4939023268 - 318582.32502206595) / 347325.4939023268 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Depth.ReadSpanEmptyLoop(Depth: 65) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 36.300578917384826 < 51.116298400560886. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.492943362939965 (T) = (0 -37301.59845347542) / Math.Sqrt((57391139.78981055 / (299)) + (273709.3096567545 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.08516068827901441 = (40773.934805342 - 37301.59845347542) / 40773.934805342 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Depth.ReadSpanEmptyLoop(Depth: 64) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 35.80709879753184 < 50.183526596589424. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.147767702366169 (T) = (0 -36724.82952256304) / Math.Sqrt((54735820.11318617 / (299)) + (316604.7270560044 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.08178812933906442 = (39996.02999700738 - 36724.82952256304) / 39996.02999700738 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Memory.Constructors<Byte>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ReadOnlySpanFromMemory - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Constructors(Byte).ReadOnlySpanFromMemory.html>)	43.38 ns	25.38 ns	0.59	0.22	False
[SpanImplicitCastFromArraySegment - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Constructors(Byte).SpanImplicitCastFromArraySegment.html>)	50.57 ns	34.67 ns	0.69	0.18	False
[ReadOnlyMemoryFromArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Constructors(Byte).ReadOnlyMemoryFromArray.html>)	19.82 ns	15.04 ns	0.76	0.33	False
[MemoryFromArrayStartLength - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Constructors(Byte).MemoryFromArrayStartLength.html>)	29.36 ns	20.00 ns	0.68	0.31	False
[SpanFromArrayStartLength - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Constructors(Byte).SpanFromArrayStartLength.html>)	31.63 ns	20.86 ns	0.66	0.23	False
[ReadOnlySpanImplicitCastFromSpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Constructors(Byte).ReadOnlySpanImplicitCastFromSpan.html>)	26.57 ns	20.37 ns	0.77	0.34	False
[ArrayAsMemoryStartLength - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Constructors(Byte).ArrayAsMemoryStartLength.html>)	30.11 ns	21.00 ns	0.70	0.31	False
[SpanFromMemory - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Constructors(Byte).SpanFromMemory.html>)	41.28 ns	25.77 ns	0.62	0.22	False
[MemoryFromArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Constructors(Byte).MemoryFromArray.html>)	19.73 ns	14.35 ns	0.73	0.42	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Memory.Constructors<Byte>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Memory.Constructors<Byte>.ReadOnlySpanFromMemory ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 25.38062335470162 < 39.407279712999895. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 5.953439551548378 (T) = (0 -26.009147174555874) / Math.Sqrt((54.28424954076112 / (299)) + (0.2794926474856918 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.09387330275624829 = (28.703653974295506 - 26.009147174555874) / 28.703653974295506 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Constructors<Byte>.SpanImplicitCastFromArraySegment ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 34.67063208141456 < 47.58481198634728. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 5.776029898281143 (T) = (0 -34.45511630272435) / Math.Sqrt((54.241242963020085 / (299)) + (0.4297458075074167 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.07297100399740976 = (37.16724768189244 - 34.45511630272435) / 37.16724768189244 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Constructors<Byte>.ReadOnlyMemoryFromArray ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 15.036198193964294 < 18.883205454661688. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 5.279065454426893 (T) = (0 -14.4797422534332) / Math.Sqrt((8.666195308574668 / (299)) + (0.08814376754899492 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.06553065836050899 = (15.495149608684905 - 14.4797422534332) / 15.495149608684905 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Constructors<Byte>.MemoryFromArrayStartLength ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 19.9997742781222 < 28.16606508620714. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.076510197227277 (T) = (0 -19.57950608494485) / Math.Sqrt((20.557429864861234 / (299)) + (0.06570845180977813 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.08964327546549732 = (21.5075097017123 - 19.57950608494485) / 21.5075097017123 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Constructors<Byte>.SpanFromArrayStartLength ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 20.85502579049069 < 29.997273154132895. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 3.5865737019153325 (T) = (0 -20.909796383731347) / Math.Sqrt((30.604400386158307 / (299)) + (0.09927049455595191 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.054145074926896734 = (22.106769050354387 - 20.909796383731347) / 22.106769050354387 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Constructors<Byte>.ReadOnlySpanImplicitCastFromSpan ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 20.37358022435194 < 24.426193522051793. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 5.335022098653971 (T) = (0 -20.629466434570624) / Math.Sqrt((5.0788831140888036 / (299)) + (0.6796482890880007 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.06767128663954936 = (22.126816581905484 - 20.629466434570624) / 22.126816581905484 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Constructors<Byte>.ArrayAsMemoryStartLength ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 20.996306312438154 < 27.70740395976374. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 2.682943973486714 (T) = (0 -20.256953311759816) / Math.Sqrt((20.40867401700559 / (299)) + (1.3570241869080966 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.05338971900191113 = (21.399464719949215 - 20.256953311759816) / 21.399464719949215 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Constructors<Byte>.SpanFromMemory ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 25.76809786547312 < 39.637251546055275. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 5.3459825482510155 (T) = (0 -26.058200430799555) / Math.Sqrt((52.50289740073382 / (299)) + (0.626313122060507 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.08918250153426549 = (28.609683580623347 - 26.058200430799555) / 28.609683580623347 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Constructors<Byte>.MemoryFromArray ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 14.34770045589289 < 18.860697554435728. IsChangePoint: Marked as a change because one of 5/25/2022 12:28:02 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 3.6976811651139108 (T) = (0 -14.61818004443395) / Math.Sqrt((7.905853245780231 / (299)) + (0.3091498739663679 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.0546367142141011 = (15.463029148928259 - 14.61818004443395) / 15.463029148928259 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Text.Json.Tests.Perf_Deep

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[WriteDeepUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Deep.WriteDeepUtf16(Formatted%3a%20False%2c%20SkipValidation%3a%20False).html>)	122.17 ms	85.82 ms	0.70	0.03	False
[WriteDeepUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Deep.WriteDeepUtf8(Formatted%3a%20True%2c%20SkipValidation%3a%20False).html>)	156.60 ms	117.16 ms	0.75	0.03	False
[WriteDeepUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Deep.WriteDeepUtf8(Formatted%3a%20False%2c%20SkipValidation%3a%20False).html>)	117.79 ms	85.13 ms	0.72	0.02	False
[WriteDeepUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Deep.WriteDeepUtf8(Formatted%3a%20False%2c%20SkipValidation%3a%20True).html>)	114.75 ms	80.92 ms	0.71	0.02	False
[WriteDeepUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Deep.WriteDeepUtf16(Formatted%3a%20True%2c%20SkipValidation%3a%20True).html>)	149.05 ms	110.62 ms	0.74	0.03	False
[WriteDeepUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Deep.WriteDeepUtf8(Formatted%3a%20True%2c%20SkipValidation%3a%20True).html>)	151.07 ms	113.43 ms	0.75	0.02	False
[WriteDeepUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Deep.WriteDeepUtf16(Formatted%3a%20False%2c%20SkipValidation%3a%20True).html>)	111.78 ms	81.52 ms	0.73	0.03	False
[WriteDeepUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Deep.WriteDeepUtf16(Formatted%3a%20True%2c%20SkipValidation%3a%20False).html>)	155.89 ms	117.74 ms	0.76	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Tests.Perf_Deep*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Tests.Perf_Deep.WriteDeepUtf16(Formatted: False, SkipValidation: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 85.81969671666667 < 111.71795140416667. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.664319505056008 (T) = (0 -85327330.46468256) / Math.Sqrt((195316387052009.9 / (299)) + (877407821377.8988 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.08803106416573235 = (93563856.30243564 - 85327330.46468256) / 93563856.30243564 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Deep.WriteDeepUtf8(Formatted: True, SkipValidation: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 117.15602053333333 < 148.0210342443452. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.022248362909021 (T) = (0 -115155089.86646824) / Math.Sqrt((310698208681659.6 / (299)) + (1829491839238.3696 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.0867617129568528 = (126095337.32900488 - 115155089.86646824) / 126095337.32900488 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Deep.WriteDeepUtf8(Formatted: False, SkipValidation: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 85.13480367857143 < 111.6420350980357. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.131296973545131 (T) = (0 -85077136.78819446) / Math.Sqrt((194437447725622.7 / (299)) + (612783184629.6647 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.09068516574003353 = (93561804.53982513 - 85077136.78819446) / 93561804.53982513 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Deep.WriteDeepUtf8(Formatted: False, SkipValidation: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 80.92112005357143 < 107.49323946416666. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.053006663945768 (T) = (0 -81038112.72634864) / Math.Sqrt((184529600969306.5 / (299)) + (1323132395227.183 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.08753528108480467 = (88812324.5167141 - 81038112.72634864) / 88812324.5167141 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Deep.WriteDeepUtf16(Formatted: True, SkipValidation: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 110.62482033333333 < 141.7137576275. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.813935233270872 (T) = (0 -110554840.04638694) / Math.Sqrt((266344046033222 / (299)) + (3171443444177.1006 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.08791727228133134 = (121211417.21750432 - 110554840.04638694) / 121211417.21750432 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Deep.WriteDeepUtf8(Formatted: True, SkipValidation: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 113.42927821428572 < 143.4109139916667. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.155295897609566 (T) = (0 -110817491.82402597) / Math.Sqrt((267424642142054.75 / (299)) + (2089914877262.2063 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.08711499252123732 = (121392607.95846078 - 110817491.82402597) / 121392607.95846078 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Deep.WriteDeepUtf16(Formatted: False, SkipValidation: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 81.51947538333334 < 107.41564415178571. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.756511513883131 (T) = (0 -81173559.70587744) / Math.Sqrt((182977627556485.62 / (299)) + (1294975173555.1167 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.08437316453653651 = (88653539.36987852 - 81173559.70587744) / 88653539.36987852 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Deep.WriteDeepUtf16(Formatted: True, SkipValidation: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 117.73825136666666 < 147.8310909763095. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.220708201429975 (T) = (0 -115269193.69940473) / Math.Sqrt((285801672434781.5 / (299)) + (3665926027517.6567 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.08243402765940512 = (125624965.58734363 - 115269193.69940473) / 125624965.58734363 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in Benchstone.MDBenchI.MDAddArray2

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Test - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Benchstone.MDBenchI.MDAddArray2.Test.html>)	206.25 ms	151.36 ms	0.73	0.13	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Benchstone.MDBenchI.MDAddArray2*'

### Payloads [Baseline]() [Compare]() ### Histogram #### Benchstone.MDBenchI.MDAddArray2.Test ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 151.361045 < 195.78051798076925. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.110660002391308 (T) = (0 -151419010.0147186) / Math.Sqrt((569990485515743 / (299)) + (122857813194.7201 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.09223574626897539 = (166804332.06349283 - 151419010.0147186) / 166804332.06349283 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in System.Collections.CtorDefaultSize<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CtorDefaultSize(String).Dictionary.html>)	88.61 ns	77.13 ns	0.87	0.14	False
[HashSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CtorDefaultSize(String).HashSet.html>)	81.40 ns	73.22 ns	0.90	0.16	False
[ConcurrentBag - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CtorDefaultSize(String).ConcurrentBag.html>)	3.14 μs	2.51 μs	0.80	0.46	False
[ConcurrentQueue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CtorDefaultSize(String).ConcurrentQueue.html>)	669.65 ns	506.10 ns	0.76	0.06	False
[SortedList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CtorDefaultSize(String).SortedList.html>)	66.91 ns	60.93 ns	0.91	0.22	False
[SortedDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CtorDefaultSize(String).SortedDictionary.html>)	161.84 ns	146.09 ns	0.90	0.12	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.CtorDefaultSize<String>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.CtorDefaultSize<String>.Dictionary ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 77.12550064014638 < 84.86260182919352. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.369929063542541 (T) = (0 -77.74835978649489) / Math.Sqrt((14.571309928686073 / (299)) + (2.3679750878126162 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.08118420192900175 = (84.61800499047052 - 77.74835978649489) / 84.61800499047052 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CtorDefaultSize<String>.HashSet ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 73.22358513910774 < 76.42997368189839. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 15.428347454700019 (T) = (0 -72.98827210830925) / Math.Sqrt((7.107075005334608 / (299)) + (1.3209458518295247 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.0717831036895055 = (78.6327768848265 - 72.98827210830925) / 78.6327768848265 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CtorDefaultSize<String>.ConcurrentBag ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.5131879853917662 < 2.947685348544714. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 3.6943811582173622 (T) = (0 -2445.731517502441) / Math.Sqrt((104216.48325266055 / (299)) + (29078.529202566147 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.07366777816918516 = (2640.2315064336917 - 2445.731517502441) / 2640.2315064336917 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CtorDefaultSize<String>.ConcurrentQueue ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 506.10054228146663 < 626.4245043352465. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.993640855413296 (T) = (0 -501.12029318409503) / Math.Sqrt((4443.032667062912 / (299)) + (105.26713475145151 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.0719642324199097 = (539.979503689601 - 501.12029318409503) / 539.979503689601 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CtorDefaultSize<String>.SortedList ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 60.92505692025181 < 64.8183695338696. IsChangePoint: Marked as a change because one of 6/5/2022 9:07:46 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.918568797401816 (T) = (0 -62.33701451632972) / Math.Sqrt((5.515019007709819 / (299)) + (1.7524033625259325 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.06876818315162175 = (66.94038303727689 - 62.33701451632972) / 66.94038303727689 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CtorDefaultSize<String>.SortedDictionary ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 146.09439806087946 < 154.20116258546594. IsChangePoint: Marked as a change because one of 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.328139244913492 (T) = (0 -149.05206489960534) / Math.Sqrt((13.754393836658199 / (299)) + (12.36941054839406 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.08491019650038867 = (162.88244533987822 - 149.05206489960534) / 162.88244533987822 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Diagnostics.Perf_Activity

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ActivityAllocations - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Diagnostics.Perf_Activity.ActivityAllocations(idFormat%3a%20W3C).html>)	3.82 μs	2.81 μs	0.73	0.06	False
[EnumerateActivityTagObjectsSmall - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Diagnostics.Perf_Activity.EnumerateActivityTagObjectsSmall.html>)	320.42 ns	282.68 ns	0.88	0.10	False
[EnumerateActivityTagsSmall - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Diagnostics.Perf_Activity.EnumerateActivityTagsSmall.html>)	454.82 ns	379.69 ns	0.83	0.06	False
[EnumerateActivityLinksSmall - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Diagnostics.Perf_Activity.EnumerateActivityLinksSmall.html>)	320.63 ns	287.46 ns	0.90	0.09	False
[ActivityAllocations - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Diagnostics.Perf_Activity.ActivityAllocations(idFormat%3a%20Hierarchical).html>)	2.39 μs	2.03 μs	0.85	0.03	False
[EnumerateActivityTagsLarge - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Diagnostics.Perf_Activity.EnumerateActivityTagsLarge.html>)	63.97 μs	51.65 μs	0.81	0.12	False
[EnumerateActivityEventsSmall - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Diagnostics.Perf_Activity.EnumerateActivityEventsSmall.html>)	325.68 ns	285.94 ns	0.88	0.08	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Diagnostics.Perf_Activity*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Diagnostics.Perf_Activity.ActivityAllocations(idFormat: W3C) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.8070205513671986 < 3.638988574682166. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.075386257938064 (T) = (0 -2803.5204818542657) / Math.Sqrt((152614.7591226533 / (299)) + (1410.4359841692103 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10464313330696796 = (3131.176613643414 - 2803.5204818542657) / 3131.176613643414 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Diagnostics.Perf_Activity.EnumerateActivityTagObjectsSmall ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 282.67756283007975 < 305.9578011243245. IsChangePoint: Marked as a change because one of 5/25/2022 8:13:38 AM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 15.69491117174341 (T) = (0 -286.8468707843659) / Math.Sqrt((109.65511843008554 / (299)) + (24.373562858322057 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.07810900643326384 = (311.1505294943538 - 286.8468707843659) / 311.1505294943538 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Diagnostics.Perf_Activity.EnumerateActivityTagsSmall ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 379.6915168662625 < 429.40502908293985. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 14.216252793494464 (T) = (0 -380.43606220142163) / Math.Sqrt((577.9839140067176 / (299)) + (40.14467964637147 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.07906520567008407 = (413.0977182572756 - 380.43606220142163) / 413.0977182572756 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Diagnostics.Perf_Activity.EnumerateActivityLinksSmall ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 287.45657673261326 < 310.18851031498286. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.167813417264577 (T) = (0 -292.7273827168644) / Math.Sqrt((105.26426973880201 / (299)) + (59.88978637769506 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.06750504172834175 = (313.9184615640419 - 292.7273827168644) / 313.9184615640419 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Diagnostics.Perf_Activity.ActivityAllocations(idFormat: Hierarchical) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.0296150111607147 < 2.2751225997512035. IsChangePoint: Marked as a change because one of 4/13/2022 5:30:39 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.356117656116245 (T) = (0 -2050.4118546196996) / Math.Sqrt((16780.698338092145 / (299)) + (1007.0283501472998 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.06305916484267161 = (2188.411239729348 - 2050.4118546196996) / 2188.411239729348 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Diagnostics.Perf_Activity.EnumerateActivityTagsLarge ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 51.65477316402555 < 60.41807418564764. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.742348593746621 (T) = (0 -51632.875780437724) / Math.Sqrt((20053832.811590686 / (299)) + (1340722.279499551 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.08293722210240378 = (56302.44409091403 - 51632.875780437724) / 56302.44409091403 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Diagnostics.Perf_Activity.EnumerateActivityEventsSmall ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 285.9428700510096 < 308.29290217878855. IsChangePoint: Marked as a change because one of 5/25/2022 12:28:02 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.017977583146054 (T) = (0 -289.5831932684985) / Math.Sqrt((91.39924955644888 / (299)) + (32.10453489255107 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.07202632485658972 = (312.05970710725813 - 289.5831932684985) / 312.05970710725813 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Collections.CtorDefaultSize<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[SortedList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CtorDefaultSize(Int32).SortedList.html>)	66.86 ns	60.34 ns	0.90	0.24	False
[ConcurrentBag - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CtorDefaultSize(Int32).ConcurrentBag.html>)	3.10 μs	2.37 μs	0.76	0.44	False
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CtorDefaultSize(Int32).Dictionary.html>)	60.04 ns	55.63 ns	0.93	0.20	False
[ConcurrentQueue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CtorDefaultSize(Int32).ConcurrentQueue.html>)	637.25 ns	480.22 ns	0.75	0.08	False
[HashSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CtorDefaultSize(Int32).HashSet.html>)	53.27 ns	46.04 ns	0.86	0.26	False
[Queue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CtorDefaultSize(Int32).Queue.html>)	39.52 ns	35.49 ns	0.90	0.36	False
[Stack - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.CtorDefaultSize(Int32).Stack.html>)	39.82 ns	35.16 ns	0.88	0.35	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.CtorDefaultSize<Int32>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.CtorDefaultSize<Int32>.SortedList ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 60.34308698842562 < 64.75953213813841. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 4.746177212760777 (T) = (0 -62.70675245690737) / Math.Sqrt((6.602495922595092 / (299)) + (11.10890697199616 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.06863026152418007 = (67.32745317614305 - 62.70675245690737) / 67.32745317614305 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CtorDefaultSize<Int32>.ConcurrentBag ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.37325123562501 < 3.202153655317796. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 3.3803387339834248 (T) = (0 -2486.358460034591) / Math.Sqrt((112324.58988350364 / (299)) + (16669.385147338628 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.05582179710762905 = (2633.3571908543804 - 2486.358460034591) / 2633.3571908543804 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CtorDefaultSize<Int32>.Dictionary ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 55.63491592831732 < 58.355282775001854. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 5.606647308639536 (T) = (0 -53.9125396045016) / Math.Sqrt((8.863110680912698 / (299)) + (2.982406208944418 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.05199756551174715 = (56.8696214726542 - 53.9125396045016) / 56.8696214726542 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CtorDefaultSize<Int32>.ConcurrentQueue ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 480.2153140757429 < 604.5864969922264. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.624768200442534 (T) = (0 -485.933382308385) / Math.Sqrt((4395.334079067726 / (299)) + (110.50620531164556 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.07125674286289155 = (523.2160541399738 - 485.933382308385) / 523.2160541399738 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CtorDefaultSize<Int32>.HashSet ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 46.044900292875276 < 49.2543111426621. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 9:07:46 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.241699379330003 (T) = (0 -47.71709472347623) / Math.Sqrt((6.004767547719739 / (299)) + (2.7545692629641207 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.07315684272949735 = (51.4834622764009 - 47.71709472347623) / 51.4834622764009 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CtorDefaultSize<Int32>.Queue ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 35.489340049559274 < 38.233133874561474. IsChangePoint: Marked as a change because one of 5/25/2022 12:28:02 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 6.5290970002395134 (T) = (0 -36.321286407458445) / Math.Sqrt((4.4402315814655 / (299)) + (0.9910240393808035 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.053130149782120044 = (38.35932298309078 - 36.321286407458445) / 38.35932298309078 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CtorDefaultSize<Int32>.Stack ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 35.15531298786826 < 37.57314393045453. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 9:07:46 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 5.620875358129827 (T) = (0 -36.062968113220705) / Math.Sqrt((4.20962238575715 / (299)) + (1.2487881610471847 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.05274066127749748 = (38.07084991303028 - 36.062968113220705) / 38.07084991303028 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in Benchstone.BenchF.Secant

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Test - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Benchstone.BenchF.Secant.Test.html>)	1.56 secs	987.56 ms	0.63	0.11	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Benchstone.BenchF.Secant*'

### Payloads [Baseline]() [Compare]() ### Histogram #### Benchstone.BenchF.Secant.Test ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 987.5628802666666 < 1.481134989729945. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.445218256223411 (T) = (0 -1012721539.7343656) / Math.Sqrt((48443649810738064 / (299)) + (3805190431496112 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.14213886737363143 = (1180519202.0226946 - 1012721539.7343656) / 1180519202.0226946 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in System.Diagnostics.Tracing.Perf_EventListener

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[WriteEvent_StringParams - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Diagnostics.Tracing.Perf_EventListener.WriteEvent_StringParams.html>)	1.28 μs	1.11 μs	0.87	0.01	False
[WriteEvent_MixedParams - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Diagnostics.Tracing.Perf_EventListener.WriteEvent_MixedParams.html>)	1.09 μs	986.72 ns	0.90	0.01	False
[WriteEvent_NoParams - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Diagnostics.Tracing.Perf_EventListener.WriteEvent_NoParams.html>)	302.99 ns	262.65 ns	0.87	0.16	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Diagnostics.Tracing.Perf_EventListener*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Diagnostics.Tracing.Perf_EventListener.WriteEvent_StringParams ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.1067497951891752 < 1.2170124181678277. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 14.655985422607454 (T) = (0 -1085.2901579946713) / Math.Sqrt((4341.448643361178 / (299)) + (95.49086438642998 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.06107352670432518 = (1155.8840749108429 - 1085.2901579946713) / 1155.8840749108429 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Diagnostics.Tracing.Perf_EventListener.WriteEvent_MixedParams ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 986.7243964570453 < 1.0571372749306498. IsChangePoint: Marked as a change because one of 5/25/2022 12:28:02 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 28.650486557371806 (T) = (0 -969.1990682638076) / Math.Sqrt((334.4691437096678 / (299)) + (223.47355288655746 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11609507191587923 = (1096.4969619125932 - 969.1990682638076) / 1096.4969619125932 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Diagnostics.Tracing.Perf_EventListener.WriteEvent_NoParams ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 262.652850526607 < 288.00994846993325. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.318354285285741 (T) = (0 -257.83604909597346) / Math.Sqrt((313.2506755864455 / (299)) + (19.85828659632948 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.061727689657608026 = (274.7987404657445 - 257.83604909597346) / 274.7987404657445 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Buffers.Text.Tests.Base64Tests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ConvertTryFromBase64Chars - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Base64Tests.ConvertTryFromBase64Chars(NumberOfBytes%3a%201000).html>)	25.21 μs	13.70 μs	0.54	0.20	False
[Base64Decode - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Base64Tests.Base64Decode(NumberOfBytes%3a%201000).html>)	182.74 ns	112.68 ns	0.62	0.21	False
[ConvertToBase64CharArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Base64Tests.ConvertToBase64CharArray(NumberOfBytes%3a%201000).html>)	36.43 μs	20.26 μs	0.56	0.10	False
[Base64EncodeDestinationTooSmall - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Base64Tests.Base64EncodeDestinationTooSmall(NumberOfBytes%3a%201000).html>)	18.49 μs	10.57 μs	0.57	0.11	False
[Base64Encode - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Base64Tests.Base64Encode(NumberOfBytes%3a%201000).html>)	18.33 μs	10.60 μs	0.58	0.06	False
[Base64DecodeDetinationTooSmall - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Base64Tests.Base64DecodeDetinationTooSmall(NumberOfBytes%3a%201000).html>)	179.42 ns	114.04 ns	0.64	0.25	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Buffers.Text.Tests.Base64Tests*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Buffers.Text.Tests.Base64Tests.ConvertTryFromBase64Chars(NumberOfBytes: 1000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 13.701363257243194 < 23.399115942548. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.206872105704218 (T) = (0 -13723.982975601202) / Math.Sqrt((18561572.998700984 / (299)) + (271223.589406598 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.17791808187888852 = (16694.179342817446 - 13723.982975601202) / 16694.179342817446 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Base64Tests.Base64Decode(NumberOfBytes: 1000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 112.68473439368653 < 172.67293234954107. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 5.720670558630012 (T) = (0 -114.74683589807155) / Math.Sqrt((798.9914609506865 / (299)) + (63.47003935055561 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.12652718294151172 = (131.3685253360186 - 114.74683589807155) / 131.3685253360186 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Base64Tests.ConvertToBase64CharArray(NumberOfBytes: 1000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 20.25711603814478 < 34.49029214031661. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.452408878872937 (T) = (0 -20334.5406369101) / Math.Sqrt((40603551.03210496 / (299)) + (84346.00404832578 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.17581674249550638 = (24672.353450226732 - 20334.5406369101) / 24672.353450226732 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Base64Tests.Base64EncodeDestinationTooSmall(NumberOfBytes: 1000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 10.566374628925578 < 17.426396435571295. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.98830344621174 (T) = (0 -10644.893725584696) / Math.Sqrt((11627373.098301029 / (299)) + (23078.494141527244 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.13164326713234248 = (12258.664351494166 - 10644.893725584696) / 12258.664351494166 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Base64Tests.Base64Encode(NumberOfBytes: 1000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 10.600541838292305 < 17.41099444844145. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.164130892519628 (T) = (0 -10615.209495864603) / Math.Sqrt((11649475.890618488 / (299)) + (1641.5974694173112 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.13200155267176072 = (12229.525903576176 - 10615.209495864603) / 12229.525903576176 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Base64Tests.Base64DecodeDetinationTooSmall(NumberOfBytes: 1000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 114.04164169717127 < 170.6929219356234. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.01492326465814 (T) = (0 -114.61136001917339) / Math.Sqrt((812.4054912437919 / (299)) + (21.849411948009816 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.1316897343308881 = (131.99355639410174 - 114.61136001917339) / 131.99355639410174 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Tests.Perf_Environment

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[GetEnvironmentVariable - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Environment.GetEnvironmentVariable.html>)	894.60 ns	633.70 ns	0.71	0.06	False
[GetEnvironmentVariables - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Environment.GetEnvironmentVariables.html>)	44.99 μs	36.98 μs	0.82	0.36	False
[SetEnvironmentVariable - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Environment.SetEnvironmentVariable.html>)	1.44 μs	1.00 μs	0.70	0.02	False
[ExpandEnvironmentVariables - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Environment.ExpandEnvironmentVariables.html>)	2.37 μs	1.77 μs	0.74	0.03	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Environment*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Tests.Perf_Environment.GetEnvironmentVariable ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 633.7011145428847 < 867.6222508605216. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 15.64610313510314 (T) = (0 -633.6105998533368) / Math.Sqrt((10441.73648705692 / (299)) + (45.25026104536286 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1331508035566511 = (730.9352104760762 - 633.6105998533368) / 730.9352104760762 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Environment.GetEnvironmentVariables ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 36.98308137430389 < 45.99473854459726. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.47828244122326 (T) = (0 -36086.73169693584) / Math.Sqrt((26150612.459817763 / (299)) + (926288.8562781613 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.09814412610416869 = (40013.8566942505 - 36086.73169693584) / 40013.8566942505 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Environment.SetEnvironmentVariable ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.0021425604350045 < 1.3581882874012994. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.892610865138147 (T) = (0 -988.0398419071043) / Math.Sqrt((30463.455826105426 / (299)) + (174.63457390209118 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11495181225528499 = (1116.3684142722593 - 988.0398419071043) / 1116.3684142722593 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Environment.ExpandEnvironmentVariables ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.7683455275980278 < 2.267960110775845. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 15.275354438539226 (T) = (0 -1776.3686592678343) / Math.Sqrt((50527.78697183085 / (299)) + (194.36889392491665 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10476151906614392 = (1984.2407326088564 - 1776.3686592678343) / 1984.2407326088564 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in JetStream.Poker

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Play - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/JetStream.Poker.Play.html>)	434.36 ms	355.27 ms	0.82	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'JetStream.Poker*'

### Payloads [Baseline]() [Compare]() ### Histogram #### JetStream.Poker.Play ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 355.27313423076924 < 416.99105194809516. IsChangePoint: Marked as a change because one of 4/20/2022 8:23:28 AM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.814154202932452 (T) = (0 -349557645.8784216) / Math.Sqrt((1110522201385263.5 / (299)) + (9357080697721.61 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.07263268929399502 = (376935483.7537925 - 349557645.8784216) / 376935483.7537925 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in Benchstone.MDBenchF.MDLLoops

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Test - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Benchstone.MDBenchF.MDLLoops.Test.html>)	7.95 secs	5.32 secs	0.67	0.04	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Benchstone.MDBenchF.MDLLoops*'

### Payloads [Baseline]() [Compare]() ### Histogram #### Benchstone.MDBenchF.MDLLoops.Test ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.324246786933333 < 7.5552324717. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.61516006756132 (T) = (0 -5326784875.161508) / Math.Sqrt((1.0934347477954298E+18 / (299)) + (5627772427350195 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12285518814753697 = (6072868246.135714 - 5326784875.161508) / 6072868246.135714 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in System.Text.Json.Serialization.Tests.WriteJson<ImmutableDictionary<String, String>>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[SerializeObjectProperty - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.WriteJson(ImmutableDictionary(String%2c%20String)).SerializeObjectProperty.html>)	543.42 μs	366.31 μs	0.67	0.03	False
[SerializeToUtf8Bytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.WriteJson(ImmutableDictionary(String%2c%20String)).SerializeToUtf8Bytes.html>)	507.06 μs	336.23 μs	0.66	0.03	False
[SerializeToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.WriteJson(ImmutableDictionary(String%2c%20String)).SerializeToString.html>)	532.57 μs	363.71 μs	0.68	0.02	False
[SerializeToStream - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.WriteJson(ImmutableDictionary(String%2c%20String)).SerializeToStream.html>)	509.08 μs	350.63 μs	0.69	0.02	False

Test Report.html>)

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson<ImmutableDictionary<String, String>>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Serialization.Tests.WriteJson<ImmutableDictionary<String, String>>.SerializeObjectProperty ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 366.3075444418387 < 508.184094443252. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.758804704885875 (T) = (0 -374306.41356749873) / Math.Sqrt((4903406256.83503 / (299)) + (49139056.02527883 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.08649730837168393 = (409748.5612224071 - 374306.41356749873) / 409748.5612224071 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Serialization.Tests.WriteJson<ImmutableDictionary<String, String>>.SerializeToUtf8Bytes ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 336.2259947006119 < 479.2870454268765. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.260706569353474 (T) = (0 -340351.76230826974) / Math.Sqrt((4570126860.859109 / (299)) + (5595391.861316615 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10686165550316876 = (381073.95612939924 - 340351.76230826974) / 381073.95612939924 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Serialization.Tests.WriteJson<ImmutableDictionary<String, String>>.SerializeToString ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 363.7108131087663 < 498.154320003113. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.997095283224239 (T) = (0 -363810.80384838855) / Math.Sqrt((4874142298.19877 / (299)) + (17626444.76727157 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.094407703638942 = (401737.96233723464 - 363810.80384838855) / 401737.96233723464 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Serialization.Tests.WriteJson<ImmutableDictionary<String, String>>.SerializeToStream ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 350.63004629629637 < 480.0332815748608. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.173524210941506 (T) = (0 -346682.4086880461) / Math.Sqrt((4621698012.131771 / (299)) + (6189789.7439166885 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.10510892369484173 = (387401.7943272319 - 346682.4086880461) / 387401.7943272319 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Text.Json.Serialization.Tests.ReadJson<LargeStructWithProperties>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[DeserializeFromString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.ReadJson(LargeStructWithProperties).DeserializeFromString.html>)	26.81 μs	21.66 μs	0.81	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Serialization.Tests.ReadJson<LargeStructWithProperties>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Serialization.Tests.ReadJson<LargeStructWithProperties>.DeserializeFromString ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 21.660719303713535 < 25.35822304829937. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.098660946522452 (T) = (0 -21774.141398762946) / Math.Sqrt((4188171.695048264 / (299)) + (61009.087318808546 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.05458547291346504 = (23031.316713382734 - 21774.141398762946) / 23031.316713382734 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.IO.Tests.Perf_File

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[AppendAllLines - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_File.AppendAllLines.html>)	53.24 μs	44.76 μs	0.84	0.01	False
[WriteAllTextAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_File.WriteAllTextAsync(size%3a%20100000).html>)	1.74 ms	1.15 ms	0.66	0.15	False
[WriteAllText - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_File.WriteAllText(size%3a%2010000).html>)	180.32 μs	121.66 μs	0.67	0.04	False
[ReadAllLines - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_File.ReadAllLines.html>)	172.19 μs	134.41 μs	0.78	0.02	False
[CopyTo - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_File.CopyTo(size%3a%20512).html>)	47.91 μs	43.34 μs	0.90	0.03	False
[WriteAllText - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_File.WriteAllText(size%3a%20100000).html>)	1.41 ms	842.42 μs	0.60	0.11	False
[AppendAllTextAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_File.AppendAllTextAsync(size%3a%2010000).html>)	168.09 μs	122.63 μs	0.73	0.03	False
[CopyToOverwrite - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_File.CopyToOverwrite(size%3a%20512).html>)	49.89 μs	45.41 μs	0.91	0.26	False
[WriteAllTextAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_File.WriteAllTextAsync(size%3a%2010000).html>)	257.97 μs	184.90 μs	0.72	0.08	False
[AppendAllText - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_File.AppendAllText(size%3a%2010000).html>)	120.35 μs	80.97 μs	0.67	0.06	False
[CopyTo - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.Perf_File.CopyTo(size%3a%204096).html>)	47.64 μs	43.84 μs	0.92	0.02	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Tests.Perf_File*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.IO.Tests.Perf_File.AppendAllLines ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 44.75953191071428 < 50.52816842367788. IsChangePoint: Marked as a change because one of 4/27/2022 1:24:17 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.734147745953528 (T) = (0 -44639.336570070205) / Math.Sqrt((11751522.362651164 / (299)) + (157560.19209423749 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.05218831575819562 = (47097.26342504328 - 44639.336570070205) / 47097.26342504328 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_File.WriteAllTextAsync(size: 100000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.1507985757211538 < 1.6799145548879792. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.043959776903675 (T) = (0 -1133557.8643535397) / Math.Sqrt((148611032156.9189 / (299)) + (250612438.55308038 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.16780793925737295 = (1362134.9179202472 - 1133557.8643535397) / 1362134.9179202472 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_File.WriteAllText(size: 10000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 121.65536373782467 < 168.85372568443745. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.25836205879336 (T) = (0 -119102.48078078243) / Math.Sqrt((553476513.2520143 / (299)) + (1915155.4991718081 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10883927273497772 = (133648.70907889833 - 119102.48078078243) / 133648.70907889833 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_File.ReadAllLines ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 134.40829963839582 < 162.5070591383605. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.694234927927347 (T) = (0 -134630.4376636703) / Math.Sqrt((221806865.28885967 / (299)) + (1358816.0104644934 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.06242728726093126 = (143594.66293590676 - 134630.4376636703) / 143594.66293590676 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_File.CopyTo(size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 43.3414034799169 < 45.049655170910036. IsChangePoint: Marked as a change because one of 4/27/2022 1:24:17 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.030425987991988 (T) = (0 -43521.90814674197) / Math.Sqrt((5391815.110674215 / (299)) + (376672.22839842195 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.05005638037900674 = (45815.253924339486 - 43521.90814674197) / 45815.253924339486 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_File.WriteAllText(size: 100000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 842.415318825911 < 1.3289954417004868. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.26081245054748 (T) = (0 -858682.8663413995) / Math.Sqrt((53323179609.9874 / (299)) + (1300547475.3784432 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.1271089311952134 = (983722.8229602099 - 858682.8663413995) / 983722.8229602099 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_File.AppendAllTextAsync(size: 10000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 122.63064433333335 < 159.701560677381. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.772281983170824 (T) = (0 -122579.43780547302) / Math.Sqrt((381761880.082115 / (299)) + (2799517.561989405 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.08135296358239855 = (133434.750177271 - 122579.43780547302) / 133434.750177271 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_File.CopyToOverwrite(size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 45.414529649758464 < 46.474788509113. IsChangePoint: Marked as a change because one of 4/28/2022 7:34:39 PM, 5/25/2022 10:02:21 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.051796048759023 (T) = (0 -45247.26582240299) / Math.Sqrt((5468204.571889588 / (299)) + (381843.42855496827 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.06227273513986991 = (48252.053148046194 - 45247.26582240299) / 48252.053148046194 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_File.WriteAllTextAsync(size: 10000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 184.89796949404763 < 244.92950004337473. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.054034418356741 (T) = (0 -185855.25204789612) / Math.Sqrt((958481182.5502672 / (299)) + (11239999.91169126 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.0810496092665663 = (202247.31815997284 - 185855.25204789612) / 202247.31815997284 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_File.AppendAllText(size: 10000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 80.96605926785713 < 114.39387723592031. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.84760268660849 (T) = (0 -81143.30520634919) / Math.Sqrt((279352701.5592273 / (299)) + (2385585.086376212 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10399561184864778 = (90561.28103765775 - 81143.30520634919) / 90561.28103765775 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_File.CopyTo(size: 4096) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 43.83858675428971 < 45.24281054213506. IsChangePoint: Marked as a change because one of 4/27/2022 1:24:17 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.550755321610344 (T) = (0 -43416.87978912509) / Math.Sqrt((5379900.110307229 / (299)) + (941742.6652700597 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.05301135454395992 = (45847.30767095616 - 43416.87978912509) / 45847.30767095616 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Globalization.Tests.StringEquality

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Compare_DifferentFirstChar - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringEquality.Compare_DifferentFirstChar(Count%3a%201024%2c%20Options%3a%20(%2c%20None)).html>)	310.35 ns	269.16 ns	0.87	0.16	False
[Compare_DifferentFirstChar - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringEquality.Compare_DifferentFirstChar(Count%3a%201024%2c%20Options%3a%20(en-US%2c%20None)).html>)	317.14 ns	278.51 ns	0.88	0.15	False
[Compare_DifferentFirstChar - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringEquality.Compare_DifferentFirstChar(Count%3a%201024%2c%20Options%3a%20(en-US%2c%20IgnoreCase)).html>)	313.23 ns	270.41 ns	0.86	0.16	False
[Compare_DifferentFirstChar - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringEquality.Compare_DifferentFirstChar(Count%3a%201024%2c%20Options%3a%20(pl-PL%2c%20None)).html>)	315.04 ns	263.13 ns	0.84	0.14	False
[Compare_DifferentFirstChar - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringEquality.Compare_DifferentFirstChar(Count%3a%201024%2c%20Options%3a%20(en-US%2c%20Ordinal)).html>)	229.37 ns	177.80 ns	0.78	0.18	False
[Compare_DifferentFirstChar - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringEquality.Compare_DifferentFirstChar(Count%3a%201024%2c%20Options%3a%20(%2c%20IgnoreCase)).html>)	310.15 ns	267.49 ns	0.86	0.19	False
[Compare_Same_Upper - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringEquality.Compare_Same_Upper(Count%3a%201024%2c%20Options%3a%20(en-US%2c%20Ordinal)).html>)	517.35 ns	362.10 ns	0.70	0.09	False
[Compare_Same_Upper - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringEquality.Compare_Same_Upper(Count%3a%201024%2c%20Options%3a%20(en-US%2c%20OrdinalIgnoreCase)).html>)	38.29 μs	23.85 μs	0.62	0.08	False
[Compare_Same - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringEquality.Compare_Same(Count%3a%201024%2c%20Options%3a%20(en-US%2c%20Ordinal)).html>)	3.64 μs	2.31 μs	0.64	0.08	False
[Compare_Same - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringEquality.Compare_Same(Count%3a%201024%2c%20Options%3a%20(en-US%2c%20OrdinalIgnoreCase)).html>)	22.15 μs	14.08 μs	0.64	0.05	False
[Compare_DifferentFirstChar - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringEquality.Compare_DifferentFirstChar(Count%3a%201024%2c%20Options%3a%20(en-US%2c%20IgnoreNonSpace)).html>)	309.41 ns	263.50 ns	0.85	0.12	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Globalization.Tests.StringEquality*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Globalization.Tests.StringEquality.Compare_DifferentFirstChar(Count: 1024, Options: (, None)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 269.16480814013494 < 295.96044351749356. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.608669317250083 (T) = (0 -267.1360395581287) / Math.Sqrt((316.2151138906503 / (299)) + (41.379654326907946 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.06402610702301621 = (285.40971234621577 - 267.1360395581287) / 285.40971234621577 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringEquality.Compare_DifferentFirstChar(Count: 1024, Options: (en-US, None)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 278.50918931886105 < 295.13661502854654. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.382164724513721 (T) = (0 -266.99792396710086) / Math.Sqrt((279.76349698660744 / (299)) + (67.0754043489245 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.06596855205871567 = (285.8553901537211 - 266.99792396710086) / 285.8553901537211 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringEquality.Compare_DifferentFirstChar(Count: 1024, Options: (en-US, IgnoreCase)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 270.4091383371066 < 296.99842038028174. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.633767461967496 (T) = (0 -266.3163716154732) / Math.Sqrt((297.52598875996637 / (299)) + (23.57778551447133 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.06990186367630814 = (286.3314753732503 - 266.3163716154732) / 286.3314753732503 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringEquality.Compare_DifferentFirstChar(Count: 1024, Options: (pl-PL, None)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 263.1253595163633 < 299.7440180817837. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.551016638502546 (T) = (0 -268.3183120553214) / Math.Sqrt((287.98333160772034 / (299)) + (35.44400743607712 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.061207188824326325 = (285.81206509165713 - 268.3183120553214) / 285.81206509165713 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringEquality.Compare_DifferentFirstChar(Count: 1024, Options: (en-US, Ordinal)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 177.8036509028553 < 218.84048479718516. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.72369191549645 (T) = (0 -179.04531796780142) / Math.Sqrt((545.4866986823196 / (299)) + (12.40719182465002 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.07610514588337432 = (193.7940417895217 - 179.04531796780142) / 193.7940417895217 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringEquality.Compare_DifferentFirstChar(Count: 1024, Options: (, IgnoreCase)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 267.49205117394075 < 294.3954957014213. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 5.005946213516971 (T) = (0 -270.6493804174856) / Math.Sqrt((288.97660330926084 / (299)) + (78.47238887991077 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.05000920029010822 = (284.89684373799884 - 270.6493804174856) / 284.89684373799884 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringEquality.Compare_Same_Upper(Count: 1024, Options: (en-US, Ordinal)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 362.09705182199093 < 495.7532422238044. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.396137759691165 (T) = (0 -361.87995074482154) / Math.Sqrt((3976.910999418132 / (299)) + (9.210764951873529 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12191865714308364 = (412.12577136351933 - 361.87995074482154) / 412.12577136351933 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringEquality.Compare_Same_Upper(Count: 1024, Options: (en-US, OrdinalIgnoreCase)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 23.85399846393035 < 36.43731533768227. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 5.058550192554217 (T) = (0 -23386.834369025997) / Math.Sqrt((50581388.306248896 / (299)) + (181031.19496921307 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.08495806648589657 = (25558.210517426018 - 23386.834369025997) / 25558.210517426018 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringEquality.Compare_Same(Count: 1024, Options: (en-US, Ordinal)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.314239094902252 < 3.4369225437070607. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 14.703400627676823 (T) = (0 -2314.2332847479247) / Math.Sqrt((260954.5018536538 / (299)) + (28.164580835550474 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.1582294441479008 = (2749.244753999854 - 2314.2332847479247) / 2749.244753999854 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringEquality.Compare_Same(Count: 1024, Options: (en-US, OrdinalIgnoreCase)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 14.08299353461421 < 21.019854557476354. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.165197803654706 (T) = (0 -14085.13295450721) / Math.Sqrt((11379335.205084708 / (299)) + (652.7713957366891 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.12350025567613168 = (16069.751355572245 - 14085.13295450721) / 16069.751355572245 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringEquality.Compare_DifferentFirstChar(Count: 1024, Options: (en-US, IgnoreNonSpace)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 263.4968231156523 < 295.09179434770897. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.376316296037337 (T) = (0 -269.31119286902066) / Math.Sqrt((268.01805696832383 / (299)) + (46.37847224051473 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.056394441496277925 = (285.4065350103153 - 269.31119286902066) / 285.4065350103153 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Collections.Sort<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Array_Comparison - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Sort(String).Array_Comparison(Size%3a%20512).html>)	2.03 ms	1.67 ms	0.82	0.06	False
[LinqQuery - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Sort(String).LinqQuery(Size%3a%20512).html>)	1.84 ms	1.56 ms	0.85	0.04	False
[Array - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Sort(String).Array(Size%3a%20512).html>)	2.01 ms	1.68 ms	0.84	0.07	False
[List - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Sort(String).List(Size%3a%20512).html>)	2.01 ms	1.69 ms	0.84	0.07	False
[LinqOrderByExtension - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Sort(String).LinqOrderByExtension(Size%3a%20512).html>)	1.85 ms	1.56 ms	0.84	0.04	False
[Array_ComparerStruct - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Sort(String).Array_ComparerStruct(Size%3a%20512).html>)	1.99 ms	1.67 ms	0.84	0.09	False
[Array_ComparerClass - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Sort(String).Array_ComparerClass(Size%3a%20512).html>)	2.11 ms	1.72 ms	0.82	0.05	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.Sort<String>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.Sort<String>.Array_Comparison(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.6733675198 < 1.9154193382166664. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.445008554349625 (T) = (0 -1682391.257337332) / Math.Sqrt((13391623151.906298 / (299)) + (1436849604.3557494 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.06717275924999637 = (1803540.016675189 - 1682391.257337332) / 1803540.016675189 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Sort<String>.LinqQuery(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.559662322506667 < 1.7546531042053846. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.49642465150657 (T) = (0 -1562895.8143569473) / Math.Sqrt((11197365928.594078 / (299)) + (490679964.49073213 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.06112655150524947 = (1664650.1366746083 - 1562895.8143569473) / 1664650.1366746083 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Sort<String>.Array(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.67961895064 < 1.917201615227738. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.002964299135725 (T) = (0 -1698889.9018790473) / Math.Sqrt((13697192878.551386 / (299)) + (1385843409.0056598 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.06305880262316388 = (1813230.0155393388 - 1698889.9018790473) / 1813230.0155393388 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Sort<String>.List(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.693917049433333 < 1.9120795316659522. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.203817719140638 (T) = (0 -1679356.2886981016) / Math.Sqrt((14366217427.155127 / (299)) + (551493133.1396273 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.0722760226472972 = (1810189.592695676 - 1679356.2886981016) / 1810189.592695676 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Sort<String>.LinqOrderByExtension(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.5576527754799998 < 1.7804693807030767. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.609355695691635 (T) = (0 -1576640.4777701588) / Math.Sqrt((11732946280.108099 / (299)) + (1198400186.0164053 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.05385756370699549 = (1666388.0799464528 - 1576640.4777701588) / 1666388.0799464528 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Sort<String>.Array_ComparerStruct(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.6656703511799997 < 1.896592844734423. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.5811814866655 (T) = (0 -1681632.6235189682) / Math.Sqrt((12492234513.552399 / (299)) + (1267101276.190284 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.06469189405004797 = (1797945.0972586265 - 1681632.6235189682) / 1797945.0972586265 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Sort<String>.Array_ComparerClass(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.7196907560857142 < 1.9120138871056667. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 14.429630886001188 (T) = (0 -1670780.3690185284) / Math.Sqrt((12648692152.001608 / (299)) + (488608667.84675753 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.07295107982445084 = (1802256.960400907 - 1670780.3690185284) / 1802256.960400907 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in System.Collections.Tests.Perf_BitArray

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[BitArraySetLengthShrink - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArraySetLengthShrink(Size%3a%20512).html>)	7.49 μs	4.89 μs	0.65	0.10	False
[BitArraySet - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArraySet(Size%3a%204).html>)	171.41 ns	101.00 ns	0.59	0.09	False
[BitArrayCopyToByteArray - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayCopyToByteArray(Size%3a%204).html>)	205.91 ns	146.09 ns	0.71	0.22	False
[BitArrayCopyToIntArray - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayCopyToIntArray(Size%3a%20512).html>)	219.12 ns	172.73 ns	0.79	0.12	False
[BitArrayBoolArrayCtor - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayBoolArrayCtor(Size%3a%204).html>)	220.78 ns	159.84 ns	0.72	0.13	False
[BitArraySetLengthGrow - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArraySetLengthGrow(Size%3a%204).html>)	445.09 ns	346.77 ns	0.78	0.11	False
[BitArrayRightShift - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayRightShift(Size%3a%204).html>)	144.14 ns	90.56 ns	0.63	0.16	False
[BitArraySetAll - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArraySetAll(Size%3a%20512).html>)	806.99 ns	519.45 ns	0.64	0.17	False
[BitArrayCopyToIntArray - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayCopyToIntArray(Size%3a%204).html>)	201.55 ns	165.45 ns	0.82	0.18	False
[BitArrayCopyToBoolArray - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayCopyToBoolArray(Size%3a%204).html>)	1.35 μs	840.37 ns	0.62	0.10	False
[BitArrayCopyToByteArray - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayCopyToByteArray(Size%3a%20512).html>)	7.37 μs	4.96 μs	0.67	0.12	False
[BitArrayAnd - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayAnd(Size%3a%204).html>)	67.69 ns	46.25 ns	0.68	0.24	False
[BitArrayGet - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayGet(Size%3a%204).html>)	1.11 μs	615.87 ns	0.56	0.16	False
[BitArrayLengthCtor - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayLengthCtor(Size%3a%204).html>)	110.84 ns	96.32 ns	0.87	0.09	False
[BitArrayLengthValueCtor - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayLengthValueCtor(Size%3a%204).html>)	204.48 ns	161.16 ns	0.79	0.11	False
[BitArrayNot - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayNot(Size%3a%204).html>)	40.69 ns	30.38 ns	0.75	0.25	False
[BitArraySetAll - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArraySetAll(Size%3a%204).html>)	114.72 ns	84.79 ns	0.74	0.21	False
[BitArrayLeftShift - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayLeftShift(Size%3a%204).html>)	115.66 ns	74.22 ns	0.64	0.18	False
[BitArraySet - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArraySet(Size%3a%20512).html>)	20.71 μs	11.86 μs	0.57	0.12	False
[BitArraySetLengthShrink - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArraySetLengthShrink(Size%3a%204).html>)	261.93 ns	206.85 ns	0.79	0.13	False
[BitArrayGet - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayGet(Size%3a%20512).html>)	137.39 μs	76.09 μs	0.55	0.13	False
[BitArrayXor - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayXor(Size%3a%204).html>)	67.69 ns	47.39 ns	0.70	0.18	False
[BitArrayOr - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayOr(Size%3a%204).html>)	67.56 ns	46.57 ns	0.69	0.22	False
[BitArrayXor - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayXor(Size%3a%20512).html>)	1.65 μs	1.16 μs	0.70	0.32	False
[BitArrayCopyToBoolArray - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayCopyToBoolArray(Size%3a%20512).html>)	140.56 μs	84.71 μs	0.60	0.07	False
[BitArraySetLengthGrow - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArraySetLengthGrow(Size%3a%20512).html>)	7.94 μs	5.46 μs	0.69	0.10	False
[BitArrayNot - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayNot(Size%3a%20512).html>)	1.25 μs	700.61 ns	0.56	0.08	False
[BitArrayAnd - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayAnd(Size%3a%20512).html>)	1.69 μs	1.16 μs	0.68	0.33	False
[BitArrayLeftShift - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayLeftShift(Size%3a%20512).html>)	4.36 μs	2.48 μs	0.57	0.09	False
[BitArrayLengthCtor - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayLengthCtor(Size%3a%20512).html>)	114.89 ns	101.08 ns	0.88	0.12	False
[BitArrayByteArrayCtor - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayByteArrayCtor(Size%3a%20512).html>)	7.48 μs	5.39 μs	0.72	0.11	False
[BitArrayOr - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayOr(Size%3a%20512).html>)	1.69 μs	1.16 μs	0.69	0.34	False
[BitArrayRightShift - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayRightShift(Size%3a%20512).html>)	4.67 μs	2.58 μs	0.55	0.08	False
[BitArrayBoolArrayCtor - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayBoolArrayCtor(Size%3a%20512).html>)	12.14 μs	8.33 μs	0.69	0.08	False
[BitArrayByteArrayCtor - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Perf_BitArray.BitArrayByteArrayCtor(Size%3a%204).html>)	212.37 ns	167.15 ns	0.79	0.12	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.Tests.Perf_BitArray*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.Tests.Perf_BitArray.BitArraySetLengthShrink(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 4.892641565839095 < 7.106711184521379. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.639021059313824 (T) = (0 -4871.031852560558) / Math.Sqrt((1412632.646831154 / (299)) + (883.9997953828764 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.09804861845709821 = (5400.548136228854 - 4871.031852560558) / 5400.548136228854 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArraySet(Size: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 100.99511923308431 < 162.96584222778196. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.764422289504653 (T) = (0 -101.67476215898854) / Math.Sqrt((798.5346134114118 / (299)) + (0.42404057634597775 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.15990171534416445 = (121.02722266674049 - 101.67476215898854) / 121.02722266674049 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayCopyToByteArray(Size: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 146.08560915453288 < 194.06562484304047. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.0895886840116 (T) = (0 -146.06968137371504) / Math.Sqrt((579.8168343490447 / (299)) + (10.986203533689116 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.0951366126529157 = (161.42733081727192 - 146.06968137371504) / 161.42733081727192 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayCopyToIntArray(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 172.72615312171476 < 208.76888388059766. IsChangePoint: Marked as a change because one of 4/21/2022 3:06:05 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.47005127392264 (T) = (0 -174.749942592038) / Math.Sqrt((242.67496231325526 / (299)) + (10.016129143724324 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.08562754536371235 = (191.11461823458882 - 174.749942592038) / 191.11461823458882 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayBoolArrayCtor(Size: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 159.83863578308691 < 197.75389859135512. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 14.635810836224499 (T) = (0 -160.92096534907373) / Math.Sqrt((241.67703989102424 / (299)) + (9.51184863573984 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10320157288613066 = (179.43939293800867 - 160.92096534907373) / 179.43939293800867 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArraySetLengthGrow(Size: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 346.7727256614385 < 428.6954338715708. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.695022994710595 (T) = (0 -347.09758028579967) / Math.Sqrt((1710.7670542300677 / (299)) + (39.225481356257575 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.08584252383009036 = (379.6912340968335 - 347.09758028579967) / 379.6912340968335 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayRightShift(Size: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 90.55904301395842 < 137.24402452535833. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.882546291197648 (T) = (0 -92.42129178718393) / Math.Sqrt((524.9626670357331 / (299)) + (8.770466924430204 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.11993314896404136 = (105.01621743665436 - 92.42129178718393) / 105.01621743665436 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArraySetAll(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 519.4468412390277 < 766.0478246939057. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.113118056157692 (T) = (0 -528.9384523639976) / Math.Sqrt((13120.012225057735 / (299)) + (325.47538851402993 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12677283054423585 = (605.728349810344 - 528.9384523639976) / 605.728349810344 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayCopyToIntArray(Size: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 165.44623771780093 < 191.6403081571171. IsChangePoint: Marked as a change because one of 4/21/2022 12:21:56 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.39973765447262 (T) = (0 -161.24341060886965) / Math.Sqrt((251.6420479817535 / (299)) + (6.688933458297771 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.0909572376461406 = (177.37714581363454 - 161.24341060886965) / 177.37714581363454 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayCopyToBoolArray(Size: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 840.3721450029042 < 1.2807998481045213. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.33750514353697 (T) = (0 -845.5354050883819) / Math.Sqrt((41923.02284789448 / (299)) + (85.60953145602146 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.13997884269456842 = (983.1565164484609 - 845.5354050883819) / 983.1565164484609 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayCopyToByteArray(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 4.955908535861304 < 7.007123544789634. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 5.743338355335938 (T) = (0 -4899.185467650828) / Math.Sqrt((1351584.1865812063 / (299)) + (7299.4763368125305 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.07783567646823997 = (5312.703324812692 - 4899.185467650828) / 5312.703324812692 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayAnd(Size: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 46.250918452782834 < 64.18238557270512. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 14.964780157300067 (T) = (0 -47.341866679667355) / Math.Sqrt((61.63774150164623 / (299)) + (0.8922578676346036 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1434059900421105 = (55.267566816156815 - 47.341866679667355) / 55.267566816156815 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayGet(Size: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 615.8707324375819 < 1.0827343006177246. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.51982870998908 (T) = (0 -620.0790738870924) / Math.Sqrt((50065.84051330941 / (299)) + (267.90491804294646 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.15915280425145972 = (737.4456108343022 - 620.0790738870924) / 737.4456108343022 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayLengthCtor(Size: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 96.31553383958433 < 106.00524822461148. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.991309313192495 (T) = (0 -98.62669951730324) / Math.Sqrt((18.150350269874973 / (299)) + (4.424522529801888 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.0704810205278595 = (106.10509488823114 - 98.62669951730324) / 106.10509488823114 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayLengthValueCtor(Size: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 161.15847314747484 < 192.77165670109338. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.997051812809847 (T) = (0 -160.03212397884005) / Math.Sqrt((242.84404354572857 / (299)) + (10.369776320620145 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.09514721379097456 = (176.8598455106838 - 160.03212397884005) / 176.8598455106838 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayNot(Size: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 30.3835981522548 < 38.66357305945076. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 2.753658089646525 (T) = (0 -32.25010991061067) / Math.Sqrt((12.266334131724106 / (299)) + (15.156586940023004 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.08884297045119792 = (35.3946782659194 - 32.25010991061067) / 35.3946782659194 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArraySetAll(Size: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 84.79036153499148 < 109.45920625865496. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.144476643777171 (T) = (0 -76.94231335463574) / Math.Sqrt((258.8332292264089 / (299)) + (10.066293506234468 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12141758667826065 = (87.5755218724817 - 76.94231335463574) / 87.5755218724817 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayLeftShift(Size: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 74.21742886687812 < 109.90524047940171. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.012498568986966 (T) = (0 -76.15942291342948) / Math.Sqrt((292.6294268776728 / (299)) + (7.368061055164384 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10410532104993993 = (85.0093484232814 - 76.15942291342948) / 85.0093484232814 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArraySet(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 11.861619521546263 < 19.69456389313777. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.2161232641192 (T) = (0 -11936.149383306409) / Math.Sqrt((14723487.383812249 / (299)) + (16157.189251684036 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.148120285763556 = (14011.543160180785 - 11936.149383306409) / 14011.543160180785 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArraySetLengthShrink(Size: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 206.85355865322182 < 248.60719660072624. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.8649569142163 (T) = (0 -202.52915115357084) / Math.Sqrt((560.716897446409 / (299)) + (19.70257891473292 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.07586191535315785 = (219.15464205867787 - 202.52915115357084) / 219.15464205867787 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayGet(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 76.09355366100323 < 130.47109128605769. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.868576775829283 (T) = (0 -76095.16502095952) / Math.Sqrt((750905010.438299 / (299)) + (8789.986609477843 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1559196618225737 = (90151.56683458283 - 76095.16502095952) / 90151.56683458283 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayXor(Size: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 47.39311516776799 < 64.56441943699294. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 5.0341673898118575 (T) = (0 -48.31508365607308) / Math.Sqrt((56.77720860607482 / (299)) + (17.559079765001233 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.12223229036691875 = (55.04313171450501 - 48.31508365607308) / 55.04313171450501 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayOr(Size: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 46.571768380969395 < 64.20699497551303. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.572575125328521 (T) = (0 -47.6002163754982) / Math.Sqrt((58.38132011522265 / (299)) + (1.4219580517832238 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.13771937343461024 = (55.20269725309491 - 47.6002163754982) / 55.20269725309491 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayXor(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.1582561914049696 < 1.5707234120418372. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.42448035335599 (T) = (0 -1150.6059801759366) / Math.Sqrt((54879.30095122186 / (299)) + (450.2910958184144 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.08754161052346687 = (1260.9955625878194 - 1150.6059801759366) / 1260.9955625878194 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayCopyToBoolArray(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 84.71219463315218 < 132.8215667940184. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.81386156059433 (T) = (0 -84702.07417686949) / Math.Sqrt((537655030.5613083 / (299)) + (84755.19099334817 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.13472408081532455 = (97890.24783757048 - 84702.07417686949) / 97890.24783757048 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArraySetLengthGrow(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.456510944503996 < 7.576294536582303. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.422075863988328 (T) = (0 -5267.3649082009915) / Math.Sqrt((1430274.0444768162 / (299)) + (7317.019959944512 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.09377643002442297 = (5812.434241081313 - 5267.3649082009915) / 5812.434241081313 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayNot(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 700.6103247301336 < 1.192127848919461. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.308582396530788 (T) = (0 -708.2150223339822) / Math.Sqrt((40253.81013437035 / (299)) + (386.4306038145723 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.19531316457752976 = (880.1125992848645 - 708.2150223339822) / 880.1125992848645 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayAnd(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.1593139337134233 < 1.6081380411363617. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.185814077644933 (T) = (0 -1127.4235799541416) / Math.Sqrt((54967.094594790644 / (299)) + (1143.7857506592993 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10818562035875062 = (1264.1908514725574 - 1127.4235799541416) / 1264.1908514725574 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayLeftShift(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.4824465462182643 < 4.177841461756121. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.2665300554665 (T) = (0 -2508.3833290272382) / Math.Sqrt((591387.1312565359 / (299)) + (3901.6840259752457 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.16417099186224102 = (3001.0723540404015 - 2508.3833290272382) / 3001.0723540404015 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayLengthCtor(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 101.08264316328834 < 108.48132833656699. IsChangePoint: Marked as a change because one of 5/25/2022 12:28:02 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.974646503855269 (T) = (0 -102.61096027647612) / Math.Sqrt((18.457115938775377 / (299)) + (3.73487525650333 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.06652831428599122 = (109.9240200285126 - 102.61096027647612) / 109.9240200285126 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayByteArrayCtor(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.3939282153509405 < 7.108342701679053. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 5.402315423886865 (T) = (0 -4882.31460062724) / Math.Sqrt((1400049.937505399 / (299)) + (30352.86569499981 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.08713626038018303 = (5348.349801538389 - 4882.31460062724) / 5348.349801538389 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayOr(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.1589582803030303 < 1.6067752462734346. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.737284910334299 (T) = (0 -1128.551529337537) / Math.Sqrt((54767.64195851877 / (299)) + (1204.6277684348677 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10349910451962441 = (1258.8403815623863 - 1128.551529337537) / 1258.8403815623863 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayRightShift(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.5798097894615335 < 4.430945505714946. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.495187798070418 (T) = (0 -2563.079049510857) / Math.Sqrt((734936.1456444844 / (299)) + (687.4202155374428 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.18362633570572012 = (3139.5905595834347 - 2563.079049510857) / 3139.5905595834347 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayBoolArrayCtor(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 8.33021310525412 < 11.59277785031138. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.717097895276052 (T) = (0 -8270.016114327454) / Math.Sqrt((2999742.2436656468 / (299)) + (8934.564281510431 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.08856914865995219 = (9073.662694397839 - 8270.016114327454) / 9073.662694397839 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayByteArrayCtor(Size: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 167.1539235890932 < 200.7462569566107. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.652976773496764 (T) = (0 -167.88580115072176) / Math.Sqrt((359.79003325686506 / (299)) + (3.8337403543172104 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.07261665551293413 = (181.03171913614548 - 167.88580115072176) / 181.03171913614548 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Collections.TryGetValueFalse<Int32, Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ConcurrentDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.TryGetValueFalse(Int32%2c%20Int32).ConcurrentDictionary(Size%3a%20512).html>)	56.80 μs	43.97 μs	0.77	0.05	False
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.TryGetValueFalse(Int32%2c%20Int32).Dictionary(Size%3a%20512).html>)	74.57 μs	53.64 μs	0.72	0.03	False
[ImmutableDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.TryGetValueFalse(Int32%2c%20Int32).ImmutableDictionary(Size%3a%20512).html>)	229.34 μs	163.31 μs	0.71	0.05	False
[IDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.TryGetValueFalse(Int32%2c%20Int32).IDictionary(Size%3a%20512).html>)	80.57 μs	56.28 μs	0.70	0.06	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.TryGetValueFalse<Int32, Int32>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.TryGetValueFalse<Int32, Int32>.ConcurrentDictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 43.97100989877589 < 53.60317166098617. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.071238522125519 (T) = (0 -44222.748250975885) / Math.Sqrt((24132485.721365266 / (299)) + (895445.2164476841 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.07479746288574467 = (47797.91070278347 - 44222.748250975885) / 47797.91070278347 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.TryGetValueFalse<Int32, Int32>.Dictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 53.637561072664354 < 68.70170004347654. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 15.560842311766963 (T) = (0 -53263.84849460531) / Math.Sqrt((47291436.3771744 / (299)) + (208830.7248238692 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10906136032634725 = (59783.96953814422 - 53263.84849460531) / 59783.96953814422 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.TryGetValueFalse<Int32, Int32>.ImmutableDictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 163.31313676215277 < 207.89105811985846. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.46137855559875 (T) = (0 -163448.879149215) / Math.Sqrt((564196122.2549665 / (299)) + (3093442.8259974224 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.07854071500386922 = (177380.4679280011 - 163448.879149215) / 177380.4679280011 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.TryGetValueFalse<Int32, Int32>.IDictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 56.27652090565122 < 74.28620338083998. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.719041850919872 (T) = (0 -57265.333743480056) / Math.Sqrt((59825874.5577625 / (299)) + (731377.4399252107 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.08056778147987671 = (62283.36639720083 - 57265.333743480056) / 62283.36639720083 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Collections.IterateFor<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ImmutableArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateFor(String).ImmutableArray(Size%3a%20512).html>)	7.90 μs	4.68 μs	0.59	0.07	False
[Span - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateFor(String).Span(Size%3a%20512).html>)	6.80 μs	4.13 μs	0.61	0.07	False
[List - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateFor(String).List(Size%3a%20512).html>)	13.44 μs	9.37 μs	0.70	0.11	False
[ImmutableList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateFor(String).ImmutableList(Size%3a%20512).html>)	130.58 μs	104.68 μs	0.80	0.06	False
[Array - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateFor(String).Array(Size%3a%20512).html>)	4.48 μs	2.78 μs	0.62	0.07	False
[IList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateFor(String).IList(Size%3a%20512).html>)	21.26 μs	17.29 μs	0.81	0.14	False
[ImmutableSortedSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateFor(String).ImmutableSortedSet(Size%3a%20512).html>)	129.82 μs	106.28 μs	0.82	0.08	False
[ReadOnlySpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateFor(String).ReadOnlySpan(Size%3a%20512).html>)	6.84 μs	4.12 μs	0.60	0.08	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.IterateFor<String>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.IterateFor<String>.ImmutableArray(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 4.676505879476377 < 7.505351458500734. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.359207031376078 (T) = (0 -4730.655418801742) / Math.Sqrt((1897251.2456062068 / (299)) + (1123.000184509207 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1370038071435415 = (5481.66429696937 - 4730.655418801742) / 5481.66429696937 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateFor<String>.Span(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 4.1320899769687305 < 6.495678883336422. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.198028227724924 (T) = (0 -4111.030285336438) / Math.Sqrt((1192215.71442317 / (299)) + (324.33276689188074 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1582460529929067 = (4883.885962107399 - 4111.030285336438) / 4883.885962107399 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateFor<String>.List(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 9.367145618445935 < 12.036284621043018. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 21.52332094191712 (T) = (0 -9411.713462212294) / Math.Sqrt((1211922.8019860254 / (299)) + (8353.461309147307 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.13614445415409704 = (10895.00843916696 - 9411.713462212294) / 10895.00843916696 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateFor<String>.ImmutableList(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 104.68234504807694 < 124.26909754588294. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 19.731782684175762 (T) = (0 -104577.0883141268) / Math.Sqrt((71289241.24961728 / (299)) + (1302225.9002635512 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.10129023571474421 = (116363.58307211338 - 104577.0883141268) / 116363.58307211338 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateFor<String>.Array(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.784824163979458 < 4.253295466190922. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.808671178173097 (T) = (0 -2763.455451069207) / Math.Sqrt((603632.4713779335 / (299)) + (463.28996274305763 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.11369517442214608 = (3117.9514895086872 - 2763.455451069207) / 3117.9514895086872 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateFor<String>.IList(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.289640261627905 < 20.25040560643877. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 14.995315518399115 (T) = (0 -17288.429755691333) / Math.Sqrt((1385371.9198314925 / (299)) + (180684.04000811395 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.11179763970877227 = (19464.51679099651 - 17288.429755691333) / 19464.51679099651 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateFor<String>.ImmutableSortedSet(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 106.27572481321842 < 123.71540685112848. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 18.096059661249576 (T) = (0 -104546.85298037935) / Math.Sqrt((72167812.693008 / (299)) + (2183189.3963297796 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10121631217639629 = (116320.37207254904 - 104546.85298037935) / 116320.37207254904 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateFor<String>.ReadOnlySpan(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 4.115950360736034 < 6.511936350775578. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.367625685811962 (T) = (0 -4093.363935840884) / Math.Sqrt((1189783.0514626303 / (299)) + (593.6182587358077 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.1609892618382762 = (4878.798029223633 - 4093.363935840884) / 4878.798029223633 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in BenchmarksGame.BinaryTrees_2

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[RunBench - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/BenchmarksGame.BinaryTrees_2.RunBench.html>)	1.01 secs	936.68 ms	0.92	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'BenchmarksGame.BinaryTrees_2*'

### Payloads [Baseline]() [Compare]() ### Histogram #### BenchmarksGame.BinaryTrees_2.RunBench ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 936.6781099230768 < 0.9554476562943681. IsChangePoint: Marked as a change because one of 4/12/2022 5:02:33 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 42.314795190363384 (T) = (0 -934484162.9046092) / Math.Sqrt((99290415882656.98 / (299)) + (34034959213163.66 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.07458817312092894 = (1009803566.1118946 - 934484162.9046092) / 1009803566.1118946 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in System.Text.Json.Serialization.Tests.WriteJson<HashSet<String>>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[SerializeToStream - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.WriteJson(HashSet(String)).SerializeToStream.html>)	222.89 μs	143.94 μs	0.65	0.02	False
[SerializeToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.WriteJson(HashSet(String)).SerializeToString.html>)	229.21 μs	147.80 μs	0.64	0.02	False
[SerializeToUtf8Bytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.WriteJson(HashSet(String)).SerializeToUtf8Bytes.html>)	216.27 μs	140.68 μs	0.65	0.03	False
[SerializeObjectProperty - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.WriteJson(HashSet(String)).SerializeObjectProperty.html>)	240.51 μs	153.44 μs	0.64	0.02	False

Test Report.html>)

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson<HashSet<String>>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Serialization.Tests.WriteJson<HashSet<String>>.SerializeToStream ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 143.93835065835066 < 212.25740236830356. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.288555561820578 (T) = (0 -145357.86031815005) / Math.Sqrt((1085221277.387856 / (299)) + (2513736.7529260614 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.1115170401773395 = (163602.30515525385 - 145357.86031815005) / 163602.30515525385 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Serialization.Tests.WriteJson<HashSet<String>>.SerializeToString ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 147.79556736760125 < 215.77106930434073. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.31480536501444 (T) = (0 -147714.81403388965) / Math.Sqrt((1141303461.0135963 / (299)) + (1265866.0590052165 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.12162720910012902 = (168168.70418146663 - 147714.81403388965) / 168168.70418146663 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Serialization.Tests.WriteJson<HashSet<String>>.SerializeToUtf8Bytes ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 140.6824029761905 < 206.39434454222055. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.984888422834722 (T) = (0 -139858.2521598102) / Math.Sqrt((1101512442.7193856 / (299)) + (1546436.8407588238 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12234945845380413 = (159355.28497870656 - 139858.2521598102) / 159355.28497870656 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Serialization.Tests.WriteJson<HashSet<String>>.SerializeObjectProperty ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 153.44086738445378 < 224.52848554657055. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.774485022653261 (T) = (0 -154820.8654937821) / Math.Sqrt((1171111514.9233866 / (299)) + (16586493.93487619 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11540680530846455 = (175019.28165722475 - 154820.8654937821) / 175019.28165722475 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in System.Security.Cryptography.Tests.Perf_Rfc2898DeriveBytes

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[DeriveBytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Security.Cryptography.Tests.Perf_Rfc2898DeriveBytes.DeriveBytes.html>)	24.25 ms	20.91 ms	0.86	0.02	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Security.Cryptography.Tests.Perf_Rfc2898DeriveBytes*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Security.Cryptography.Tests.Perf_Rfc2898DeriveBytes.DeriveBytes ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 20.90858933939394 < 23.110031618309527. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.089048058905233 (T) = (0 -20669415.787438825) / Math.Sqrt((1946531824659.3481 / (299)) + (89199514310.35268 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.05572887838644277 = (21889280.85836112 - 20669415.787438825) / 21889280.85836112 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Threading.Channels.Tests.UnboundedChannelPerfTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ReadAsyncThenWriteAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Threading.Channels.Tests.UnboundedChannelPerfTests.ReadAsyncThenWriteAsync.html>)	1.71 μs	1.42 μs	0.83	0.08	False
[TryWriteThenTryRead - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Threading.Channels.Tests.UnboundedChannelPerfTests.TryWriteThenTryRead.html>)	509.86 ns	406.38 ns	0.80	0.09	False
[WriteAsyncThenReadAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Threading.Channels.Tests.UnboundedChannelPerfTests.WriteAsyncThenReadAsync.html>)	949.51 ns	832.53 ns	0.88	0.06	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Threading.Channels.Tests.UnboundedChannelPerfTests*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Threading.Channels.Tests.UnboundedChannelPerfTests.ReadAsyncThenWriteAsync ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.4212238720047314 < 1.602756867896116. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.28839581357389 (T) = (0 -1465.5788000116775) / Math.Sqrt((3725.454694995428 / (299)) + (934.0282538080821 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.07932373380388652 = (1591.850310279959 - 1465.5788000116775) / 1591.850310279959 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Threading.Channels.Tests.UnboundedChannelPerfTests.TryWriteThenTryRead ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 406.3764648186119 < 472.7510460072791. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.096276681925113 (T) = (0 -412.76510584384647) / Math.Sqrt((1011.4265784510654 / (299)) + (58.230368354068304 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.08345220283286872 = (450.3476055690954 - 412.76510584384647) / 450.3476055690954 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Threading.Channels.Tests.UnboundedChannelPerfTests.WriteAsyncThenReadAsync ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 832.5255556590715 < 928.9928473479478. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 15.09379356506207 (T) = (0 -818.8755972392347) / Math.Sqrt((1437.755459038099 / (299)) + (369.69269341385996 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.09910156927130928 = (908.9544051895929 - 818.8755972392347) / 908.9544051895929 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Memory.MemoryMarshal<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Read - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.MemoryMarshal(Int32).Read.html>)	33.13 ns	23.61 ns	0.71	0.10	False
[CastToByte - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.MemoryMarshal(Int32).CastToByte.html>)	45.17 ns	33.02 ns	0.73	0.16	False
[GetReference - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.MemoryMarshal(Int32).GetReference.html>)	24.88 ns	16.70 ns	0.67	0.26	False
[TryGetArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.MemoryMarshal(Int32).TryGetArray.html>)	100.50 ns	90.49 ns	0.90	0.14	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Memory.MemoryMarshal<Int32>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Memory.MemoryMarshal<Int32>.Read ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 23.613360067730106 < 30.369637053420796. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.537433137425712 (T) = (0 -24.081882794727274) / Math.Sqrt((11.846389367992108 / (299)) + (0.1973145919444648 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.07744065590910566 = (26.10334278111721 - 24.081882794727274) / 26.10334278111721 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.MemoryMarshal<Int32>.CastToByte ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 33.022723836171785 < 42.90340577386016. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 3.8336895186722706 (T) = (0 -33.38036863260591) / Math.Sqrt((32.191166772888145 / (299)) + (2.1317658797699397 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.05779993828859287 = (35.42811127816526 - 33.38036863260591) / 35.42811127816526 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.MemoryMarshal<Int32>.GetReference ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 16.702818717796262 < 23.650094614971245. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 6.327216762188739 (T) = (0 -16.884289392675857) / Math.Sqrt((13.645598659792295 / (299)) + (0.5316367617211802 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10103051488007392 = (18.781827049917524 - 16.884289392675857) / 18.781827049917524 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.MemoryMarshal<Int32>.TryGetArray ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 90.48830170257146 < 96.75635269565728. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 3.6813101520841474 (T) = (0 -83.95877368744576) / Math.Sqrt((58.320755715038594 / (299)) + (17.850956971078634 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.05381542972925805 = (88.73403385073351 - 83.95877368744576) / 88.73403385073351 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in System.Numerics.Tests.Perf_VectorOf<Double>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[AndNotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).AndNotBenchmark.html>)	123.73 ns	85.39 ns	0.69	0.27	False
[LessThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).LessThanAnyBenchmark.html>)	129.06 ns	73.94 ns	0.57	0.25	False
[AddBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).AddBenchmark.html>)	89.58 ns	58.87 ns	0.66	0.24	False
[MaxBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).MaxBenchmark.html>)	99.75 ns	58.91 ns	0.59	0.20	False
[LessThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).LessThanOrEqualAllBenchmark.html>)	197.51 ns	113.94 ns	0.58	0.25	False
[LessThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).LessThanOrEqualBenchmark.html>)	101.44 ns	55.16 ns	0.54	0.18	False
[EqualsStaticBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).EqualsStaticBenchmark.html>)	87.61 ns	51.25 ns	0.58	0.20	False
[DivisionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).DivisionOperatorBenchmark.html>)	86.71 ns	54.81 ns	0.63	0.19	False
[MultiplyOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).MultiplyOperatorBenchmark.html>)	86.64 ns	51.53 ns	0.59	0.21	False
[EqualsAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).EqualsAllBenchmark.html>)	37.64 ns	23.27 ns	0.62	0.33	False
[InequalityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).InequalityOperatorBenchmark.html>)	39.90 ns	23.99 ns	0.60	0.31	False
[GreaterThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).GreaterThanAllBenchmark.html>)	160.49 ns	98.35 ns	0.61	0.24	False
[LessThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).LessThanBenchmark.html>)	97.71 ns	56.45 ns	0.58	0.22	False
[LessThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).LessThanOrEqualAnyBenchmark.html>)	149.46 ns	73.40 ns	0.49	0.28	False
[EqualityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).EqualityOperatorBenchmark.html>)	39.18 ns	23.63 ns	0.60	0.27	False
[MinBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).MinBenchmark.html>)	103.19 ns	58.11 ns	0.56	0.21	False
[SubtractionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).SubtractionOperatorBenchmark.html>)	87.01 ns	51.59 ns	0.59	0.20	False
[MultiplyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).MultiplyBenchmark.html>)	90.26 ns	54.20 ns	0.60	0.23	False
[OneBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).OneBenchmark.html>)	47.50 ns	34.29 ns	0.72	0.17	False
[UnaryNegateOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).UnaryNegateOperatorBenchmark.html>)	88.62 ns	52.62 ns	0.59	0.23	False
[OnesComplementBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).OnesComplementBenchmark.html>)	83.50 ns	61.01 ns	0.73	0.21	False
[AddOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).AddOperatorBenchmark.html>)	86.50 ns	51.38 ns	0.59	0.23	False
[GreaterThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).GreaterThanBenchmark.html>)	87.96 ns	50.77 ns	0.58	0.21	False
[LessThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).LessThanAllBenchmark.html>)	194.27 ns	115.50 ns	0.59	0.25	False
[GreaterThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).GreaterThanAnyBenchmark.html>)	138.64 ns	82.41 ns	0.59	0.26	False
[GetHashCodeBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).GetHashCodeBenchmark.html>)	303.14 ns	222.27 ns	0.73	0.06	False
[DivideBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).DivideBenchmark.html>)	90.08 ns	54.45 ns	0.60	0.21	False
[ConditionalSelectBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).ConditionalSelectBenchmark.html>)	194.78 ns	143.90 ns	0.74	0.34	False
[GreaterThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).GreaterThanOrEqualBenchmark.html>)	91.26 ns	51.42 ns	0.56	0.23	False
[EqualsAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).EqualsAnyBenchmark.html>)	139.44 ns	81.77 ns	0.59	0.25	False
[DotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).DotBenchmark.html>)	64.97 ns	35.36 ns	0.54	0.29	False
[SquareRootBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).SquareRootBenchmark.html>)	57.30 ns	34.43 ns	0.60	0.19	False
[GreaterThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).GreaterThanOrEqualAnyBenchmark.html>)	144.51 ns	93.20 ns	0.64	0.27	False
[GreaterThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).GreaterThanOrEqualAllBenchmark.html>)	166.31 ns	105.29 ns	0.63	0.24	False
[SubtractBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).SubtractBenchmark.html>)	89.90 ns	53.87 ns	0.60	0.21	False
[NegateBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).NegateBenchmark.html>)	89.78 ns	55.18 ns	0.61	0.25	False
[AbsBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).AbsBenchmark.html>)	88.49 ns	53.11 ns	0.60	0.25	False
[OnesComplementOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Double).OnesComplementOperatorBenchmark.html>)	83.46 ns	67.97 ns	0.81	0.21	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_VectorOf<Double>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorOf<Double>.AndNotBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 85.39148284924947 < 112.61689618586713. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.397522144396435 (T) = (0 -86.65125727692173) / Math.Sqrt((202.02857822209722 / (299)) + (5.681902929327715 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.0956909589958518 = (95.82040358758753 - 86.65125727692173) / 95.82040358758753 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.LessThanAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 73.9415510835509 < 123.16474199680748. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 5.647498683640655 (T) = (0 -76.68576336431659) / Math.Sqrt((593.6612008966327 / (299)) + (19.37219541355968 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12259753972389584 = (87.40089848868766 - 76.68576336431659) / 87.40089848868766 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.AddBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 58.87427435553036 < 85.56564678510979. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 6.39206881199154 (T) = (0 -56.13304047321651) / Math.Sqrt((224.15593208522054 / (299)) + (9.5345347985606 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12396530876257872 = (64.076275785297 - 56.13304047321651) / 64.076275785297 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.MaxBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 58.91449533013708 < 95.21591844373735. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.35690166198965 (T) = (0 -57.09394639733023) / Math.Sqrt((330.4543925199368 / (299)) + (0.5682458446118578 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1630025112355735 = (68.2128048933721 - 57.09394639733023) / 68.2128048933721 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.LessThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 113.94323036517821 < 188.2392149880469. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 15.745541618085973 (T) = (0 -114.81696290813147) / Math.Sqrt((948.8135311512578 / (299)) + (4.377285300664267 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.20581679826778543 = (144.57238916373586 - 114.81696290813147) / 144.57238916373586 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.LessThanOrEqualBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 55.16226292771791 < 96.3467576001956. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 6.420810210688882 (T) = (0 -57.610463910888996) / Math.Sqrt((352.8437898657277 / (299)) + (20.535280141472633 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1593198242814368 = (68.52839590471729 - 57.610463910888996) / 68.52839590471729 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.EqualsStaticBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 51.25428926559679 < 83.51282904188564. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.34352814034276 (T) = (0 -51.259155614902745) / Math.Sqrt((238.59830514341016 / (299)) + (3.894143278812992 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1470875271960514 = (60.09896355060718 - 51.259155614902745) / 60.09896355060718 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.DivisionOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 54.807466957487584 < 82.40548756110698. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 6.6781801436297945 (T) = (0 -55.2417338011978) / Math.Sqrt((195.14188250937 / (299)) + (5.420258398332691 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11272029510266193 = (62.25966118270394 - 55.2417338011978) / 62.25966118270394 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.MultiplyOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 51.528532951429696 < 82.307062427812. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.061829889930848 (T) = (0 -52.55680652053803) / Math.Sqrt((206.31426782150197 / (299)) + (1.8056276942310718 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.13649488639749877 = (60.86449945996683 - 52.55680652053803) / 60.86449945996683 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.EqualsAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 23.268157326429286 < 36.093759564957736. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 5.248464695414843 (T) = (0 -23.911766329548257) / Math.Sqrt((43.988826731859774 / (299)) + (2.289006120381543 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11314798136389684 = (26.962521172723218 - 23.911766329548257) / 26.962521172723218 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.InequalityOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 23.98782128174094 < 37.53406929416649. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.418240822830714 (T) = (0 -23.828678534004222) / Math.Sqrt((49.197826691103536 / (299)) + (1.8062164249823514 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.15146100870857393 = (28.082007755163243 - 23.828678534004222) / 28.082007755163243 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.GreaterThanAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 98.35471483641957 < 151.40183545435028. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 14.363285048189512 (T) = (0 -98.04449041560618) / Math.Sqrt((551.1461269194201 / (299)) + (5.191573644850913 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.18100521853606025 = (119.71320530315622 - 98.04449041560618) / 119.71320530315622 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.LessThanBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 56.44798121754677 < 92.84504423542735. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 6.383185064421852 (T) = (0 -57.72724084098141) / Math.Sqrt((315.15694647919094 / (299)) + (8.062138585707851 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12683992866735852 = (66.11301035888697 - 57.72724084098141) / 66.11301035888697 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.LessThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 73.39733018995126 < 127.36461301565599. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.067149064715634 (T) = (0 -73.72491012255429) / Math.Sqrt((629.4411779110314 / (299)) + (0.14557478885664774 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.17927133046032812 = (89.82860336035894 - 73.72491012255429) / 89.82860336035894 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.EqualityOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 23.633935176205217 < 36.141681929748096. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.9134720690655085 (T) = (0 -23.441125638576008) / Math.Sqrt((41.12351734925747 / (299)) + (0.5019550647135206 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12508999713552757 = (26.792613596632002 - 23.441125638576008) / 26.792613596632002 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.MinBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 58.113615793409224 < 96.61545570485833. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.0519897431581855 (T) = (0 -59.65701358611866) / Math.Sqrt((318.8447317818955 / (299)) + (12.008603936051909 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.14795934494886606 = (70.01662800061862 - 59.65701358611866) / 70.01662800061862 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.SubtractionOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 51.591684944675514 < 82.7683846641575. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.8214279612109765 (T) = (0 -52.98880450925436) / Math.Sqrt((225.12323103852628 / (299)) + (3.088875755306143 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.1304905983770979 = (60.94103687706311 - 52.98880450925436) / 60.94103687706311 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.MultiplyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 54.203818096627685 < 85.67132519606218. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.091658529880707 (T) = (0 -55.40290399742503) / Math.Sqrt((227.08191875234846 / (299)) + (8.225710283435411 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.1358065716341625 = (64.1093789641402 - 55.40290399742503) / 64.1093789641402 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.OneBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 34.28857966869998 < 45.87839776248975. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.9524114808683 (T) = (0 -34.9400526827292) / Math.Sqrt((29.52989891721704 / (299)) + (0.3315732967240273 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.09195477649281227 = (38.4783177954271 - 34.9400526827292) / 38.4783177954271 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.UnaryNegateOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 52.6156539303451 < 84.13435466822618. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.371757563081415 (T) = (0 -53.664929644317816) / Math.Sqrt((220.6967159419329 / (299)) + (4.3468996858298246 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.14242001151199293 = (62.577171068245256 - 53.664929644317816) / 62.577171068245256 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.OnesComplementBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 61.011311324596136 < 80.25208722926287. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.641748695386438 (T) = (0 -62.067565319304855) / Math.Sqrt((90.92757674460954 / (299)) + (2.324751649145691 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.09877909228700145 = (68.87053416993162 - 62.067565319304855) / 68.87053416993162 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.AddOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 51.38357002066066 < 81.97067589881634. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.250443962883082 (T) = (0 -52.72945841907357) / Math.Sqrt((218.40724817958184 / (299)) + (3.1734324893752177 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.13499962976375018 = (60.95888537558897 - 52.72945841907357) / 60.95888537558897 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.GreaterThanBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 50.76890420261908 < 83.27328049353275. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.93125782425169 (T) = (0 -51.44283795817153) / Math.Sqrt((240.55788810165186 / (299)) + (1.2868751092217383 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.14220545663131884 = (59.9710482607504 - 51.44283795817153) / 59.9710482607504 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.LessThanAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 115.50073420296097 < 184.62052674472093. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.825140970963153 (T) = (0 -116.46751672647775) / Math.Sqrt((899.8083898291205 / (299)) + (13.740619005273851 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.18330478690467467 = (142.60830094137404 - 116.46751672647775) / 142.60830094137404 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.GreaterThanAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 82.40850367748477 < 134.82677142705555. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.844517543142812 (T) = (0 -82.31183344628329) / Math.Sqrt((575.060254256328 / (299)) + (1.1202053319319407 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.15788603121567343 = (97.74429174367981 - 82.31183344628329) / 97.74429174367981 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.GetHashCodeBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 222.2707783405816 < 285.35187351687523. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 14.139924678845297 (T) = (0 -224.33252505618646) / Math.Sqrt((871.364464786746 / (299)) + (4.36630966371062 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10243180669046406 = (249.93368384525965 - 224.33252505618646) / 249.93368384525965 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.DivideBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 54.44965392748522 < 85.88023013866133. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.582028506574439 (T) = (0 -55.04499316231656) / Math.Sqrt((207.39259079501647 / (299)) + (0.14412325805436774 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.16118467761139713 = (65.62230289924955 - 55.04499316231656) / 65.62230289924955 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.ConditionalSelectBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 143.89644543109054 < 184.78752087224393. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 3.59308456283965 (T) = (0 -149.06324813569555) / Math.Sqrt((526.43533439242 / (299)) + (66.84077912428246 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.06126509187233068 = (158.79163206256598 - 149.06324813569555) / 158.79163206256598 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.GreaterThanOrEqualBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 51.419032911078546 < 86.39955428775394. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.135470399789776 (T) = (0 -52.13865746531989) / Math.Sqrt((274.6302433000004 / (299)) + (6.295183755764469 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1578546125465274 = (61.91170579581246 - 52.13865746531989) / 61.91170579581246 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.EqualsAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 81.76901121397863 < 132.99200699325522. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.028865538084272 (T) = (0 -82.33393639974065) / Math.Sqrt((599.5699158286137 / (299)) + (0.9940120546568881 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.16217357539607194 = (98.27087566337262 - 82.33393639974065) / 98.27087566337262 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.DotBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 35.35579996898182 < 60.89427246507271. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.576083779142158 (T) = (0 -36.19628661085314) / Math.Sqrt((136.6961536653066 / (299)) + (4.11185664400709 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.17484727097570513 = (43.866166029231444 - 36.19628661085314) / 43.866166029231444 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.SquareRootBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 34.433975352815665 < 54.612930075595024. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.004221939024502 (T) = (0 -35.01207477909515) / Math.Sqrt((91.98788304433036 / (299)) + (0.9203800072226811 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.13858281857002974 = (40.64473699140106 - 35.01207477909515) / 40.64473699140106 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.GreaterThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 93.20344687526081 < 136.71711115509424. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.458416548482727 (T) = (0 -84.04666481294593) / Math.Sqrt((610.5659452325674 / (299)) + (9.534104160502174 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.15933618026091048 = (99.97654572434301 - 84.04666481294593) / 99.97654572434301 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.GreaterThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 105.28818878034902 < 156.01226968557052. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.358083864394729 (T) = (0 -100.33432285309037) / Math.Sqrt((563.2617485115221 / (299)) + (18.328151932348923 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.17292302119712863 = (121.31195212121172 - 100.33432285309037) / 121.31195212121172 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.SubtractBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 53.87408862499582 < 85.57401962442871. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.829455739320167 (T) = (0 -54.085883066000726) / Math.Sqrt((224.1906705628625 / (299)) + (0.6834087892787479 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.15284307617854784 = (63.84399577592301 - 54.085883066000726) / 63.84399577592301 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.NegateBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 55.17947181150941 < 84.61258916690993. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 4.317121368376848 (T) = (0 -55.40207035659572) / Math.Sqrt((231.4248189428557 / (299)) + (26.318971121894094 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11834346929729973 = (62.83860939864985 - 55.40207035659572) / 62.83860939864985 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.AbsBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 53.106336103353456 < 83.7481768432693. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.156158420158166 (T) = (0 -52.888484603337766) / Math.Sqrt((210.74288417829467 / (299)) + (0.8356470438517152 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.15710656902835576 = (62.746348067241 - 52.888484603337766) / 62.746348067241 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Double>.OnesComplementOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 67.96763661100216 < 80.0084848745921. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 4.67776604897762 (T) = (0 -63.72900460490254) / Math.Sqrt((88.21477174957397 / (299)) + (10.68069652703844 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.07399312553802863 = (68.82130831040577 - 63.72900460490254) / 68.82130831040577 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22%5cs%5ba-zA-Z%5d%7b0%2c12%7ding%5cs%22%2c%20Options%3a%20NonBacktracking).html>)	109.48 ms	64.15 ms	0.59	0.12	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22(%3fi)Sherlock%7cHolmes%7cWatson%7cIrene%7cAdler%7cJohn%7cBaker%22%2c%20Options%3a%20Compiled).html>)	75.53 ms	51.13 ms	0.68	0.02	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22(%3fm)%5eSherlock%20Holmes%7cSherlock%20Holmes%24%22%2c%20Options%3a%20None).html>)	4.32 ms	2.43 ms	0.56	0.08	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22aqj%22%2c%20Options%3a%20None).html>)	7.05 ms	4.65 ms	0.66	0.12	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22Sherlock%22%2c%20Options%3a%20Compiled).html>)	4.02 ms	2.37 ms	0.59	0.06	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22(%3fi)Sherlock%22%2c%20Options%3a%20Compiled).html>)	8.54 ms	6.29 ms	0.74	0.09	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22%5cp%7bL%7d%22%2c%20Options%3a%20None).html>)	518.98 ms	372.06 ms	0.72	0.05	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22(%3fm)%5eSherlock%20Holmes%7cSherlock%20Holmes%24%22%2c%20Options%3a%20Compiled).html>)	4.09 ms	2.44 ms	0.60	0.06	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22%5cw%2b%5cs%2bHolmes%5cs%2b%5cw%2b%22%2c%20Options%3a%20NonBacktracking).html>)	111.72 ms	57.51 ms	0.51	0.14	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22%5cw%2b%5cs%2bHolmes%22%2c%20Options%3a%20None).html>)	235.34 ms	164.76 ms	0.70	0.04	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22Sherlock%20Holmes%22%2c%20Options%3a%20Compiled).html>)	4.03 ms	2.39 ms	0.59	0.07	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22Sherlock%20Holmes%22%2c%20Options%3a%20None).html>)	4.06 ms	2.39 ms	0.59	0.03	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22(%3fi)Sherlock%7cHolmes%7cWatson%7cIrene%7cAdler%7cJohn%7cBaker%22%2c%20Options%3a%20NonBacktracking).html>)	54.47 ms	33.66 ms	0.62	0.04	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22%5ba-q%5d%5b%5eu-z%5d%7b13%7dx%22%2c%20Options%3a%20None).html>)	4.59 ms	2.79 ms	0.61	0.04	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22the%5cs%2b%5cw%2b%22%2c%20Options%3a%20Compiled).html>)	22.70 ms	16.64 ms	0.73	0.03	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22Sherlock%7cHolmes%22%2c%20Options%3a%20None).html>)	8.90 ms	5.53 ms	0.62	0.02	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22aei%22%2c%20Options%3a%20NonBacktracking).html>)	7.19 ms	4.53 ms	0.63	0.13	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22aei%22%2c%20Options%3a%20None).html>)	6.98 ms	4.70 ms	0.67	0.09	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22%5cw%2b%5cs%2bHolmes%5cs%2b%5cw%2b%22%2c%20Options%3a%20None).html>)	227.25 ms	165.77 ms	0.73	0.02	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22%5cb%5cw%2bn%5cb%22%2c%20Options%3a%20Compiled).html>)	587.62 ms	425.97 ms	0.72	0.04	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22Sherlock%7cHolmes%7cWatson%7cIrene%7cAdler%7cJohn%7cBaker%22%2c%20Options%3a%20Compiled).html>)	67.18 ms	47.95 ms	0.71	0.02	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22%5cp%7bLl%7d%22%2c%20Options%3a%20None).html>)	505.68 ms	374.99 ms	0.74	0.07	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22(%3fi)Sherlock%7cHolmes%7cWatson%7cIrene%7cAdler%7cJohn%7cBaker%22%2c%20Options%3a%20None).html>)	542.55 ms	377.70 ms	0.70	0.05	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22%5cb%5cw%2bn%5cb%22%2c%20Options%3a%20NonBacktracking).html>)	184.31 ms	91.42 ms	0.50	0.06	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22(%3fi)the%22%2c%20Options%3a%20None).html>)	24.70 ms	17.71 ms	0.72	0.03	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22.*%22%2c%20Options%3a%20None).html>)	32.75 ms	23.75 ms	0.73	0.03	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22aqj%22%2c%20Options%3a%20Compiled).html>)	7.33 ms	4.52 ms	0.62	0.08	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22Sherlock%7cHolmes%7cWatson%22%2c%20Options%3a%20None).html>)	12.85 ms	9.47 ms	0.74	0.04	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22(%3fi)Sher%5ba-z%5d%2b%7cHol%5ba-z%5d%2b%22%2c%20Options%3a%20Compiled).html>)	27.39 ms	18.64 ms	0.68	0.05	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22%5cp%7bLu%7d%22%2c%20Options%3a%20Compiled).html>)	46.43 ms	30.00 ms	0.65	0.05	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22Sherlock%7cStreet%22%2c%20Options%3a%20NonBacktracking).html>)	4.56 ms	2.77 ms	0.61	0.04	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22Sher%5ba-z%5d%2b%7cHol%5ba-z%5d%2b%22%2c%20Options%3a%20Compiled).html>)	8.06 ms	4.95 ms	0.61	0.02	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22Sher%5ba-z%5d%2b%7cHol%5ba-z%5d%2b%22%2c%20Options%3a%20NonBacktracking).html>)	9.31 ms	5.42 ms	0.58	0.04	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22Sherlock%7cHolmes%7cWatson%7cIrene%7cAdler%7cJohn%7cBaker%22%2c%20Options%3a%20NonBacktracking).html>)	47.98 ms	32.57 ms	0.68	0.06	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22aqj%22%2c%20Options%3a%20NonBacktracking).html>)	7.11 ms	4.50 ms	0.63	0.11	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22Sherlock%5cs%2bHolmes%22%2c%20Options%3a%20NonBacktracking).html>)	4.59 ms	2.77 ms	0.60	0.04	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22Sherlock%7cHolmes%22%2c%20Options%3a%20Compiled).html>)	7.31 ms	4.30 ms	0.59	0.04	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22Sherlock%7cHolmes%7cWatson%7cIrene%7cAdler%7cJohn%7cBaker%22%2c%20Options%3a%20None).html>)	54.64 ms	35.57 ms	0.65	0.01	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22%5cw%2b%5cs%2bHolmes%5cs%2b%5cw%2b%22%2c%20Options%3a%20Compiled).html>)	224.82 ms	165.76 ms	0.74	0.05	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22%5cp%7bLl%7d%22%2c%20Options%3a%20Compiled).html>)	514.44 ms	366.67 ms	0.71	0.07	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22Sherlock%22%2c%20Options%3a%20None).html>)	4.06 ms	2.37 ms	0.59	0.04	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22%5ba-zA-Z%5d%2bing%22%2c%20Options%3a%20NonBacktracking).html>)	141.02 ms	82.91 ms	0.59	0.07	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22%5cw%2b%5cs%2bHolmes%22%2c%20Options%3a%20Compiled).html>)	227.41 ms	162.56 ms	0.71	0.05	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22(%3fs).*%22%2c%20Options%3a%20None).html>)	42.31 ms	27.00 ms	0.64	0.10	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22%5ba-zA-Z%5d%2bing%22%2c%20Options%3a%20None).html>)	309.31 ms	219.50 ms	0.71	0.06	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22%5ba-zA-Z%5d%2bing%22%2c%20Options%3a%20Compiled).html>)	309.70 ms	220.15 ms	0.71	0.04	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22%5cw%2b%22%2c%20Options%3a%20Compiled).html>)	208.44 ms	140.73 ms	0.68	0.05	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22Holmes%22%2c%20Options%3a%20None).html>)	4.56 ms	2.78 ms	0.61	0.07	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22Sherlock%7cHolmes%7cWatson%22%2c%20Options%3a%20Compiled).html>)	9.72 ms	7.11 ms	0.73	0.06	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22%5cp%7bLu%7d%22%2c%20Options%3a%20None).html>)	46.16 ms	30.02 ms	0.65	0.03	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22.*%22%2c%20Options%3a%20Compiled).html>)	32.26 ms	23.15 ms	0.72	0.03	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22zqj%22%2c%20Options%3a%20Compiled).html>)	3.83 ms	2.23 ms	0.58	0.11	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22the%5cs%2b%5cw%2b%22%2c%20Options%3a%20None).html>)	22.74 ms	16.43 ms	0.72	0.04	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22The%22%2c%20Options%3a%20Compiled).html>)	4.85 ms	2.95 ms	0.61	0.03	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22(%3fi)Sherlock%7cHolmes%7cWatson%22%2c%20Options%3a%20Compiled).html>)	50.43 ms	31.88 ms	0.63	0.03	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22Sherlock%20Holmes%22%2c%20Options%3a%20NonBacktracking).html>)	4.30 ms	2.67 ms	0.62	0.05	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22Sherlock%5cs%2bHolmes%22%2c%20Options%3a%20Compiled).html>)	4.14 ms	2.46 ms	0.59	0.05	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22(%3fi)Holmes%22%2c%20Options%3a%20NonBacktracking).html>)	12.88 ms	8.73 ms	0.68	0.06	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22Holmes%22%2c%20Options%3a%20Compiled).html>)	4.55 ms	2.74 ms	0.60	0.06	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22%5ba-q%5d%5b%5eu-z%5d%7b13%7dx%22%2c%20Options%3a%20NonBacktracking).html>)	4.78 ms	3.11 ms	0.65	0.06	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22The%22%2c%20Options%3a%20NonBacktracking).html>)	5.59 ms	3.60 ms	0.64	0.04	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22Sherlock%7cHolmes%7cWatson%22%2c%20Options%3a%20NonBacktracking).html>)	9.83 ms	7.40 ms	0.75	0.07	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22Sher%5ba-z%5d%2b%7cHol%5ba-z%5d%2b%22%2c%20Options%3a%20None).html>)	9.60 ms	6.02 ms	0.63	0.02	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22Sherlock%7cStreet%22%2c%20Options%3a%20Compiled).html>)	4.48 ms	2.70 ms	0.60	0.05	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22(%3fi)Sherlock%7cHolmes%7cWatson%22%2c%20Options%3a%20NonBacktracking).html>)	43.04 ms	26.68 ms	0.62	0.03	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22%5cs%5ba-zA-Z%5d%7b0%2c12%7ding%5cs%22%2c%20Options%3a%20None).html>)	332.16 ms	236.69 ms	0.71	0.07	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22%5cp%7bL%7d%22%2c%20Options%3a%20Compiled).html>)	524.96 ms	371.65 ms	0.71	0.07	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22(%3fi)the%22%2c%20Options%3a%20Compiled).html>)	24.49 ms	17.17 ms	0.70	0.04	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22zqj%22%2c%20Options%3a%20None).html>)	3.84 ms	2.30 ms	0.60	0.07	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22the%22%2c%20Options%3a%20None).html>)	15.62 ms	11.01 ms	0.71	0.03	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22Sherlock%5cs%2bHolmes%22%2c%20Options%3a%20None).html>)	4.11 ms	2.46 ms	0.60	0.07	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22zqj%22%2c%20Options%3a%20NonBacktracking).html>)	3.95 ms	2.23 ms	0.56	0.10	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22%5b%5e%5cn%5d*%22%2c%20Options%3a%20Compiled).html>)	32.36 ms	23.53 ms	0.73	0.02	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22The%22%2c%20Options%3a%20None).html>)	4.85 ms	2.95 ms	0.61	0.03	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22(%3fi)Sher%5ba-z%5d%2b%7cHol%5ba-z%5d%2b%22%2c%20Options%3a%20NonBacktracking).html>)	27.85 ms	18.67 ms	0.67	0.04	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22%5cs%5ba-zA-Z%5d%7b0%2c12%7ding%5cs%22%2c%20Options%3a%20Compiled).html>)	331.39 ms	235.83 ms	0.71	0.05	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22(%3fm)%5eSherlock%20Holmes%7cSherlock%20Holmes%24%22%2c%20Options%3a%20NonBacktracking).html>)	4.33 ms	2.58 ms	0.60	0.06	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22(%3fi)Holmes%22%2c%20Options%3a%20None).html>)	12.55 ms	8.39 ms	0.67	0.06	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22aei%22%2c%20Options%3a%20Compiled).html>)	7.27 ms	4.50 ms	0.62	0.07	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22Sherlock%7cStreet%22%2c%20Options%3a%20None).html>)	5.18 ms	3.23 ms	0.62	0.03	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22(%3fi)Sherlock%20Holmes%22%2c%20Options%3a%20None).html>)	8.56 ms	6.29 ms	0.73	0.12	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22Sherlock%7cHolmes%22%2c%20Options%3a%20NonBacktracking).html>)	7.73 ms	4.59 ms	0.59	0.04	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22(%3fi)Holmes%22%2c%20Options%3a%20Compiled).html>)	12.62 ms	8.17 ms	0.65	0.05	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22%5b%5e%5cn%5d*%22%2c%20Options%3a%20None).html>)	32.60 ms	23.77 ms	0.73	0.04	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22(%3fs).*%22%2c%20Options%3a%20Compiled).html>)	44.34 ms	26.92 ms	0.61	0.14	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22Holmes.%7b0%2c25%7dWatson%7cWatson.%7b0%2c25%7dHolmes%22%2c%20Options%3a%20NonBacktracking).html>)	8.86 ms	4.86 ms	0.55	0.05	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22the%22%2c%20Options%3a%20Compiled).html>)	15.90 ms	11.26 ms	0.71	0.03	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22%5cw%2b%22%2c%20Options%3a%20None).html>)	198.91 ms	138.75 ms	0.70	0.05	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22%5cw%2b%5cs%2bHolmes%22%2c%20Options%3a%20NonBacktracking).html>)	101.50 ms	57.78 ms	0.57	0.10	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22Holmes.%7b0%2c25%7dWatson%7cWatson.%7b0%2c25%7dHolmes%22%2c%20Options%3a%20Compiled).html>)	10.37 ms	6.42 ms	0.62	0.03	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22Holmes%22%2c%20Options%3a%20NonBacktracking).html>)	5.24 ms	3.29 ms	0.63	0.05	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22%5ba-q%5d%5b%5eu-z%5d%7b13%7dx%22%2c%20Options%3a%20Compiled).html>)	4.66 ms	2.82 ms	0.60	0.06	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22(%3fi)Sherlock%7cHolmes%7cWatson%22%2c%20Options%3a%20None).html>)	172.51 ms	120.32 ms	0.70	0.03	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22(%3fi)Sher%5ba-z%5d%2b%7cHol%5ba-z%5d%2b%22%2c%20Options%3a%20None).html>)	111.07 ms	77.45 ms	0.70	0.02	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22%5cb%5cw%2bn%5cb%22%2c%20Options%3a%20None).html>)	588.95 ms	427.70 ms	0.73	0.04	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22(%3fi)Sherlock%20Holmes%22%2c%20Options%3a%20Compiled).html>)	8.45 ms	6.37 ms	0.75	0.13	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22(%3fi)Sherlock%22%2c%20Options%3a%20NonBacktracking).html>)	8.45 ms	6.45 ms	0.76	0.11	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22Sherlock%22%2c%20Options%3a%20NonBacktracking).html>)	4.24 ms	2.51 ms	0.59	0.09	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22Holmes.%7b0%2c25%7dWatson%7cWatson.%7b0%2c25%7dHolmes%22%2c%20Options%3a%20None).html>)	11.88 ms	7.76 ms	0.65	0.07	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\s[a-zA-Z]{0,12}ing\s", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 64.14692085714286 < 104.78362170833333. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 6.882357806430982 (T) = (0 -75438166.73514818) / Math.Sqrt((196795394509808.66 / (299)) + (15257338031780.238 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.11541319378257918 = (85280682.69266768 - 75438166.73514818) / 85280682.69266768 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?i)Sherlock|Holmes|Watson|Irene|Adler|John|Baker", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 51.12765618333333 < 72.20386578749999. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.3545529465285 (T) = (0 -50826681.31162587) / Math.Sqrt((98538991485652.92 / (299)) + (310131039439.5819 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.12693338663044834 = (58216269.56443007 - 50826681.31162587) / 58216269.56443007 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?m)^Sherlock Holmes|Sherlock Holmes$", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.434630466836735 < 3.9023515813969487. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.061724205483415 (T) = (0 -2432080.138976202) / Math.Sqrt((480525843205.7376 / (299)) + (82420962.7901455 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.15451892185871932 = (2876563.6533497903 - 2432080.138976202) / 2876563.6533497903 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aqj", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 4.650905815848215 < 6.700689813782051. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.773762311897778 (T) = (0 -4574153.986338857) / Math.Sqrt((1037678476439.0187 / (299)) + (9538252864.198256 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12246025876238424 = (5212475.026929054 - 4574153.986338857) / 5212475.026929054 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.370579635204082 < 3.8291837397042414. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.020135557697179 (T) = (0 -2403827.845479818) / Math.Sqrt((464256009290.93884 / (299)) + (2650657036.4354334 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.1500494774869742 = (2828197.385387193 - 2403827.845479818) / 2828197.385387193 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?i)Sherlock", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.285135683760683 < 8.106740298719583. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 6.957145403035234 (T) = (0 -6334399.968696326) / Math.Sqrt((914906225532.6758 / (299)) + (11501748471.913752 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.06509082406301427 = (6775417.475550881 - 6334399.968696326) / 6775417.475550881 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\p{L}", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 372.05993166666667 < 506.2417395516666. IsChangePoint: Marked as a change because one of 4/20/2022 8:23:28 AM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 15.081389369395483 (T) = (0 -379946179.834768) / Math.Sqrt((2540003391908558 / (299)) + (95109480421967.23 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.13856092963977423 = (441059841.499744 - 379946179.834768) / 441059841.499744 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?m)^Sherlock Holmes|Sherlock Holmes$", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.437727746173469 < 3.8879851210236374. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.077887183664476 (T) = (0 -2443883.431256541) / Math.Sqrt((472328890734.5422 / (299)) + (2234539432.5995607 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.14829712249722543 = (2869408.447253461 - 2443883.431256541) / 2869408.447253461 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\w+\s+Holmes\s+\w+", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 57.50739344642857 < 97.20349252583333. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 4.487569395026059 (T) = (0 -70482744.71027306) / Math.Sqrt((182506091596432.16 / (299)) + (27705128932263.1 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.10122434477103956 = (78420843.17728631 - 70482744.71027306) / 78420843.17728631 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\w+\s+Holmes", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 164.76063216666665 < 217.22066533214286. IsChangePoint: Marked as a change because one of 4/20/2022 8:23:28 AM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.682661426647721 (T) = (0 -162475279.12684676) / Math.Sqrt((568004820921540.2 / (299)) + (13943520720276.375 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12017072958115137 = (184666826.3826905 - 162475279.12684676) / 184666826.3826905 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock Holmes", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.394940056662088 < 3.8304178446614587. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.737035247251479 (T) = (0 -2389019.217531873) / Math.Sqrt((465136729945.77686 / (299)) + (875767057.9800823 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.15379231450632602 = (2823206.7121183486 - 2389019.217531873) / 2823206.7121183486 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock Holmes", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.387193047831633 < 3.839482805980282. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.157564188738668 (T) = (0 -2398951.7648075134) / Math.Sqrt((459491011728.4731 / (299)) + (1980485289.9018314 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.1492546645612488 = (2819823.5886539565 - 2398951.7648075134) / 2819823.5886539565 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?i)Sherlock|Holmes|Watson|Irene|Adler|John|Baker", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 33.6639086 < 50.792371616666664. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 14.74404053650404 (T) = (0 -34318780.09924837) / Math.Sqrt((54445911837986.76 / (299)) + (107807951171.0856 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.15838956525220668 = (40777512.59052858 - 34318780.09924837) / 40777512.59052858 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "[a-q][^u-z]{13}x", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.7901740092147436 < 4.355845827653245. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.426066579024917 (T) = (0 -2790431.671469907) / Math.Sqrt((525403910119.8084 / (299)) + (117856510.73925962 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.14684946918325448 = (3270737.7780079986 - 2790431.671469907) / 3270737.7780079986 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "the\s+\w+", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 16.63800207555556 < 21.767553533181815. IsChangePoint: Marked as a change because one of 4/20/2022 8:23:28 AM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 14.534021267244922 (T) = (0 -16422955.316315195) / Math.Sqrt((5940639141596.364 / (299)) + (27675926457.413635 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11643930465498009 = (18587240.69873007 - 16422955.316315195) / 18587240.69873007 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock|Holmes", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.532487237878788 < 8.541720110596998. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.063205978663316 (T) = (0 -5577292.148172944) / Math.Sqrt((1813801645059.3008 / (299)) + (12853794458.06042 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.14352896851438482 = (6511944.8797920225 - 5577292.148172944) / 6511944.8797920225 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aei", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 4.53494123125 < 6.754214056267362. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.700212813765987 (T) = (0 -4476335.348123188) / Math.Sqrt((1035021775798.7856 / (299)) + (6180469491.409147 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1415038358089537 = (5214158.821945583 - 4476335.348123188) / 5214158.821945583 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aei", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 4.69696265703125 < 6.631389846636905. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.56611038912493 (T) = (0 -4591722.720170129) / Math.Sqrt((1028788234173.9384 / (299)) + (20244598346.098236 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11784687882895122 = (5205131.184113101 - 4591722.720170129) / 5205131.184113101 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\w+\s+Holmes\s+\w+", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 165.77104046666668 < 216.26214155892856. IsChangePoint: Marked as a change because one of 4/20/2022 8:23:28 AM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.047950063579924 (T) = (0 -163881745.694826) / Math.Sqrt((579131048015261.4 / (299)) + (7298194451203.422 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11270199135835719 = (184697524.5055618 - 163881745.694826) / 184697524.5055618 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\b\w+n\b", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 425.97225278571426 < 557.412650955. IsChangePoint: Marked as a change because one of 4/20/2022 8:23:28 AM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 14.53932242378488 (T) = (0 -425253115.94044566) / Math.Sqrt((3597581621117649.5 / (299)) + (21640728520573.836 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11282433102079967 = (479333609.8021593 - 425253115.94044566) / 479333609.8021593 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock|Holmes|Watson|Irene|Adler|John|Baker", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 47.951170607142856 < 64.32467666098216. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.13225721035605 (T) = (0 -47323204.53885282) / Math.Sqrt((62197035115472.52 / (299)) + (232019669749.78888 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.1172527868448342 = (53609010.40934188 - 47323204.53885282) / 53609010.40934188 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\p{Ll}", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 374.99085793333336 < 493.17796508595234. IsChangePoint: Marked as a change because one of 4/20/2022 8:23:28 AM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 15.725169928632988 (T) = (0 -371000433.70915747) / Math.Sqrt((2345099301223903 / (299)) + (63425487276845.08 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.13313216810516398 = (427978083.92336947 - 371000433.70915747) / 427978083.92336947 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?i)Sherlock|Holmes|Watson|Irene|Adler|John|Baker", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 377.70487353333334 < 507.2982900633333. IsChangePoint: Marked as a change because one of 4/7/2022 2:11:06 AM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 14.706262426872868 (T) = (0 -375901210.4801588) / Math.Sqrt((3418326633632626.5 / (299)) + (30506222493042.6 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12759104480306196 = (430877294.69180274 - 375901210.4801588) / 430877294.69180274 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\b\w+n\b", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 91.41531968333334 < 175.18616075260988. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 2.813612461147383 (T) = (0 -133219788.70318851) / Math.Sqrt((428223573772245.9 / (299)) + (201795306768176.8 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.0858599856511302 = (145732367.7030802 - 133219788.70318851) / 145732367.7030802 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?i)the", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.709809852380953 < 23.42345691392857. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.117558897749031 (T) = (0 -17215709.50708617) / Math.Sqrt((7818435816700.117 / (299)) + (109613072468.6328 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12520391542531192 = (19679682.85484059 - 17215709.50708617) / 19679682.85484059 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: ".*", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 23.75067882857143 < 31.035980179835157. IsChangePoint: Marked as a change because one of 4/20/2022 8:23:28 AM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 15.10669695599834 (T) = (0 -23319347.94957315) / Math.Sqrt((11281007194428.271 / (299)) + (130886259560.174 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.12611588353113048 = (26684714.2660063 - 23319347.94957315) / 26684714.2660063 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aqj", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 4.5154082265625 < 6.6505626513106675. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.515533013450993 (T) = (0 -4581599.167917478) / Math.Sqrt((1037780962120.1934 / (299)) + (23537079587.116966 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12048387610825032 = (5209227.032296429 - 4581599.167917478) / 5209227.032296429 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock|Holmes|Watson", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 9.474021325714286 < 12.057825282329059. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.80738458037701 (T) = (0 -9574616.61988963) / Math.Sqrt((1705388052160.042 / (299)) + (19501900550.590908 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.0813628442037168 = (10422631.568380514 - 9574616.61988963) / 10422631.568380514 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?i)Sher[a-z]+|Hol[a-z]+", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 18.642618627218937 < 26.075779034097224. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.844608653698083 (T) = (0 -19010617.667009912) / Math.Sqrt((12587172895189.314 / (299)) + (92230758862.29262 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.10422463986757881 = (21222528.005458422 - 19010617.667009912) / 21222528.005458422 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\p{Lu}", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 30.00283775 < 44.295493756666666. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.948963578539898 (T) = (0 -30044261.931124087) / Math.Sqrt((45485215968597.5 / (299)) + (123943020787.70409 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1381536829200488 = (34860347.298249185 - 30044261.931124087) / 34860347.298249185 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock|Street", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.7668803005952385 < 4.328745299632983. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 14.534106767664257 (T) = (0 -2800114.8630745695) / Math.Sqrt((454585747773.52106 / (299)) + (1126662095.0720396 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.17255777241815967 = (3384060.868222509 - 2800114.8630745695) / 3384060.868222509 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sher[a-z]+|Hol[a-z]+", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 4.952436197142857 < 7.645748430714284. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.930771071035876 (T) = (0 -4989022.782101593) / Math.Sqrt((1584197230042.1501 / (299)) + (2838936756.746805 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.14015545520146014 = (5802238.104878031 - 4989022.782101593) / 5802238.104878031 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sher[a-z]+|Hol[a-z]+", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.416279837792642 < 8.82163002839506. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 2.807957056423204 (T) = (0 -5955148.046129963) / Math.Sqrt((2552254465022.7217 / (299)) + (44099858361.84729 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.05016295743940928 = (6269652.350129397 - 5955148.046129963) / 6269652.350129397 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock|Holmes|Watson|Irene|Adler|John|Baker", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 32.569048479591835 < 46.02480735288461. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.109140097614539 (T) = (0 -33477859.88542593) / Math.Sqrt((33345594501125.72 / (299)) + (627533446895.3525 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12770298603846003 = (38378968.802594095 - 33477859.88542593) / 38378968.802594095 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aqj", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 4.501022936458333 < 6.667804507795138. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.620281372562946 (T) = (0 -4565433.490434045) / Math.Sqrt((1050995170082.219 / (299)) + (22175252841.113815 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.12313279733137651 = (5206527.82603772 - 4565433.490434045) / 5206527.82603772 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock\s+Holmes", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.7737045996527776 < 4.389600756815476. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.743088142028029 (T) = (0 -2799494.0505456356) / Math.Sqrt((556278424659.4996 / (299)) + (290554778.2157353 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.1428776246391595 = (3266154.4384103552 - 2799494.0505456356) / 3266154.4384103552 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock|Holmes", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 4.299366401169592 < 6.9366060538340335. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.346125452299415 (T) = (0 -4341531.758280026) / Math.Sqrt((1454998007291.9917 / (299)) + (8831530954.380417 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.151367533902794 = (5115915.230354536 - 4341531.758280026) / 5115915.230354536 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock|Holmes|Watson|Irene|Adler|John|Baker", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 35.567345590476194 < 51.99122734553571. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.446208343931717 (T) = (0 -35450377.355782315) / Math.Sqrt((58444634627053.3 / (299)) + (39252507185.89063 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.13533350899749613 = (40998902.726854555 - 35450377.355782315) / 40998902.726854555 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\w+\s+Holmes\s+\w+", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 165.76367786666668 < 215.81396415384614. IsChangePoint: Marked as a change because one of 4/20/2022 8:23:28 AM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.30877200941642 (T) = (0 -163398416.53588077) / Math.Sqrt((579546348438627.8 / (299)) + (7719913534098.526 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.11687506236462535 = (185022990.03512552 - 163398416.53588077) / 185022990.03512552 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\p{Ll}", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 366.6674088666667 < 485.560173685. IsChangePoint: Marked as a change because one of 4/20/2022 2:49:46 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 18.183019837857337 (T) = (0 -366948779.1482296) / Math.Sqrt((2390589044148050.5 / (299)) + (36667923707380.26 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1414284262299645 = (427394512.4189671 - 366948779.1482296) / 427394512.4189671 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.3729478654761906 < 3.849317094658954. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.186500949901918 (T) = (0 -2382121.5924823936) / Math.Sqrt((458008260719.80865 / (299)) + (85209563.61344355 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1555619786611708 = (2820954.9218373857 - 2382121.5924823936) / 2820954.9218373857 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "[a-zA-Z]+ing", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 82.90961382142856 < 134.76342623571426. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 5.042534286284306 (T) = (0 -99225747.04181546) / Math.Sqrt((291086552720410.06 / (299)) + (34565957222692.375 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.09071556088832944 = (109125090.86678585 - 99225747.04181546) / 109125090.86678585 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\w+\s+Holmes", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 162.55542553846155 < 215.90766435166665. IsChangePoint: Marked as a change because one of 4/20/2022 8:23:28 AM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 14.829204300855743 (T) = (0 -162243144.46856478) / Math.Sqrt((562846491315778.8 / (299)) + (4529655440627.871 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.12160675243746533 = (184704453.18059477 - 162243144.46856478) / 184704453.18059477 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?s).*", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 27.00133795238095 < 40.10234004326923. IsChangePoint: Marked as a change because one of 4/7/2022 3:14:09 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.510929613410253 (T) = (0 -27273846.975034762) / Math.Sqrt((36914760101368.49 / (299)) + (215118093767.88397 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.13696171215128436 = (31602128.61820989 - 27273846.975034762) / 31602128.61820989 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "[a-zA-Z]+ing", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 219.4992515 < 292.7285699780952. IsChangePoint: Marked as a change because one of 4/20/2022 8:23:28 AM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.479888313911925 (T) = (0 -220568475.85760072) / Math.Sqrt((1156756158662772 / (299)) + (13293991967036.844 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11207508954838671 = (248408928.7971614 - 220568475.85760072) / 248408928.7971614 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "[a-zA-Z]+ing", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 220.14946913333333 < 293.56347551928576. IsChangePoint: Marked as a change because one of 4/20/2022 8:23:28 AM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.668236322203056 (T) = (0 -221381992.62252748) / Math.Sqrt((1170903853360236.2 / (299)) + (17701801005183.13 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10903522948377274 = (248474462.68190625 - 221381992.62252748) / 248474462.68190625 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\w+", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 140.72919466666664 < 185.23314208940474. IsChangePoint: Marked as a change because one of 4/20/2022 8:23:28 AM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.731087034443664 (T) = (0 -139792963.2157204) / Math.Sqrt((414125676660884.25 / (299)) + (10626077769684.002 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12892572575266767 = (160483402.3327242 - 139792963.2157204) / 160483402.3327242 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Holmes", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.7849819013888886 < 4.320441098716517. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.4394183615429 (T) = (0 -2755786.9271246693) / Math.Sqrt((528819516654.2131 / (299)) + (303753495.49273413 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1495279274777632 = (3240302.6697300696 - 2755786.9271246693) / 3240302.6697300696 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock|Holmes|Watson", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 7.1132885619047626 < 9.15756352302198. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.063187386823564 (T) = (0 -7227151.541363675) / Math.Sqrt((1017853190215.2838 / (299)) + (6761609779.311005 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.07320873247014031 = (7798035.862623002 - 7227151.541363675) / 7798035.862623002 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\p{Lu}", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 30.017960366666667 < 44.06209423544642. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.6680803989841 (T) = (0 -30182338.394990083) / Math.Sqrt((44590597161602.85 / (299)) + (126860573390.82407 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.13381779841014435 = (34845253.503929265 - 30182338.394990083) / 34845253.503929265 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: ".*", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 23.15180086 < 31.11132058073554. IsChangePoint: Marked as a change because one of 4/20/2022 8:23:28 AM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 16.142278971111864 (T) = (0 -23352147.953194384) / Math.Sqrt((10886904227129.43 / (299)) + (71330681541.2124 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.12523761381730986 = (26695418.46111956 - 23352147.953194384) / 26695418.46111956 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "zqj", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.226188793269231 < 3.647723350598958. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.327270042840125 (T) = (0 -2225927.5319075147) / Math.Sqrt((431671246530.1769 / (299)) + (12694712.692219943 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.16207605544168727 = (2656479.202394494 - 2225927.5319075147) / 2656479.202394494 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "the\s+\w+", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 16.42994667111111 < 21.773152812166664. IsChangePoint: Marked as a change because one of 4/20/2022 8:23:28 AM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.11950893861888 (T) = (0 -16465985.689126983) / Math.Sqrt((6038488055951.198 / (299)) + (67101475322.48079 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11343433929682875 = (18572776.297321443 - 16465985.689126983) / 18572776.297321443 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "The", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.948372469444445 < 4.6048697265260135. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.034353667817113 (T) = (0 -2988393.649585137) / Math.Sqrt((567802467853.4747 / (299)) + (1781066711.544025 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.14356089508645228 = (3489324.1474381266 - 2988393.649585137) / 3489324.1474381266 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?i)Sherlock|Holmes|Watson", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 31.884670641666666 < 48.07541423660714. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.662800093811141 (T) = (0 -31864453.199188314) / Math.Sqrt((51414734438929.04 / (299)) + (58798691720.05571 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.1529345968781694 = (37617465.05258385 - 31864453.199188314) / 37617465.05258385 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock Holmes", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.6676208109374997 < 4.096625669226763. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.562848117728782 (T) = (0 -2616250.7977493466) / Math.Sqrt((504109150422.48193 / (299)) + (1608317191.8478384 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.13489977408117684 = (3024216.9859227883 - 2616250.7977493466) / 3024216.9859227883 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock\s+Holmes", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.4573778577806125 < 3.926115186966145. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.476028639314952 (T) = (0 -2459961.3858542372) / Math.Sqrt((477633921985.9305 / (299)) + (1162997302.3458498 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.14915007250275844 = (2891181.2839782047 - 2459961.3858542372) / 2891181.2839782047 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?i)Holmes", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 8.732737358090187 < 12.325551215687828. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.70415879822343 (T) = (0 -8473334.46720324) / Math.Sqrt((3594659592378.825 / (299)) + (12175547175.97758 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11564276702000709 = (9581348.069773672 - 8473334.46720324) / 9581348.069773672 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Holmes", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.741998034722223 < 4.319776108294271. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.186219523540668 (T) = (0 -2762490.4374875994) / Math.Sqrt((530114016663.453 / (299)) + (417528565.1881603 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.14687979057953504 = (3238102.212306274 - 2762490.4374875994) / 3238102.212306274 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "[a-q][^u-z]{13}x", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.1094637470238093 < 4.576928487859256. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.287377649736287 (T) = (0 -2986982.4421104) / Math.Sqrt((589083936178.6229 / (299)) + (1810179527.7561166 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12526007201541078 = (3414709.1570318984 - 2986982.4421104) / 3414709.1570318984 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "The", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.6038704873949574 < 5.291425825768398. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 5.386157219300091 (T) = (0 -3643011.003567636) / Math.Sqrt((820741091903.0234 / (299)) + (1111805868.0991237 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.07300799527021518 = (3929927.102909115 - 3643011.003567636) / 3929927.102909115 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock|Holmes|Watson", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 7.3950200779220765 < 9.425624318576387. IsChangePoint: Marked as a change because one of 4/13/2022 5:30:39 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 15.117969754353489 (T) = (0 -7488469.678995722) / Math.Sqrt((790476117999.8533 / (299)) + (24589423928.21567 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.12358895409540013 = (8544472.041958798 - 7488469.678995722) / 8544472.041958798 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sher[a-z]+|Hol[a-z]+", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.024800699186993 < 9.115719621649816. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.600042479125767 (T) = (0 -6100096.798648301) / Math.Sqrt((1895641762028.4277 / (299)) + (5798344643.314887 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1357538808296073 = (7058286.596072779 - 6100096.798648301) / 7058286.596072779 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock|Street", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.6958728405448715 < 4.253758572014509. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.383425709977827 (T) = (0 -2706722.854660155) / Math.Sqrt((506978543317.7991 / (299)) + (226914297.7145048 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.14831226021019306 = (3178069.529717738 - 2706722.854660155) / 3178069.529717738 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?i)Sherlock|Holmes|Watson", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 26.682402785185193 < 41.11270670711995. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 15.268861219060584 (T) = (0 -26898492.003846154) / Math.Sqrt((37690891542903.11 / (299)) + (28268998257.091488 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.16903112702458153 = (32370035.603778698 - 26898492.003846154) / 32370035.603778698 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\s[a-zA-Z]{0,12}ing\s", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 236.69197540000002 < 318.2326169678571. IsChangePoint: Marked as a change because one of 4/20/2022 8:23:28 AM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.11963966011716 (T) = (0 -237246719.95972225) / Math.Sqrt((1515443698733803 / (299)) + (16512292194705.982 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10633066446392733 = (265474835.63079676 - 237246719.95972225) / 265474835.63079676 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\p{L}", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 371.65045058333334 < 501.33664009976184. IsChangePoint: Marked as a change because one of 4/20/2022 8:23:28 AM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 18.136769932802007 (T) = (0 -379119704.3863706) / Math.Sqrt((2515799808356636 / (299)) + (39030847218457.68 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.14045151619560545 = (441068434.8000618 - 379119704.3863706) / 441068434.8000618 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?i)the", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.166564384615384 < 23.465775922. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 14.39495227793636 (T) = (0 -17128559.60357024) / Math.Sqrt((7608638105092.502 / (299)) + (72589807148.92719 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.130770796487805 = (19705458.047613714 - 17128559.60357024) / 19705458.047613714 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "zqj", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.3018786125 < 3.653091012254464. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.81869727319945 (T) = (0 -2235203.016525625) / Math.Sqrt((453831546864.7223 / (299)) + (597549863.6499543 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.16081827214557032 = (2663550.625965677 - 2235203.016525625) / 2663550.625965677 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "the", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 11.011353193939394 < 15.014890111196582. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.627992162585238 (T) = (0 -11050057.493737742) / Math.Sqrt((3222965659719.2305 / (299)) + (23847334620.69739 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12230535522473804 = (12589865.461201673 - 11050057.493737742) / 12589865.461201673 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock\s+Holmes", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.455481563095238 < 3.9206113688932294. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.038029501992282 (T) = (0 -2451324.8847859977) / Math.Sqrt((488183352913.8741 / (299)) + (106712108.07732391 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1542929276281483 = (2898550.7687798627 - 2451324.8847859977) / 2898550.7687798627 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "zqj", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.2302306218112244 < 3.6513886687585853. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.316841070063084 (T) = (0 -2229692.4497010186) / Math.Sqrt((427995012071.0618 / (299)) + (78221558.6648882 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.16140060769669629 = (2658829.0787773263 - 2229692.4497010186) / 2658829.0787773263 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "[^\n]*", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 23.53380691333333 < 30.74943330408163. IsChangePoint: Marked as a change because one of 4/20/2022 8:23:28 AM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.807466786559715 (T) = (0 -23547012.803712398) / Math.Sqrt((11480321465539.445 / (299)) + (151828724872.15033 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1169864165519739 = (26666648.4469753 - 23547012.803712398) / 26666648.4469753 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "The", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.9540394631944444 < 4.598195250082132. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.99561379166309 (T) = (0 -2967006.86942791) / Math.Sqrt((560464405857.367 / (299)) + (414625717.8745867 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.15012812340798884 = (3491122.5458190436 - 2967006.86942791) / 3491122.5458190436 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?i)Sher[a-z]+|Hol[a-z]+", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 18.6683634010989 < 26.251339946413307. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 6.861988727734034 (T) = (0 -19071845.585200448) / Math.Sqrt((14622413308517.629 / (299)) + (99542353424.11751 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.0792325592948206 = (20712988.689732637 - 19071845.585200448) / 20712988.689732637 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\s[a-zA-Z]{0,12}ing\s", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 235.83072407142856 < 317.2458407849999. IsChangePoint: Marked as a change because one of 4/20/2022 8:23:28 AM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.605783702930205 (T) = (0 -238133374.54123935) / Math.Sqrt((1469837239059678.2 / (299)) + (18409802474119.074 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10161643339595747 = (265068711.62103 - 238133374.54123935) / 265068711.62103 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?m)^Sherlock Holmes|Sherlock Holmes$", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.5778658824404763 < 4.128556543288855. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.570520004003487 (T) = (0 -2612575.070947524) / Math.Sqrt((509231704439.34216 / (299)) + (295055542.78642964 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.14396410533216214 = (3051945.7037035404 - 2612575.070947524) / 3051945.7037035404 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?i)Holmes", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 8.393994833333334 < 12.077375737738093. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.14532769001316 (T) = (0 -8143494.847381539) / Math.Sqrt((3337918307237.836 / (299)) + (20806339175.347538 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.13452118568110336 = (9409236.497360367 - 8143494.847381539) / 9409236.497360367 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aei", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 4.5037987109375 < 6.70432247985844. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.929551628178311 (T) = (0 -4525342.146952027) / Math.Sqrt((1059436267388.2068 / (299)) + (5087826972.978744 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1320373461197507 = (5213752.143276406 - 4525342.146952027) / 5213752.143276406 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock|Street", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.2297657850000006 < 4.9453222167210384. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.410630514687941 (T) = (0 -3247284.4575713524) / Math.Sqrt((619330788220.651 / (299)) + (365730340.689295 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.138745350250481 = (3770411.525227491 - 3247284.4575713524) / 3770411.525227491 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?i)Sherlock Holmes", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.291803138461539 < 8.14589498112245. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 3.1462881472791175 (T) = (0 -6430260.02822736) / Math.Sqrt((914945360352.923 / (299)) + (154233945384.0579 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.05813435451826166 = (6827152.109299473 - 6430260.02822736) / 6827152.109299473 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock|Holmes", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 4.594454742063492 < 7.3422009677563365. IsChangePoint: Marked as a change because one of 4/19/2022 4:39:14 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 18.57407151900232 (T) = (0 -4631461.46362427) / Math.Sqrt((1304285784314.6045 / (299)) + (1109502021.1736994 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.2111490994390507 = (5871149.364640203 - 4631461.46362427) / 5871149.364640203 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?i)Holmes", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 8.166037926108375 < 12.007897846666665. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.63329175529576 (T) = (0 -8158639.4414477525) / Math.Sqrt((3239192006186.646 / (299)) + (10207581185.223827 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.13392710135594513 = (9420268.72590185 - 8158639.4414477525) / 9420268.72590185 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "[^\n]*", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 23.773433835714286 < 30.987088612723216. IsChangePoint: Marked as a change because one of 4/20/2022 9:36:38 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 14.605551142379323 (T) = (0 -23635087.21526307) / Math.Sqrt((11014647082498.578 / (299)) + (78495735480.13603 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.11472035721768364 = (26697877.22778887 - 23635087.21526307) / 26697877.22778887 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?s).*", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 26.922800541666668 < 40.33885743849206. IsChangePoint: Marked as a change because one of 4/7/2022 3:14:09 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.912571335570377 (T) = (0 -27354804.38609724) / Math.Sqrt((36648937026092.94 / (299)) + (1224760570855.103 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.13612774115647566 = (31665334.898839593 - 27354804.38609724) / 31665334.898839593 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Holmes.{0,25}Watson|Watson.{0,25}Holmes", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 4.863241057315234 < 8.170801885445403. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.558354673256186 (T) = (0 -5184062.309565369) / Math.Sqrt((2080548838174.5205 / (299)) + (14750376146.423117 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.14381417934227797 = (6054833.173461074 - 5184062.309565369) / 6054833.173461074 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "the", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 11.263629060317461 < 14.986379434333333. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.743984635833865 (T) = (0 -11149636.243244322) / Math.Sqrt((3236152071110.595 / (299)) + (27682904630.692028 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11580506836603831 = (12609930.055400996 - 11149636.243244322) / 12609930.055400996 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\w+", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 138.75395296666667 < 184.417322815. IsChangePoint: Marked as a change because one of 4/20/2022 8:23:28 AM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 17.28964880637271 (T) = (0 -139158230.92988402) / Math.Sqrt((397893437711915.6 / (299)) + (2220238689835.412 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.13267136739876448 = (160444640.81916645 - 139158230.92988402) / 160444640.81916645 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\w+\s+Holmes", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 57.77848948214286 < 96.47518388519231. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 6.166130525003396 (T) = (0 -70002679.71315627) / Math.Sqrt((179357262564699.16 / (299)) + (16544741791419.344 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11024206385495228 = (78676094.77747269 - 70002679.71315627) / 78676094.77747269 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Holmes.{0,25}Watson|Watson.{0,25}Holmes", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.415750263513514 < 9.811808212562111. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.7648216833471 (T) = (0 -6490509.804922179) / Math.Sqrt((2513421346676.0596 / (299)) + (2227425891.077505 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.13324853059667213 = (7488317.048242502 - 6490509.804922179) / 7488317.048242502 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Holmes", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.29423138375 < 4.967786799772037. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 6.905016648112035 (T) = (0 -3348751.5429707794) / Math.Sqrt((698746912919.29 / (299)) + (2168803214.5566835 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.09403822427539693 = (3696349.7055848665 - 3348751.5429707794) / 3696349.7055848665 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "[a-q][^u-z]{13}x", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.815366086939103 < 4.360770852103794. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.870046707884502 (T) = (0 -2801459.162782703) / Math.Sqrt((516049884985.43677 / (299)) + (1795819700.090034 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.14431094331883676 = (3273921.923985233 - 2801459.162782703) / 3273921.923985233 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?i)Sherlock|Holmes|Watson", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 120.32481786666666 < 164.85747366. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.903897229062963 (T) = (0 -119614920.2146215) / Math.Sqrt((391062875062908.56 / (299)) + (1365831563017.615 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12172727867646646 = (136193368.31316474 - 119614920.2146215) / 136193368.31316474 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?i)Sher[a-z]+|Hol[a-z]+", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 77.44966131666666 < 104.18652316416666. IsChangePoint: Marked as a change because one of 4/20/2022 8:23:28 AM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 16.253023808173644 (T) = (0 -78294859.98459873) / Math.Sqrt((120307753873083.22 / (299)) + (890165519232.012 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.12611320019247252 = (89593823.82459956 - 78294859.98459873) / 89593823.82459956 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\b\w+n\b", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 427.70436286666666 < 557.992269325. IsChangePoint: Marked as a change because one of 4/20/2022 8:23:28 AM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.914722792366009 (T) = (0 -425705795.6777556) / Math.Sqrt((3628483398249348.5 / (299)) + (56080166113059.76 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.11185315030868885 = (479319152.93705773 - 425705795.6777556) / 479319152.93705773 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?i)Sherlock Holmes", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.36923432105263 < 8.129907237244899. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 6.043727804064433 (T) = (0 -6392331.010044844) / Math.Sqrt((937244389371.2372 / (299)) + (23128788508.71643 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.0630279471868633 = (6822328.361718689 - 6392331.010044844) / 6822328.361718689 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?i)Sherlock", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.4478386684210545 < 8.142055190919539. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 6.552356171655367 (T) = (0 -6386000.00688904) / Math.Sqrt((918028150006.814 / (299)) + (12965848846.545485 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.06268987335878241 = (6813113.211283446 - 6386000.00688904) / 6813113.211283446 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.511183785119048 < 4.024554119541266. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.39939830141176 (T) = (0 -2527893.434245516) / Math.Sqrt((499686506225.0153 / (299)) + (135524704.15050572 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.14441742212832756 = (2954587.3181918287 - 2527893.434245516) / 2954587.3181918287 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Holmes.{0,25}Watson|Watson.{0,25}Holmes", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 7.759491952688172 < 11.469692833511905. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.841712326742433 (T) = (0 -7770429.327477272) / Math.Sqrt((3026552032147.9536 / (299)) + (104390532091.53839 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12161261320147478 = (8846244.201887164 - 7770429.327477272) / 8846244.201887164 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Text.Json.Document.Tests.Perf_DocumentParse

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented%3a%20True%2c%20TestRandomAccess%3a%20True%2c%20TestCase%3a%20Json400KB).html>)	183.90 ms	144.74 ms	0.79	0.07	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented%3a%20False%2c%20TestRandomAccess%3a%20True%2c%20TestCase%3a%20Json400KB).html>)	178.96 ms	137.30 ms	0.77	0.06	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented%3a%20True%2c%20TestRandomAccess%3a%20False%2c%20TestCase%3a%20BasicJson).html>)	34.74 μs	28.24 μs	0.81	0.01	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented%3a%20False%2c%20TestRandomAccess%3a%20False%2c%20TestCase%3a%20Json400KB).html>)	21.59 ms	15.99 ms	0.74	0.01	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented%3a%20True%2c%20TestRandomAccess%3a%20False%2c%20TestCase%3a%20Json400KB).html>)	27.18 ms	20.67 ms	0.76	0.03	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented%3a%20False%2c%20TestRandomAccess%3a%20False%2c%20TestCase%3a%20HelloWorld).html>)	6.10 μs	5.03 μs	0.83	0.04	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented%3a%20True%2c%20TestRandomAccess%3a%20False%2c%20TestCase%3a%20Json400B).html>)	41.55 μs	32.58 μs	0.78	0.01	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented%3a%20False%2c%20TestRandomAccess%3a%20False%2c%20TestCase%3a%20Json400B).html>)	34.56 μs	27.81 μs	0.80	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Document.Tests.Perf_DocumentParse*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented: True, TestRandomAccess: True, TestCase: Json400KB) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 144.74255314285713 < 175.38970125267855. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.121541565793022 (T) = (0 -140313241.07721308) / Math.Sqrt((356908662973604.94 / (299)) + (8177462227259.31 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.07343942718295113 = (151434504.3310171 - 140313241.07721308) / 151434504.3310171 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented: False, TestRandomAccess: True, TestCase: Json400KB) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 137.2975099642857 < 170.03382991880952. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.192326186318159 (T) = (0 -136000645.05626038) / Math.Sqrt((342850150054016.94 / (299)) + (3126970829667.4033 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.07480431638657317 = (146996627.27035087 - 136000645.05626038) / 146996627.27035087 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented: True, TestRandomAccess: False, TestCase: BasicJson) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 28.237558218268713 < 33.04195974143005. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.95171511611894 (T) = (0 -28287.778167533048) / Math.Sqrt((7265190.096437531 / (299)) + (73853.269382844 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.057841081385493535 = (30024.423277902726 - 28287.778167533048) / 30024.423277902726 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented: False, TestRandomAccess: False, TestCase: Json400KB) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 15.985022208888891 < 20.36479826681818. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.011869047327144 (T) = (0 -16178142.000466518) / Math.Sqrt((4884386621037.693 / (299)) + (43258044922.64399 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.07347693426055504 = (17461132.48411681 - 16178142.000466518) / 17461132.48411681 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented: True, TestRandomAccess: False, TestCase: Json400KB) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 20.67358578787879 < 25.81241304424603. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 6.816355401526055 (T) = (0 -20434341.502014145) / Math.Sqrt((8271952192298.348 / (299)) + (205072049940.96222 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.06697522773435871 = (21901177.878047045 - 20434341.502014145) / 21901177.878047045 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented: False, TestRandomAccess: False, TestCase: HelloWorld) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.029670064395175 < 5.7640648738146005. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.276386625164937 (T) = (0 -5060.493179698806) / Math.Sqrt((178949.41429026704 / (299)) + (3270.1898158404833 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.056543262531046544 = (5363.7787285029935 - 5060.493179698806) / 5363.7787285029935 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented: True, TestRandomAccess: False, TestCase: Json400B) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 32.582503547768475 < 38.847051331315434. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.884362265905796 (T) = (0 -32605.850650433975) / Math.Sqrt((12120964.917102817 / (299)) + (105463.6410922265 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.05706313241555756 = (34579.038927560054 - 32605.850650433975) / 34579.038927560054 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented: False, TestRandomAccess: False, TestCase: Json400B) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 27.80712141569368 < 32.65405511409411. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.10494379663678 (T) = (0 -27701.816582611184) / Math.Sqrt((8026166.402508096 / (299)) + (51395.56891337654 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.05480908084589394 = (29308.170467192795 - 27701.816582611184) / 29308.170467192795 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in System.Collections.IterateFor<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ImmutableList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateFor(Int32).ImmutableList(Size%3a%20512).html>)	128.94 μs	105.89 μs	0.82	0.04	False
[ImmutableArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateFor(Int32).ImmutableArray(Size%3a%20512).html>)	7.22 μs	4.25 μs	0.59	0.07	False
[Span - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateFor(Int32).Span(Size%3a%20512).html>)	6.08 μs	3.35 μs	0.55	0.08	False
[Array - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateFor(Int32).Array(Size%3a%20512).html>)	3.76 μs	2.28 μs	0.61	0.06	False
[ReadOnlySpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateFor(Int32).ReadOnlySpan(Size%3a%20512).html>)	6.03 μs	4.39 μs	0.73	0.08	False
[List - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateFor(Int32).List(Size%3a%20512).html>)	11.99 μs	8.96 μs	0.75	0.18	False
[ImmutableSortedSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateFor(Int32).ImmutableSortedSet(Size%3a%20512).html>)	129.51 μs	103.94 μs	0.80	0.03	False
[IList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateFor(Int32).IList(Size%3a%20512).html>)	21.05 μs	16.70 μs	0.79	0.12	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.IterateFor<Int32>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.IterateFor<Int32>.ImmutableList(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 105.88975523648648 < 122.663135506547. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 17.947605839598978 (T) = (0 -104631.05319333723) / Math.Sqrt((65181329.24387439 / (299)) + (2116277.582251736 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.09900659792112222 = (116128.54539436157 - 104631.05319333723) / 116128.54539436157 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateFor<Int32>.ImmutableArray(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 4.2480269635063514 < 6.690222273242204. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 6.645917432994523 (T) = (0 -4278.496948927953) / Math.Sqrt((1518997.2935184713 / (299)) + (554.483789552729 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10008608488776828 = (4754.340250860956 - 4278.496948927953) / 4754.340250860956 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateFor<Int32>.Span(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.347839059133994 < 5.769470905669612. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 16.323185330867688 (T) = (0 -3387.141135250913) / Math.Sqrt((957428.7915870349 / (299)) + (851.9049258715572 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.21612216604563744 = (4321.006397341391 - 3387.141135250913) / 4321.006397341391 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateFor<Int32>.Array(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.2824427525326683 < 3.578641422954433. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.022674175365582 (T) = (0 -2271.292009754352) / Math.Sqrt((390996.6861041098 / (299)) + (322.9766651278151 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.15059298479213062 = (2673.9736888074967 - 2271.292009754352) / 2673.9736888074967 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateFor<Int32>.ReadOnlySpan(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 4.390985592008122 < 5.731404941046413. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.919062750174164 (T) = (0 -3485.8610292307862) / Math.Sqrt((933143.2799604787 / (299)) + (91127.49662262479 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.19524460216651413 = (4331.578313876753 - 3485.8610292307862) / 4331.578313876753 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateFor<Int32>.List(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 8.961214275516033 < 11.335535684094474. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 22.497560355173718 (T) = (0 -9029.407092632524) / Math.Sqrt((798004.9498761786 / (299)) + (13759.20785734996 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.1349429294383958 = (10437.932247372462 - 9029.407092632524) / 10437.932247372462 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateFor<Int32>.ImmutableSortedSet(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 103.9387095716783 < 123.29958013267618. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 21.489392042394055 (T) = (0 -104345.005276006) / Math.Sqrt((65955524.280826874 / (299)) + (842514.0901021603 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.10093729691827183 = (116059.7641503105 - 104345.005276006) / 116059.7641503105 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateFor<Int32>.IList(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 16.696744974271763 < 19.55321670151768. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.709176583895626 (T) = (0 -17046.542535304525) / Math.Sqrt((1234403.33598973 / (299)) + (186861.98297777923 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10142929812395998 = (18970.730405203147 - 17046.542535304525) / 18970.730405203147 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in System.Text.Json.Serialization.Tests.ReadJson<BinaryData>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[DeserializeFromString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.ReadJson(BinaryData).DeserializeFromString.html>)	51.93 μs	33.84 μs	0.65	0.01	False
[DeserializeFromStream - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.ReadJson(BinaryData).DeserializeFromStream.html>)	48.64 μs	35.16 μs	0.72	0.01	False
[DeserializeFromUtf8Bytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.ReadJson(BinaryData).DeserializeFromUtf8Bytes.html>)	37.09 μs	24.37 μs	0.66	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Serialization.Tests.ReadJson<BinaryData>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Serialization.Tests.ReadJson<BinaryData>.DeserializeFromString ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 33.84492166848221 < 49.12992934006426. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.354061751108759 (T) = (0 -33926.219460457025) / Math.Sqrt((52447139.557381734 / (299)) + (16256.960442273208 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.1233873753265115 = (38701.495398943756 - 33926.219460457025) / 38701.495398943756 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Serialization.Tests.ReadJson<BinaryData>.DeserializeFromStream ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 35.15561721017414 < 46.24422887248478. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.565753102558526 (T) = (0 -35091.6199077991) / Math.Sqrt((28707201.997650146 / (299)) + (31884.26957010517 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10110688516154581 = (39038.701407903915 - 35091.6199077991) / 39038.701407903915 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Serialization.Tests.ReadJson<BinaryData>.DeserializeFromUtf8Bytes ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 24.374428709508884 < 34.950328307221355. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.801248273789055 (T) = (0 -24400.715008617826) / Math.Sqrt((24841100.287177436 / (299)) + (44921.493793166184 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12473416350918999 = (27878.061717166114 - 24400.715008617826) / 27878.061717166114 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in Benchstone.BenchF.LLoops

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Test - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Benchstone.BenchF.LLoops.Test.html>)	7.09 secs	4.56 secs	0.64	0.03	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Benchstone.BenchF.LLoops*'

### Payloads [Baseline]() [Compare]() ### Histogram #### Benchstone.BenchF.LLoops.Test ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 4.562632160071428 < 6.7527378731151275. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.46490996371544 (T) = (0 -4559337065.306166) / Math.Sqrt((1.113532552343643E+18 / (299)) + (1267664688052517.8 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12437712702121416 = (5206964329.056108 - 4559337065.306166) / 5206964329.056108 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in Span.Sorting

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[QuickSortArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Span.Sorting.QuickSortArray(Size%3a%20512).html>)	85.36 μs	62.37 μs	0.73	0.02	False
[BubbleSortArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Span.Sorting.BubbleSortArray(Size%3a%20512).html>)	2.36 ms	1.54 ms	0.65	0.13	False
[BubbleSortSpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Span.Sorting.BubbleSortSpan(Size%3a%20512).html>)	4.09 ms	2.55 ms	0.62	0.14	False
[QuickSortSpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Span.Sorting.QuickSortSpan(Size%3a%20512).html>)	145.31 μs	99.89 μs	0.69	0.02	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Span.Sorting*'

### Payloads [Baseline]() [Compare]() ### Histogram #### Span.Sorting.QuickSortArray(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 62.374718333333334 < 81.67858162345237. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.580874384023595 (T) = (0 -61344.59808974359) / Math.Sqrt((89217073.43959947 / (299)) + (489225.4286155879 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.10721151385922827 = (68711.23344669903 - 61344.59808974359) / 68711.23344669903 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Span.Sorting.BubbleSortArray(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.544947922433333 < 2.26266900250206. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.555169397080554 (T) = (0 -1569299.836313553) / Math.Sqrt((115530924397.84517 / (299)) + (1372276093.0128598 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10872819985081576 = (1760742.1619879345 - 1569299.836313553) / 1760742.1619879345 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Span.Sorting.BubbleSortSpan(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.551258971642857 < 3.884780583129167. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.985215120053706 (T) = (0 -2579052.0490131197) / Math.Sqrt((336769545156.13495 / (299)) + (2502763888.0629683 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.15630071394849415 = (3056838.012845817 - 2579052.0490131197) / 3056838.012845817 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Span.Sorting.QuickSortSpan(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 99.8894572 < 138.84563164333335. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.496302014846396 (T) = (0 -99739.2253020646) / Math.Sqrt((300307282.06434065 / (299)) + (1226021.627197724 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.12506186627738505 = (113995.74605086914 - 99739.2253020646) / 113995.74605086914 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in System.ComponentModel.Tests.Perf_TypeDescriptorTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[GetConverter - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert%3a%20typeof(System.ComponentModel.Tests.DerivedClass)).html>)	6.96 μs	6.56 μs	0.94	0.01	False
[GetConverter - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert%3a%20typeof(System.ComponentModel.Tests.SomeValueType%3f)).html>)	6.86 μs	6.39 μs	0.93	0.00	False
[GetConverter - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert%3a%20typeof(string)).html>)	4.02 μs	3.74 μs	0.93	0.01	False
[GetConverter - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert%3a%20typeof(System.ComponentModel.Tests.IDerived)).html>)	2.29 μs	2.02 μs	0.88	0.03	False
[GetConverter - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert%3a%20typeof(int)).html>)	6.84 μs	6.21 μs	0.91	0.01	False
[GetConverter - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert%3a%20typeof(System.ComponentModel.Tests.ClassIDerived)).html>)	4.07 μs	3.70 μs	0.91	0.02	False
[GetConverter - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert%3a%20typeof(System.ComponentModel.Tests.ClassWithNoConverter)).html>)	4.02 μs	3.79 μs	0.94	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.ComponentModel.Tests.Perf_TypeDescriptorTests*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert: typeof(System.ComponentModel.Tests.DerivedClass)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.564565860557205 < 6.572876899408323. IsChangePoint: Marked as a change because one of 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 23.587673393316177 (T) = (0 -6493.19498911666) / Math.Sqrt((7694.60392576908 / (299)) + (3138.1803661959757 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.0602081127580976 = (6909.1839132309 - 6493.19498911666) / 6909.1839132309 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert: typeof(System.ComponentModel.Tests.SomeValueType?)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.390435165776133 < 6.5268149314212. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 27.28181311919596 (T) = (0 -6375.682528859916) / Math.Sqrt((8460.796209494802 / (299)) + (1878.5088561494965 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.05693652224487397 = (6760.60803885294 - 6375.682528859916) / 6760.60803885294 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert: typeof(string)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.7360834759650396 < 3.914756403669784. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.990311925814916 (T) = (0 -3738.411586658524) / Math.Sqrt((6683.758744031217 / (299)) + (4211.684885340058 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.058354678590320695 = (3970.0845973109895 - 3738.411586658524) / 3970.0845973109895 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert: typeof(System.ComponentModel.Tests.IDerived)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.0223140278863694 < 2.160855858660657. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.906305030866571 (T) = (0 -2025.5159321019369) / Math.Sqrt((5082.62211763619 / (299)) + (1158.035423778744 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.07056107954196914 = (2179.2889102424883 - 2025.5159321019369) / 2179.2889102424883 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert: typeof(int)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.2134530232576255 < 6.52693606217924. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.405090556053464 (T) = (0 -6371.031539925305) / Math.Sqrt((10321.728034820042 / (299)) + (8275.179132733732 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.05358539418044541 = (6731.75530127017 - 6371.031539925305) / 6731.75530127017 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert: typeof(System.ComponentModel.Tests.ClassIDerived)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.699946205954067 < 3.8635229551090466. IsChangePoint: Marked as a change because one of 5/25/2022 10:02:21 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.575652406299707 (T) = (0 -3733.7931632586256) / Math.Sqrt((5799.094607362216 / (299)) + (4850.610541391869 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.05998132971874395 = (3972.04149375189 - 3733.7931632586256) / 3972.04149375189 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert: typeof(System.ComponentModel.Tests.ClassWithNoConverter)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.7914311907679745 < 3.8272871636638515. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 17.045974888872856 (T) = (0 -3719.788716084982) / Math.Sqrt((6005.348659531385 / (299)) + (1905.4481080339037 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.05774862890316779 = (3947.7668382216775 - 3719.788716084982) / 3947.7668382216775 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Text.Json.Document.Tests.Perf_EnumerateArray

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_EnumerateArray.Parse(TestCase%3a%20ArrayOfNumbers).html>)	273.04 μs	202.36 μs	0.74	0.07	False
[EnumerateArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_EnumerateArray.EnumerateArray(TestCase%3a%20Json400KB).html>)	56.05 μs	44.50 μs	0.79	0.15	False
[EnumerateArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_EnumerateArray.EnumerateArray(TestCase%3a%20ArrayOfNumbers).html>)	52.21 μs	40.03 μs	0.77	0.19	False
[EnumerateUsingIndexer - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_EnumerateArray.EnumerateUsingIndexer(TestCase%3a%20Json400KB).html>)	5.03 ms	3.69 ms	0.73	0.14	False
[EnumerateArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_EnumerateArray.EnumerateArray(TestCase%3a%20ArrayOfStrings).html>)	56.76 μs	39.97 μs	0.70	0.20	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_EnumerateArray.Parse(TestCase%3a%20Json400KB).html>)	21.60 ms	16.38 ms	0.76	0.02	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_EnumerateArray.Parse(TestCase%3a%20ArrayOfStrings).html>)	200.93 μs	148.32 μs	0.74	0.05	False
[EnumerateUsingIndexer - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_EnumerateArray.EnumerateUsingIndexer(TestCase%3a%20ArrayOfNumbers).html>)	53.20 μs	40.72 μs	0.77	0.20	False
[EnumerateUsingIndexer - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_EnumerateArray.EnumerateUsingIndexer(TestCase%3a%20ArrayOfStrings).html>)	52.78 μs	40.55 μs	0.77	0.18	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Document.Tests.Perf_EnumerateArray*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Document.Tests.Perf_EnumerateArray.Parse(TestCase: ArrayOfNumbers) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 202.35616547619048 < 264.7309495808531. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 6.272022040297846 (T) = (0 -200719.23078414678) / Math.Sqrt((1186906704.6924005 / (299)) + (13415299.202222534 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.06584049511555899 = (214866.1226853079 - 200719.23078414678) / 214866.1226853079 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_EnumerateArray.EnumerateArray(TestCase: Json400KB) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 44.50327690298508 < 53.7646404849799. IsChangePoint: Marked as a change because one of 5/25/2022 12:28:02 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.357616109678024 (T) = (0 -43830.03302736797) / Math.Sqrt((23818959.860917974 / (299)) + (3253627.113132611 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.09326518665427931 = (48338.31499823137 - 43830.03302736797) / 48338.31499823137 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_EnumerateArray.EnumerateArray(TestCase: ArrayOfNumbers) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 40.029396797558306 < 49.68094372069731. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.273507622086076 (T) = (0 -40943.88839815517) / Math.Sqrt((17438321.081536055 / (299)) + (3438462.8571518585 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.09762802309142843 = (45373.625783930576 - 40943.88839815517) / 45373.625783930576 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_EnumerateArray.EnumerateUsingIndexer(TestCase: Json400KB) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.6910552833333337 < 4.781461331305803. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.205842145917549 (T) = (0 -3693804.3262075945) / Math.Sqrt((360630722066.1863 / (299)) + (7441093109.4504595 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.09758302696023854 = (4093234.5429686876 - 3693804.3262075945) / 4093234.5429686876 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_EnumerateArray.EnumerateArray(TestCase: ArrayOfStrings) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 39.96961060267857 < 49.43557848841431. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.375046705595167 (T) = (0 -41084.90344355227) / Math.Sqrt((22248430.062159017 / (299)) + (3147369.0023216503 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.09433352118679672 = (45364.27526542712 - 41084.90344355227) / 45364.27526542712 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_EnumerateArray.Parse(TestCase: Json400KB) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 16.38381598095238 < 20.227838004696967. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.240947194332085 (T) = (0 -16249279.220999183) / Math.Sqrt((5739728663810.536 / (299)) + (35399656735.15676 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.07017699568894128 = (17475669.18183412 - 16249279.220999183) / 17475669.18183412 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_EnumerateArray.Parse(TestCase: ArrayOfStrings) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 148.32222763645552 < 189.4932159872505. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.553190821703523 (T) = (0 -146537.50578464803) / Math.Sqrt((574084442.4133718 / (299)) + (2741846.4971704655 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.07056024418913202 = (157662.1882897669 - 146537.50578464803) / 157662.1882897669 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_EnumerateArray.EnumerateUsingIndexer(TestCase: ArrayOfNumbers) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 40.716504349226796 < 49.979692317913994. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.965592578707449 (T) = (0 -41353.762767730725) / Math.Sqrt((18559892.430975493 / (299)) + (2800359.918375589 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10541831671187706 = (46226.92766940063 - 41353.762767730725) / 46226.92766940063 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_EnumerateArray.EnumerateUsingIndexer(TestCase: ArrayOfStrings) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 40.54659773316062 < 50.11807813750899. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.68693828969452 (T) = (0 -41275.92113466903) / Math.Sqrt((17525446.13028596 / (299)) + (2745837.446300353 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.10462079698594666 = (46098.81600524642 - 41275.92113466903) / 46098.81600524642 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Tests.Perf_Int16

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[TryParse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int16.TryParse(value%3a%20%220%22).html>)	186.98 ns	125.88 ns	0.67	0.21	False
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int16.ToString(value%3a%20-32768).html>)	401.41 ns	312.29 ns	0.78	0.13	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int16.Parse(value%3a%20%220%22).html>)	186.19 ns	125.40 ns	0.67	0.26	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int16.Parse(value%3a%20%2232767%22).html>)	319.36 ns	194.58 ns	0.61	0.17	False
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int16.ToString(value%3a%200).html>)	22.66 ns	17.39 ns	0.77	0.26	False
[TryParse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int16.TryParse(value%3a%20%22-32768%22).html>)	326.75 ns	200.95 ns	0.62	0.25	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int16.Parse(value%3a%20%22-32768%22).html>)	316.98 ns	211.38 ns	0.67	0.22	False
[TryParse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Int16.TryParse(value%3a%20%2232767%22).html>)	330.57 ns	198.20 ns	0.60	0.24	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Int16*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Tests.Perf_Int16.TryParse(value: "0") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 125.87827860456096 < 177.65303782742237. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.788166123388697 (T) = (0 -130.1695789184997) / Math.Sqrt((511.1176949458404 / (299)) + (3.470306741189228 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1302443626609456 = (149.6622422784666 - 130.1695789184997) / 149.6622422784666 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Int16.ToString(value: -32768) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 312.28921662906055 < 380.61843209676823. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 17.990092105642095 (T) = (0 -311.36902669542474) / Math.Sqrt((876.000384803346 / (299)) + (27.682044473107393 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11677602845312238 = (352.53688387792886 - 311.36902669542474) / 352.53688387792886 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Int16.Parse(value: "0") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 125.4025710927154 < 175.55877013538498. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.32175775722311 (T) = (0 -130.71613476109312) / Math.Sqrt((520.4394756918269 / (299)) + (22.90483769656319 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.11069561147235765 = (146.9869444561164 - 130.71613476109312) / 146.9869444561164 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Int16.Parse(value: "32767") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 194.580286849783 < 287.98579609876447. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.130838866412379 (T) = (0 -197.23308992890597) / Math.Sqrt((1873.8462246243691 / (299)) + (37.02247512130353 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.12563185714426658 = (225.5721363369119 - 197.23308992890597) / 225.5721363369119 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Int16.ToString(value: 0) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.392742817325264 < 21.69561647191815. IsChangePoint: Marked as a change because one of 5/30/2022 12:57:05 PM, 5/31/2022 12:36:20 AM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.631108223398604 (T) = (0 -19.41413947397842) / Math.Sqrt((2.3042325200228366 / (299)) + (1.14114771059077 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.12923597047865443 = (22.295523030102967 - 19.41413947397842) / 22.295523030102967 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Int16.TryParse(value: "-32768") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 200.95473706693645 < 301.2422242911467. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.710663031043575 (T) = (0 -207.67375907979965) / Math.Sqrt((2087.294420178407 / (299)) + (75.6555641836976 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.12143532196479152 = (236.3784525736159 - 207.67375907979965) / 236.3784525736159 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Int16.Parse(value: "-32768") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 211.38334593359542 < 298.1887609849254. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.677733565013298 (T) = (0 -202.4170863042631) / Math.Sqrt((2124.773570051215 / (299)) + (13.887791075920035 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.13167369957556163 = (233.11177630496914 - 202.4170863042631) / 233.11177630496914 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Int16.TryParse(value: "32767") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 198.19786570413655 < 302.6700038534908. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.1581935987417 (T) = (0 -200.63771332038712) / Math.Sqrt((1828.0003727869848 / (299)) + (35.98409492103879 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.12267963704232313 = (228.69378369833433 - 200.63771332038712) / 228.69378369833433 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Threading.Tests.Perf_Interlocked

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[CompareExchange_object_Match - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Threading.Tests.Perf_Interlocked.CompareExchange_object_Match.html>)	68.80 ns	58.63 ns	0.85	0.30	False
[CompareExchange_object_NoMatch - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Threading.Tests.Perf_Interlocked.CompareExchange_object_NoMatch.html>)	68.98 ns	57.97 ns	0.84	0.30	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Threading.Tests.Perf_Interlocked*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Threading.Tests.Perf_Interlocked.CompareExchange_object_Match ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 58.62587123013308 < 67.56385693031937. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.935277697309492 (T) = (0 -59.588203228402676) / Math.Sqrt((21.5506639063632 / (299)) + (2.492356484240899 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.06580255718709183 = (63.78544887575379 - 59.588203228402676) / 63.78544887575379 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Threading.Tests.Perf_Interlocked.CompareExchange_object_NoMatch ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 57.973504074955045 < 66.35965916378981. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 9:07:46 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 5.484410868433472 (T) = (0 -59.7063596725321) / Math.Sqrt((23.198652461861826 / (299)) + (4.459587875857269 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.06000800054078724 = (63.51794452174252 - 59.7063596725321) / 63.51794452174252 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in GuardedDevirtualization.TwoClassVirtual

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.TwoClassVirtual.Call(testInput%3a%20pB%20%3d%200.90).html>)	23.38 ns	17.15 ns	0.73	0.06	False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.TwoClassVirtual.Call(testInput%3a%20pB%20%3d%200.80).html>)	23.39 ns	17.19 ns	0.73	0.08	False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.TwoClassVirtual.Call(testInput%3a%20pB%20%3d%200.40).html>)	23.34 ns	17.50 ns	0.75	0.07	False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.TwoClassVirtual.Call(testInput%3a%20pB%20%3d%200.60).html>)	23.34 ns	17.72 ns	0.76	0.04	False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.TwoClassVirtual.Call(testInput%3a%20pB%20%3d%201.00).html>)	23.39 ns	17.18 ns	0.73	0.06	False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.TwoClassVirtual.Call(testInput%3a%20pB%20%3d%200.20).html>)	26.19 ns	17.19 ns	0.66	0.07	False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.TwoClassVirtual.Call(testInput%3a%20pB%20%3d%200.30).html>)	23.39 ns	17.15 ns	0.73	0.03	False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.TwoClassVirtual.Call(testInput%3a%20pB%20%3d%200.00).html>)	23.38 ns	17.19 ns	0.74	0.08	False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.TwoClassVirtual.Call(testInput%3a%20pB%20%3d%200.50).html>)	23.39 ns	17.15 ns	0.73	0.08	False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.TwoClassVirtual.Call(testInput%3a%20pB%20%3d%200.70).html>)	23.87 ns	17.18 ns	0.72	0.07	False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.TwoClassVirtual.Call(testInput%3a%20pB%20%3d%200.10).html>)	23.55 ns	17.23 ns	0.73	0.06	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'GuardedDevirtualization.TwoClassVirtual*'

### Payloads [Baseline]() [Compare]() ### Histogram #### GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 0.90) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.15054255527678 < 22.212463600945433. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 16.30540151780342 (T) = (0 -17.35861306109611) / Math.Sqrt((4.58284387828732 / (299)) + (0.0869667452132513 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12367712094621072 = (19.80846726247647 - 17.35861306109611) / 19.80846726247647 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 0.80) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.189552265121996 < 22.221354315163364. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 16.439916895071708 (T) = (0 -17.331116419331032) / Math.Sqrt((4.300547284317834 / (299)) + (0.09903612432688386 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12489225809278291 = (19.80455158762446 - 17.331116419331032) / 19.80455158762446 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 0.40) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.497668288590607 < 22.168265155622127. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 14.88208411761518 (T) = (0 -17.386017318604186) / Math.Sqrt((4.417747670638802 / (299)) + (0.1338796400995682 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12114278864199367 = (19.782527916838035 - 17.386017318604186) / 19.782527916838035 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 0.60) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.71736709541168 < 22.171225820402974. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.154618964358347 (T) = (0 -17.503595616026924) / Math.Sqrt((4.048795591751973 / (299)) + (0.16781981996032275 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.1131092890009702 = (19.73591041032571 - 17.503595616026924) / 19.73591041032571 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 1.00) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.17557548076923 < 22.13403487357637. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 17.616909442936965 (T) = (0 -17.264248987780295) / Math.Sqrt((4.543878067363831 / (299)) + (0.05675126559429748 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.12708684499248335 = (19.777739502197825 - 17.264248987780295) / 19.777739502197825 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 0.20) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.191526749539594 < 22.208900534516907. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 19.474129344707897 (T) = (0 -17.253999677419348) / Math.Sqrt((4.224051098621236 / (299)) + (0.02946386060090591 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1268991630920454 = (19.761749099363566 - 17.253999677419348) / 19.761749099363566 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 0.30) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.15336901984998 < 22.16460183379178. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 20.395241359010157 (T) = (0 -17.21308188435273) / Math.Sqrt((4.367997859101244 / (299)) + (0.01305519853319059 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.12961327956034924 = (19.776360875149884 - 17.21308188435273) / 19.776360875149884 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 0.00) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.190612867107195 < 22.170535860084723. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 19.940864160241986 (T) = (0 -17.227801895991817) / Math.Sqrt((4.443447689520908 / (299)) + (0.020799295124342573 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12975787491408644 = (19.796561668732163 - 17.227801895991817) / 19.796561668732163 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 0.50) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.153232436882547 < 22.209177327657255. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 20.71226982248881 (T) = (0 -17.18631441906821) / Math.Sqrt((4.686270137722221 / (299)) + (0.0012088841956263289 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1314627522823577 = (19.787653856217123 - 17.18631441906821) / 19.787653856217123 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 0.70) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.17829259157509 < 22.14516298345412. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 20.857676916854242 (T) = (0 -17.22821509484194) / Math.Sqrt((4.117895972882379 / (299)) + (0.007832356370816959 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.12717480408243512 = (19.738448403440774 - 17.22821509484194) / 19.738448403440774 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 0.10) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.23195759422408 < 22.159434757503817. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 19.371863881621515 (T) = (0 -17.242991616388853) / Math.Sqrt((4.263695473845263 / (299)) + (0.03548533385582131 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12847455612595388 = (19.78484017602684 - 17.242991616388853) / 19.78484017602684 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Memory.Span<Byte>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[SequenceCompareTo - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Byte).SequenceCompareTo(Size%3a%20512).html>)	767.38 ns	478.82 ns	0.62	0.08	False
[EndsWith - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Byte).EndsWith(Size%3a%20512).html>)	410.15 ns	268.91 ns	0.66	0.11	False
[IndexOfAnyFourValues - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Byte).IndexOfAnyFourValues(Size%3a%20512).html>)	20.00 μs	12.27 μs	0.61	0.11	False
[IndexOfValue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Byte).IndexOfValue(Size%3a%20512).html>)	1.38 μs	810.66 ns	0.59	0.31	False
[BinarySearch - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Byte).BinarySearch(Size%3a%20512).html>)	350.65 ns	229.00 ns	0.65	0.09	False
[ToArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Byte).ToArray(Size%3a%20512).html>)	315.44 ns	278.47 ns	0.88	0.06	False
[GetPinnableReference - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Byte).GetPinnableReference(Size%3a%20512).html>)	22.66 ns	18.30 ns	0.81	0.10	False
[Fill - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Byte).Fill(Size%3a%20512).html>)	46.87 ns	25.01 ns	0.53	0.40	False
[LastIndexOfValue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Byte).LastIndexOfValue(Size%3a%20512).html>)	1.37 μs	809.67 ns	0.59	0.13	False
[IndexOfAnyThreeValues - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Byte).IndexOfAnyThreeValues(Size%3a%20512).html>)	2.25 μs	1.51 μs	0.67	0.04	False
[Clear - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Byte).Clear(Size%3a%20512).html>)	50.17 ns	33.35 ns	0.66	0.31	False
[StartsWith - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Byte).StartsWith(Size%3a%20512).html>)	408.89 ns	266.34 ns	0.65	0.15	False
[LastIndexOfAnyValues - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Byte).LastIndexOfAnyValues(Size%3a%20512).html>)	1.95 μs	1.25 μs	0.64	0.09	False
[SequenceEqual - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Byte).SequenceEqual(Size%3a%20512).html>)	654.76 ns	418.19 ns	0.64	0.10	False
[IndexOfAnyTwoValues - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Byte).IndexOfAnyTwoValues(Size%3a%20512).html>)	1.97 μs	1.25 μs	0.63	0.11	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Memory.Span<Byte>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Memory.Span<Byte>.SequenceCompareTo(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 478.81797945770995 < 724.9297903755587. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 5.239002279472775 (T) = (0 -488.9590308915956) / Math.Sqrt((14913.434828465155 / (299)) + (657.6124327881828 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.09879376897364099 = (542.5606415689488 - 488.9590308915956) / 542.5606415689488 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Byte>.EndsWith(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 268.9132491702179 < 391.4383526957987. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.262675401829362 (T) = (0 -270.1399024213566) / Math.Sqrt((3934.8235919521544 / (299)) + (20.442919008315656 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.105482769660352 = (301.99519166197007 - 270.1399024213566) / 301.99519166197007 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Byte>.IndexOfAnyFourValues(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 12.273878052058745 < 18.973063988371162. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.009826204138427 (T) = (0 -12269.860951057213) / Math.Sqrt((12181330.324111337 / (299)) + (1794.5027379164421 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11661178056745697 = (13889.545594052559 - 12269.860951057213) / 13889.545594052559 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Byte>.IndexOfValue(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 810.6605230599137 < 1.478365486481618. IsChangePoint: Marked as a change because one of 4/19/2022 4:39:14 PM, 4/26/2022 10:28:11 AM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 46.029325350252584 (T) = (0 -820.5484543190828) / Math.Sqrt((18566.194441264033 / (299)) + (178.13555598491914 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.3297782217236521 = (1224.293929136919 - 820.5484543190828) / 1224.293929136919 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Byte>.BinarySearch(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 228.99547137570184 < 326.28301855896. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.070524187780137 (T) = (0 -227.66146156218107) / Math.Sqrt((2367.9386582036527 / (299)) + (21.405159176732255 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.12110426351553204 = (259.0312503651613 - 227.66146156218107) / 259.0312503651613 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Byte>.ToArray(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 278.4694919061085 < 300.5663039334943. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 6.837757703807372 (T) = (0 -273.22658282630323) / Math.Sqrt((328.6296023490392 / (299)) + (40.01808537010224 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.051655133444118886 = (288.1088857670359 - 273.22658282630323) / 288.1088857670359 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Byte>.GetPinnableReference(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 18.295350879466444 < 21.41918849480317. IsChangePoint: Marked as a change because one of 3/31/2022 5:34:47 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 26.475957040881287 (T) = (0 -18.461440787888563) / Math.Sqrt((0.6674993663221825 / (299)) + (0.17562967277644828 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.15701491920261687 = (21.90008009444937 - 18.461440787888563) / 21.90008009444937 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Byte>.Fill(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 25.010682881565874 < 41.86835163100949. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.0283638759259555 (T) = (0 -26.119725742202164) / Math.Sqrt((55.08608818749667 / (299)) + (1.9377995145325149 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.13907308742729768 = (30.3390745030246 - 26.119725742202164) / 30.3390745030246 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Byte>.LastIndexOfValue(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 809.6736028979722 < 1.2998985688413798. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.0832585690977 (T) = (0 -811.7150743366224) / Math.Sqrt((49455.19403757815 / (299)) + (11.899901457393407 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1497535273974492 = (954.6820839515085 - 811.7150743366224) / 954.6820839515085 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Byte>.IndexOfAnyThreeValues(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.5120767916220685 < 2.1666145905090595. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.448469032451106 (T) = (0 -1494.235925332015) / Math.Sqrt((99847.74883783498 / (299)) + (1410.8555324530141 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.13068479286582718 = (1718.8655082406606 - 1494.235925332015) / 1718.8655082406606 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Byte>.Clear(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 33.347432361246035 < 47.40717566036299. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.4805536876904 (T) = (0 -34.018750223650635) / Math.Sqrt((39.9219896072593 / (299)) + (3.200050476261869 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1498754808653609 = (40.01619698991753 - 34.018750223650635) / 40.01619698991753 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Byte>.StartsWith(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 266.3419871206699 < 388.5960936212358. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.715060516613008 (T) = (0 -266.26021463900537) / Math.Sqrt((3918.6120846397343 / (299)) + (20.019492827438896 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11175025427085669 = (299.75827847880623 - 266.26021463900537) / 299.75827847880623 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Byte>.LastIndexOfAnyValues(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.246828765909006 < 1.8436518991214925. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.448209670962277 (T) = (0 -1289.113040319518) / Math.Sqrt((85157.63907212595 / (299)) + (810.8337736208694 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.09784654176506263 = (1428.9287798571063 - 1289.113040319518) / 1428.9287798571063 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Byte>.SequenceEqual(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 418.18960971193184 < 623.0788969082688. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.730593706315622 (T) = (0 -422.28825787787576) / Math.Sqrt((10472.460273660263 / (299)) + (101.08975580906032 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10767553123746199 = (473.2451845274384 - 422.28825787787576) / 473.2451845274384 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Byte>.IndexOfAnyTwoValues(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.24590460485669 < 1.8550038917079419. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.005765245106456 (T) = (0 -1260.9493432550369) / Math.Sqrt((93900.46590673036 / (299)) + (1864.550719049159 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1209248429045855 = (1434.4044796139926 - 1260.9493432550369) / 1434.4044796139926 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	6a56aa3512c912df602bf074dc925b77f3895b24
Diff	Diff

Improvements in GuardedDevirtualization.ThreeClassInterface

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.ThreeClassInterface.Call(testInput%3a%20pB%3d0.67%20pD%3d0.33).html>)	23.91 ns	17.69 ns	0.74	0.05	False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.ThreeClassInterface.Call(testInput%3a%20pB%3d0.33%20pD%3d0.00).html>)	24.15 ns	17.80 ns	0.74	0.07	False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.ThreeClassInterface.Call(testInput%3a%20pB%3d0.33%20pD%3d0.33).html>)	23.86 ns	17.87 ns	0.75	0.07	False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.ThreeClassInterface.Call(testInput%3a%20pB%3d0.00%20pD%3d0.33).html>)	23.92 ns	17.72 ns	0.74	0.06	False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.ThreeClassInterface.Call(testInput%3a%20pB%3d0.00%20pD%3d0.00).html>)	23.90 ns	17.66 ns	0.74	0.06	False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.ThreeClassInterface.Call(testInput%3a%20pB%3d0.00%20pD%3d1.00).html>)	24.34 ns	17.73 ns	0.73	0.06	False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.ThreeClassInterface.Call(testInput%3a%20pB%3d0.00%20pD%3d0.67).html>)	23.89 ns	17.69 ns	0.74	0.06	False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.ThreeClassInterface.Call(testInput%3a%20pB%3d0.67%20pD%3d0.00).html>)	24.49 ns	17.69 ns	0.72	0.05	False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.ThreeClassInterface.Call(testInput%3a%20pB%3d1.00%20pD%3d0.00).html>)	23.93 ns	17.70 ns	0.74	0.06	False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.ThreeClassInterface.Call(testInput%3a%20pB%3d0.33%20pD%3d0.67).html>)	23.89 ns	17.70 ns	0.74	0.07	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'GuardedDevirtualization.ThreeClassInterface*'

### Payloads [Baseline]() [Compare]() ### Histogram #### GuardedDevirtualization.ThreeClassInterface.Call(testInput: pB=0.67 pD=0.33) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.69218261608154 < 22.599421270647674. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 14.816006763058295 (T) = (0 -17.823596828824027) / Math.Sqrt((4.75624217088156 / (299)) + (0.048842497868055945 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.10600476612546607 = (19.93701549344663 - 17.823596828824027) / 19.93701549344663 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.ThreeClassInterface.Call(testInput: pB=0.33 pD=0.00) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.79831717936881 < 22.604254593692477. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.300408495087765 (T) = (0 -17.798606333636812) / Math.Sqrt((5.1064123641664665 / (299)) + (0.10492472583177541 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.10866703084605049 = (19.96852685762448 - 17.798606333636812) / 19.96852685762448 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.ThreeClassInterface.Call(testInput: pB=0.33 pD=0.33) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.871019305713208 < 22.603117892772296. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 4.868468866098199 (T) = (0 -18.173905307593433) / Math.Sqrt((4.914190671358803 / (299)) + (1.438614753581171 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.09000429613802212 = (19.97141879952208 - 18.173905307593433) / 19.97141879952208 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.ThreeClassInterface.Call(testInput: pB=0.00 pD=0.33) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.72476700207861 < 22.593899190670054. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 15.66125479101706 (T) = (0 -17.764156442284825) / Math.Sqrt((4.953558338777217 / (299)) + (0.03524498861110246 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1096270276485742 = (19.951365319828465 - 17.764156442284825) / 19.951365319828465 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.ThreeClassInterface.Call(testInput: pB=0.00 pD=0.00) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.65849215214932 < 22.599625340170537. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 14.166901176370244 (T) = (0 -17.802036232306182) / Math.Sqrt((4.926091145985907 / (299)) + (0.06802895366460388 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10588393373610192 = (19.9102073030549 - 17.802036232306182) / 19.9102073030549 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.ThreeClassInterface.Call(testInput: pB=0.00 pD=1.00) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.731630619988543 < 22.79758932734548. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 17.339575108574977 (T) = (0 -17.691471474963617) / Math.Sqrt((4.836274007982458 / (299)) + (0.004338838183446028 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11192900796034794 = (19.921235614656467 - 17.691471474963617) / 19.921235614656467 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.ThreeClassInterface.Call(testInput: pB=0.00 pD=0.67) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.690703809996222 < 22.62180944676017. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 16.52319628183506 (T) = (0 -17.742582800516878) / Math.Sqrt((5.406886298396268 / (299)) + (0.005082428644036876 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11244445577924113 = (19.990391492730986 - 17.742582800516878) / 19.990391492730986 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.ThreeClassInterface.Call(testInput: pB=0.67 pD=0.00) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.68909793621582 < 22.584302312134533. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 17.81162375106784 (T) = (0 -17.69385973177041) / Math.Sqrt((4.803351145560553 / (299)) + (0.000674443891953973 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.11334430586510534 = (19.955727853340203 - 17.69385973177041) / 19.955727853340203 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.ThreeClassInterface.Call(testInput: pB=1.00 pD=0.00) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.700623105235646 < 22.58744026985076. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 16.726565286777177 (T) = (0 -17.706628551964545) / Math.Sqrt((5.265521833955189 / (299)) + (0.0066424279827721165 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11293574917371982 = (19.960931280311684 - 17.706628551964545) / 19.960931280311684 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.ThreeClassInterface.Call(testInput: pB=0.33 pD=0.67) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.69505193235397 < 22.70258571810398. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.582439208630268 (T) = (0 -17.843221209660495) / Math.Sqrt((5.0135599402453295 / (299)) + (0.1352841963881647 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1056129677599904 = (19.950223523446894 - 17.843221209660495) / 19.950223523446894 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Collections.Concurrent.Count<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Bag - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Concurrent.Count(Int32).Bag(Size%3a%20512).html>)	515.94 ns	449.36 ns	0.87	0.07	False
[Queue_EnqueueCountDequeue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Concurrent.Count(Int32).Queue_EnqueueCountDequeue(Size%3a%20512).html>)	302.91 ns	233.34 ns	0.77	0.16	False
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Concurrent.Count(Int32).Dictionary(Size%3a%20512).html>)	156.91 μs	141.95 μs	0.90	0.08	False
[Queue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Concurrent.Count(Int32).Queue(Size%3a%20512).html>)	80.87 ns	55.40 ns	0.69	0.23	False
[Stack - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Concurrent.Count(Int32).Stack(Size%3a%20512).html>)	2.73 μs	1.77 μs	0.65	0.05	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.Concurrent.Count<Int32>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.Concurrent.Count<Int32>.Bag(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 449.3623771669143 < 483.44067564333943. IsChangePoint: Marked as a change because one of 4/21/2022 3:06:05 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 16.624610701792676 (T) = (0 -450.5068662641119) / Math.Sqrt((382.2484427272102 / (299)) + (32.71494953609059 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.06876871704256401 = (483.77548575620966 - 450.5068662641119) / 483.77548575620966 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Concurrent.Count<Int32>.Queue_EnqueueCountDequeue(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 233.34017741197258 < 290.5631596005226. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 16.62007506167024 (T) = (0 -232.76000423107268) / Math.Sqrt((660.801724461037 / (299)) + (9.535559373077186 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11013990234904503 = (261.5692116609235 - 232.76000423107268) / 261.5692116609235 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Concurrent.Count<Int32>.Dictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 141.94549701704548 < 150.58218988839283. IsChangePoint: Marked as a change because one of 4/21/2022 3:06:05 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.279270952661862 (T) = (0 -141166.34856522013) / Math.Sqrt((49838883.362189226 / (299)) + (11534560.699007628 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.05192023098259314 = (148897.1215064798 - 141166.34856522013) / 148897.1215064798 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Concurrent.Count<Int32>.Queue(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 55.39696964580356 < 76.87427957199638. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.214736160272581 (T) = (0 -56.47345854285481) / Math.Sqrt((100.54262151183626 / (299)) + (4.1142043343969545 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.12089162019609365 = (64.23947244758577 - 56.47345854285481) / 64.23947244758577 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Concurrent.Count<Int32>.Stack(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.7659536282080401 < 2.592124541355737. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.367278194041281 (T) = (0 -1728.8655207556892) / Math.Sqrt((135802.31208256749 / (299)) + (4658.257947403881 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.16303074071189685 = (2065.6260687832214 - 1728.8655207556892) / 2065.6260687832214 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Collections.Sort<BigStruct>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Array_ComparerClass - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Sort(BigStruct).Array_ComparerClass(Size%3a%20512).html>)	307.77 μs	250.36 μs	0.81	0.02	False
[Array_ComparerStruct - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Sort(BigStruct).Array_ComparerStruct(Size%3a%20512).html>)	321.95 μs	253.49 μs	0.79	0.02	False
[Array_Comparison - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Sort(BigStruct).Array_Comparison(Size%3a%20512).html>)	307.98 μs	252.44 μs	0.82	0.04	False
[LinqOrderByExtension - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Sort(BigStruct).LinqOrderByExtension(Size%3a%20512).html>)	1.01 ms	852.23 μs	0.84	0.02	False
[LinqQuery - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Sort(BigStruct).LinqQuery(Size%3a%20512).html>)	1.01 ms	849.47 μs	0.84	0.02	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.Sort<BigStruct>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.Sort<BigStruct>.Array_ComparerClass(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 250.36132798666674 < 293.8365134481667. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.198478022237099 (T) = (0 -251034.1029315873) / Math.Sqrt((551794764.040792 / (299)) + (6833486.677354881 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.07021159560046324 = (269990.57177283976 - 251034.1029315873) / 269990.57177283976 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Sort<BigStruct>.Array_ComparerStruct(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 253.48673865714278 < 292.34597699969044. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.651546871962484 (T) = (0 -251853.48013367524) / Math.Sqrt((491368460.16836673 / (299)) + (10830517.10531179 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.06874281180936666 = (270444.6025517491 - 251853.48013367524) / 270444.6025517491 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Sort<BigStruct>.Array_Comparison(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 252.4384940142857 < 294.7706126367857. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.64504191747993 (T) = (0 -252483.11822380952) / Math.Sqrt((553392198.4084625 / (299)) + (39003198.551461846 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.0640102522994448 = (269749.8758336664 - 252483.11822380952) / 269749.8758336664 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Sort<BigStruct>.LinqOrderByExtension(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 852.2261345733332 < 0.964196852934487. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.636367987600776 (T) = (0 -853550.8719673565) / Math.Sqrt((3671176500.9885354 / (299)) + (23336160.889546245 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.052879990642747614 = (901206.6723694339 - 853550.8719673565) / 901206.6723694339 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Sort<BigStruct>.LinqQuery(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 849.46984065 < 0.9611448305288335. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 12.016334377894644 (T) = (0 -850435.264797023) / Math.Sqrt((3478023812.331278 / (299)) + (66182485.75900761 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.05603311937289663 = (900916.4222287707 - 850435.264797023) / 900916.4222287707 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in MicroBenchmarks.Serializers.Xml_ToStream<MyEventsListerViewModel>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[DataContractSerializer_ - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/MicroBenchmarks.Serializers.XmlToStream(MyEventsListerViewModel).DataContractSerializer.html>)	21.04 ms	17.18 ms	0.82	0.01	False
[XmlSerializer_ - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/MicroBenchmarks.Serializers.XmlToStream(MyEventsListerViewModel).XmlSerializer.html>)	8.88 ms	7.03 ms	0.79	0.02	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'MicroBenchmarks.Serializers.Xml_ToStream<MyEventsListerViewModel>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### MicroBenchmarks.Serializers.Xml_ToStream<MyEventsListerViewModel>.DataContractSerializer_ ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.175371263736267 < 19.95309962380952. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.060744226353146 (T) = (0 -17080878.31806646) / Math.Sqrt((2212507197029.9146 / (299)) + (24462051881.03842 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.05918643350754569 = (18155433.686769072 - 17080878.31806646) / 18155433.686769072 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### MicroBenchmarks.Serializers.Xml_ToStream<MyEventsListerViewModel>.XmlSerializer_ ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 7.027375948979591 < 8.464131153524189. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.288070522484155 (T) = (0 -7094308.163430012) / Math.Sqrt((602177944041.0018 / (299)) + (17440084461.009903 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.06549979967050165 = (7591553.389639304 - 7094308.163430012) / 7591553.389639304 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.Text.Json.Tests.Utf8JsonReaderCommentsTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Utf8JsonReaderCommentParsing - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling%3a%20Allow%2c%20SegmentSize%3a%20100%2c%20TestCase%3a%20LongSingleLine).html>)	35.62 μs	26.09 μs	0.73	0.01	False
[Utf8JsonReaderCommentParsing - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling%3a%20Allow%2c%20SegmentSize%3a%20100%2c%20TestCase%3a%20ShortSingleLine).html>)	1.41 μs	1.04 μs	0.74	0.03	False
[Utf8JsonReaderCommentParsing - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling%3a%20Skip%2c%20SegmentSize%3a%200%2c%20TestCase%3a%20ShortSingleLine).html>)	1.16 μs	786.47 ns	0.68	0.05	False
[Utf8JsonReaderCommentParsing - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling%3a%20Skip%2c%20SegmentSize%3a%200%2c%20TestCase%3a%20LongSingleLine).html>)	18.05 μs	11.97 μs	0.66	0.01	False
[Utf8JsonReaderCommentParsing - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling%3a%20Skip%2c%20SegmentSize%3a%20100%2c%20TestCase%3a%20ShortMultiLine).html>)	1.50 μs	1.08 μs	0.72	0.04	False
[Utf8JsonReaderCommentParsing - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling%3a%20Skip%2c%20SegmentSize%3a%200%2c%20TestCase%3a%20ShortMultiLine).html>)	1.29 μs	900.14 ns	0.70	0.06	False
[Utf8JsonReaderCommentParsing - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling%3a%20Allow%2c%20SegmentSize%3a%200%2c%20TestCase%3a%20LongSingleLine).html>)	18.09 μs	12.04 μs	0.67	0.02	False
[Utf8JsonReaderCommentParsing - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling%3a%20Allow%2c%20SegmentSize%3a%200%2c%20TestCase%3a%20LongMultiLine).html>)	253.00 μs	157.99 μs	0.62	0.13	False
[Utf8JsonReaderCommentParsing - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling%3a%20Skip%2c%20SegmentSize%3a%200%2c%20TestCase%3a%20LongMultiLine).html>)	254.57 μs	158.41 μs	0.62	0.08	False
[Utf8JsonReaderCommentParsing - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling%3a%20Skip%2c%20SegmentSize%3a%20100%2c%20TestCase%3a%20ShortSingleLine).html>)	1.37 μs	974.63 ns	0.71	0.06	False
[Utf8JsonReaderCommentParsing - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling%3a%20Allow%2c%20SegmentSize%3a%200%2c%20TestCase%3a%20ShortMultiLine).html>)	1.34 μs	952.92 ns	0.71	0.06	False
[Utf8JsonReaderCommentParsing - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling%3a%20Allow%2c%20SegmentSize%3a%20100%2c%20TestCase%3a%20LongMultiLine).html>)	325.81 μs	226.07 μs	0.69	0.03	False
[Utf8JsonReaderCommentParsing - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling%3a%20Skip%2c%20SegmentSize%3a%20100%2c%20TestCase%3a%20LongSingleLine).html>)	34.23 μs	24.65 μs	0.72	0.02	False
[Utf8JsonReaderCommentParsing - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling%3a%20Allow%2c%20SegmentSize%3a%200%2c%20TestCase%3a%20ShortSingleLine).html>)	1.24 μs	843.27 ns	0.68	0.07	False
[Utf8JsonReaderCommentParsing - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling%3a%20Allow%2c%20SegmentSize%3a%20100%2c%20TestCase%3a%20ShortMultiLine).html>)	1.56 μs	1.12 μs	0.72	0.04	False
[Utf8JsonReaderCommentParsing - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling%3a%20Skip%2c%20SegmentSize%3a%20100%2c%20TestCase%3a%20LongMultiLine).html>)	332.74 μs	228.25 μs	0.69	0.04	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Tests.Utf8JsonReaderCommentsTests*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling: Allow, SegmentSize: 100, TestCase: LongSingleLine) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 26.094405756944443 < 33.812622204425004. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.273577810264324 (T) = (0 -26276.280515908893) / Math.Sqrt((15424875.297918042 / (299)) + (19818.053120237815 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.08274919754097883 = (28646.778444309733 - 26276.280515908893) / 28646.778444309733 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling: Allow, SegmentSize: 100, TestCase: ShortSingleLine) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.0438031459155552 < 1.3447097300756852. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.311698337586162 (T) = (0 -1048.015971473768) / Math.Sqrt((24805.62232423779 / (299)) + (313.3822965598421 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.09318536056688537 = (1155.7113503691603 - 1048.015971473768) / 1155.7113503691603 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling: Skip, SegmentSize: 0, TestCase: ShortSingleLine) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 786.4689100699375 < 1.0985679761781137. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.765941497950086 (T) = (0 -812.25341928653) / Math.Sqrt((19352.92550667941 / (299)) + (274.862094249059 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10116507225358426 = (903.6736270619062 - 812.25341928653) / 903.6736270619062 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling: Skip, SegmentSize: 0, TestCase: LongSingleLine) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 11.96606646521549 < 17.060491479166668. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.034915460731519 (T) = (0 -11988.218546040684) / Math.Sqrt((5859725.632302366 / (299)) + (32677.61414460281 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.12148294094197316 = (13645.971267643707 - 11988.218546040684) / 13645.971267643707 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling: Skip, SegmentSize: 100, TestCase: ShortMultiLine) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.077036783622673 < 1.420730201213884. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.406232309598433 (T) = (0 -1097.648387443654) / Math.Sqrt((28755.76749070504 / (299)) + (791.950524967569 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.09034182771551771 = (1206.6602828258663 - 1097.648387443654) / 1206.6602828258663 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling: Skip, SegmentSize: 0, TestCase: ShortMultiLine) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 900.1443104587598 < 1.2259858477624122. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.638428112483975 (T) = (0 -909.9143691203656) / Math.Sqrt((25462.034530600682 / (299)) + (285.7374082186442 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.0909769671735426 = (1000.9805431344646 - 909.9143691203656) / 1000.9805431344646 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling: Allow, SegmentSize: 0, TestCase: LongSingleLine) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 12.036131004240556 < 17.105039645205803. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.059898173293043 (T) = (0 -12041.64097982553) / Math.Sqrt((6105947.350435338 / (299)) + (24633.219204013898 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.12146725721472523 = (13706.536357027582 - 12041.64097982553) / 13706.536357027582 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling: Allow, SegmentSize: 0, TestCase: LongMultiLine) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 157.9919363215488 < 240.22366829133063. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 20.389834331515704 (T) = (0 -159244.6372676446) / Math.Sqrt((992465310.183523 / (299)) + (816104.4609627569 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.19085283501374595 = (196805.53075947548 - 159244.6372676446) / 196805.53075947548 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling: Skip, SegmentSize: 0, TestCase: LongMultiLine) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 158.4120952861953 < 239.4861850364023. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 19.987518199284402 (T) = (0 -159193.03071825975) / Math.Sqrt((1040988031.9510144 / (299)) + (372458.02842066146 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.19048979475280348 = (196653.51923469288 - 159193.03071825975) / 196653.51923469288 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling: Skip, SegmentSize: 100, TestCase: ShortSingleLine) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 974.6273954512375 < 1.3032090708858364. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 11.962868359662165 (T) = (0 -988.1292411824834) / Math.Sqrt((22711.98728068948 / (299)) + (266.1799990577882 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1070914674598132 = (1106.6410557993083 - 988.1292411824834) / 1106.6410557993083 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling: Allow, SegmentSize: 0, TestCase: ShortMultiLine) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 952.922568660088 < 1.2762292795011025. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.768538252978855 (T) = (0 -954.9027239975882) / Math.Sqrt((27985.832750787376 / (299)) + (146.30770008831792 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.08629710418320533 = (1045.0910557134257 - 954.9027239975882) / 1045.0910557134257 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling: Allow, SegmentSize: 100, TestCase: LongMultiLine) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 226.0674537377451 < 309.52899546014856. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.476978912147077 (T) = (0 -226586.7035317421) / Math.Sqrt((1720950177.24445 / (299)) + (14646877.627973787 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10883555769358384 = (254259.13868972904 - 226586.7035317421) / 254259.13868972904 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling: Skip, SegmentSize: 100, TestCase: LongSingleLine) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 24.64516823070759 < 32.304912511369636. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.378401896397701 (T) = (0 -24983.974543619257) / Math.Sqrt((14300874.990441635 / (299)) + (64221.15649859316 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.08778513386481976 = (27388.256288203163 - 24983.974543619257) / 27388.256288203163 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling: Allow, SegmentSize: 0, TestCase: ShortSingleLine) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 843.2679622509063 < 1.1593332366479927. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.097605525528666 (T) = (0 -862.9830481326309) / Math.Sqrt((22681.332600017355 / (299)) + (357.0814167860063 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.0977491634947503 = (956.4779695580916 - 862.9830481326309) / 956.4779695580916 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling: Allow, SegmentSize: 100, TestCase: ShortMultiLine) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.1237683501699047 < 1.4966002525576905. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.152917914814148 (T) = (0 -1128.8902095463054) / Math.Sqrt((33324.54498407708 / (299)) + (371.7761432450389 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.09693206240025738 = (1250.0612219129096 - 1128.8902095463054) / 1250.0612219129096 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling: Skip, SegmentSize: 100, TestCase: LongMultiLine) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 228.24864322916665 < 312.4492317591411. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.81790771626452 (T) = (0 -225694.94717387928) / Math.Sqrt((1895819475.5336046 / (299)) + (26137049.174483817 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.1034205339845984 = (251728.88263537618 - 225694.94717387928) / 251728.88263537618 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in System.IO.Tests.StreamReaderReadLineTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ReadLine - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StreamReaderReadLineTests.ReadLine(LineLengthRange%3a%20%5b%20%20%201%2c%20%20%20%208%5d).html>)	1.26 ms	1.06 ms	0.84	0.01	False
[ReadLine - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StreamReaderReadLineTests.ReadLine(LineLengthRange%3a%20%5b%20%20%209%2c%20%20%2032%5d).html>)	537.83 μs	432.38 μs	0.80	0.04	False
[ReadLine - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StreamReaderReadLineTests.ReadLine(LineLengthRange%3a%20%5b%20%2033%2c%20%20128%5d).html>)	373.37 μs	264.27 μs	0.71	0.05	False
[ReadLineAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StreamReaderReadLineTests.ReadLineAsync(LineLengthRange%3a%20%5b%20%20%201%2c%20%20%20%201%5d).html>)	6.60 ms	5.58 ms	0.85	0.03	False
[ReadLine - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StreamReaderReadLineTests.ReadLine(LineLengthRange%3a%20%5b%20129%2c%201024%5d).html>)	338.77 μs	234.44 μs	0.69	0.06	False
[ReadLine - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StreamReaderReadLineTests.ReadLine(LineLengthRange%3a%20%5b%20%20%200%2c%201024%5d).html>)	336.53 μs	232.21 μs	0.69	0.07	False
[ReadLineAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StreamReaderReadLineTests.ReadLineAsync(LineLengthRange%3a%20%5b%20%20%200%2c%201024%5d).html>)	344.91 μs	258.33 μs	0.75	0.06	False
[ReadLineAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StreamReaderReadLineTests.ReadLineAsync(LineLengthRange%3a%20%5b%20%20%201%2c%20%20%20%208%5d).html>)	2.83 ms	2.38 ms	0.84	0.02	False
[ReadLine - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StreamReaderReadLineTests.ReadLine(LineLengthRange%3a%20%5b%20%20%200%2c%20%20%20%200%5d).html>)	1.93 ms	1.55 ms	0.80	0.12	False
[ReadLineAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StreamReaderReadLineTests.ReadLineAsync(LineLengthRange%3a%20%5b%20129%2c%201024%5d).html>)	342.93 μs	256.71 μs	0.75	0.02	False
[ReadLineAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StreamReaderReadLineTests.ReadLineAsync(LineLengthRange%3a%20%5b%20%20%209%2c%20%20%2032%5d).html>)	897.61 μs	733.38 μs	0.82	0.02	False
[ReadLine - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StreamReaderReadLineTests.ReadLine(LineLengthRange%3a%20%5b1025%2c%202048%5d).html>)	340.82 μs	235.05 μs	0.69	0.06	False
[ReadLineAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StreamReaderReadLineTests.ReadLineAsync(LineLengthRange%3a%20%5b%20%20%200%2c%20%20%20%200%5d).html>)	9.63 ms	8.06 ms	0.84	0.03	False
[ReadLine - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StreamReaderReadLineTests.ReadLine(LineLengthRange%3a%20%5b%20%20%201%2c%20%20%20%201%5d).html>)	2.70 ms	2.19 ms	0.81	0.04	False
[ReadLineAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StreamReaderReadLineTests.ReadLineAsync(LineLengthRange%3a%20%5b1025%2c%202048%5d).html>)	330.37 μs	241.38 μs	0.73	0.07	False
[ReadLineAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StreamReaderReadLineTests.ReadLineAsync(LineLengthRange%3a%20%5b%20%2033%2c%20%20128%5d).html>)	443.68 μs	347.93 μs	0.78	0.02	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Tests.StreamReaderReadLineTests*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.IO.Tests.StreamReaderReadLineTests.ReadLine(LineLengthRange: [ 1, 8]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.0550300644444446 < 1.1959970338461539. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.41828210572626 (T) = (0 -1044342.9308167989) / Math.Sqrt((6985571211.855059 / (299)) + (217914402.1555867 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.05492109092000181 = (1105032.522451941 - 1044342.9308167989) / 1105032.522451941 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StreamReaderReadLineTests.ReadLine(LineLengthRange: [ 9, 32]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 432.3754611486486 < 508.6079903437223. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.566049350100343 (T) = (0 -428705.90091175714) / Math.Sqrt((2184542689.568637 / (299)) + (21183555.194375455 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.05723616481464877 = (454733.07832970895 - 428705.90091175714) / 454733.07832970895 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StreamReaderReadLineTests.ReadLine(LineLengthRange: [ 33, 128]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 264.27282020833337 < 350.2923277456023. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.477875056466747 (T) = (0 -266585.7845238891) / Math.Sqrt((1738755142.8738046 / (299)) + (7071025.961124811 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.0904682629934499 = (293102.23456443194 - 266585.7845238891) / 293102.23456443194 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StreamReaderReadLineTests.ReadLineAsync(LineLengthRange: [ 1, 1]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.582042755952381 < 6.26519563422371. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 17.7265829499972 (T) = (0 -5624418.123208563) / Math.Sqrt((85106725795.32455 / (299)) + (5385799289.41162 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.07864331374894683 = (6104495.9103666935 - 5624418.123208563) / 6104495.9103666935 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StreamReaderReadLineTests.ReadLine(LineLengthRange: [ 129, 1024]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 234.43583076298702 < 319.1102040623416. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.776188934403475 (T) = (0 -234690.33454675693) / Math.Sqrt((1715532024.2790692 / (299)) + (1945500.415707259 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.10045036830536755 = (260897.59394890908 - 234690.33454675693) / 260897.59394890908 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StreamReaderReadLineTests.ReadLine(LineLengthRange: [ 0, 1024]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 232.21468543443487 < 317.74409244902483. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.235697026632291 (T) = (0 -235113.14691142945) / Math.Sqrt((1682011159.1524577 / (299)) + (38284486.1377889 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.09420716064042722 = (259566.13553896348 - 235113.14691142945) / 259566.13553896348 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StreamReaderReadLineTests.ReadLineAsync(LineLengthRange: [ 0, 1024]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 258.3349741290983 < 324.16664461730073. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 6.227279126823491 (T) = (0 -259607.90761669225) / Math.Sqrt((1286134792.0374205 / (299)) + (47897687.99306498 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.06461380591209669 = (277540.8801814061 - 259607.90761669225) / 277540.8801814061 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StreamReaderReadLineTests.ReadLineAsync(LineLengthRange: [ 1, 8]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.3794403833333333 < 2.69626196015625. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 20.941088832286788 (T) = (0 -2403668.709874575) / Math.Sqrt((18208431889.388206 / (299)) + (343252916.6368859 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.07614562635689465 = (2601783.1147954683 - 2403668.709874575) / 2601783.1147954683 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StreamReaderReadLineTests.ReadLine(LineLengthRange: [ 0, 0]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.5468748519230768 < 1.82627468515997. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 14.141627176277423 (T) = (0 -1523338.5987842365) / Math.Sqrt((19789173779.353596 / (299)) + (1053672700.6692482 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10329933266884286 = (1698826.212896815 - 1523338.5987842365) / 1698826.212896815 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StreamReaderReadLineTests.ReadLineAsync(LineLengthRange: [ 129, 1024]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 256.7058600134408 < 320.2787333002332. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 8.140770613520516 (T) = (0 -253839.10886408555) / Math.Sqrt((1309925001.899495 / (299)) + (5868388.74152325 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.06609612239496701 = (271804.3204992873 - 253839.10886408555) / 271804.3204992873 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StreamReaderReadLineTests.ReadLineAsync(LineLengthRange: [ 9, 32]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 733.3804179421769 < 847.915823536482. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 13.142256769452144 (T) = (0 -741748.6104141312) / Math.Sqrt((2868421049.653509 / (299)) + (91601504.30533408 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.06850122036148755 = (796295.8477540703 - 741748.6104141312) / 796295.8477540703 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StreamReaderReadLineTests.ReadLine(LineLengthRange: [1025, 2048]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 235.0516710858586 < 322.90387525249093. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 9.995649468737714 (T) = (0 -236256.54157008475) / Math.Sqrt((1849947617.953837 / (299)) + (9039418.411472535 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10028259595354361 = (262589.7204027919 - 236256.54157008475) / 262589.7204027919 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StreamReaderReadLineTests.ReadLineAsync(LineLengthRange: [ 0, 0]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 8.056881127403846 < 9.250488860052084. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 20.12050980576567 (T) = (0 -8212136.734977868) / Math.Sqrt((201529828532.95584 / (299)) + (9827839009.868793 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.08648272910571943 = (8989580.160798341 - 8212136.734977868) / 8989580.160798341 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StreamReaderReadLineTests.ReadLine(LineLengthRange: [ 1, 1]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.191929144770408 < 2.517480035921999. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.856068289691855 (T) = (0 -2226171.714987096) / Math.Sqrt((22062615635.756145 / (299)) + (1618201078.7941966 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.06758034904607406 = (2387521.233287584 - 2226171.714987096) / 2387521.233287584 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StreamReaderReadLineTests.ReadLineAsync(LineLengthRange: [1025, 2048]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 241.3798243686869 < 308.81046602824716. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 7.46052387353483 (T) = (0 -241290.8296198037) / Math.Sqrt((1368254580.0833907 / (299)) + (12729893.363197481 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.068388714925554 = (259003.76421537434 - 241290.8296198037) / 259003.76421537434 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StreamReaderReadLineTests.ReadLineAsync(LineLengthRange: [ 33, 128]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 347.930698460145 < 425.30125917091834. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 10.991498085529217 (T) = (0 -348669.7774425906) / Math.Sqrt((1587884787.437924 / (299)) + (8067324.891359429 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.07192647846911507 = (375691.9784409423 - 348669.7774425906) / 375691.9784409423 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare	f9e9d86e77210bee1779970273d124ceeae0df7e
Diff	Diff

Improvements in Microsoft.Extensions.Caching.Memory.Tests.MemoryCacheTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[SetOverride - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Caching.Memory.Tests.MemoryCacheTests.SetOverride.html>)	1.40 μs	1.20 μs	0.85	0.08	False
[GetHit - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Caching.Memory.Tests.MemoryCacheTests.GetHit.html>)	502.87 ns	388.06 ns	0.77	0.14	False
[TryGetValueHit - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Caching.Memory.Tests.MemoryCacheTests.TryGetValueHit.html>)	488.24 ns	355.69 ns	0.73	0.15	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Microsoft.Extensions.Caching.Memory.Tests.MemoryCacheTests*'

### Payloads [Baseline]() [Compare]() ### Histogram #### Microsoft.Extensions.Caching.Memory.Tests.MemoryCacheTests.SetOverride ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.1968677331407302 < 1.3399080076380894. IsChangePoint: Marked as a change because one of 4/27/2022 1:24:17 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 15.420170784174779 (T) = (0 -1196.9784489079268) / Math.Sqrt((16628.990006215947 / (299)) + (499.84640614984636 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11273157903583073 = (1349.0601272692704 - 1196.9784489079268) / 1349.0601272692704 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Caching.Memory.Tests.MemoryCacheTests.GetHit ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 388.0601824778714 < 470.6691570757282. IsChangePoint: Marked as a change because one of 4/27/2022 1:24:17 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 15.181391373435378 (T) = (0 -390.4079824034091) / Math.Sqrt((3148.237309140475 / (299)) + (180.03505317625275 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.16422077339052363 = (467.1185523325168 - 390.4079824034091) / 467.1185523325168 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Caching.Memory.Tests.MemoryCacheTests.TryGetValueHit ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 355.6946977846605 < 464.67088739142844. IsChangePoint: Marked as a change because one of 4/27/2022 1:24:17 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/7/2022 3:01:09 PM falls between 5/29/2022 5:15:01 PM and 6/7/2022 3:01:09 PM. IsImprovementStdDev: Marked as improvement because 18.200232398305385 (T) = (0 -364.95634076723735) / Math.Sqrt((3558.3274252282913 / (299)) + (68.7961038522977 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.1752492906669574 = (442.5050341119068 - 364.95634076723735) / 442.5050341119068 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)